2023-10-06T04:22:46.303 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-06T04:22:46.303 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --verbose --name yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/alternate-pool} --archive /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412279 -- /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412279/orig.config.yaml 2023-10-06T04:22:46.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T04:22:46.433 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412279 branch: wip-yuri3-testing-2023-10-05-0943-quincy description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/alternate-pool} email: yweinste@redhat.com first_in_suite: false job_id: '7412279' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri3-testing-2023-10-05-0943-quincy ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - bad backtrace - object missing on disk - error reading table object - error reading sessionmap - unmatched fragstat - unmatched rstat - was unreadable, recreating it now - Scrub error on inode - Metadata damage detected - MDS_FAILED - MDS_DAMAGE sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri3-testing-2023-10-05-0943-quincy sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 4002 sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri3-testing-2023-10-05-0943-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 targets: smithi008.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIo0QN1QY8bs+wQIFzVw3f/mTM2iPX5y10ShPml9hTHVPd6MYxPJSGOldqrVjgpInPZ0mQgyVpqIvGcB0+5dRWQ= smithi184.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNHnsmBL45Qs5cNPlTOPZoi39J/JUz0zxyDMxkeWW6uWlO8/WqOWdJHuwXz8+4To7WZ+LDy33tWa1H/myoLMUK8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_recovery_pool teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-05_23:54:57 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-06T04:22:46.433 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa; will attempt to use it 2023-10-06T04:22:46.434 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa/tasks 2023-10-06T04:22:46.434 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-06T04:22:46.436 INFO:teuthology.task.internal:Checking packages... 2023-10-06T04:22:46.459 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564' 2023-10-06T04:22:46.459 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-06T04:22:46.459 INFO:teuthology.packaging:ref: None 2023-10-06T04:22:46.459 INFO:teuthology.packaging:tag: None 2023-10-06T04:22:46.459 INFO:teuthology.packaging:branch: wip-yuri3-testing-2023-10-05-0943-quincy 2023-10-06T04:22:46.459 INFO:teuthology.packaging:sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T04:22:46.459 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri3-testing-2023-10-05-0943-quincy 2023-10-06T04:22:46.602 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1274.g68e53a4a 2023-10-06T04:22:46.602 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-06T04:22:46.609 INFO:teuthology.task.internal:no buildpackages task found 2023-10-06T04:22:46.609 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-06T04:22:46.626 INFO:teuthology.task.internal:Saving configuration 2023-10-06T04:22:46.642 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-06T04:22:46.649 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T04:22:46.675 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412279', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 04:18:01.080374', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIo0QN1QY8bs+wQIFzVw3f/mTM2iPX5y10ShPml9hTHVPd6MYxPJSGOldqrVjgpInPZ0mQgyVpqIvGcB0+5dRWQ='} 2023-10-06T04:22:46.700 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412279', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 04:18:01.078923', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNHnsmBL45Qs5cNPlTOPZoi39J/JUz0zxyDMxkeWW6uWlO8/WqOWdJHuwXz8+4To7WZ+LDy33tWa1H/myoLMUK8='} 2023-10-06T04:22:46.700 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-06T04:22:46.706 INFO:teuthology.task.internal:roles: ubuntu@smithi008.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-06T04:22:46.706 INFO:teuthology.task.internal:roles: ubuntu@smithi184.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-06T04:22:46.707 INFO:teuthology.run_tasks:Running task console_log... 2023-10-06T04:22:46.773 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3081c7ab80>, signals=[15]) 2023-10-06T04:22:46.773 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-06T04:22:46.779 INFO:teuthology.task.internal:Opening connections... 2023-10-06T04:22:46.779 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi008.front.sepia.ceph.com 2023-10-06T04:22:46.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:22:46.852 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi184.front.sepia.ceph.com 2023-10-06T04:22:46.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:22:46.918 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-06T04:22:46.924 DEBUG:teuthology.orchestra.run.smithi008:> uname -m 2023-10-06T04:22:46.942 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2023-10-06T04:22:46.943 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2023-10-06T04:22:47.000 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T04:22:47.000 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T04:22:47.000 INFO:teuthology.orchestra.run.smithi008.stdout:ID="rhel" 2023-10-06T04:22:47.000 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="fedora" 2023-10-06T04:22:47.000 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8.4" 2023-10-06T04:22:47.001 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8" 2023-10-06T04:22:47.001 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T04:22:47.001 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2023-10-06T04:22:47.001 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T04:22:47.001 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T04:22:47.001 INFO:teuthology.orchestra.run.smithi008.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T04:22:47.001 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T04:22:47.001 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:22:47.001 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T04:22:47.001 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T04:22:47.001 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T04:22:47.002 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T04:22:47.003 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2023-10-06T04:22:47.022 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2023-10-06T04:22:47.037 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2023-10-06T04:22:47.037 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2023-10-06T04:22:47.095 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T04:22:47.095 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T04:22:47.095 INFO:teuthology.orchestra.run.smithi184.stdout:ID="rhel" 2023-10-06T04:22:47.095 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="fedora" 2023-10-06T04:22:47.095 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="8.4" 2023-10-06T04:22:47.095 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el8" 2023-10-06T04:22:47.095 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T04:22:47.095 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2023-10-06T04:22:47.096 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T04:22:47.096 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T04:22:47.096 INFO:teuthology.orchestra.run.smithi184.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T04:22:47.096 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T04:22:47.096 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:22:47.096 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T04:22:47.096 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T04:22:47.096 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T04:22:47.096 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T04:22:47.097 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2023-10-06T04:22:47.122 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-06T04:22:47.132 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-06T04:22:47.138 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-06T04:22:47.138 DEBUG:teuthology.orchestra.run.smithi008:> test '!' -e /home/ubuntu/cephtest 2023-10-06T04:22:47.140 DEBUG:teuthology.orchestra.run.smithi184:> test '!' -e /home/ubuntu/cephtest 2023-10-06T04:22:47.154 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-06T04:22:47.161 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-06T04:22:47.161 DEBUG:teuthology.orchestra.run.smithi008:> test -z $(ls -A /var/lib/ceph) 2023-10-06T04:22:47.197 DEBUG:teuthology.orchestra.run.smithi184:> test -z $(ls -A /var/lib/ceph) 2023-10-06T04:22:47.211 INFO:teuthology.orchestra.run.smithi184.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-06T04:22:47.212 INFO:teuthology.orchestra.run.smithi008.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-06T04:22:47.213 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-06T04:22:47.271 INFO:teuthology.run_tasks:Running task kernel... 2023-10-06T04:22:47.285 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-10-06T04:22:47.285 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-10-06T04:22:47.285 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-10-06T04:22:47.286 DEBUG:teuthology.orchestra.run.smithi008:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T04:22:47.286 DEBUG:teuthology.orchestra.run.smithi184:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T04:22:47.299 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:22:47.300 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2023-10-06T04:22:47.301 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:22:47.302 DEBUG:teuthology.orchestra.run.smithi008:> uname -r 2023-10-06T04:22:47.357 INFO:teuthology.orchestra.run.smithi184.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-06T04:22:47.357 INFO:teuthology.task.kernel:Running kernel on smithi184: 4.18.0-305.25.1.el8_4.x86_64 2023-10-06T04:22:47.357 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum install -y kernel 2023-10-06T04:22:47.359 INFO:teuthology.orchestra.run.smithi008.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-06T04:22:47.359 INFO:teuthology.task.kernel:Running kernel on smithi008: 4.18.0-305.25.1.el8_4.x86_64 2023-10-06T04:22:47.359 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum install -y kernel 2023-10-06T04:22:48.743 INFO:teuthology.orchestra.run.smithi184.stdout:Updating Subscription Management repositories. 2023-10-06T04:22:48.744 INFO:teuthology.orchestra.run.smithi184.stdout:Unable to read consumer identity 2023-10-06T04:22:48.831 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-06T04:22:48.832 INFO:teuthology.orchestra.run.smithi008.stdout:Unable to read consumer identity 2023-10-06T04:22:50.045 INFO:teuthology.orchestra.run.smithi184.stdout:Copr repo for python3-asyncssh owned by ceph 35 kB/s | 3.5 kB 00:00 2023-10-06T04:22:50.200 INFO:teuthology.orchestra.run.smithi008.stdout:Copr repo for python3-asyncssh owned by ceph 34 kB/s | 3.5 kB 00:00 2023-10-06T04:22:50.637 INFO:teuthology.orchestra.run.smithi184.stdout:Extra Packages for Enterprise Linux 29 MB/s | 16 MB 00:00 2023-10-06T04:22:52.089 INFO:teuthology.orchestra.run.smithi008.stdout:Extra Packages for Enterprise Linux 8.6 MB/s | 16 MB 00:01 2023-10-06T04:22:53.945 INFO:teuthology.orchestra.run.smithi184.stdout:lab-extras 3.8 MB/s | 24 kB 00:00 2023-10-06T04:22:54.647 INFO:teuthology.orchestra.run.smithi184.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-06T04:22:54.648 INFO:teuthology.orchestra.run.smithi184.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-06T04:22:54.648 INFO:teuthology.orchestra.run.smithi184.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-06T04:22:54.808 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-10-06T04:22:54.809 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2023-10-06T04:22:54.809 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-10-06T04:22:54.924 DEBUG:teuthology.orchestra.run.smithi184:> echo no | sudo yum reinstall kernel || true 2023-10-06T04:22:55.267 INFO:teuthology.orchestra.run.smithi184.stdout:Updating Subscription Management repositories. 2023-10-06T04:22:55.268 INFO:teuthology.orchestra.run.smithi184.stdout:Unable to read consumer identity 2023-10-06T04:22:55.539 INFO:teuthology.orchestra.run.smithi008.stdout:lab-extras 4.7 MB/s | 24 kB 00:00 2023-10-06T04:22:55.556 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:00:02 ago on Fri 06 Oct 2023 04:22:53 AM UTC. 2023-10-06T04:22:55.691 INFO:teuthology.orchestra.run.smithi184.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T04:22:55.691 INFO:teuthology.orchestra.run.smithi184.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T04:22:55.691 INFO:teuthology.orchestra.run.smithi184.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T04:22:55.711 INFO:teuthology.orchestra.run.smithi184.stderr:Error: No packages marked for reinstall. 2023-10-06T04:22:55.762 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum reinstall -y kernel || true 2023-10-06T04:22:56.104 INFO:teuthology.orchestra.run.smithi184.stdout:Updating Subscription Management repositories. 2023-10-06T04:22:56.104 INFO:teuthology.orchestra.run.smithi184.stdout:Unable to read consumer identity 2023-10-06T04:22:56.305 INFO:teuthology.orchestra.run.smithi008.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-06T04:22:56.305 INFO:teuthology.orchestra.run.smithi008.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-06T04:22:56.305 INFO:teuthology.orchestra.run.smithi008.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-06T04:22:56.388 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:00:03 ago on Fri 06 Oct 2023 04:22:53 AM UTC. 2023-10-06T04:22:56.470 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-06T04:22:56.471 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-06T04:22:56.471 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-06T04:22:56.525 INFO:teuthology.orchestra.run.smithi184.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T04:22:56.526 INFO:teuthology.orchestra.run.smithi184.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T04:22:56.526 INFO:teuthology.orchestra.run.smithi184.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T04:22:56.536 INFO:teuthology.orchestra.run.smithi184.stderr:Error: No packages marked for reinstall. 2023-10-06T04:22:56.591 DEBUG:teuthology.orchestra.run.smithi184:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T04:22:56.694 DEBUG:teuthology.orchestra.run.smithi008:> echo no | sudo yum reinstall kernel || true 2023-10-06T04:22:56.716 INFO:teuthology.orchestra.run.smithi184.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T04:22:56.716 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:22:56.716 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:22:56.716 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T04:22:56.716 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T04:22:56.716 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2023-10-06T04:22:56.716 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi184.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T04:22:56.717 DEBUG:teuthology.orchestra.run.smithi184:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T04:22:56.841 INFO:teuthology.orchestra.run.smithi184.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T04:22:56.841 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:22:56.841 DEBUG:teuthology.orchestra.run.smithi184:> sudo rpm -qi grub2-tools 2023-10-06T04:22:56.868 INFO:teuthology.orchestra.run.smithi184.stdout:Name : grub2-tools 2023-10-06T04:22:56.868 INFO:teuthology.orchestra.run.smithi184.stdout:Epoch : 1 2023-10-06T04:22:56.869 INFO:teuthology.orchestra.run.smithi184.stdout:Version : 2.02 2023-10-06T04:22:56.869 INFO:teuthology.orchestra.run.smithi184.stdout:Release : 99.el8_4.1 2023-10-06T04:22:56.869 INFO:teuthology.orchestra.run.smithi184.stdout:Architecture: x86_64 2023-10-06T04:22:56.869 INFO:teuthology.orchestra.run.smithi184.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-06T04:22:56.869 INFO:teuthology.orchestra.run.smithi184.stdout:Group : System Environment/Base 2023-10-06T04:22:56.869 INFO:teuthology.orchestra.run.smithi184.stdout:Size : 9264631 2023-10-06T04:22:56.869 INFO:teuthology.orchestra.run.smithi184.stdout:License : GPLv3+ 2023-10-06T04:22:56.869 INFO:teuthology.orchestra.run.smithi184.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-06T04:22:56.869 INFO:teuthology.orchestra.run.smithi184.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-06T04:22:56.869 INFO:teuthology.orchestra.run.smithi184.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-06T04:22:56.869 INFO:teuthology.orchestra.run.smithi184.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-06T04:22:56.870 INFO:teuthology.orchestra.run.smithi184.stdout:Relocations : (not relocatable) 2023-10-06T04:22:56.870 INFO:teuthology.orchestra.run.smithi184.stdout:Packager : Red Hat, Inc. 2023-10-06T04:22:56.870 INFO:teuthology.orchestra.run.smithi184.stdout:Vendor : Red Hat, Inc. 2023-10-06T04:22:56.870 INFO:teuthology.orchestra.run.smithi184.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T04:22:56.870 INFO:teuthology.orchestra.run.smithi184.stdout:Summary : Support tools for GRUB. 2023-10-06T04:22:56.870 INFO:teuthology.orchestra.run.smithi184.stdout:Description : 2023-10-06T04:22:56.870 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:22:56.870 INFO:teuthology.orchestra.run.smithi184.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T04:22:56.870 INFO:teuthology.orchestra.run.smithi184.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T04:22:56.870 INFO:teuthology.orchestra.run.smithi184.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T04:22:56.870 INFO:teuthology.orchestra.run.smithi184.stdout:hardware devices. 2023-10-06T04:22:56.871 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:22:56.871 INFO:teuthology.orchestra.run.smithi184.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T04:22:56.871 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T04:22:56.872 INFO:teuthology.task.kernel:Updating grub on smithi184 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:22:56.872 DEBUG:teuthology.orchestra.run.smithi184:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T04:22:57.100 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-06T04:22:57.100 INFO:teuthology.orchestra.run.smithi008.stdout:Unable to read consumer identity 2023-10-06T04:22:57.408 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:00:02 ago on Fri 06 Oct 2023 04:22:55 AM UTC. 2023-10-06T04:22:57.541 INFO:teuthology.orchestra.run.smithi008.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T04:22:57.541 INFO:teuthology.orchestra.run.smithi008.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T04:22:57.541 INFO:teuthology.orchestra.run.smithi008.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T04:22:57.563 INFO:teuthology.orchestra.run.smithi008.stderr:Error: No packages marked for reinstall. 2023-10-06T04:22:57.614 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum reinstall -y kernel || true 2023-10-06T04:22:57.977 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-06T04:22:57.977 INFO:teuthology.orchestra.run.smithi008.stdout:Unable to read consumer identity 2023-10-06T04:22:58.263 INFO:teuthology.orchestra.run.smithi184.stderr:Generating grub configuration file ... 2023-10-06T04:22:58.269 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:00:03 ago on Fri 06 Oct 2023 04:22:55 AM UTC. 2023-10-06T04:22:58.407 INFO:teuthology.orchestra.run.smithi008.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T04:22:58.407 INFO:teuthology.orchestra.run.smithi008.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T04:22:58.407 INFO:teuthology.orchestra.run.smithi008.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T04:22:58.420 INFO:teuthology.orchestra.run.smithi008.stderr:Error: No packages marked for reinstall. 2023-10-06T04:22:58.471 DEBUG:teuthology.orchestra.run.smithi008:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T04:22:58.600 INFO:teuthology.orchestra.run.smithi008.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T04:22:58.601 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:22:58.601 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:22:58.601 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T04:22:58.601 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T04:22:58.601 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-10-06T04:22:58.601 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi008.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T04:22:58.601 DEBUG:teuthology.orchestra.run.smithi008:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T04:22:58.732 INFO:teuthology.orchestra.run.smithi008.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T04:22:58.732 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:22:58.732 DEBUG:teuthology.orchestra.run.smithi008:> sudo rpm -qi grub2-tools 2023-10-06T04:22:58.761 INFO:teuthology.orchestra.run.smithi008.stdout:Name : grub2-tools 2023-10-06T04:22:58.761 INFO:teuthology.orchestra.run.smithi008.stdout:Epoch : 1 2023-10-06T04:22:58.761 INFO:teuthology.orchestra.run.smithi008.stdout:Version : 2.02 2023-10-06T04:22:58.761 INFO:teuthology.orchestra.run.smithi008.stdout:Release : 99.el8_4.1 2023-10-06T04:22:58.761 INFO:teuthology.orchestra.run.smithi008.stdout:Architecture: x86_64 2023-10-06T04:22:58.761 INFO:teuthology.orchestra.run.smithi008.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-06T04:22:58.761 INFO:teuthology.orchestra.run.smithi008.stdout:Group : System Environment/Base 2023-10-06T04:22:58.762 INFO:teuthology.orchestra.run.smithi008.stdout:Size : 9264631 2023-10-06T04:22:58.762 INFO:teuthology.orchestra.run.smithi008.stdout:License : GPLv3+ 2023-10-06T04:22:58.762 INFO:teuthology.orchestra.run.smithi008.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-06T04:22:58.762 INFO:teuthology.orchestra.run.smithi008.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-06T04:22:58.762 INFO:teuthology.orchestra.run.smithi008.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-06T04:22:58.762 INFO:teuthology.orchestra.run.smithi008.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-06T04:22:58.762 INFO:teuthology.orchestra.run.smithi008.stdout:Relocations : (not relocatable) 2023-10-06T04:22:58.762 INFO:teuthology.orchestra.run.smithi008.stdout:Packager : Red Hat, Inc. 2023-10-06T04:22:58.762 INFO:teuthology.orchestra.run.smithi008.stdout:Vendor : Red Hat, Inc. 2023-10-06T04:22:58.762 INFO:teuthology.orchestra.run.smithi008.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T04:22:58.762 INFO:teuthology.orchestra.run.smithi008.stdout:Summary : Support tools for GRUB. 2023-10-06T04:22:58.763 INFO:teuthology.orchestra.run.smithi008.stdout:Description : 2023-10-06T04:22:58.763 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:22:58.763 INFO:teuthology.orchestra.run.smithi008.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T04:22:58.763 INFO:teuthology.orchestra.run.smithi008.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T04:22:58.763 INFO:teuthology.orchestra.run.smithi008.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T04:22:58.763 INFO:teuthology.orchestra.run.smithi008.stdout:hardware devices. 2023-10-06T04:22:58.763 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:22:58.763 INFO:teuthology.orchestra.run.smithi008.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T04:22:58.764 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T04:22:58.764 INFO:teuthology.task.kernel:Updating grub on smithi008 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:22:58.764 DEBUG:teuthology.orchestra.run.smithi008:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T04:23:00.067 INFO:teuthology.orchestra.run.smithi008.stderr:Generating grub configuration file ... 2023-10-06T04:23:00.551 INFO:teuthology.orchestra.run.smithi184.stderr:done 2023-10-06T04:23:00.552 DEBUG:teuthology.orchestra.run.smithi184:> mktemp 2023-10-06T04:23:00.580 INFO:teuthology.orchestra.run.smithi184.stdout:/tmp/tmp.sfFZ81UFmj 2023-10-06T04:23:00.580 DEBUG:teuthology.orchestra.run.smithi184:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.sfFZ81UFmj 2023-10-06T04:23:00.651 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0666 /tmp/tmp.sfFZ81UFmj 2023-10-06T04:23:00.820 DEBUG:teuthology.orchestra.remote:smithi184:/tmp/tmp.sfFZ81UFmj is 6KB 2023-10-06T04:23:00.870 DEBUG:teuthology.orchestra.run.smithi184:> rm -fr /tmp/tmp.sfFZ81UFmj 2023-10-06T04:23:00.884 DEBUG:teuthology.orchestra.run.smithi184:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T04:23:00.946 INFO:teuthology.orchestra.run.smithi184.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-06T04:23:00.946 INFO:teuthology.orchestra.run.smithi184.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-06T04:23:00.946 INFO:teuthology.orchestra.run.smithi184.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-06T04:23:00.946 INFO:teuthology.orchestra.run.smithi184.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-06T04:23:00.948 DEBUG:teuthology.orchestra.run.smithi184:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-06T04:23:01.152 DEBUG:teuthology.orchestra.run.smithi184:> sudo shutdown -r now 2023-10-06T04:23:02.354 INFO:teuthology.orchestra.run.smithi008.stderr:done 2023-10-06T04:23:02.356 DEBUG:teuthology.orchestra.run.smithi008:> mktemp 2023-10-06T04:23:02.370 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/tmp.yWMfwLykpA 2023-10-06T04:23:02.370 DEBUG:teuthology.orchestra.run.smithi008:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.yWMfwLykpA 2023-10-06T04:23:02.458 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0666 /tmp/tmp.yWMfwLykpA 2023-10-06T04:23:02.570 DEBUG:teuthology.orchestra.remote:smithi008:/tmp/tmp.yWMfwLykpA is 6KB 2023-10-06T04:23:02.617 DEBUG:teuthology.orchestra.run.smithi008:> rm -fr /tmp/tmp.yWMfwLykpA 2023-10-06T04:23:02.631 DEBUG:teuthology.orchestra.run.smithi008:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T04:23:02.694 INFO:teuthology.orchestra.run.smithi008.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-06T04:23:02.694 INFO:teuthology.orchestra.run.smithi008.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-06T04:23:02.695 INFO:teuthology.orchestra.run.smithi008.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-06T04:23:02.695 INFO:teuthology.orchestra.run.smithi008.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-06T04:23:02.696 DEBUG:teuthology.orchestra.run.smithi008:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-06T04:23:02.846 DEBUG:teuthology.orchestra.run.smithi008:> sudo shutdown -r now 2023-10-06T04:23:31.182 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-06T04:23:31.183 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-10-06T04:23:31.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:23:32.850 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-06T04:23:32.850 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-06T04:23:32.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:24:31.242 DEBUG:teuthology.orchestra.remote:timed out 2023-10-06T04:24:32.854 DEBUG:teuthology.orchestra.remote:timed out 2023-10-06T04:24:40.251 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-10-06T04:24:40.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:24:40.841 DEBUG:teuthology.orchestra.run.smithi184:> true 2023-10-06T04:24:41.319 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-10-06T04:24:41.319 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-06T04:24:41.319 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2023-10-06T04:24:41.333 INFO:teuthology.orchestra.run.smithi184.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-06T04:24:41.333 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:24:41.333 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T04:24:41.334 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T04:24:41.855 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-06T04:24:41.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:24:42.266 DEBUG:teuthology.orchestra.run.smithi008:> true 2023-10-06T04:24:42.335 DEBUG:teuthology.parallel:result is None 2023-10-06T04:24:42.506 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-06T04:24:42.506 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-06T04:24:42.507 DEBUG:teuthology.orchestra.run.smithi008:> uname -r 2023-10-06T04:24:42.560 INFO:teuthology.orchestra.run.smithi008.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-06T04:24:42.561 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:24:42.561 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T04:24:42.561 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T04:24:43.562 DEBUG:teuthology.parallel:result is None 2023-10-06T04:24:43.562 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-06T04:24:43.570 INFO:teuthology.task.internal:Creating test directory... 2023-10-06T04:24:43.570 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T04:24:43.573 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T04:24:43.589 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-06T04:24:43.596 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-06T04:24:43.603 INFO:teuthology.task.internal:Creating archive directory... 2023-10-06T04:24:43.603 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T04:24:43.630 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T04:24:43.675 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-06T04:24:43.682 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-06T04:24:43.682 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T04:24:43.712 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T04:24:43.839 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T04:24:43.851 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T04:24:43.964 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T04:24:43.986 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T04:24:43.988 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-06T04:24:43.996 INFO:teuthology.task.internal:Configuring sudo... 2023-10-06T04:24:43.996 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T04:24:43.998 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T04:24:44.023 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-06T04:24:44.032 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-06T04:24:44.033 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T04:24:44.065 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T04:24:44.081 DEBUG:teuthology.orchestra.run.smithi008:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T04:24:44.161 DEBUG:teuthology.orchestra.run.smithi008:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T04:24:44.223 DEBUG:teuthology.orchestra.run.smithi008:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T04:24:44.266 DEBUG:teuthology.orchestra.run.smithi008:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T04:24:44.305 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T04:24:44.305 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T04:24:44.380 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T04:24:44.422 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T04:24:44.494 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T04:24:44.536 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T04:24:44.577 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-06T04:24:44.578 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T04:24:44.646 DEBUG:teuthology.orchestra.run.smithi008:> sudo service rsyslog restart 2023-10-06T04:24:44.648 DEBUG:teuthology.orchestra.run.smithi184:> sudo service rsyslog restart 2023-10-06T04:24:44.717 INFO:teuthology.orchestra.run.smithi008.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T04:24:44.761 INFO:teuthology.orchestra.run.smithi184.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T04:24:44.779 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-06T04:24:44.789 INFO:teuthology.task.internal:Starting timer... 2023-10-06T04:24:44.789 INFO:teuthology.run_tasks:Running task pcp... 2023-10-06T04:24:44.798 INFO:teuthology.run_tasks:Running task selinux... 2023-10-06T04:24:44.807 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-10-06T04:24:44.807 DEBUG:teuthology.orchestra.run.smithi008:> sudo service auditd rotate 2023-10-06T04:24:44.898 INFO:teuthology.orchestra.run.smithi008.stdout:Rotating logs: [ OK ] 2023-10-06T04:24:44.900 DEBUG:teuthology.orchestra.run.smithi184:> sudo service auditd rotate 2023-10-06T04:24:45.056 INFO:teuthology.orchestra.run.smithi184.stdout:Rotating logs: [ OK ] 2023-10-06T04:24:45.059 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-06T04:24:45.059 DEBUG:teuthology.orchestra.run.smithi008:> /usr/sbin/getenforce 2023-10-06T04:24:45.086 INFO:teuthology.orchestra.run.smithi008.stdout:Permissive 2023-10-06T04:24:45.087 DEBUG:teuthology.orchestra.run.smithi184:> /usr/sbin/getenforce 2023-10-06T04:24:45.113 INFO:teuthology.orchestra.run.smithi184.stdout:Permissive 2023-10-06T04:24:45.114 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi008.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi184.front.sepia.ceph.com': 'permissive'} 2023-10-06T04:24:45.114 DEBUG:teuthology.orchestra.run.smithi008:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T04:24:45.153 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:24:45.154 DEBUG:teuthology.orchestra.run.smithi184:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T04:24:45.183 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:24:45.183 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-06T04:24:45.183 DEBUG:teuthology.orchestra.run.smithi008:> sudo /usr/sbin/setenforce permissive 2023-10-06T04:24:45.220 DEBUG:teuthology.orchestra.run.smithi184:> sudo /usr/sbin/setenforce permissive 2023-10-06T04:24:45.252 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-06T04:24:45.262 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-06T04:24:45.262 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-06T04:24:45.278 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-06T04:24:45.279 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi008.front.sepia.ceph.com,smithi184.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-06T04:33:11.560 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi008.front.sepia.ceph.com'), Remote(name='ubuntu@smithi184.front.sepia.ceph.com')] 2023-10-06T04:33:11.561 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-06T04:33:11.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:33:11.633 DEBUG:teuthology.orchestra.run.smithi008:> true 2023-10-06T04:33:11.702 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-06T04:33:11.702 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-10-06T04:33:11.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:33:11.768 DEBUG:teuthology.orchestra.run.smithi184:> true 2023-10-06T04:33:11.832 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-10-06T04:33:11.833 INFO:teuthology.run_tasks:Running task clock... 2023-10-06T04:33:11.845 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-06T04:33:11.845 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T04:33:11.846 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T04:33:11.848 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T04:33:11.848 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T04:33:11.876 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T04:33:11.890 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T04:33:11.900 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T04:33:11.914 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T04:33:11.923 INFO:teuthology.orchestra.run.smithi008.stderr:sudo: ntpd: command not found 2023-10-06T04:33:11.934 INFO:teuthology.orchestra.run.smithi008.stdout:506 Cannot talk to daemon 2023-10-06T04:33:11.949 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: ntpd: command not found 2023-10-06T04:33:11.949 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T04:33:11.959 INFO:teuthology.orchestra.run.smithi184.stdout:506 Cannot talk to daemon 2023-10-06T04:33:11.963 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T04:33:11.973 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T04:33:11.987 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T04:33:12.029 INFO:teuthology.orchestra.run.smithi008.stderr:bash: ntpq: command not found 2023-10-06T04:33:12.032 INFO:teuthology.orchestra.run.smithi008.stdout:210 Number of sources = 4 2023-10-06T04:33:12.032 INFO:teuthology.orchestra.run.smithi008.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T04:33:12.032 INFO:teuthology.orchestra.run.smithi008.stdout:=============================================================================== 2023-10-06T04:33:12.032 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:33:12.032 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:33:12.032 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:33:12.032 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:33:12.051 INFO:teuthology.orchestra.run.smithi184.stderr:bash: ntpq: command not found 2023-10-06T04:33:12.053 INFO:teuthology.orchestra.run.smithi184.stdout:210 Number of sources = 4 2023-10-06T04:33:12.054 INFO:teuthology.orchestra.run.smithi184.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T04:33:12.054 INFO:teuthology.orchestra.run.smithi184.stdout:=============================================================================== 2023-10-06T04:33:12.054 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:33:12.054 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:33:12.054 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:33:12.054 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:33:12.055 INFO:teuthology.run_tasks:Running task install... 2023-10-06T04:33:12.063 DEBUG:teuthology.task.install:project ceph 2023-10-06T04:33:12.063 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}} 2023-10-06T04:33:12.063 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'} 2023-10-06T04:33:12.064 INFO:teuthology.task.install:Using flavor: default 2023-10-06T04:33:12.069 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-06T04:33:12.069 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-06T04:33:12.070 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'tag': None, 'wait_for_package': False} 2023-10-06T04:33:12.070 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T04:33:12.072 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'tag': None, 'wait_for_package': False} 2023-10-06T04:33:12.072 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T04:33:12.294 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/ 2023-10-06T04:33:12.295 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1274.g68e53a4a 2023-10-06T04:33:12.299 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/ 2023-10-06T04:33:12.300 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1274.g68e53a4a 2023-10-06T04:33:12.403 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T04:33:12.404 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-06T04:33:12.404 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T04:33:12.429 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T04:33:12.429 DEBUG:teuthology.orchestra.run.smithi184:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T04:33:12.465 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T04:33:12.466 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T04:33:12.466 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T04:33:12.493 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T04:33:12.493 DEBUG:teuthology.orchestra.run.smithi008:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T04:33:12.494 DEBUG:teuthology.orchestra.run.smithi184:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T04:33:12.560 DEBUG:teuthology.orchestra.run.smithi008:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T04:33:12.569 DEBUG:teuthology.orchestra.run.smithi184:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T04:33:12.632 INFO:teuthology.orchestra.run.smithi184.stdout:check_obsoletes = 1 2023-10-06T04:33:12.633 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum clean all 2023-10-06T04:33:12.636 DEBUG:teuthology.orchestra.run.smithi008:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T04:33:12.701 INFO:teuthology.orchestra.run.smithi008.stdout:check_obsoletes = 1 2023-10-06T04:33:12.702 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum clean all 2023-10-06T04:33:13.023 INFO:teuthology.orchestra.run.smithi184.stdout:Updating Subscription Management repositories. 2023-10-06T04:33:13.113 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-06T04:33:13.351 INFO:teuthology.orchestra.run.smithi184.stdout:44 files removed 2023-10-06T04:33:13.403 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T04:33:13.454 INFO:teuthology.orchestra.run.smithi008.stdout:44 files removed 2023-10-06T04:33:13.504 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T04:33:13.751 INFO:teuthology.orchestra.run.smithi184.stdout:Updating Subscription Management repositories. 2023-10-06T04:33:13.877 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-06T04:33:14.494 INFO:teuthology.orchestra.run.smithi184.stdout:ceph packages for x86_64 283 kB/s | 78 kB 00:00 2023-10-06T04:33:14.649 INFO:teuthology.orchestra.run.smithi008.stdout:ceph packages for x86_64 254 kB/s | 78 kB 00:00 2023-10-06T04:33:14.788 INFO:teuthology.orchestra.run.smithi184.stdout:ceph noarch packages 36 kB/s | 9.2 kB 00:00 2023-10-06T04:33:14.939 INFO:teuthology.orchestra.run.smithi008.stdout:ceph noarch packages 37 kB/s | 9.2 kB 00:00 2023-10-06T04:33:15.062 INFO:teuthology.orchestra.run.smithi184.stdout:ceph source packages 5.9 kB/s | 1.4 kB 00:00 2023-10-06T04:33:15.171 INFO:teuthology.orchestra.run.smithi184.stdout:Copr repo for python3-asyncssh owned by ceph 44 kB/s | 3.5 kB 00:00 2023-10-06T04:33:15.273 INFO:teuthology.orchestra.run.smithi008.stdout:ceph source packages 4.8 kB/s | 1.4 kB 00:00 2023-10-06T04:33:15.386 INFO:teuthology.orchestra.run.smithi008.stdout:Copr repo for python3-asyncssh owned by ceph 42 kB/s | 3.5 kB 00:00 2023-10-06T04:33:16.426 INFO:teuthology.orchestra.run.smithi008.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:01 2023-10-06T04:33:16.704 INFO:teuthology.orchestra.run.smithi184.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2023-10-06T04:33:20.031 INFO:teuthology.orchestra.run.smithi184.stdout:lab-extras 4.3 MB/s | 24 kB 00:00 2023-10-06T04:33:20.032 INFO:teuthology.orchestra.run.smithi008.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2023-10-06T04:33:20.508 INFO:teuthology.orchestra.run.smithi184.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 97 MB/s | 38 MB 00:00 2023-10-06T04:33:20.519 INFO:teuthology.orchestra.run.smithi008.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 82 MB/s | 33 MB 00:00 2023-10-06T04:33:26.262 INFO:teuthology.orchestra.run.smithi184.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 71 MB/s | 33 MB 00:00 2023-10-06T04:33:26.280 INFO:teuthology.orchestra.run.smithi008.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 77 MB/s | 38 MB 00:00 2023-10-06T04:33:34.255 INFO:teuthology.orchestra.run.smithi184.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T04:33:34.256 INFO:teuthology.orchestra.run.smithi184.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T04:33:34.266 INFO:teuthology.orchestra.run.smithi184.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-06T04:33:34.267 INFO:teuthology.orchestra.run.smithi184.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-06T04:33:34.268 INFO:teuthology.orchestra.run.smithi184.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T04:33:34.269 INFO:teuthology.orchestra.run.smithi184.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T04:33:34.270 INFO:teuthology.orchestra.run.smithi184.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T04:33:34.273 INFO:teuthology.orchestra.run.smithi184.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T04:33:34.273 INFO:teuthology.orchestra.run.smithi184.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T04:33:34.757 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-10-06T04:33:34.769 INFO:teuthology.orchestra.run.smithi184.stdout:====================================================================================================================== 2023-10-06T04:33:34.769 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2023-10-06T04:33:34.769 INFO:teuthology.orchestra.run.smithi184.stdout:====================================================================================================================== 2023-10-06T04:33:34.769 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2023-10-06T04:33:34.769 INFO:teuthology.orchestra.run.smithi184.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T04:33:34.769 INFO:teuthology.orchestra.run.smithi184.stdout: ceph x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 6.4 k 2023-10-06T04:33:34.770 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 5.2 M 2023-10-06T04:33:34.770 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-fuse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 877 k 2023-10-06T04:33:34.770 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 162 k 2023-10-06T04:33:34.770 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 1.6 M 2023-10-06T04:33:34.770 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 121 k 2023-10-06T04:33:34.770 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 1.7 M 2023-10-06T04:33:34.770 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 7.4 M 2023-10-06T04:33:34.770 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-rook noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 47 k 2023-10-06T04:33:34.770 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-radosgw x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 17 M 2023-10-06T04:33:34.770 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-test x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 52 M 2023-10-06T04:33:34.770 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-volume noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 267 k 2023-10-06T04:33:34.770 INFO:teuthology.orchestra.run.smithi184.stdout: cephadm noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 80 k 2023-10-06T04:33:34.771 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-mirror x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 255 k 2023-10-06T04:33:34.771 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-top noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 18 k 2023-10-06T04:33:34.771 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-06T04:33:34.771 INFO:teuthology.orchestra.run.smithi184.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T04:33:34.771 INFO:teuthology.orchestra.run.smithi184.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T04:33:34.771 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs-devel x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 25 k 2023-10-06T04:33:34.771 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 797 k 2023-10-06T04:33:34.771 INFO:teuthology.orchestra.run.smithi184.stdout: librados-devel x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 130 k 2023-10-06T04:33:34.771 INFO:teuthology.orchestra.run.smithi184.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T04:33:34.771 INFO:teuthology.orchestra.run.smithi184.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-06T04:33:34.771 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T04:33:34.772 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cephfs x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 190 k 2023-10-06T04:33:34.772 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rados x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 371 k 2023-10-06T04:33:34.772 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rbd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 358 k 2023-10-06T04:33:34.772 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rgw x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 107 k 2023-10-06T04:33:34.772 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-fuse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 91 k 2023-10-06T04:33:34.772 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-mirror x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.5 M 2023-10-06T04:33:34.772 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-nbd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 173 k 2023-10-06T04:33:34.772 INFO:teuthology.orchestra.run.smithi184.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-06T04:33:34.772 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrading: 2023-10-06T04:33:34.772 INFO:teuthology.orchestra.run.smithi184.stdout: librados2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.4 M 2023-10-06T04:33:34.772 INFO:teuthology.orchestra.run.smithi184.stdout: librbd1 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.5 M 2023-10-06T04:33:34.772 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2023-10-06T04:33:34.773 INFO:teuthology.orchestra.run.smithi184.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T04:33:34.773 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-common x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 23 M 2023-10-06T04:33:34.773 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 23 k 2023-10-06T04:33:34.773 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mds x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 2.3 M 2023-10-06T04:33:34.773 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 238 k 2023-10-06T04:33:34.773 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mon x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.9 M 2023-10-06T04:33:34.773 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-osd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 17 M 2023-10-06T04:33:34.773 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 14 k 2023-10-06T04:33:34.773 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-selinux x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 24 k 2023-10-06T04:33:34.773 INFO:teuthology.orchestra.run.smithi184.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T04:33:34.773 INFO:teuthology.orchestra.run.smithi184.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T04:33:34.773 INFO:teuthology.orchestra.run.smithi184.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-06T04:33:34.774 INFO:teuthology.orchestra.run.smithi184.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T04:33:34.774 INFO:teuthology.orchestra.run.smithi184.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T04:33:34.774 INFO:teuthology.orchestra.run.smithi184.stdout: libcephsqlite x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 175 k 2023-10-06T04:33:34.774 INFO:teuthology.orchestra.run.smithi184.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-06T04:33:34.774 INFO:teuthology.orchestra.run.smithi184.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-06T04:33:34.774 INFO:teuthology.orchestra.run.smithi184.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T04:33:34.774 INFO:teuthology.orchestra.run.smithi184.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-06T04:33:34.774 INFO:teuthology.orchestra.run.smithi184.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T04:33:34.774 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 506 k 2023-10-06T04:33:34.774 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-06T04:33:34.774 INFO:teuthology.orchestra.run.smithi184.stdout: librgw2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 5.6 M 2023-10-06T04:33:34.775 INFO:teuthology.orchestra.run.smithi184.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T04:33:34.775 INFO:teuthology.orchestra.run.smithi184.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-06T04:33:34.775 INFO:teuthology.orchestra.run.smithi184.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T04:33:34.775 INFO:teuthology.orchestra.run.smithi184.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T04:33:34.775 INFO:teuthology.orchestra.run.smithi184.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T04:33:34.775 INFO:teuthology.orchestra.run.smithi184.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T04:33:34.775 INFO:teuthology.orchestra.run.smithi184.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-06T04:33:34.775 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T04:33:34.775 INFO:teuthology.orchestra.run.smithi184.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T04:33:34.775 INFO:teuthology.orchestra.run.smithi184.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T04:33:34.775 INFO:teuthology.orchestra.run.smithi184.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T04:33:34.775 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T04:33:34.776 INFO:teuthology.orchestra.run.smithi184.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T04:33:34.776 INFO:teuthology.orchestra.run.smithi184.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T04:33:34.776 INFO:teuthology.orchestra.run.smithi184.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T04:33:34.776 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T04:33:34.776 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 45 k 2023-10-06T04:33:34.776 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 115 k 2023-10-06T04:33:34.776 INFO:teuthology.orchestra.run.smithi184.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T04:33:34.776 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T04:33:34.776 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T04:33:34.776 INFO:teuthology.orchestra.run.smithi184.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T04:33:34.776 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T04:33:34.776 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T04:33:34.777 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T04:33:34.777 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T04:33:34.777 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T04:33:34.777 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T04:33:34.777 INFO:teuthology.orchestra.run.smithi184.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T04:33:34.777 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T04:33:34.777 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T04:33:34.777 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T04:33:34.777 INFO:teuthology.orchestra.run.smithi184.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T04:33:34.777 INFO:teuthology.orchestra.run.smithi184.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T04:33:34.777 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T04:33:34.777 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T04:33:34.778 INFO:teuthology.orchestra.run.smithi184.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T04:33:34.778 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T04:33:34.778 INFO:teuthology.orchestra.run.smithi184.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T04:33:34.778 INFO:teuthology.orchestra.run.smithi184.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T04:33:34.778 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T04:33:34.778 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T04:33:34.778 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T04:33:34.778 INFO:teuthology.orchestra.run.smithi184.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T04:33:34.778 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T04:33:34.778 INFO:teuthology.orchestra.run.smithi184.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T04:33:34.778 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T04:33:34.779 INFO:teuthology.orchestra.run.smithi184.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-06T04:33:34.779 INFO:teuthology.orchestra.run.smithi184.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T04:33:34.779 INFO:teuthology.orchestra.run.smithi184.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T04:33:34.779 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T04:33:34.779 INFO:teuthology.orchestra.run.smithi184.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T04:33:34.779 INFO:teuthology.orchestra.run.smithi184.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T04:33:34.779 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T04:33:34.779 INFO:teuthology.orchestra.run.smithi184.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T04:33:34.779 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T04:33:34.779 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T04:33:34.779 INFO:teuthology.orchestra.run.smithi184.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T04:33:34.779 INFO:teuthology.orchestra.run.smithi184.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-06T04:33:34.780 INFO:teuthology.orchestra.run.smithi184.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T04:33:34.780 INFO:teuthology.orchestra.run.smithi184.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T04:33:34.780 INFO:teuthology.orchestra.run.smithi184.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T04:33:34.780 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:33:34.780 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2023-10-06T04:33:34.780 INFO:teuthology.orchestra.run.smithi184.stdout:====================================================================================================================== 2023-10-06T04:33:34.780 INFO:teuthology.orchestra.run.smithi184.stdout:Install 118 Packages 2023-10-06T04:33:34.780 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrade 2 Packages 2023-10-06T04:33:34.780 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:33:34.781 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 201 M 2023-10-06T04:33:34.781 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2023-10-06T04:33:35.162 INFO:teuthology.orchestra.run.smithi184.stdout:(1/120): ceph-17.2.6-1274.g68e53a4a.el8.x86_64. 29 kB/s | 6.4 kB 00:00 2023-10-06T04:33:35.191 INFO:teuthology.orchestra.run.smithi008.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T04:33:35.191 INFO:teuthology.orchestra.run.smithi008.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T04:33:35.203 INFO:teuthology.orchestra.run.smithi008.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-06T04:33:35.204 INFO:teuthology.orchestra.run.smithi008.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-06T04:33:35.205 INFO:teuthology.orchestra.run.smithi008.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T04:33:35.205 INFO:teuthology.orchestra.run.smithi008.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T04:33:35.207 INFO:teuthology.orchestra.run.smithi008.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T04:33:35.210 INFO:teuthology.orchestra.run.smithi008.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T04:33:35.211 INFO:teuthology.orchestra.run.smithi008.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T04:33:35.730 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-06T04:33:35.743 INFO:teuthology.orchestra.run.smithi008.stdout:====================================================================================================================== 2023-10-06T04:33:35.743 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-06T04:33:35.743 INFO:teuthology.orchestra.run.smithi008.stdout:====================================================================================================================== 2023-10-06T04:33:35.743 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-06T04:33:35.743 INFO:teuthology.orchestra.run.smithi008.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T04:33:35.743 INFO:teuthology.orchestra.run.smithi008.stdout: ceph x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 6.4 k 2023-10-06T04:33:35.743 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-base x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 5.2 M 2023-10-06T04:33:35.743 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-fuse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 877 k 2023-10-06T04:33:35.743 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 162 k 2023-10-06T04:33:35.743 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 1.6 M 2023-10-06T04:33:35.744 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 121 k 2023-10-06T04:33:35.744 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 1.7 M 2023-10-06T04:33:35.744 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 7.4 M 2023-10-06T04:33:35.744 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-rook noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 47 k 2023-10-06T04:33:35.744 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-radosgw x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 17 M 2023-10-06T04:33:35.744 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-test x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 52 M 2023-10-06T04:33:35.744 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-volume noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 267 k 2023-10-06T04:33:35.744 INFO:teuthology.orchestra.run.smithi008.stdout: cephadm noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 80 k 2023-10-06T04:33:35.744 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-mirror x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 255 k 2023-10-06T04:33:35.744 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-top noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 18 k 2023-10-06T04:33:35.744 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-06T04:33:35.744 INFO:teuthology.orchestra.run.smithi008.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T04:33:35.745 INFO:teuthology.orchestra.run.smithi008.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T04:33:35.745 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs-devel x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 25 k 2023-10-06T04:33:35.745 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 797 k 2023-10-06T04:33:35.745 INFO:teuthology.orchestra.run.smithi008.stdout: librados-devel x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 130 k 2023-10-06T04:33:35.745 INFO:teuthology.orchestra.run.smithi008.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T04:33:35.745 INFO:teuthology.orchestra.run.smithi008.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-06T04:33:35.745 INFO:teuthology.orchestra.run.smithi008.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T04:33:35.745 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cephfs x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 190 k 2023-10-06T04:33:35.745 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rados x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 371 k 2023-10-06T04:33:35.745 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rbd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 358 k 2023-10-06T04:33:35.745 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rgw x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 107 k 2023-10-06T04:33:35.745 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-fuse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 91 k 2023-10-06T04:33:35.746 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-mirror x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.5 M 2023-10-06T04:33:35.746 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-nbd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 173 k 2023-10-06T04:33:35.746 INFO:teuthology.orchestra.run.smithi008.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-06T04:33:35.746 INFO:teuthology.orchestra.run.smithi008.stdout:Upgrading: 2023-10-06T04:33:35.746 INFO:teuthology.orchestra.run.smithi008.stdout: librados2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.4 M 2023-10-06T04:33:35.746 INFO:teuthology.orchestra.run.smithi008.stdout: librbd1 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.5 M 2023-10-06T04:33:35.746 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-10-06T04:33:35.746 INFO:teuthology.orchestra.run.smithi008.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T04:33:35.746 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-common x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 23 M 2023-10-06T04:33:35.746 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 23 k 2023-10-06T04:33:35.746 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mds x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 2.3 M 2023-10-06T04:33:35.747 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 238 k 2023-10-06T04:33:35.747 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mon x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.9 M 2023-10-06T04:33:35.747 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-osd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 17 M 2023-10-06T04:33:35.747 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 14 k 2023-10-06T04:33:35.747 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-selinux x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 24 k 2023-10-06T04:33:35.747 INFO:teuthology.orchestra.run.smithi008.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T04:33:35.747 INFO:teuthology.orchestra.run.smithi008.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T04:33:35.747 INFO:teuthology.orchestra.run.smithi008.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-06T04:33:35.747 INFO:teuthology.orchestra.run.smithi008.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T04:33:35.747 INFO:teuthology.orchestra.run.smithi008.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T04:33:35.747 INFO:teuthology.orchestra.run.smithi008.stdout: libcephsqlite x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 175 k 2023-10-06T04:33:35.748 INFO:teuthology.orchestra.run.smithi008.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-06T04:33:35.748 INFO:teuthology.orchestra.run.smithi008.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-06T04:33:35.748 INFO:teuthology.orchestra.run.smithi008.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T04:33:35.748 INFO:teuthology.orchestra.run.smithi008.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-06T04:33:35.748 INFO:teuthology.orchestra.run.smithi008.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T04:33:35.748 INFO:teuthology.orchestra.run.smithi008.stdout: libradosstriper1 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 506 k 2023-10-06T04:33:35.748 INFO:teuthology.orchestra.run.smithi008.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-06T04:33:35.748 INFO:teuthology.orchestra.run.smithi008.stdout: librgw2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 5.6 M 2023-10-06T04:33:35.748 INFO:teuthology.orchestra.run.smithi008.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T04:33:35.748 INFO:teuthology.orchestra.run.smithi008.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-06T04:33:35.748 INFO:teuthology.orchestra.run.smithi008.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T04:33:35.749 INFO:teuthology.orchestra.run.smithi008.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T04:33:35.749 INFO:teuthology.orchestra.run.smithi008.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T04:33:35.749 INFO:teuthology.orchestra.run.smithi008.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T04:33:35.749 INFO:teuthology.orchestra.run.smithi008.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-06T04:33:35.749 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T04:33:35.749 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T04:33:35.749 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T04:33:35.749 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T04:33:35.749 INFO:teuthology.orchestra.run.smithi008.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T04:33:35.749 INFO:teuthology.orchestra.run.smithi008.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T04:33:35.749 INFO:teuthology.orchestra.run.smithi008.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T04:33:35.749 INFO:teuthology.orchestra.run.smithi008.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T04:33:35.750 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T04:33:35.750 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-argparse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 45 k 2023-10-06T04:33:35.750 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-common x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 115 k 2023-10-06T04:33:35.750 INFO:teuthology.orchestra.run.smithi008.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T04:33:35.750 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T04:33:35.750 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T04:33:35.750 INFO:teuthology.orchestra.run.smithi008.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T04:33:35.750 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T04:33:35.750 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T04:33:35.750 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T04:33:35.750 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T04:33:35.751 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T04:33:35.751 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T04:33:35.751 INFO:teuthology.orchestra.run.smithi008.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T04:33:35.751 INFO:teuthology.orchestra.run.smithi008.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T04:33:35.751 INFO:teuthology.orchestra.run.smithi008.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T04:33:35.751 INFO:teuthology.orchestra.run.smithi008.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T04:33:35.751 INFO:teuthology.orchestra.run.smithi008.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T04:33:35.751 INFO:teuthology.orchestra.run.smithi008.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T04:33:35.751 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T04:33:35.751 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T04:33:35.751 INFO:teuthology.orchestra.run.smithi008.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T04:33:35.751 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T04:33:35.752 INFO:teuthology.orchestra.run.smithi008.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T04:33:35.752 INFO:teuthology.orchestra.run.smithi008.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T04:33:35.752 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T04:33:35.752 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T04:33:35.752 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T04:33:35.752 INFO:teuthology.orchestra.run.smithi008.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T04:33:35.752 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T04:33:35.752 INFO:teuthology.orchestra.run.smithi008.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T04:33:35.752 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T04:33:35.752 INFO:teuthology.orchestra.run.smithi008.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-06T04:33:35.752 INFO:teuthology.orchestra.run.smithi008.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T04:33:35.753 INFO:teuthology.orchestra.run.smithi008.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T04:33:35.753 INFO:teuthology.orchestra.run.smithi008.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T04:33:35.753 INFO:teuthology.orchestra.run.smithi008.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T04:33:35.753 INFO:teuthology.orchestra.run.smithi008.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T04:33:35.753 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T04:33:35.753 INFO:teuthology.orchestra.run.smithi008.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T04:33:35.753 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T04:33:35.753 INFO:teuthology.orchestra.run.smithi008.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T04:33:35.753 INFO:teuthology.orchestra.run.smithi008.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T04:33:35.753 INFO:teuthology.orchestra.run.smithi008.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-06T04:33:35.753 INFO:teuthology.orchestra.run.smithi008.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T04:33:35.753 INFO:teuthology.orchestra.run.smithi008.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T04:33:35.753 INFO:teuthology.orchestra.run.smithi008.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T04:33:35.754 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:33:35.754 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-06T04:33:35.754 INFO:teuthology.orchestra.run.smithi008.stdout:====================================================================================================================== 2023-10-06T04:33:35.754 INFO:teuthology.orchestra.run.smithi008.stdout:Install 118 Packages 2023-10-06T04:33:35.754 INFO:teuthology.orchestra.run.smithi008.stdout:Upgrade 2 Packages 2023-10-06T04:33:35.754 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:33:35.754 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 201 M 2023-10-06T04:33:35.755 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-06T04:33:36.063 INFO:teuthology.orchestra.run.smithi008.stdout:(1/120): ceph-17.2.6-1274.g68e53a4a.el8.x86_64. 28 kB/s | 6.4 kB 00:00 2023-10-06T04:33:36.409 INFO:teuthology.orchestra.run.smithi184.stdout:(2/120): ceph-fuse-17.2.6-1274.g68e53a4a.el8.x8 703 kB/s | 877 kB 00:01 2023-10-06T04:33:36.642 INFO:teuthology.orchestra.run.smithi184.stdout:(3/120): ceph-immutable-object-cache-17.2.6-127 694 kB/s | 162 kB 00:00 2023-10-06T04:33:36.829 INFO:teuthology.orchestra.run.smithi008.stdout:(2/120): ceph-fuse-17.2.6-1274.g68e53a4a.el8.x8 1.1 MB/s | 877 kB 00:00 2023-10-06T04:33:36.968 INFO:teuthology.orchestra.run.smithi008.stdout:(3/120): ceph-immutable-object-cache-17.2.6-127 1.1 MB/s | 162 kB 00:00 2023-10-06T04:33:38.321 INFO:teuthology.orchestra.run.smithi008.stdout:(4/120): ceph-base-17.2.6-1274.g68e53a4a.el8.x8 2.1 MB/s | 5.2 MB 00:02 2023-10-06T04:33:38.394 INFO:teuthology.orchestra.run.smithi008.stdout:(5/120): ceph-mds-17.2.6-1274.g68e53a4a.el8.x86 1.6 MB/s | 2.3 MB 00:01 2023-10-06T04:33:38.583 INFO:teuthology.orchestra.run.smithi008.stdout:(6/120): ceph-mgr-17.2.6-1274.g68e53a4a.el8.x86 6.0 MB/s | 1.6 MB 00:00 2023-10-06T04:33:38.789 INFO:teuthology.orchestra.run.smithi184.stdout:(4/120): ceph-base-17.2.6-1274.g68e53a4a.el8.x8 1.3 MB/s | 5.2 MB 00:03 2023-10-06T04:33:39.123 INFO:teuthology.orchestra.run.smithi184.stdout:(5/120): ceph-mds-17.2.6-1274.g68e53a4a.el8.x86 950 kB/s | 2.3 MB 00:02 2023-10-06T04:33:39.820 INFO:teuthology.orchestra.run.smithi184.stdout:(6/120): ceph-mgr-17.2.6-1274.g68e53a4a.el8.x86 1.5 MB/s | 1.6 MB 00:01 2023-10-06T04:33:40.371 INFO:teuthology.orchestra.run.smithi008.stdout:(7/120): ceph-osd-17.2.6-1274.g68e53a4a.el8.x86 9.3 MB/s | 17 MB 00:01 2023-10-06T04:33:40.384 INFO:teuthology.orchestra.run.smithi008.stdout:(8/120): ceph-mon-17.2.6-1274.g68e53a4a.el8.x86 2.0 MB/s | 3.9 MB 00:01 2023-10-06T04:33:40.418 INFO:teuthology.orchestra.run.smithi008.stdout:(9/120): ceph-selinux-17.2.6-1274.g68e53a4a.el8 716 kB/s | 24 kB 00:00 2023-10-06T04:33:41.443 INFO:teuthology.orchestra.run.smithi008.stdout:(10/120): ceph-radosgw-17.2.6-1274.g68e53a4a.el 16 MB/s | 17 MB 00:01 2023-10-06T04:33:41.470 INFO:teuthology.orchestra.run.smithi008.stdout:(11/120): cephfs-mirror-17.2.6-1274.g68e53a4a.e 9.4 MB/s | 255 kB 00:00 2023-10-06T04:33:41.491 INFO:teuthology.orchestra.run.smithi008.stdout:(12/120): libcephfs-devel-17.2.6-1274.g68e53a4a 1.2 MB/s | 25 kB 00:00 2023-10-06T04:33:41.533 INFO:teuthology.orchestra.run.smithi008.stdout:(13/120): libcephfs2-17.2.6-1274.g68e53a4a.el8. 19 MB/s | 797 kB 00:00 2023-10-06T04:33:41.560 INFO:teuthology.orchestra.run.smithi008.stdout:(14/120): libcephsqlite-17.2.6-1274.g68e53a4a.e 6.3 MB/s | 175 kB 00:00 2023-10-06T04:33:41.582 INFO:teuthology.orchestra.run.smithi008.stdout:(15/120): librados-devel-17.2.6-1274.g68e53a4a. 5.9 MB/s | 130 kB 00:00 2023-10-06T04:33:41.614 INFO:teuthology.orchestra.run.smithi008.stdout:(16/120): libradosstriper1-17.2.6-1274.g68e53a4 15 MB/s | 506 kB 00:00 2023-10-06T04:33:41.619 INFO:teuthology.orchestra.run.smithi184.stdout:(7/120): ceph-mon-17.2.6-1274.g68e53a4a.el8.x86 1.6 MB/s | 3.9 MB 00:02 2023-10-06T04:33:41.945 INFO:teuthology.orchestra.run.smithi008.stdout:(17/120): librgw2-17.2.6-1274.g68e53a4a.el8.x86 17 MB/s | 5.6 MB 00:00 2023-10-06T04:33:41.968 INFO:teuthology.orchestra.run.smithi008.stdout:(18/120): python3-ceph-argparse-17.2.6-1274.g68 2.0 MB/s | 45 kB 00:00 2023-10-06T04:33:41.990 INFO:teuthology.orchestra.run.smithi008.stdout:(19/120): python3-ceph-common-17.2.6-1274.g68e5 5.2 MB/s | 115 kB 00:00 2023-10-06T04:33:42.012 INFO:teuthology.orchestra.run.smithi008.stdout:(20/120): python3-cephfs-17.2.6-1274.g68e53a4a. 8.4 MB/s | 190 kB 00:00 2023-10-06T04:33:42.042 INFO:teuthology.orchestra.run.smithi008.stdout:(21/120): python3-rados-17.2.6-1274.g68e53a4a.e 12 MB/s | 371 kB 00:00 2023-10-06T04:33:42.071 INFO:teuthology.orchestra.run.smithi008.stdout:(22/120): python3-rbd-17.2.6-1274.g68e53a4a.el8 12 MB/s | 358 kB 00:00 2023-10-06T04:33:42.095 INFO:teuthology.orchestra.run.smithi008.stdout:(23/120): python3-rgw-17.2.6-1274.g68e53a4a.el8 4.4 MB/s | 107 kB 00:00 2023-10-06T04:33:42.117 INFO:teuthology.orchestra.run.smithi008.stdout:(24/120): rbd-fuse-17.2.6-1274.g68e53a4a.el8.x8 4.1 MB/s | 91 kB 00:00 2023-10-06T04:33:42.330 INFO:teuthology.orchestra.run.smithi008.stdout:(25/120): rbd-mirror-17.2.6-1274.g68e53a4a.el8. 16 MB/s | 3.5 MB 00:00 2023-10-06T04:33:42.352 INFO:teuthology.orchestra.run.smithi008.stdout:(26/120): rbd-nbd-17.2.6-1274.g68e53a4a.el8.x86 7.5 MB/s | 173 kB 00:00 2023-10-06T04:33:42.374 INFO:teuthology.orchestra.run.smithi008.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1274.g 1.1 MB/s | 23 kB 00:00 2023-10-06T04:33:42.395 INFO:teuthology.orchestra.run.smithi008.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1274.g68e53a4 5.5 MB/s | 121 kB 00:00 2023-10-06T04:33:42.513 INFO:teuthology.orchestra.run.smithi008.stdout:(29/120): ceph-mgr-dashboard-17.2.6-1274.g68e53 14 MB/s | 1.7 MB 00:00 2023-10-06T04:33:42.970 INFO:teuthology.orchestra.run.smithi008.stdout:(30/120): ceph-mgr-diskprediction-local-17.2.6- 16 MB/s | 7.4 MB 00:00 2023-10-06T04:33:42.996 INFO:teuthology.orchestra.run.smithi008.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1274.g68 8.8 MB/s | 238 kB 00:00 2023-10-06T04:33:43.019 INFO:teuthology.orchestra.run.smithi008.stdout:(32/120): ceph-mgr-rook-17.2.6-1274.g68e53a4a.e 2.1 MB/s | 47 kB 00:00 2023-10-06T04:33:43.040 INFO:teuthology.orchestra.run.smithi008.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1274.g6 693 kB/s | 14 kB 00:00 2023-10-06T04:33:43.065 INFO:teuthology.orchestra.run.smithi008.stdout:(34/120): ceph-volume-17.2.6-1274.g68e53a4a.el8 10 MB/s | 267 kB 00:00 2023-10-06T04:33:43.092 INFO:teuthology.orchestra.run.smithi008.stdout:(35/120): cephadm-17.2.6-1274.g68e53a4a.el8.noa 3.0 MB/s | 80 kB 00:00 2023-10-06T04:33:43.113 INFO:teuthology.orchestra.run.smithi008.stdout:(36/120): cephfs-top-17.2.6-1274.g68e53a4a.el8. 851 kB/s | 18 kB 00:00 2023-10-06T04:33:43.599 INFO:teuthology.orchestra.run.smithi184.stdout:(8/120): ceph-osd-17.2.6-1274.g68e53a4a.el8.x86 4.4 MB/s | 17 MB 00:03 2023-10-06T04:33:43.619 INFO:teuthology.orchestra.run.smithi008.stdout:(37/120): gperftools-libs-2.7-9.el8.x86_64.rpm 606 kB/s | 306 kB 00:00 2023-10-06T04:33:43.621 INFO:teuthology.orchestra.run.smithi184.stdout:(9/120): ceph-selinux-17.2.6-1274.g68e53a4a.el8 1.1 MB/s | 24 kB 00:00 2023-10-06T04:33:43.701 INFO:teuthology.orchestra.run.smithi008.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 716 kB/s | 59 kB 00:00 2023-10-06T04:33:43.786 INFO:teuthology.orchestra.run.smithi008.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 886 kB/s | 75 kB 00:00 2023-10-06T04:33:43.940 INFO:teuthology.orchestra.run.smithi008.stdout:(40/120): python3-asyncssh-2.7.0-2.el8.noarch.r 3.0 MB/s | 476 kB 00:00 2023-10-06T04:33:44.014 INFO:teuthology.orchestra.run.smithi008.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 586 kB/s | 44 kB 00:00 2023-10-06T04:33:44.098 INFO:teuthology.orchestra.run.smithi008.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 2.2 MB/s | 185 kB 00:00 2023-10-06T04:33:44.211 INFO:teuthology.orchestra.run.smithi008.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 443 kB/s | 33 kB 00:00 2023-10-06T04:33:44.246 INFO:teuthology.orchestra.run.smithi008.stdout:(44/120): python3-certifi-2018.10.15-7.el8.noar 223 kB/s | 16 kB 00:00 2023-10-06T04:33:44.329 INFO:teuthology.orchestra.run.smithi008.stdout:(45/120): python3-cheroot-8.5.2-1.el8.noarch.rp 2.0 MB/s | 173 kB 00:00 2023-10-06T04:33:44.426 INFO:teuthology.orchestra.run.smithi008.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 3.9 MB/s | 384 kB 00:00 2023-10-06T04:33:44.503 INFO:teuthology.orchestra.run.smithi008.stdout:(47/120): python3-google-auth-1.1.1-10.el8.noar 1.0 MB/s | 81 kB 00:00 2023-10-06T04:33:44.576 INFO:teuthology.orchestra.run.smithi008.stdout:(48/120): python3-jaraco-6.2-6.el8.noarch.rpm 152 kB/s | 11 kB 00:00 2023-10-06T04:33:44.650 INFO:teuthology.orchestra.run.smithi008.stdout:(49/120): python3-jaraco-functools-2.0-4.el8.no 239 kB/s | 18 kB 00:00 2023-10-06T04:33:44.795 INFO:teuthology.orchestra.run.smithi008.stdout:(50/120): python3-kubernetes-11.0.0-6.el8.noarc 8.0 MB/s | 1.2 MB 00:00 2023-10-06T04:33:44.870 INFO:teuthology.orchestra.run.smithi008.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 652 kB/s | 49 kB 00:00 2023-10-06T04:33:44.945 INFO:teuthology.orchestra.run.smithi008.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 787 kB/s | 59 kB 00:00 2023-10-06T04:33:45.020 INFO:teuthology.orchestra.run.smithi008.stdout:(53/120): python3-natsort-7.1.1-2.el8.noarch.rp 808 kB/s | 60 kB 00:00 2023-10-06T04:33:45.105 INFO:teuthology.orchestra.run.smithi008.stdout:(54/120): python3-pecan-1.3.2-9.el8.noarch.rpm 3.3 MB/s | 283 kB 00:00 2023-10-06T04:33:45.178 INFO:teuthology.orchestra.run.smithi008.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 213 kB/s | 16 kB 00:00 2023-10-06T04:33:45.252 INFO:teuthology.orchestra.run.smithi008.stdout:(56/120): python3-repoze-lru-0.7-6.el8.noarch.r 457 kB/s | 34 kB 00:00 2023-10-06T04:33:45.333 INFO:teuthology.orchestra.run.smithi008.stdout:(57/120): python3-routes-2.4.1-12.el8.noarch.rp 2.4 MB/s | 196 kB 00:00 2023-10-06T04:33:45.408 INFO:teuthology.orchestra.run.smithi008.stdout:(58/120): python3-rsa-4.9-2.el8.noarch.rpm 859 kB/s | 64 kB 00:00 2023-10-06T04:33:45.482 INFO:teuthology.orchestra.run.smithi008.stdout:(59/120): python3-simplegeneric-0.8.1-17.el8.no 256 kB/s | 19 kB 00:00 2023-10-06T04:33:45.555 INFO:teuthology.orchestra.run.smithi008.stdout:(60/120): python3-singledispatch-3.4.0.3-18.el8 326 kB/s | 24 kB 00:00 2023-10-06T04:33:45.629 INFO:teuthology.orchestra.run.smithi008.stdout:(61/120): python3-tempora-1.14.1-5.el8.noarch.r 398 kB/s | 29 kB 00:00 2023-10-06T04:33:45.703 INFO:teuthology.orchestra.run.smithi008.stdout:(62/120): python3-trustme-0.6.0-4.el8.noarch.rp 373 kB/s | 27 kB 00:00 2023-10-06T04:33:45.787 INFO:teuthology.orchestra.run.smithi008.stdout:(63/120): python3-waitress-1.4.3-1.el8.noarch.r 3.0 MB/s | 255 kB 00:00 2023-10-06T04:33:45.872 INFO:teuthology.orchestra.run.smithi008.stdout:(64/120): python3-webob-1.8.5-1.el8.1.noarch.rp 2.9 MB/s | 251 kB 00:00 2023-10-06T04:33:45.947 INFO:teuthology.orchestra.run.smithi008.stdout:(65/120): python3-websocket-client-0.56.0-5.el8 821 kB/s | 61 kB 00:00 2023-10-06T04:33:46.023 INFO:teuthology.orchestra.run.smithi008.stdout:(66/120): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2023-10-06T04:33:46.097 INFO:teuthology.orchestra.run.smithi008.stdout:(67/120): python3-zc-lockfile-2.0-2.el8.noarch. 313 kB/s | 23 kB 00:00 2023-10-06T04:33:46.247 INFO:teuthology.orchestra.run.smithi008.stdout:(68/120): thrift-0.13.0-2.el8.x86_64.rpm 12 MB/s | 1.7 MB 00:00 2023-10-06T04:33:46.251 INFO:teuthology.orchestra.run.smithi008.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 17 MB/s | 70 kB 00:00 2023-10-06T04:33:46.553 INFO:teuthology.orchestra.run.smithi008.stdout:(70/120): python3-scipy-1.0.0-20.module+el8.1.0 49 MB/s | 15 MB 00:00 2023-10-06T04:33:46.564 INFO:teuthology.orchestra.run.smithi008.stdout:(71/120): python3-prettytable-0.7.2-14.el8.noar 3.3 MB/s | 44 kB 00:00 2023-10-06T04:33:46.577 INFO:teuthology.orchestra.run.smithi008.stdout:(72/120): python3-jsonpatch-1.21-2.el8.noarch.r 2.0 MB/s | 27 kB 00:00 2023-10-06T04:33:46.591 INFO:teuthology.orchestra.run.smithi008.stdout:(73/120): jq-1.5-12.el8.x86_64.rpm 11 MB/s | 161 kB 00:00 2023-10-06T04:33:46.607 INFO:teuthology.orchestra.run.smithi008.stdout:(74/120): flex-2.6.1-9.el8.x86_64.rpm 20 MB/s | 320 kB 00:00 2023-10-06T04:33:46.625 INFO:teuthology.orchestra.run.smithi008.stdout:(75/120): python3-werkzeug-0.12.2-4.el8.noarch. 25 MB/s | 457 kB 00:00 2023-10-06T04:33:46.667 INFO:teuthology.orchestra.run.smithi184.stdout:(10/120): ceph-radosgw-17.2.6-1274.g68e53a4a.el 3.3 MB/s | 17 MB 00:05 2023-10-06T04:33:46.702 INFO:teuthology.orchestra.run.smithi008.stdout:(76/120): python3-babel-2.5.1-5.el8.noarch.rpm 62 MB/s | 4.8 MB 00:00 2023-10-06T04:33:46.716 INFO:teuthology.orchestra.run.smithi008.stdout:(77/120): python3-markupsafe-0.23-19.el8.x86_64 3.0 MB/s | 39 kB 00:00 2023-10-06T04:33:46.735 INFO:teuthology.orchestra.run.smithi008.stdout:(78/120): bison-3.0.4-10.el8.x86_64.rpm 35 MB/s | 688 kB 00:00 2023-10-06T04:33:46.750 INFO:teuthology.orchestra.run.smithi008.stdout:(79/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 17 MB/s | 259 kB 00:00 2023-10-06T04:33:46.751 INFO:teuthology.orchestra.run.smithi184.stdout:(11/120): cephfs-mirror-17.2.6-1274.g68e53a4a.e 3.0 MB/s | 255 kB 00:00 2023-10-06T04:33:46.765 INFO:teuthology.orchestra.run.smithi008.stdout:(80/120): python3-numpy-f2py-1.14.3-9.el8.x86_6 16 MB/s | 225 kB 00:00 2023-10-06T04:33:46.778 INFO:teuthology.orchestra.run.smithi008.stdout:(81/120): python3-pyasn1-0.3.7-6.el8.noarch.rpm 9.4 MB/s | 126 kB 00:00 2023-10-06T04:33:46.796 INFO:teuthology.orchestra.run.smithi184.stdout:(12/120): libcephfs-devel-17.2.6-1274.g68e53a4a 558 kB/s | 25 kB 00:00 2023-10-06T04:33:46.839 INFO:teuthology.orchestra.run.smithi008.stdout:(82/120): python3-numpy-1.14.3-9.el8.x86_64.rpm 62 MB/s | 3.7 MB 00:00 2023-10-06T04:33:46.855 INFO:teuthology.orchestra.run.smithi008.stdout:(83/120): oniguruma-6.8.2-2.el8.x86_64.rpm 12 MB/s | 187 kB 00:00 2023-10-06T04:33:46.874 INFO:teuthology.orchestra.run.smithi008.stdout:(84/120): python3-jinja2-2.10.1-2.el8_0.noarch. 27 MB/s | 538 kB 00:00 2023-10-06T04:33:46.891 INFO:teuthology.orchestra.run.smithi008.stdout:(85/120): socat-1.7.3.3-2.el8.x86_64.rpm 18 MB/s | 302 kB 00:00 2023-10-06T04:33:46.905 INFO:teuthology.orchestra.run.smithi008.stdout:(86/120): python3-mako-1.0.6-13.el8.noarch.rpm 11 MB/s | 157 kB 00:00 2023-10-06T04:33:46.919 INFO:teuthology.orchestra.run.smithi008.stdout:(87/120): python3-pyasn1-modules-0.3.7-6.el8.no 8.1 MB/s | 110 kB 00:00 2023-10-06T04:33:46.937 INFO:teuthology.orchestra.run.smithi008.stdout:(88/120): librdkafka-0.11.4-1.el8.x86_64.rpm 20 MB/s | 353 kB 00:00 2023-10-06T04:33:46.949 INFO:teuthology.orchestra.run.smithi008.stdout:(89/120): python3-jsonpointer-1.10-11.el8.noarc 1.7 MB/s | 20 kB 00:00 2023-10-06T04:33:46.970 INFO:teuthology.orchestra.run.smithi008.stdout:(90/120): libtool-2.4.6-25.el8.x86_64.rpm 34 MB/s | 709 kB 00:00 2023-10-06T04:33:46.977 INFO:teuthology.orchestra.run.smithi184.stdout:(13/120): ceph-common-17.2.6-1274.g68e53a4a.el8 1.9 MB/s | 23 MB 00:12 2023-10-06T04:33:46.983 INFO:teuthology.orchestra.run.smithi008.stdout:(91/120): python3-pytz-2017.2-9.el8.noarch.rpm 4.1 MB/s | 54 kB 00:00 2023-10-06T04:33:47.027 INFO:teuthology.orchestra.run.smithi184.stdout:(14/120): libcephsqlite-17.2.6-1274.g68e53a4a.e 3.5 MB/s | 175 kB 00:00 2023-10-06T04:33:47.038 INFO:teuthology.orchestra.run.smithi184.stdout:(15/120): libcephfs2-17.2.6-1274.g68e53a4a.el8. 3.2 MB/s | 797 kB 00:00 2023-10-06T04:33:47.057 INFO:teuthology.orchestra.run.smithi008.stdout:(92/120): openblas-threads-0.3.12-1.el8.x86_64. 64 MB/s | 4.7 MB 00:00 2023-10-06T04:33:47.072 INFO:teuthology.orchestra.run.smithi184.stdout:(16/120): librados-devel-17.2.6-1274.g68e53a4a. 2.8 MB/s | 130 kB 00:00 2023-10-06T04:33:47.130 INFO:teuthology.orchestra.run.smithi008.stdout:(93/120): openblas-0.3.12-1.el8.x86_64.rpm 63 MB/s | 4.6 MB 00:00 2023-10-06T04:33:47.153 INFO:teuthology.orchestra.run.smithi008.stdout:(94/120): automake-1.16.1-7.el8.noarch.rpm 32 MB/s | 713 kB 00:00 2023-10-06T04:33:47.166 INFO:teuthology.orchestra.run.smithi008.stdout:(95/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 1.4 MB/s | 19 kB 00:00 2023-10-06T04:33:47.172 INFO:teuthology.orchestra.run.smithi184.stdout:(17/120): libradosstriper1-17.2.6-1274.g68e53a4 3.7 MB/s | 506 kB 00:00 2023-10-06T04:33:47.178 INFO:teuthology.orchestra.run.smithi008.stdout:(96/120): python3-jwt-1.6.1-2.el8.noarch.rpm 3.4 MB/s | 43 kB 00:00 2023-10-06T04:33:47.192 INFO:teuthology.orchestra.run.smithi008.stdout:(97/120): python3-oauthlib-2.1.0-1.el8.noarch.r 11 MB/s | 155 kB 00:00 2023-10-06T04:33:47.208 INFO:teuthology.orchestra.run.smithi008.stdout:(98/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 14 MB/s | 220 kB 00:00 2023-10-06T04:33:47.220 INFO:teuthology.orchestra.run.smithi008.stdout:(99/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 3.8 MB/s | 48 kB 00:00 2023-10-06T04:33:47.222 INFO:teuthology.orchestra.run.smithi184.stdout:(18/120): python3-ceph-argparse-17.2.6-1274.g68 897 kB/s | 45 kB 00:00 2023-10-06T04:33:47.235 INFO:teuthology.orchestra.run.smithi008.stdout:(100/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 15 MB/s | 229 kB 00:00 2023-10-06T04:33:47.249 INFO:teuthology.orchestra.run.smithi008.stdout:(101/120): python3-requests-oauthlib-1.0.0-1.el 3.0 MB/s | 43 kB 00:00 2023-10-06T04:33:47.270 INFO:teuthology.orchestra.run.smithi184.stdout:(19/120): python3-ceph-common-17.2.6-1274.g68e5 2.3 MB/s | 115 kB 00:00 2023-10-06T04:33:47.294 INFO:teuthology.orchestra.run.smithi008.stdout:(102/120): openssl-devel-1.1.1g-15.el8_3.x86_64 53 MB/s | 2.3 MB 00:00 2023-10-06T04:33:47.307 INFO:teuthology.orchestra.run.smithi008.stdout:(103/120): libverto-devel-0.3.0-5.el8.x86_64.rp 1.3 MB/s | 18 kB 00:00 2023-10-06T04:33:47.322 INFO:teuthology.orchestra.run.smithi184.stdout:(20/120): python3-cephfs-17.2.6-1274.g68e53a4a. 3.6 MB/s | 190 kB 00:00 2023-10-06T04:33:47.326 INFO:teuthology.orchestra.run.smithi008.stdout:(104/120): pcre2-devel-10.32-2.el8.x86_64.rpm 31 MB/s | 605 kB 00:00 2023-10-06T04:33:47.340 INFO:teuthology.orchestra.run.smithi008.stdout:(105/120): fuse-2.9.7-12.el8.x86_64.rpm 5.9 MB/s | 83 kB 00:00 2023-10-06T04:33:47.353 INFO:teuthology.orchestra.run.smithi008.stdout:(106/120): elfutils-libelf-devel-0.182-3.el8.x8 4.6 MB/s | 59 kB 00:00 2023-10-06T04:33:47.367 INFO:teuthology.orchestra.run.smithi008.stdout:(107/120): libquadmath-8.4.1-1.el8.x86_64.rpm 12 MB/s | 169 kB 00:00 2023-10-06T04:33:47.380 INFO:teuthology.orchestra.run.smithi008.stdout:(108/120): libcom_err-devel-1.45.6-1.el8.x86_64 3.0 MB/s | 38 kB 00:00 2023-10-06T04:33:47.394 INFO:teuthology.orchestra.run.smithi008.stdout:(109/120): libsepol-devel-2.9-2.el8.x86_64.rpm 6.1 MB/s | 86 kB 00:00 2023-10-06T04:33:47.407 INFO:teuthology.orchestra.run.smithi008.stdout:(110/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 4.2 MB/s | 58 kB 00:00 2023-10-06T04:33:47.419 INFO:teuthology.orchestra.run.smithi184.stdout:(21/120): python3-rados-17.2.6-1274.g68e53a4a.e 3.7 MB/s | 371 kB 00:00 2023-10-06T04:33:47.420 INFO:teuthology.orchestra.run.smithi008.stdout:(111/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.7 MB/s | 47 kB 00:00 2023-10-06T04:33:47.441 INFO:teuthology.orchestra.run.smithi008.stdout:(112/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.r 26 MB/s | 559 kB 00:00 2023-10-06T04:33:47.462 INFO:teuthology.orchestra.run.smithi008.stdout:(113/120): libgfortran-8.4.1-1.el8.x86_64.rpm 31 MB/s | 639 kB 00:00 2023-10-06T04:33:47.475 INFO:teuthology.orchestra.run.smithi008.stdout:(114/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rp 5.1 MB/s | 70 kB 00:00 2023-10-06T04:33:47.490 INFO:teuthology.orchestra.run.smithi008.stdout:(115/120): libselinux-devel-2.9-5.el8.x86_64.rp 14 MB/s | 200 kB 00:00 2023-10-06T04:33:47.503 INFO:teuthology.orchestra.run.smithi008.stdout:(116/120): libuuid-devel-2.32.1-27.el8.x86_64.r 7.2 MB/s | 97 kB 00:00 2023-10-06T04:33:47.518 INFO:teuthology.orchestra.run.smithi184.stdout:(22/120): python3-rbd-17.2.6-1274.g68e53a4a.el8 3.5 MB/s | 358 kB 00:00 2023-10-06T04:33:47.564 INFO:teuthology.orchestra.run.smithi184.stdout:(23/120): python3-rgw-17.2.6-1274.g68e53a4a.el8 2.3 MB/s | 107 kB 00:00 2023-10-06T04:33:47.601 INFO:teuthology.orchestra.run.smithi184.stdout:(24/120): rbd-fuse-17.2.6-1274.g68e53a4a.el8.x8 2.4 MB/s | 91 kB 00:00 2023-10-06T04:33:48.002 INFO:teuthology.orchestra.run.smithi008.stdout:(117/120): ceph-test-17.2.6-1274.g68e53a4a.el8. 6.8 MB/s | 52 MB 00:07 2023-10-06T04:33:48.138 INFO:teuthology.orchestra.run.smithi008.stdout:(118/120): ceph-common-17.2.6-1274.g68e53a4a.el 1.9 MB/s | 23 MB 00:12 2023-10-06T04:33:48.184 INFO:teuthology.orchestra.run.smithi184.stdout:(25/120): librgw2-17.2.6-1274.g68e53a4a.el8.x86 5.0 MB/s | 5.6 MB 00:01 2023-10-06T04:33:48.209 INFO:teuthology.orchestra.run.smithi184.stdout:(26/120): rbd-mirror-17.2.6-1274.g68e53a4a.el8. 5.7 MB/s | 3.5 MB 00:00 2023-10-06T04:33:48.215 INFO:teuthology.orchestra.run.smithi008.stdout:(119/120): librados2-17.2.6-1274.g68e53a4a.el8. 4.8 MB/s | 3.4 MB 00:00 2023-10-06T04:33:48.224 INFO:teuthology.orchestra.run.smithi184.stdout:(27/120): rbd-nbd-17.2.6-1274.g68e53a4a.el8.x86 4.2 MB/s | 173 kB 00:00 2023-10-06T04:33:48.248 INFO:teuthology.orchestra.run.smithi184.stdout:(28/120): ceph-grafana-dashboards-17.2.6-1274.g 598 kB/s | 23 kB 00:00 2023-10-06T04:33:48.266 INFO:teuthology.orchestra.run.smithi184.stdout:(29/120): ceph-mgr-cephadm-17.2.6-1274.g68e53a4 2.8 MB/s | 121 kB 00:00 2023-10-06T04:33:48.540 INFO:teuthology.orchestra.run.smithi008.stdout:(120/120): librbd1-17.2.6-1274.g68e53a4a.el8.x8 6.6 MB/s | 3.5 MB 00:00 2023-10-06T04:33:48.544 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-06T04:33:48.544 INFO:teuthology.orchestra.run.smithi008.stdout:Total 16 MB/s | 201 MB 00:12 2023-10-06T04:33:48.558 INFO:teuthology.orchestra.run.smithi184.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1274.g68e53 5.5 MB/s | 1.7 MB 00:00 2023-10-06T04:33:48.599 INFO:teuthology.orchestra.run.smithi184.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1274.g68 5.7 MB/s | 238 kB 00:00 2023-10-06T04:33:48.603 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-06T04:33:48.635 INFO:teuthology.orchestra.run.smithi184.stdout:(32/120): ceph-mgr-rook-17.2.6-1274.g68e53a4a.e 1.3 MB/s | 47 kB 00:00 2023-10-06T04:33:48.671 INFO:teuthology.orchestra.run.smithi184.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1274.g6 403 kB/s | 14 kB 00:00 2023-10-06T04:33:48.713 INFO:teuthology.orchestra.run.smithi184.stdout:(34/120): ceph-volume-17.2.6-1274.g68e53a4a.el8 6.2 MB/s | 267 kB 00:00 2023-10-06T04:33:48.730 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-06T04:33:48.730 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-06T04:33:48.751 INFO:teuthology.orchestra.run.smithi184.stdout:(35/120): cephadm-17.2.6-1274.g68e53a4a.el8.noa 2.1 MB/s | 80 kB 00:00 2023-10-06T04:33:48.787 INFO:teuthology.orchestra.run.smithi184.stdout:(36/120): cephfs-top-17.2.6-1274.g68e53a4a.el8. 495 kB/s | 18 kB 00:00 2023-10-06T04:33:49.321 INFO:teuthology.orchestra.run.smithi184.stdout:(37/120): ceph-test-17.2.6-1274.g68e53a4a.el8.x 9.1 MB/s | 52 MB 00:05 2023-10-06T04:33:49.401 INFO:teuthology.orchestra.run.smithi184.stdout:(38/120): gperftools-libs-2.7-9.el8.x86_64.rpm 498 kB/s | 306 kB 00:00 2023-10-06T04:33:49.423 INFO:teuthology.orchestra.run.smithi184.stdout:(39/120): ceph-mgr-diskprediction-local-17.2.6- 6.4 MB/s | 7.4 MB 00:01 2023-10-06T04:33:49.474 INFO:teuthology.orchestra.run.smithi184.stdout:(40/120): libunwind-1.3.1-3.el8.x86_64.rpm 1.0 MB/s | 75 kB 00:00 2023-10-06T04:33:49.479 INFO:teuthology.orchestra.run.smithi184.stdout:(41/120): liboath-2.6.2-3.el8.x86_64.rpm 374 kB/s | 59 kB 00:00 2023-10-06T04:33:49.529 INFO:teuthology.orchestra.run.smithi184.stdout:(42/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 806 kB/s | 44 kB 00:00 2023-10-06T04:33:49.563 INFO:teuthology.orchestra.run.smithi184.stdout:(43/120): python3-beautifulsoup4-4.6.3-2.el8.1. 2.2 MB/s | 185 kB 00:00 2023-10-06T04:33:49.577 INFO:teuthology.orchestra.run.smithi184.stdout:(44/120): python3-cachetools-3.1.1-4.el8.noarch 687 kB/s | 33 kB 00:00 2023-10-06T04:33:49.595 INFO:teuthology.orchestra.run.smithi184.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 525 kB/s | 16 kB 00:00 2023-10-06T04:33:49.668 INFO:teuthology.orchestra.run.smithi184.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 5.1 MB/s | 384 kB 00:00 2023-10-06T04:33:49.670 INFO:teuthology.orchestra.run.smithi184.stdout:(47/120): python3-asyncssh-2.7.0-2.el8.noarch.r 1.9 MB/s | 476 kB 00:00 2023-10-06T04:33:49.689 INFO:teuthology.orchestra.run.smithi184.stdout:(48/120): python3-cheroot-8.5.2-1.el8.noarch.rp 1.5 MB/s | 173 kB 00:00 2023-10-06T04:33:49.701 INFO:teuthology.orchestra.run.smithi184.stdout:(49/120): python3-google-auth-1.1.1-10.el8.noar 2.4 MB/s | 81 kB 00:00 2023-10-06T04:33:49.702 INFO:teuthology.orchestra.run.smithi184.stdout:(50/120): python3-jaraco-6.2-6.el8.noarch.rpm 352 kB/s | 11 kB 00:00 2023-10-06T04:33:49.728 INFO:teuthology.orchestra.run.smithi184.stdout:(51/120): python3-jaraco-functools-2.0-4.el8.no 449 kB/s | 18 kB 00:00 2023-10-06T04:33:49.741 INFO:teuthology.orchestra.run.smithi184.stdout:(52/120): python3-logutils-0.3.5-11.el8.noarch. 1.2 MB/s | 49 kB 00:00 2023-10-06T04:33:49.785 INFO:teuthology.orchestra.run.smithi184.stdout:(53/120): python3-kubernetes-11.0.0-6.el8.noarc 14 MB/s | 1.2 MB 00:00 2023-10-06T04:33:49.786 INFO:teuthology.orchestra.run.smithi184.stdout:(54/120): python3-more-itertools-7.2.0-3.el8.no 1.0 MB/s | 59 kB 00:00 2023-10-06T04:33:49.786 INFO:teuthology.orchestra.run.smithi184.stdout:(55/120): python3-natsort-7.1.1-2.el8.noarch.rp 1.3 MB/s | 60 kB 00:00 2023-10-06T04:33:49.816 INFO:teuthology.orchestra.run.smithi184.stdout:(56/120): python3-portend-2.6-1.el8.noarch.rpm 522 kB/s | 16 kB 00:00 2023-10-06T04:33:49.820 INFO:teuthology.orchestra.run.smithi184.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 1.0 MB/s | 34 kB 00:00 2023-10-06T04:33:49.851 INFO:teuthology.orchestra.run.smithi184.stdout:(58/120): python3-routes-2.4.1-12.el8.noarch.rp 5.5 MB/s | 196 kB 00:00 2023-10-06T04:33:49.854 INFO:teuthology.orchestra.run.smithi184.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 1.9 MB/s | 64 kB 00:00 2023-10-06T04:33:49.881 INFO:teuthology.orchestra.run.smithi184.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 623 kB/s | 19 kB 00:00 2023-10-06T04:33:49.885 INFO:teuthology.orchestra.run.smithi184.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 774 kB/s | 24 kB 00:00 2023-10-06T04:33:49.913 INFO:teuthology.orchestra.run.smithi184.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 916 kB/s | 29 kB 00:00 2023-10-06T04:33:49.915 INFO:teuthology.orchestra.run.smithi184.stdout:(63/120): python3-pecan-1.3.2-9.el8.noarch.rpm 2.1 MB/s | 283 kB 00:00 2023-10-06T04:33:49.916 INFO:teuthology.orchestra.run.smithi184.stdout:(64/120): python3-trustme-0.6.0-4.el8.noarch.rp 887 kB/s | 27 kB 00:00 2023-10-06T04:33:49.947 INFO:teuthology.orchestra.run.smithi184.stdout:(65/120): python3-waitress-1.4.3-1.el8.noarch.r 7.4 MB/s | 255 kB 00:00 2023-10-06T04:33:49.949 INFO:teuthology.orchestra.run.smithi184.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 1.8 MB/s | 61 kB 00:00 2023-10-06T04:33:49.979 INFO:teuthology.orchestra.run.smithi184.stdout:(67/120): python3-webtest-2.0.33-1.el8.noarch.r 2.7 MB/s | 85 kB 00:00 2023-10-06T04:33:49.981 INFO:teuthology.orchestra.run.smithi184.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 741 kB/s | 23 kB 00:00 2023-10-06T04:33:49.985 INFO:teuthology.orchestra.run.smithi184.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 17 MB/s | 70 kB 00:00 2023-10-06T04:33:50.013 INFO:teuthology.orchestra.run.smithi184.stdout:(70/120): python3-webob-1.8.5-1.el8.1.noarch.rp 2.5 MB/s | 251 kB 00:00 2023-10-06T04:33:50.023 INFO:teuthology.orchestra.run.smithi184.stdout:(71/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 501 kB/s | 19 kB 00:00 2023-10-06T04:33:50.041 INFO:teuthology.orchestra.run.smithi184.stdout:(72/120): thrift-0.13.0-2.el8.x86_64.rpm 28 MB/s | 1.7 MB 00:00 2023-10-06T04:33:50.045 INFO:teuthology.orchestra.run.smithi184.stdout:(73/120): python3-oauthlib-2.1.0-1.el8.noarch.r 7.3 MB/s | 155 kB 00:00 2023-10-06T04:33:50.052 INFO:teuthology.orchestra.run.smithi184.stdout:(74/120): python3-jwt-1.6.1-2.el8.noarch.rpm 1.1 MB/s | 43 kB 00:00 2023-10-06T04:33:50.061 INFO:teuthology.orchestra.run.smithi184.stdout:(75/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 2.7 MB/s | 48 kB 00:00 2023-10-06T04:33:50.074 INFO:teuthology.orchestra.run.smithi184.stdout:(76/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 10 MB/s | 229 kB 00:00 2023-10-06T04:33:50.077 INFO:teuthology.orchestra.run.smithi184.stdout:(77/120): python3-requests-oauthlib-1.0.0-1.el8 2.6 MB/s | 43 kB 00:00 2023-10-06T04:33:50.088 INFO:teuthology.orchestra.run.smithi184.stdout:(78/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.6 MB/s | 220 kB 00:00 2023-10-06T04:33:50.094 INFO:teuthology.orchestra.run.smithi184.stdout:(79/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.1 MB/s | 18 kB 00:00 2023-10-06T04:33:50.114 INFO:teuthology.orchestra.run.smithi184.stdout:(80/120): pcre2-devel-10.32-2.el8.x86_64.rpm 23 MB/s | 605 kB 00:00 2023-10-06T04:33:50.115 INFO:teuthology.orchestra.run.smithi184.stdout:(81/120): fuse-2.9.7-12.el8.x86_64.rpm 3.8 MB/s | 83 kB 00:00 2023-10-06T04:33:50.127 INFO:teuthology.orchestra.run.smithi184.stdout:(82/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 44 MB/s | 2.3 MB 00:00 2023-10-06T04:33:50.134 INFO:teuthology.orchestra.run.smithi184.stdout:(83/120): libquadmath-8.4.1-1.el8.x86_64.rpm 8.9 MB/s | 169 kB 00:00 2023-10-06T04:33:50.137 INFO:teuthology.orchestra.run.smithi184.stdout:(84/120): elfutils-libelf-devel-0.182-3.el8.x86 2.6 MB/s | 59 kB 00:00 2023-10-06T04:33:50.149 INFO:teuthology.orchestra.run.smithi184.stdout:(85/120): libcom_err-devel-1.45.6-1.el8.x86_64. 1.7 MB/s | 38 kB 00:00 2023-10-06T04:33:50.152 INFO:teuthology.orchestra.run.smithi184.stdout:(86/120): libsepol-devel-2.9-2.el8.x86_64.rpm 4.7 MB/s | 86 kB 00:00 2023-10-06T04:33:50.154 INFO:teuthology.orchestra.run.smithi184.stdout:(87/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 3.2 MB/s | 58 kB 00:00 2023-10-06T04:33:50.165 INFO:teuthology.orchestra.run.smithi184.stdout:(88/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 2.9 MB/s | 47 kB 00:00 2023-10-06T04:33:50.180 INFO:teuthology.orchestra.run.smithi184.stdout:(89/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 4.7 MB/s | 70 kB 00:00 2023-10-06T04:33:50.188 INFO:teuthology.orchestra.run.smithi184.stdout:(90/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 16 MB/s | 559 kB 00:00 2023-10-06T04:33:50.193 INFO:teuthology.orchestra.run.smithi184.stdout:(91/120): libgfortran-8.4.1-1.el8.x86_64.rpm 16 MB/s | 639 kB 00:00 2023-10-06T04:33:50.201 INFO:teuthology.orchestra.run.smithi184.stdout:(92/120): libselinux-devel-2.9-5.el8.x86_64.rpm 9.1 MB/s | 200 kB 00:00 2023-10-06T04:33:50.210 INFO:teuthology.orchestra.run.smithi184.stdout:(93/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 4.2 MB/s | 97 kB 00:00 2023-10-06T04:33:50.220 INFO:teuthology.orchestra.run.smithi184.stdout:(94/120): python3-prettytable-0.7.2-14.el8.noar 2.3 MB/s | 44 kB 00:00 2023-10-06T04:33:50.228 INFO:teuthology.orchestra.run.smithi184.stdout:(95/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.4 MB/s | 27 kB 00:00 2023-10-06T04:33:50.240 INFO:teuthology.orchestra.run.smithi184.stdout:(96/120): jq-1.5-12.el8.x86_64.rpm 8.1 MB/s | 161 kB 00:00 2023-10-06T04:33:50.250 INFO:teuthology.orchestra.run.smithi184.stdout:(97/120): flex-2.6.1-9.el8.x86_64.rpm 14 MB/s | 320 kB 00:00 2023-10-06T04:33:50.264 INFO:teuthology.orchestra.run.smithi184.stdout:(98/120): python3-werkzeug-0.12.2-4.el8.noarch. 19 MB/s | 457 kB 00:00 2023-10-06T04:33:50.282 INFO:teuthology.orchestra.run.smithi184.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 2.0 MB/s | 39 kB 00:00 2023-10-06T04:33:50.311 INFO:teuthology.orchestra.run.smithi184.stdout:(100/120): bison-3.0.4-10.el8.x86_64.rpm 24 MB/s | 688 kB 00:00 2023-10-06T04:33:50.338 INFO:teuthology.orchestra.run.smithi184.stdout:(101/120): python3-babel-2.5.1-5.el8.noarch.rpm 54 MB/s | 4.8 MB 00:00 2023-10-06T04:33:50.342 INFO:teuthology.orchestra.run.smithi184.stdout:(102/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 8.2 MB/s | 259 kB 00:00 2023-10-06T04:33:50.359 INFO:teuthology.orchestra.run.smithi184.stdout:(103/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 11 MB/s | 225 kB 00:00 2023-10-06T04:33:50.363 INFO:teuthology.orchestra.run.smithi184.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 6.0 MB/s | 126 kB 00:00 2023-10-06T04:33:50.443 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-06T04:33:50.447 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-06T04:33:50.477 INFO:teuthology.orchestra.run.smithi184.stdout:(105/120): python3-scipy-1.0.0-20.module+el8.1. 51 MB/s | 15 MB 00:00 2023-10-06T04:33:50.480 INFO:teuthology.orchestra.run.smithi184.stdout:(106/120): oniguruma-6.8.2-2.el8.x86_64.rpm 1.6 MB/s | 187 kB 00:00 2023-10-06T04:33:50.502 INFO:teuthology.orchestra.run.smithi184.stdout:(107/120): python3-jinja2-2.10.1-2.el8_0.noarch 21 MB/s | 538 kB 00:00 2023-10-06T04:33:50.504 INFO:teuthology.orchestra.run.smithi184.stdout:(108/120): socat-1.7.3.3-2.el8.x86_64.rpm 13 MB/s | 302 kB 00:00 2023-10-06T04:33:50.525 INFO:teuthology.orchestra.run.smithi184.stdout:(109/120): python3-numpy-1.14.3-9.el8.x86_64.rp 22 MB/s | 3.7 MB 00:00 2023-10-06T04:33:50.527 INFO:teuthology.orchestra.run.smithi184.stdout:(110/120): python3-mako-1.0.6-13.el8.noarch.rpm 6.3 MB/s | 157 kB 00:00 2023-10-06T04:33:50.528 INFO:teuthology.orchestra.run.smithi184.stdout:(111/120): python3-pyasn1-modules-0.3.7-6.el8.n 4.5 MB/s | 110 kB 00:00 2023-10-06T04:33:50.544 INFO:teuthology.orchestra.run.smithi184.stdout:(112/120): python3-jsonpointer-1.10-11.el8.noar 1.1 MB/s | 20 kB 00:00 2023-10-06T04:33:50.547 INFO:teuthology.orchestra.run.smithi184.stdout:(113/120): librdkafka-0.11.4-1.el8.x86_64.rpm 16 MB/s | 353 kB 00:00 2023-10-06T04:33:50.554 INFO:teuthology.orchestra.run.smithi184.stdout:(114/120): libtool-2.4.6-25.el8.x86_64.rpm 27 MB/s | 709 kB 00:00 2023-10-06T04:33:50.561 INFO:teuthology.orchestra.run.smithi184.stdout:(115/120): python3-pytz-2017.2-9.el8.noarch.rpm 3.1 MB/s | 54 kB 00:00 2023-10-06T04:33:50.591 INFO:teuthology.orchestra.run.smithi184.stdout:(116/120): automake-1.16.1-7.el8.noarch.rpm 24 MB/s | 713 kB 00:00 2023-10-06T04:33:50.631 INFO:teuthology.orchestra.run.smithi184.stdout:(117/120): openblas-threads-0.3.12-1.el8.x86_64 57 MB/s | 4.7 MB 00:00 2023-10-06T04:33:50.647 INFO:teuthology.orchestra.run.smithi184.stdout:(118/120): openblas-0.3.12-1.el8.x86_64.rpm 49 MB/s | 4.6 MB 00:00 2023-10-06T04:33:51.078 INFO:teuthology.orchestra.run.smithi184.stdout:(119/120): librbd1-17.2.6-1274.g68e53a4a.el8.x8 7.9 MB/s | 3.5 MB 00:00 2023-10-06T04:33:51.257 INFO:teuthology.orchestra.run.smithi184.stdout:(120/120): librados2-17.2.6-1274.g68e53a4a.el8. 5.1 MB/s | 3.4 MB 00:00 2023-10-06T04:33:51.262 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2023-10-06T04:33:51.263 INFO:teuthology.orchestra.run.smithi184.stdout:Total 12 MB/s | 201 MB 00:16 2023-10-06T04:33:51.310 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2023-10-06T04:33:51.420 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2023-10-06T04:33:51.420 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2023-10-06T04:33:53.131 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2023-10-06T04:33:53.135 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2023-10-06T04:33:55.169 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-06T04:33:55.369 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-06T04:33:55.572 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 2/122 2023-10-06T04:33:55.780 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-06T04:33:55.917 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-06T04:33:56.096 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-06T04:33:56.493 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-06T04:33:56.888 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 5/122 2023-10-06T04:33:57.302 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 5/122 2023-10-06T04:33:57.488 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/122 2023-10-06T04:33:57.623 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/122 2023-10-06T04:33:57.821 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 7/122 2023-10-06T04:33:57.907 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 7/122 2023-10-06T04:33:58.423 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2023-10-06T04:33:58.660 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-06T04:33:58.885 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T04:33:59.022 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T04:33:59.039 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 8/122 2023-10-06T04:33:59.771 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-06T04:33:59.943 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T04:33:59.979 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/122 2023-10-06T04:34:00.091 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/122 2023-10-06T04:34:00.309 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-06T04:34:00.328 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T04:34:00.470 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-06T04:34:00.551 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 4/122 2023-10-06T04:34:00.671 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/122 2023-10-06T04:34:00.782 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/122 2023-10-06T04:34:00.929 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 14/122 2023-10-06T04:34:00.944 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 4/122 2023-10-06T04:34:00.999 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 14/122 2023-10-06T04:34:01.126 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 5/122 2023-10-06T04:34:01.162 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 15/122 2023-10-06T04:34:01.273 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 5/122 2023-10-06T04:34:01.346 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-06T04:34:01.443 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/122 2023-10-06T04:34:01.463 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-06T04:34:01.550 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/122 2023-10-06T04:34:01.654 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-06T04:34:01.714 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 7/122 2023-10-06T04:34:02.040 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-06T04:34:02.240 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-06T04:34:02.412 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-06T04:34:02.716 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-06T04:34:02.892 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/122 2023-10-06T04:34:02.964 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-06T04:34:02.999 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/122 2023-10-06T04:34:03.154 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openblas-0.3.12-1.el8.x86_64 19/122 2023-10-06T04:34:03.271 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-06T04:34:03.449 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-06T04:34:03.625 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/122 2023-10-06T04:34:03.754 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/122 2023-10-06T04:34:03.917 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 14/122 2023-10-06T04:34:03.978 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 14/122 2023-10-06T04:34:04.017 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 19/122 2023-10-06T04:34:04.188 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-06T04:34:04.437 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 20/122 2023-10-06T04:34:04.481 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-06T04:34:04.632 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 21/122 2023-10-06T04:34:04.735 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-06T04:34:04.812 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/122 2023-10-06T04:34:04.891 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-06T04:34:05.042 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T04:34:05.125 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/122 2023-10-06T04:34:05.162 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T04:34:05.405 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/122 2023-10-06T04:34:05.486 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T04:34:05.671 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-06T04:34:05.828 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8. 26/122 2023-10-06T04:34:05.950 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el 27/122 2023-10-06T04:34:06.074 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T04:34:06.190 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_6 28/122 2023-10-06T04:34:06.267 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T04:34:06.802 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T04:34:06.983 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T04:34:07.275 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/122 2023-10-06T04:34:07.581 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 30/122 2023-10-06T04:34:07.707 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T04:34:07.899 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 31/122 2023-10-06T04:34:07.994 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-06T04:34:08.136 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 32/122 2023-10-06T04:34:08.259 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-06T04:34:08.408 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 33/122 2023-10-06T04:34:08.505 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-06T04:34:08.628 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-06T04:34:08.681 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8. 26/122 2023-10-06T04:34:08.852 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el 27/122 2023-10-06T04:34:09.090 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_6 28/122 2023-10-06T04:34:09.297 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-06T04:34:09.573 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-06T04:34:09.799 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T04:34:10.813 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-06T04:34:11.125 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 35/122 2023-10-06T04:34:11.380 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-06T04:34:11.590 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-06T04:34:11.807 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 38/122 2023-10-06T04:34:11.861 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T04:34:12.053 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 39/122 2023-10-06T04:34:12.248 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-06T04:34:12.249 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_6 40/122 2023-10-06T04:34:12.418 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 41/122 2023-10-06T04:34:12.559 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 42/122 2023-10-06T04:34:12.765 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 43/122 2023-10-06T04:34:12.906 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : fuse-2.9.7-12.el8.x86_64 44/122 2023-10-06T04:34:13.042 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 45/122 2023-10-06T04:34:13.222 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 46/122 2023-10-06T04:34:13.267 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-06T04:34:13.424 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 47/122 2023-10-06T04:34:13.594 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-06T04:34:13.728 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 48/122 2023-10-06T04:34:13.870 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-06T04:34:13.988 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 49/122 2023-10-06T04:34:14.096 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-06T04:34:14.259 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 50/122 2023-10-06T04:34:14.302 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-06T04:34:14.517 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 38/122 2023-10-06T04:34:14.567 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 51/122 2023-10-06T04:34:14.686 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 39/122 2023-10-06T04:34:14.792 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : automake-1.16.1-7.el8.noarch 52/122 2023-10-06T04:34:14.960 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 53/122 2023-10-06T04:34:14.988 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_6 40/122 2023-10-06T04:34:15.134 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 54/122 2023-10-06T04:34:15.226 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-06T04:34:15.325 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 55/122 2023-10-06T04:34:15.406 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-06T04:34:15.519 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-06T04:34:15.601 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-06T04:34:15.636 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-06T04:34:15.786 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : jq-1.5-12.el8.x86_64 57/122 2023-10-06T04:34:15.843 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-06T04:34:15.955 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 58/122 2023-10-06T04:34:15.982 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T04:34:16.061 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T04:34:16.145 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-06T04:34:16.232 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-06T04:34:16.327 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-06T04:34:16.417 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-06T04:34:16.570 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-06T04:34:16.590 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-06T04:34:16.754 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-06T04:34:16.795 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-06T04:34:16.961 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-06T04:34:16.984 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-06T04:34:17.089 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-06T04:34:17.168 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-06T04:34:17.241 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-06T04:34:17.311 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-06T04:34:17.436 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-06T04:34:17.543 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-06T04:34:17.679 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-06T04:34:17.736 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-06T04:34:17.877 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-06T04:34:18.028 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-06T04:34:18.064 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-06T04:34:18.275 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-06T04:34:18.276 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-06T04:34:18.509 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-06T04:34:18.565 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-06T04:34:18.833 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-06T04:34:18.864 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-06T04:34:19.035 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-06T04:34:19.059 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-06T04:34:19.211 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-06T04:34:19.349 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-06T04:34:19.505 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-06T04:34:19.602 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-06T04:34:19.756 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-06T04:34:19.803 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-06T04:34:19.997 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-06T04:34:20.049 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-06T04:34:20.151 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-06T04:34:20.344 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-06T04:34:20.538 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-06T04:34:20.780 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-06T04:34:21.013 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-06T04:34:21.210 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-06T04:34:21.237 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-06T04:34:21.427 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-06T04:34:21.527 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-06T04:34:21.693 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-06T04:34:21.737 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-06T04:34:21.945 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-06T04:34:22.076 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-06T04:34:22.221 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-06T04:34:22.328 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-06T04:34:22.504 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-06T04:34:22.698 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-06T04:34:22.763 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-06T04:34:22.916 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-06T04:34:22.980 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-06T04:34:23.087 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-06T04:34:23.250 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-06T04:34:23.285 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-06T04:34:24.419 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-06T04:34:24.745 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-06T04:34:24.965 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-06T04:34:25.301 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-06T04:34:25.601 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-06T04:34:25.927 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-06T04:34:26.189 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-06T04:34:26.473 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-06T04:34:26.681 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-06T04:34:28.638 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 87/122 2023-10-06T04:34:28.884 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 87/122 2023-10-06T04:34:29.500 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 87/122 2023-10-06T04:34:30.077 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 88/122 2023-10-06T04:34:30.687 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 88/122 2023-10-06T04:34:30.958 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 89/122 2023-10-06T04:34:32.163 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 87/122 2023-10-06T04:34:32.429 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 87/122 2023-10-06T04:34:33.031 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 87/122 2023-10-06T04:34:33.279 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 88/122 2023-10-06T04:34:33.372 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 88/122 2023-10-06T04:34:33.496 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 89/122 2023-10-06T04:34:49.781 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 89/122 2023-10-06T04:34:49.782 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /sys 2023-10-06T04:34:49.782 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /proc 2023-10-06T04:34:49.782 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /dev 2023-10-06T04:34:49.782 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /run 2023-10-06T04:34:49.782 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /mnt 2023-10-06T04:34:49.782 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /var/tmp 2023-10-06T04:34:49.782 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /home 2023-10-06T04:34:49.782 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /tmp 2023-10-06T04:34:49.782 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /dev 2023-10-06T04:34:49.783 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:34:50.173 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 90/122 2023-10-06T04:34:51.698 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 89/122 2023-10-06T04:34:51.699 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /sys 2023-10-06T04:34:51.699 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /proc 2023-10-06T04:34:51.699 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /dev 2023-10-06T04:34:51.699 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /run 2023-10-06T04:34:51.699 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /mnt 2023-10-06T04:34:51.699 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /var/tmp 2023-10-06T04:34:51.699 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /home 2023-10-06T04:34:51.699 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /tmp 2023-10-06T04:34:51.699 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /dev 2023-10-06T04:34:51.699 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:34:51.758 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 90/122 2023-10-06T04:34:51.936 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 91/122 2023-10-06T04:34:52.101 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 90/122 2023-10-06T04:34:52.170 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 91/122 2023-10-06T04:34:52.306 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 92/122 2023-10-06T04:34:52.724 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 92/122 2023-10-06T04:34:53.023 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 93/122 2023-10-06T04:34:53.041 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 93/122 2023-10-06T04:34:53.585 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 90/122 2023-10-06T04:34:53.776 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 91/122 2023-10-06T04:34:53.998 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 91/122 2023-10-06T04:34:54.142 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 92/122 2023-10-06T04:34:54.538 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 92/122 2023-10-06T04:34:54.717 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 93/122 2023-10-06T04:34:54.734 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 93/122 2023-10-06T04:34:56.083 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 94/122 2023-10-06T04:34:56.441 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 94/122 2023-10-06T04:34:56.579 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.e 95/122 2023-10-06T04:34:56.773 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a. 96/122 2023-10-06T04:34:56.947 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 97/122 2023-10-06T04:34:57.176 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 97/122 2023-10-06T04:34:57.360 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 98/122 2023-10-06T04:34:57.697 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 94/122 2023-10-06T04:34:57.886 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 94/122 2023-10-06T04:34:58.040 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.e 95/122 2023-10-06T04:34:58.264 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a. 96/122 2023-10-06T04:34:58.391 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 98/122 2023-10-06T04:34:58.424 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 97/122 2023-10-06T04:34:58.572 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 99/122 2023-10-06T04:34:58.638 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 97/122 2023-10-06T04:34:58.674 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 99/122 2023-10-06T04:34:58.874 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 98/122 2023-10-06T04:34:59.025 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el 100/122 2023-10-06T04:34:59.211 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 101/122 2023-10-06T04:34:59.249 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 101/122 2023-10-06T04:34:59.422 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 102/122 2023-10-06T04:34:59.433 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 102/122 2023-10-06T04:34:59.844 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 98/122 2023-10-06T04:34:59.999 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 99/122 2023-10-06T04:35:00.098 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 99/122 2023-10-06T04:35:00.478 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el 100/122 2023-10-06T04:35:00.650 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 101/122 2023-10-06T04:35:00.686 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 101/122 2023-10-06T04:35:00.841 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 102/122 2023-10-06T04:35:00.852 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 102/122 2023-10-06T04:35:01.133 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 103/122 2023-10-06T04:35:01.368 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 104/122 2023-10-06T04:35:01.450 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 104/122 2023-10-06T04:35:01.621 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1274.g68e53 105/122 2023-10-06T04:35:01.666 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1274.g68e53 105/122 2023-10-06T04:35:01.821 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 106/122 2023-10-06T04:35:02.189 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 106/122 2023-10-06T04:35:02.354 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 107/122 2023-10-06T04:35:02.433 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 103/122 2023-10-06T04:35:02.682 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 104/122 2023-10-06T04:35:02.762 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 104/122 2023-10-06T04:35:02.932 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1274.g68e53 105/122 2023-10-06T04:35:02.975 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1274.g68e53 105/122 2023-10-06T04:35:03.103 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 106/122 2023-10-06T04:35:03.450 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 106/122 2023-10-06T04:35:03.632 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 107/122 2023-10-06T04:35:07.593 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 107/122 2023-10-06T04:35:07.914 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 108/122 2023-10-06T04:35:08.212 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libtool-2.4.6-25.el8.x86_64 109/122 2023-10-06T04:35:08.550 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 107/122 2023-10-06T04:35:08.963 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 109/122 2023-10-06T04:35:09.352 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 110/122 2023-10-06T04:35:09.492 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 108/122 2023-10-06T04:35:09.514 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 111/122 2023-10-06T04:35:09.666 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 112/122 2023-10-06T04:35:09.833 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_ 113/122 2023-10-06T04:35:09.905 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-06T04:35:09.967 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-06T04:35:10.094 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 110/122 2023-10-06T04:35:10.129 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 115/122 2023-10-06T04:35:10.339 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-06T04:35:10.413 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 116/122 2023-10-06T04:35:10.514 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T04:35:10.525 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T04:35:10.571 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 117/122 2023-10-06T04:35:10.669 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_ 113/122 2023-10-06T04:35:10.787 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 118/122 2023-10-06T04:35:10.861 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-06T04:35:10.961 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : bison-3.0.4-10.el8.x86_64 119/122 2023-10-06T04:35:11.021 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 119/122 2023-10-06T04:35:11.030 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 115/122 2023-10-06T04:35:11.212 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/122 2023-10-06T04:35:11.222 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/122 2023-10-06T04:35:11.222 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T04:35:11.238 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 116/122 2023-10-06T04:35:11.398 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T04:35:11.398 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T04:35:11.477 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 117/122 2023-10-06T04:35:11.655 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T04:35:11.738 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T04:35:11.906 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T04:35:11.914 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T04:35:12.074 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-06T04:35:12.075 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T04:35:12.258 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T04:35:12.258 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 1/122 2023-10-06T04:35:12.258 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 2/122 2023-10-06T04:35:12.258 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 3/122 2023-10-06T04:35:12.259 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 4/122 2023-10-06T04:35:12.259 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1274.g68e53 5/122 2023-10-06T04:35:12.259 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/122 2023-10-06T04:35:12.259 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 7/122 2023-10-06T04:35:12.259 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 8/122 2023-10-06T04:35:12.259 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 9/122 2023-10-06T04:35:12.259 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/122 2023-10-06T04:35:12.259 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 11/122 2023-10-06T04:35:12.259 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 12/122 2023-10-06T04:35:12.259 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/122 2023-10-06T04:35:12.259 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_ 14/122 2023-10-06T04:35:12.260 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 15/122 2023-10-06T04:35:12.260 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 16/122 2023-10-06T04:35:12.260 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_6 17/122 2023-10-06T04:35:12.260 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 18/122 2023-10-06T04:35:12.260 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 19/122 2023-10-06T04:35:12.260 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el 20/122 2023-10-06T04:35:12.260 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8. 21/122 2023-10-06T04:35:12.260 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_6 22/122 2023-10-06T04:35:12.260 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 23/122 2023-10-06T04:35:12.260 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 24/122 2023-10-06T04:35:12.260 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 25/122 2023-10-06T04:35:12.261 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 26/122 2023-10-06T04:35:12.261 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 27/122 2023-10-06T04:35:12.261 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 28/122 2023-10-06T04:35:12.261 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a. 29/122 2023-10-06T04:35:12.261 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 30/122 2023-10-06T04:35:12.261 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 31/122 2023-10-06T04:35:12.261 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 32/122 2023-10-06T04:35:12.261 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el 33/122 2023-10-06T04:35:12.261 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 34/122 2023-10-06T04:35:12.261 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.e 35/122 2023-10-06T04:35:12.261 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 36/122 2023-10-06T04:35:12.262 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 37/122 2023-10-06T04:35:12.262 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 38/122 2023-10-06T04:35:12.262 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-06T04:35:12.262 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-06T04:35:12.262 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-06T04:35:12.262 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-06T04:35:12.262 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-06T04:35:12.262 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-06T04:35:12.262 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-06T04:35:12.262 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-06T04:35:12.262 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-06T04:35:12.263 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-06T04:35:12.263 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-06T04:35:12.263 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-06T04:35:12.263 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-06T04:35:12.263 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-06T04:35:12.263 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-06T04:35:12.263 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-06T04:35:12.263 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-06T04:35:12.263 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-06T04:35:12.263 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-06T04:35:12.263 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-06T04:35:12.264 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-06T04:35:12.264 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-06T04:35:12.264 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-06T04:35:12.264 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-06T04:35:12.264 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-06T04:35:12.264 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-06T04:35:12.264 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-06T04:35:12.264 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-06T04:35:12.264 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-06T04:35:12.264 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-06T04:35:12.264 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-06T04:35:12.265 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-06T04:35:12.265 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-06T04:35:12.265 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 72/122 2023-10-06T04:35:12.265 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/122 2023-10-06T04:35:12.265 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 74/122 2023-10-06T04:35:12.265 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : jq-1.5-12.el8.x86_64 75/122 2023-10-06T04:35:12.265 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : flex-2.6.1-9.el8.x86_64 76/122 2023-10-06T04:35:12.265 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/122 2023-10-06T04:35:12.265 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 78/122 2023-10-06T04:35:12.265 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 79/122 2023-10-06T04:35:12.265 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : bison-3.0.4-10.el8.x86_64 80/122 2023-10-06T04:35:12.266 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 81/122 2023-10-06T04:35:12.266 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 82/122 2023-10-06T04:35:12.266 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 83/122 2023-10-06T04:35:12.266 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 84/122 2023-10-06T04:35:12.266 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 85/122 2023-10-06T04:35:12.266 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 86/122 2023-10-06T04:35:12.266 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 87/122 2023-10-06T04:35:12.266 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 88/122 2023-10-06T04:35:12.266 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 89/122 2023-10-06T04:35:12.266 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 90/122 2023-10-06T04:35:12.266 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 91/122 2023-10-06T04:35:12.267 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 92/122 2023-10-06T04:35:12.267 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 93/122 2023-10-06T04:35:12.267 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 94/122 2023-10-06T04:35:12.267 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 95/122 2023-10-06T04:35:12.267 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : automake-1.16.1-7.el8.noarch 96/122 2023-10-06T04:35:12.267 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 97/122 2023-10-06T04:35:12.267 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/122 2023-10-06T04:35:12.267 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 99/122 2023-10-06T04:35:12.267 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 100/122 2023-10-06T04:35:12.267 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 101/122 2023-10-06T04:35:12.267 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 102/122 2023-10-06T04:35:12.268 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/122 2023-10-06T04:35:12.268 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 104/122 2023-10-06T04:35:12.268 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 105/122 2023-10-06T04:35:12.268 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 106/122 2023-10-06T04:35:12.268 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 107/122 2023-10-06T04:35:12.268 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 108/122 2023-10-06T04:35:12.268 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 109/122 2023-10-06T04:35:12.268 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 110/122 2023-10-06T04:35:12.268 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 111/122 2023-10-06T04:35:12.268 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 112/122 2023-10-06T04:35:12.268 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 113/122 2023-10-06T04:35:12.269 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 114/122 2023-10-06T04:35:12.269 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 115/122 2023-10-06T04:35:12.269 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 116/122 2023-10-06T04:35:12.269 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 117/122 2023-10-06T04:35:12.269 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 118/122 2023-10-06T04:35:12.269 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 119/122 2023-10-06T04:35:12.269 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-06T04:35:12.269 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 121/122 2023-10-06T04:35:12.270 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T04:35:12.270 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T04:35:13.115 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T04:35:13.115 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 1/122 2023-10-06T04:35:13.115 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 2/122 2023-10-06T04:35:13.115 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 3/122 2023-10-06T04:35:13.115 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 4/122 2023-10-06T04:35:13.115 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1274.g68e53 5/122 2023-10-06T04:35:13.115 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/122 2023-10-06T04:35:13.115 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 7/122 2023-10-06T04:35:13.115 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 8/122 2023-10-06T04:35:13.116 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 9/122 2023-10-06T04:35:13.116 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/122 2023-10-06T04:35:13.116 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 11/122 2023-10-06T04:35:13.116 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 12/122 2023-10-06T04:35:13.116 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/122 2023-10-06T04:35:13.116 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_ 14/122 2023-10-06T04:35:13.116 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 15/122 2023-10-06T04:35:13.116 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 16/122 2023-10-06T04:35:13.116 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_6 17/122 2023-10-06T04:35:13.116 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 18/122 2023-10-06T04:35:13.116 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 19/122 2023-10-06T04:35:13.116 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el 20/122 2023-10-06T04:35:13.117 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8. 21/122 2023-10-06T04:35:13.117 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_6 22/122 2023-10-06T04:35:13.117 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 23/122 2023-10-06T04:35:13.117 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 24/122 2023-10-06T04:35:13.117 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 25/122 2023-10-06T04:35:13.117 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 26/122 2023-10-06T04:35:13.117 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 27/122 2023-10-06T04:35:13.117 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 28/122 2023-10-06T04:35:13.117 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a. 29/122 2023-10-06T04:35:13.117 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 30/122 2023-10-06T04:35:13.117 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 31/122 2023-10-06T04:35:13.117 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 32/122 2023-10-06T04:35:13.118 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el 33/122 2023-10-06T04:35:13.125 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 34/122 2023-10-06T04:35:13.125 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.e 35/122 2023-10-06T04:35:13.126 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 36/122 2023-10-06T04:35:13.126 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 37/122 2023-10-06T04:35:13.126 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 38/122 2023-10-06T04:35:13.126 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-06T04:35:13.126 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-06T04:35:13.126 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-06T04:35:13.126 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-06T04:35:13.126 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-06T04:35:13.126 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-06T04:35:13.126 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-06T04:35:13.127 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-06T04:35:13.127 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-06T04:35:13.127 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-06T04:35:13.127 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-06T04:35:13.127 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-06T04:35:13.127 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-06T04:35:13.127 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-06T04:35:13.127 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-06T04:35:13.127 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-06T04:35:13.127 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-06T04:35:13.127 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-06T04:35:13.127 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-06T04:35:13.128 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-06T04:35:13.128 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-06T04:35:13.128 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-06T04:35:13.128 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-06T04:35:13.128 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-06T04:35:13.128 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-06T04:35:13.128 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-06T04:35:13.128 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-06T04:35:13.128 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-06T04:35:13.128 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-06T04:35:13.128 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-06T04:35:13.128 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-06T04:35:13.129 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-06T04:35:13.129 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-06T04:35:13.129 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-06T04:35:13.129 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-06T04:35:13.129 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-06T04:35:13.129 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-06T04:35:13.129 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-06T04:35:13.129 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-06T04:35:13.129 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-06T04:35:13.129 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-06T04:35:13.129 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-06T04:35:13.130 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-06T04:35:13.130 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-06T04:35:13.130 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-06T04:35:13.130 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-06T04:35:13.130 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-06T04:35:13.130 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-06T04:35:13.130 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-06T04:35:13.130 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-06T04:35:13.130 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-06T04:35:13.130 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-06T04:35:13.130 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-06T04:35:13.130 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-06T04:35:13.131 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-06T04:35:13.131 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-06T04:35:13.131 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-06T04:35:13.131 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-06T04:35:13.131 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-06T04:35:13.131 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-06T04:35:13.131 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-06T04:35:13.131 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-06T04:35:13.131 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-06T04:35:13.131 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-06T04:35:13.131 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-06T04:35:13.132 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-06T04:35:13.132 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-06T04:35:13.132 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-06T04:35:13.132 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-06T04:35:13.132 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-06T04:35:13.132 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-06T04:35:13.132 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-06T04:35:13.132 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-06T04:35:13.132 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-06T04:35:13.132 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-06T04:35:13.132 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-06T04:35:13.132 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-06T04:35:13.133 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-06T04:35:13.133 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-06T04:35:13.133 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-06T04:35:13.133 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 119/122 2023-10-06T04:35:13.133 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-06T04:35:13.133 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 121/122 2023-10-06T04:35:14.589 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T04:35:14.589 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:01:48 ago on Fri 06 Oct 2023 04:33:26 AM UTC. 2023-10-06T04:35:15.402 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T04:35:15.403 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:49 ago on Fri 06 Oct 2023 04:33:26 AM UTC. 2023-10-06T04:35:20.407 INFO:teuthology.orchestra.run.smithi008.stdout:Installed products updated. 2023-10-06T04:35:20.558 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:35:20.558 INFO:teuthology.orchestra.run.smithi008.stdout:Upgraded: 2023-10-06T04:35:20.559 INFO:teuthology.orchestra.run.smithi008.stdout: librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:20.559 INFO:teuthology.orchestra.run.smithi008.stdout: librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:20.559 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-06T04:35:20.559 INFO:teuthology.orchestra.run.smithi008.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T04:35:20.559 INFO:teuthology.orchestra.run.smithi008.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T04:35:20.559 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:20.559 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:20.560 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:20.560 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:20.560 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:35:20.560 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-immutable-object-cache-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:20.560 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:20.560 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:20.560 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:35:20.561 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:35:20.561 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:35:20.561 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:35:20.561 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:35:20.561 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:20.562 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:20.562 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:35:20.562 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:20.562 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:20.562 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:20.562 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:35:20.563 INFO:teuthology.orchestra.run.smithi008.stdout: cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:35:20.563 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:20.563 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:35:20.563 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-06T04:35:20.563 INFO:teuthology.orchestra.run.smithi008.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T04:35:20.563 INFO:teuthology.orchestra.run.smithi008.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-06T04:35:20.563 INFO:teuthology.orchestra.run.smithi008.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T04:35:20.564 INFO:teuthology.orchestra.run.smithi008.stdout: jq-1.5-12.el8.x86_64 2023-10-06T04:35:20.564 INFO:teuthology.orchestra.run.smithi008.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-06T04:35:20.564 INFO:teuthology.orchestra.run.smithi008.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-06T04:35:20.564 INFO:teuthology.orchestra.run.smithi008.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T04:35:20.564 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:20.564 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:20.564 INFO:teuthology.orchestra.run.smithi008.stdout: libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:20.565 INFO:teuthology.orchestra.run.smithi008.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-06T04:35:20.565 INFO:teuthology.orchestra.run.smithi008.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-06T04:35:20.565 INFO:teuthology.orchestra.run.smithi008.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T04:35:20.565 INFO:teuthology.orchestra.run.smithi008.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-06T04:35:20.565 INFO:teuthology.orchestra.run.smithi008.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T04:35:20.565 INFO:teuthology.orchestra.run.smithi008.stdout: librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:20.565 INFO:teuthology.orchestra.run.smithi008.stdout: libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:20.566 INFO:teuthology.orchestra.run.smithi008.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-06T04:35:20.566 INFO:teuthology.orchestra.run.smithi008.stdout: librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:20.566 INFO:teuthology.orchestra.run.smithi008.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T04:35:20.566 INFO:teuthology.orchestra.run.smithi008.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-06T04:35:20.566 INFO:teuthology.orchestra.run.smithi008.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T04:35:20.566 INFO:teuthology.orchestra.run.smithi008.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T04:35:20.567 INFO:teuthology.orchestra.run.smithi008.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-06T04:35:20.567 INFO:teuthology.orchestra.run.smithi008.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T04:35:20.567 INFO:teuthology.orchestra.run.smithi008.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T04:35:20.567 INFO:teuthology.orchestra.run.smithi008.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T04:35:20.567 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-06T04:35:20.567 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-06T04:35:20.568 INFO:teuthology.orchestra.run.smithi008.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-06T04:35:20.568 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T04:35:20.568 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T04:35:20.568 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T04:35:20.568 INFO:teuthology.orchestra.run.smithi008.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T04:35:20.568 INFO:teuthology.orchestra.run.smithi008.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-06T04:35:20.568 INFO:teuthology.orchestra.run.smithi008.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T04:35:20.569 INFO:teuthology.orchestra.run.smithi008.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T04:35:20.569 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T04:35:20.569 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:20.569 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:20.569 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:20.569 INFO:teuthology.orchestra.run.smithi008.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T04:35:20.570 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T04:35:20.570 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T04:35:20.570 INFO:teuthology.orchestra.run.smithi008.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T04:35:20.570 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T04:35:20.570 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T04:35:20.570 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-06T04:35:20.570 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T04:35:20.571 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T04:35:20.571 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T04:35:20.571 INFO:teuthology.orchestra.run.smithi008.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T04:35:20.571 INFO:teuthology.orchestra.run.smithi008.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T04:35:20.571 INFO:teuthology.orchestra.run.smithi008.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T04:35:20.571 INFO:teuthology.orchestra.run.smithi008.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T04:35:20.571 INFO:teuthology.orchestra.run.smithi008.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T04:35:20.572 INFO:teuthology.orchestra.run.smithi008.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T04:35:20.572 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-06T04:35:20.572 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-06T04:35:20.572 INFO:teuthology.orchestra.run.smithi008.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T04:35:20.572 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T04:35:20.573 INFO:teuthology.orchestra.run.smithi008.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T04:35:20.573 INFO:teuthology.orchestra.run.smithi008.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T04:35:20.573 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T04:35:20.573 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T04:35:20.573 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T04:35:20.573 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:20.573 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:20.574 INFO:teuthology.orchestra.run.smithi008.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T04:35:20.574 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T04:35:20.574 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:20.574 INFO:teuthology.orchestra.run.smithi008.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T04:35:20.574 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T04:35:20.574 INFO:teuthology.orchestra.run.smithi008.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-06T04:35:20.575 INFO:teuthology.orchestra.run.smithi008.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T04:35:20.575 INFO:teuthology.orchestra.run.smithi008.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T04:35:20.575 INFO:teuthology.orchestra.run.smithi008.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T04:35:20.575 INFO:teuthology.orchestra.run.smithi008.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T04:35:20.575 INFO:teuthology.orchestra.run.smithi008.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T04:35:20.575 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T04:35:20.575 INFO:teuthology.orchestra.run.smithi008.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T04:35:20.575 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T04:35:20.576 INFO:teuthology.orchestra.run.smithi008.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T04:35:20.576 INFO:teuthology.orchestra.run.smithi008.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T04:35:20.576 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:20.576 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:20.576 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:20.576 INFO:teuthology.orchestra.run.smithi008.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-06T04:35:20.577 INFO:teuthology.orchestra.run.smithi008.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T04:35:20.577 INFO:teuthology.orchestra.run.smithi008.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-06T04:35:20.577 INFO:teuthology.orchestra.run.smithi008.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T04:35:20.578 INFO:teuthology.orchestra.run.smithi008.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-06T04:35:20.578 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:35:20.578 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-06T04:35:20.745 DEBUG:teuthology.parallel:result is None 2023-10-06T04:35:22.812 INFO:teuthology.orchestra.run.smithi184.stdout:Installed products updated. 2023-10-06T04:35:22.950 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:35:22.950 INFO:teuthology.orchestra.run.smithi184.stdout:Upgraded: 2023-10-06T04:35:22.950 INFO:teuthology.orchestra.run.smithi184.stdout: librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:22.950 INFO:teuthology.orchestra.run.smithi184.stdout: librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:22.950 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2023-10-06T04:35:22.950 INFO:teuthology.orchestra.run.smithi184.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T04:35:22.950 INFO:teuthology.orchestra.run.smithi184.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T04:35:22.951 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:22.951 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:22.951 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:22.951 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:22.951 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:35:22.951 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-immutable-object-cache-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:22.951 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:22.951 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:22.951 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:35:22.951 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:35:22.951 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:35:22.951 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:35:22.952 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:35:22.952 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:22.952 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:22.952 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:35:22.952 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:22.952 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:22.952 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:22.952 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:35:22.952 INFO:teuthology.orchestra.run.smithi184.stdout: cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:35:22.952 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:22.952 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:35:22.952 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-06T04:35:22.953 INFO:teuthology.orchestra.run.smithi184.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T04:35:22.953 INFO:teuthology.orchestra.run.smithi184.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-06T04:35:22.953 INFO:teuthology.orchestra.run.smithi184.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T04:35:22.953 INFO:teuthology.orchestra.run.smithi184.stdout: jq-1.5-12.el8.x86_64 2023-10-06T04:35:22.953 INFO:teuthology.orchestra.run.smithi184.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-06T04:35:22.953 INFO:teuthology.orchestra.run.smithi184.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-06T04:35:22.953 INFO:teuthology.orchestra.run.smithi184.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T04:35:22.953 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:22.953 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:22.953 INFO:teuthology.orchestra.run.smithi184.stdout: libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:22.953 INFO:teuthology.orchestra.run.smithi184.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-06T04:35:22.953 INFO:teuthology.orchestra.run.smithi184.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-06T04:35:22.954 INFO:teuthology.orchestra.run.smithi184.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T04:35:22.954 INFO:teuthology.orchestra.run.smithi184.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-06T04:35:22.954 INFO:teuthology.orchestra.run.smithi184.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T04:35:22.954 INFO:teuthology.orchestra.run.smithi184.stdout: librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:22.954 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:22.954 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-06T04:35:22.954 INFO:teuthology.orchestra.run.smithi184.stdout: librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:22.954 INFO:teuthology.orchestra.run.smithi184.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T04:35:22.954 INFO:teuthology.orchestra.run.smithi184.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-06T04:35:22.954 INFO:teuthology.orchestra.run.smithi184.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T04:35:22.954 INFO:teuthology.orchestra.run.smithi184.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T04:35:22.955 INFO:teuthology.orchestra.run.smithi184.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-06T04:35:22.955 INFO:teuthology.orchestra.run.smithi184.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T04:35:22.955 INFO:teuthology.orchestra.run.smithi184.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T04:35:22.955 INFO:teuthology.orchestra.run.smithi184.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T04:35:22.955 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-06T04:35:22.955 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-06T04:35:22.955 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-06T04:35:22.955 INFO:teuthology.orchestra.run.smithi184.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T04:35:22.955 INFO:teuthology.orchestra.run.smithi184.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T04:35:22.955 INFO:teuthology.orchestra.run.smithi184.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T04:35:22.955 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T04:35:22.955 INFO:teuthology.orchestra.run.smithi184.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-06T04:35:22.956 INFO:teuthology.orchestra.run.smithi184.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T04:35:22.956 INFO:teuthology.orchestra.run.smithi184.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T04:35:22.956 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T04:35:22.956 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:22.956 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:22.956 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:22.956 INFO:teuthology.orchestra.run.smithi184.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T04:35:22.956 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T04:35:22.956 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T04:35:22.956 INFO:teuthology.orchestra.run.smithi184.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T04:35:22.956 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T04:35:22.956 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T04:35:22.957 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-06T04:35:22.957 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T04:35:22.957 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T04:35:22.957 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T04:35:22.957 INFO:teuthology.orchestra.run.smithi184.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T04:35:22.957 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T04:35:22.957 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T04:35:22.957 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T04:35:22.957 INFO:teuthology.orchestra.run.smithi184.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T04:35:22.957 INFO:teuthology.orchestra.run.smithi184.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T04:35:22.957 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-06T04:35:22.957 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-06T04:35:22.958 INFO:teuthology.orchestra.run.smithi184.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T04:35:22.958 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T04:35:22.958 INFO:teuthology.orchestra.run.smithi184.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T04:35:22.958 INFO:teuthology.orchestra.run.smithi184.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T04:35:22.958 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T04:35:22.958 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T04:35:22.958 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T04:35:22.958 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:22.958 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:22.958 INFO:teuthology.orchestra.run.smithi184.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T04:35:22.958 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T04:35:22.959 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:22.959 INFO:teuthology.orchestra.run.smithi184.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T04:35:22.959 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T04:35:22.959 INFO:teuthology.orchestra.run.smithi184.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-06T04:35:22.959 INFO:teuthology.orchestra.run.smithi184.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T04:35:22.959 INFO:teuthology.orchestra.run.smithi184.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T04:35:22.959 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T04:35:22.959 INFO:teuthology.orchestra.run.smithi184.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T04:35:22.959 INFO:teuthology.orchestra.run.smithi184.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T04:35:22.959 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T04:35:22.959 INFO:teuthology.orchestra.run.smithi184.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T04:35:22.959 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T04:35:22.960 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T04:35:22.960 INFO:teuthology.orchestra.run.smithi184.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T04:35:22.960 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:22.960 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:22.960 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:35:22.960 INFO:teuthology.orchestra.run.smithi184.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-06T04:35:22.960 INFO:teuthology.orchestra.run.smithi184.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T04:35:22.960 INFO:teuthology.orchestra.run.smithi184.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-06T04:35:22.960 INFO:teuthology.orchestra.run.smithi184.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T04:35:22.961 INFO:teuthology.orchestra.run.smithi184.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-06T04:35:22.961 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:35:22.961 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-10-06T04:35:23.173 DEBUG:teuthology.parallel:result is None 2023-10-06T04:35:23.173 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T04:35:23.313 DEBUG:teuthology.orchestra.run.smithi008:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T04:35:23.338 INFO:teuthology.orchestra.run.smithi008.stdout:17.2.6-1274.g68e53a4a.el8 2023-10-06T04:35:23.338 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1274.g68e53a4a.el8 2023-10-06T04:35:23.338 INFO:teuthology.task.install:The correct ceph version 17.2.6-1274.g68e53a4a is installed. 2023-10-06T04:35:23.339 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T04:35:23.556 DEBUG:teuthology.orchestra.run.smithi184:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T04:35:23.578 INFO:teuthology.orchestra.run.smithi184.stdout:17.2.6-1274.g68e53a4a.el8 2023-10-06T04:35:23.578 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1274.g68e53a4a.el8 2023-10-06T04:35:23.578 INFO:teuthology.task.install:The correct ceph version 17.2.6-1274.g68e53a4a is installed. 2023-10-06T04:35:23.578 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-06T04:35:23.578 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T04:35:23.578 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T04:35:23.623 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-06T04:35:23.623 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T04:35:23.662 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-06T04:35:23.662 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T04:35:23.662 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T04:35:23.691 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T04:35:23.761 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-06T04:35:23.761 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T04:35:23.786 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T04:35:23.849 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-06T04:35:23.850 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T04:35:23.850 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T04:35:23.877 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T04:35:23.944 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-06T04:35:23.944 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T04:35:23.968 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T04:35:24.032 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-06T04:35:24.032 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T04:35:24.033 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T04:35:24.060 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T04:35:24.127 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-06T04:35:24.127 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T04:35:24.151 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T04:35:24.214 INFO:teuthology.run_tasks:Running task ceph... 2023-10-06T04:35:24.279 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-06T04:35:24.279 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 777 /var/log/ceph 2023-10-06T04:35:24.282 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 777 /var/log/ceph 2023-10-06T04:35:24.309 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-06T04:35:24.309 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T04:35:24.352 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T04:35:24.378 INFO:tasks.ceph:Creating extra log directories... 2023-10-06T04:35:24.379 DEBUG:teuthology.orchestra.run.smithi008:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T04:35:24.422 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T04:35:24.453 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-06T04:35:24.454 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-06T04:35:24.454 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-06T04:35:24.454 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T04:35:24.454 DEBUG:teuthology.orchestra.run.smithi008:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T04:35:24.544 DEBUG:teuthology.orchestra.run.smithi008:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T04:35:24.663 DEBUG:teuthology.orchestra.run.smithi008:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T04:35:24.690 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-06T04:35:24.690 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T04:35:24.704 DEBUG:teuthology.orchestra.run.smithi184:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T04:35:24.813 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T04:35:24.844 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-06T04:35:24.844 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'unmatched fragstat', 'unmatched rstat', 'was unreadable, recreating it now', 'Scrub error on inode', 'Metadata damage detected', 'MDS_FAILED', 'MDS_DAMAGE'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-06T04:35:24.845 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412279', 'branch': 'wip-yuri3-testing-2023-10-05-0943-quincy', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/alternate-pool}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7412279', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri3-testing-2023-10-05-0943-quincy'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'unmatched fragstat', 'unmatched rstat', 'was unreadable, recreating it now', 'Scrub error on inode', 'Metadata damage detected', 'MDS_FAILED', 'MDS_DAMAGE'], 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri3-testing-2023-10-05-0943-quincy', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 4002, 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri3-testing-2023-10-05-0943-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'targets': {'smithi008.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIo0QN1QY8bs+wQIFzVw3f/mTM2iPX5y10ShPml9hTHVPd6MYxPJSGOldqrVjgpInPZ0mQgyVpqIvGcB0+5dRWQ=', 'smithi184.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNHnsmBL45Qs5cNPlTOPZoi39J/JUz0zxyDMxkeWW6uWlO8/WqOWdJHuwXz8+4To7WZ+LDy33tWa1H/myoLMUK8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_recovery_pool']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-05_23:54:57', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-06T04:35:24.845 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T04:35:24.848 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T04:35:24.893 DEBUG:teuthology.orchestra.run.smithi008:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T04:35:24.905 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T04:35:24.956 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T04:35:24.956 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T04:35:24.989 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T04:35:24.989 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_1 2023-10-06T04:35:25.046 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T04:35:25.046 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:35:25.046 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 6h/6d Inode: 219674 Links: 1 2023-10-06T04:35:25.046 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:35:25.046 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:35:25.047 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-10-06 04:35:11.825651414 +0000 2023-10-06T04:35:25.047 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-10-06 04:32:41.732513985 +0000 2023-10-06T04:35:25.047 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-10-06 04:32:41.732513985 +0000 2023-10-06T04:35:25.047 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: - 2023-10-06T04:35:25.047 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T04:35:25.112 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-10-06T04:35:25.112 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-10-06T04:35:25.112 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000119516 s, 4.3 MB/s 2023-10-06T04:35:25.113 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T04:35:25.170 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_2 2023-10-06T04:35:25.226 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T04:35:25.226 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:35:25.226 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 6h/6d Inode: 222263 Links: 1 2023-10-06T04:35:25.227 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:35:25.227 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:35:25.227 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-10-06 04:35:11.826651404 +0000 2023-10-06T04:35:25.227 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-10-06 04:32:42.223509118 +0000 2023-10-06T04:35:25.227 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-10-06 04:32:42.223509118 +0000 2023-10-06T04:35:25.227 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: - 2023-10-06T04:35:25.227 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T04:35:25.290 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-10-06T04:35:25.291 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-10-06T04:35:25.291 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000145825 s, 3.5 MB/s 2023-10-06T04:35:25.292 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T04:35:25.349 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_3 2023-10-06T04:35:25.405 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T04:35:25.405 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:35:25.405 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 6h/6d Inode: 217057 Links: 1 2023-10-06T04:35:25.405 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:35:25.406 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:35:25.406 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-10-06 04:35:11.826651404 +0000 2023-10-06T04:35:25.406 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-10-06 04:32:42.733504061 +0000 2023-10-06T04:35:25.406 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-10-06 04:32:42.733504061 +0000 2023-10-06T04:35:25.406 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: - 2023-10-06T04:35:25.406 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T04:35:25.469 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-10-06T04:35:25.470 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-10-06T04:35:25.470 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000119821 s, 4.3 MB/s 2023-10-06T04:35:25.471 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T04:35:25.528 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_4 2023-10-06T04:35:25.584 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T04:35:25.584 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:35:25.584 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 6h/6d Inode: 215835 Links: 1 2023-10-06T04:35:25.584 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:35:25.584 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:35:25.584 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-10-06 04:35:11.826651404 +0000 2023-10-06T04:35:25.584 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-10-06 04:32:43.233499104 +0000 2023-10-06T04:35:25.585 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-10-06 04:32:43.233499104 +0000 2023-10-06T04:35:25.585 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: - 2023-10-06T04:35:25.585 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T04:35:25.648 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-10-06T04:35:25.649 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-10-06T04:35:25.649 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000116797 s, 4.4 MB/s 2023-10-06T04:35:25.649 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T04:35:25.707 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T04:35:25.707 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-06T04:35:25.707 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T04:35:25.724 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T04:35:25.724 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_1 2023-10-06T04:35:25.780 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T04:35:25.780 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:35:25.780 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 6h/6d Inode: 216771 Links: 1 2023-10-06T04:35:25.780 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:35:25.781 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:35:25.781 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2023-10-06 04:35:12.699226787 +0000 2023-10-06T04:35:25.781 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-10-06 04:32:28.427185453 +0000 2023-10-06T04:35:25.781 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-10-06 04:32:28.427185453 +0000 2023-10-06T04:35:25.781 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2023-10-06T04:35:25.782 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T04:35:25.845 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2023-10-06T04:35:25.845 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2023-10-06T04:35:25.845 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000311749 s, 1.6 MB/s 2023-10-06T04:35:25.846 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T04:35:25.903 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_2 2023-10-06T04:35:25.959 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T04:35:25.959 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:35:25.959 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 6h/6d Inode: 218700 Links: 1 2023-10-06T04:35:25.959 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:35:25.959 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:35:25.959 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2023-10-06 04:35:12.699226787 +0000 2023-10-06T04:35:25.959 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-10-06 04:32:28.938174673 +0000 2023-10-06T04:35:25.959 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-10-06 04:32:28.938174673 +0000 2023-10-06T04:35:25.959 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2023-10-06T04:35:25.960 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T04:35:26.022 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2023-10-06T04:35:26.022 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2023-10-06T04:35:26.022 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000255216 s, 2.0 MB/s 2023-10-06T04:35:26.023 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T04:35:26.079 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_3 2023-10-06T04:35:26.134 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T04:35:26.135 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:35:26.135 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 6h/6d Inode: 217771 Links: 1 2023-10-06T04:35:26.135 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:35:26.136 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:35:26.136 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2023-10-06 04:35:12.700226765 +0000 2023-10-06T04:35:26.136 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-10-06 04:32:29.448163914 +0000 2023-10-06T04:35:26.136 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-10-06 04:32:29.448163914 +0000 2023-10-06T04:35:26.136 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2023-10-06T04:35:26.136 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T04:35:26.197 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2023-10-06T04:35:26.197 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2023-10-06T04:35:26.197 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000234015 s, 2.2 MB/s 2023-10-06T04:35:26.198 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T04:35:26.254 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_4 2023-10-06T04:35:26.310 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T04:35:26.310 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:35:26.311 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 6h/6d Inode: 220611 Links: 1 2023-10-06T04:35:26.311 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:35:26.311 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:35:26.311 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2023-10-06 04:35:12.700226765 +0000 2023-10-06T04:35:26.311 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-10-06 04:32:29.923153893 +0000 2023-10-06T04:35:26.311 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-10-06 04:32:29.923153893 +0000 2023-10-06T04:35:26.312 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2023-10-06T04:35:26.312 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T04:35:26.373 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2023-10-06T04:35:26.373 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2023-10-06T04:35:26.373 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000197557 s, 2.6 MB/s 2023-10-06T04:35:26.374 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T04:35:26.430 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T04:35:26.430 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi008.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi184.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T04:35:26.430 INFO:tasks.ceph:Generating config... 2023-10-06T04:35:26.431 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-06T04:35:26.431 INFO:tasks.ceph:[client] debug client = 20 2023-10-06T04:35:26.432 INFO:tasks.ceph:[client] debug ms = 1 2023-10-06T04:35:26.432 INFO:tasks.ceph:[client] pid file = 2023-10-06T04:35:26.432 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-06T04:35:26.432 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-06T04:35:26.432 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-06T04:35:26.432 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-06T04:35:26.432 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-06T04:35:26.432 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-06T04:35:26.432 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-06T04:35:26.432 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-06T04:35:26.432 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-06T04:35:26.432 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-06T04:35:26.433 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-06T04:35:26.433 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-06T04:35:26.433 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-06T04:35:26.433 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-06T04:35:26.433 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-06T04:35:26.433 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-06T04:35:26.433 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-06T04:35:26.433 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-06T04:35:26.434 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-06T04:35:26.434 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-06T04:35:26.434 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-10-06T04:35:26.434 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-10-06T04:35:26.434 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-06T04:35:26.434 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-06T04:35:26.434 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-10-06T04:35:26.434 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-06T04:35:26.435 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-06T04:35:26.435 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-06T04:35:26.435 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-06T04:35:26.435 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-06T04:35:26.435 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-06T04:35:26.435 INFO:tasks.ceph:Setting up mon.a... 2023-10-06T04:35:26.435 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-06T04:35:26.490 INFO:teuthology.orchestra.run.smithi008.stdout:creating /etc/ceph/ceph.keyring 2023-10-06T04:35:26.493 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-06T04:35:26.536 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T04:35:26.602 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.8'), ('mon.b', '172.21.15.184'), ('mon.c', '[v2:172.21.15.184:3301,v1:172.21.15.184:6790]')] 2023-10-06T04:35:26.603 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.8,172.21.15.184,[v2:172.21.15.184:3301,v1:172.21.15.184:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-06T04:35:26.604 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T04:35:26.604 DEBUG:teuthology.orchestra.run.smithi008:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T04:35:26.659 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.8 --add b 172.21.15.184 --addv c '[v2:172.21.15.184:3301,v1:172.21.15.184:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:35:26.743 INFO:teuthology.orchestra.run.smithi008.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:35:26.743 INFO:teuthology.orchestra.run.smithi008.stdout:monmaptool: generated fsid c030d94d-df8f-49bb-8df7-07e9e557d96b 2023-10-06T04:35:26.743 INFO:teuthology.orchestra.run.smithi008.stdout:setting min_mon_release = octopus 2023-10-06T04:35:26.744 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 0 2023-10-06T04:35:26.744 INFO:teuthology.orchestra.run.smithi008.stdout:fsid c030d94d-df8f-49bb-8df7-07e9e557d96b 2023-10-06T04:35:26.744 INFO:teuthology.orchestra.run.smithi008.stdout:last_changed 2023-10-06T04:35:26.742610+0000 2023-10-06T04:35:26.744 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-06T04:35:26.742610+0000 2023-10-06T04:35:26.744 INFO:teuthology.orchestra.run.smithi008.stdout:min_mon_release 15 (octopus) 2023-10-06T04:35:26.744 INFO:teuthology.orchestra.run.smithi008.stdout:election_strategy: 1 2023-10-06T04:35:26.744 INFO:teuthology.orchestra.run.smithi008.stdout:0: [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] mon.a 2023-10-06T04:35:26.744 INFO:teuthology.orchestra.run.smithi008.stdout:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2023-10-06T04:35:26.744 INFO:teuthology.orchestra.run.smithi008.stdout:2: [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] mon.c 2023-10-06T04:35:26.744 INFO:teuthology.orchestra.run.smithi008.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-06T04:35:26.745 DEBUG:teuthology.orchestra.run.smithi008:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T04:35:26.760 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c030d94d-df8f-49bb-8df7-07e9e557d96b... 2023-10-06T04:35:26.761 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T04:35:26.802 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T04:35:26.844 INFO:teuthology.orchestra.run.smithi008.stdout:[global] 2023-10-06T04:35:26.845 INFO:teuthology.orchestra.run.smithi008.stdout: chdir = "" 2023-10-06T04:35:26.845 INFO:teuthology.orchestra.run.smithi008.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T04:35:26.845 INFO:teuthology.orchestra.run.smithi008.stdout: auth supported = cephx 2023-10-06T04:35:26.846 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:35:26.846 INFO:teuthology.orchestra.run.smithi008.stdout: filestore xattr use omap = true 2023-10-06T04:35:26.846 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:35:26.846 INFO:teuthology.orchestra.run.smithi008.stdout: mon clock drift allowed = 1.000 2023-10-06T04:35:26.847 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:35:26.847 INFO:teuthology.orchestra.run.smithi008.stdout: osd crush chooseleaf type = 0 2023-10-06T04:35:26.848 INFO:teuthology.orchestra.run.smithi008.stdout: auth debug = true 2023-10-06T04:35:26.848 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:35:26.848 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on old message = true 2023-10-06T04:35:26.849 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on bug = true 2023-10-06T04:35:26.849 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:35:26.849 INFO:teuthology.orchestra.run.smithi008.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T04:35:26.849 INFO:teuthology.orchestra.run.smithi008.stdout: mon pg warn max object skew = 0 2023-10-06T04:35:26.850 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:35:26.850 INFO:teuthology.orchestra.run.smithi008.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T04:35:26.850 INFO:teuthology.orchestra.run.smithi008.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T04:35:26.850 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:35:26.850 INFO:teuthology.orchestra.run.smithi008.stdout: osd pool default size = 2 2023-10-06T04:35:26.851 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:35:26.851 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd allow primary affinity = true 2023-10-06T04:35:26.851 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd allow pg remap = true 2023-10-06T04:35:26.852 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on legacy crush tunables = false 2023-10-06T04:35:26.852 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on crush straw calc version zero = false 2023-10-06T04:35:26.852 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on no sortbitwise = false 2023-10-06T04:35:26.852 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on osd down out interval zero = false 2023-10-06T04:35:26.853 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on too few osds = false 2023-10-06T04:35:26.854 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T04:35:26.854 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T04:35:26.854 INFO:teuthology.orchestra.run.smithi008.stdout: mon_allow_pool_size_one = true 2023-10-06T04:35:26.854 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:35:26.854 INFO:teuthology.orchestra.run.smithi008.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T04:35:26.855 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:35:26.855 INFO:teuthology.orchestra.run.smithi008.stdout: osd default data pool replay window = 5 2023-10-06T04:35:26.855 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:35:26.855 INFO:teuthology.orchestra.run.smithi008.stdout: mon allow pool delete = true 2023-10-06T04:35:26.855 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:35:26.855 INFO:teuthology.orchestra.run.smithi008.stdout: mon cluster log file level = debug 2023-10-06T04:35:26.855 INFO:teuthology.orchestra.run.smithi008.stdout: debug asserts on shutdown = true 2023-10-06T04:35:26.855 INFO:teuthology.orchestra.run.smithi008.stdout: mon health detail to clog = false 2023-10-06T04:35:26.855 INFO:teuthology.orchestra.run.smithi008.stdout: mon host = "172.21.15.8,172.21.15.184,[v2:172.21.15.184:3301,v1:172.21.15.184:6790]" 2023-10-06T04:35:26.855 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on skipped message = False 2023-10-06T04:35:26.855 INFO:teuthology.orchestra.run.smithi008.stdout: fsid = c030d94d-df8f-49bb-8df7-07e9e557d96b 2023-10-06T04:35:26.856 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:35:26.856 INFO:teuthology.orchestra.run.smithi008.stdout:[osd] 2023-10-06T04:35:26.856 INFO:teuthology.orchestra.run.smithi008.stdout: osd journal size = 100 2023-10-06T04:35:26.856 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:35:26.856 INFO:teuthology.orchestra.run.smithi008.stdout: osd scrub load threshold = 5.0 2023-10-06T04:35:26.856 INFO:teuthology.orchestra.run.smithi008.stdout: osd scrub max interval = 600 2023-10-06T04:35:26.857 INFO:teuthology.orchestra.run.smithi008.stdout: osd mclock profile = high_recovery_ops 2023-10-06T04:35:26.857 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:35:26.857 INFO:teuthology.orchestra.run.smithi008.stdout: osd recover clone overlap = true 2023-10-06T04:35:26.857 INFO:teuthology.orchestra.run.smithi008.stdout: osd recovery max chunk = 1048576 2023-10-06T04:35:26.857 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:35:26.857 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug shutdown = true 2023-10-06T04:35:26.857 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug op order = true 2023-10-06T04:35:26.857 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug verify stray on activate = true 2023-10-06T04:35:26.857 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:35:26.857 INFO:teuthology.orchestra.run.smithi008.stdout: osd open classes on start = true 2023-10-06T04:35:26.857 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug pg log writeout = true 2023-10-06T04:35:26.857 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:35:26.858 INFO:teuthology.orchestra.run.smithi008.stdout: osd deep scrub update digest min age = 30 2023-10-06T04:35:26.858 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:35:26.858 INFO:teuthology.orchestra.run.smithi008.stdout: osd map max advance = 10 2023-10-06T04:35:26.858 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:35:26.858 INFO:teuthology.orchestra.run.smithi008.stdout: journal zero on create = true 2023-10-06T04:35:26.858 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:35:26.858 INFO:teuthology.orchestra.run.smithi008.stdout: filestore ondisk finisher threads = 3 2023-10-06T04:35:26.858 INFO:teuthology.orchestra.run.smithi008.stdout: filestore apply finisher threads = 3 2023-10-06T04:35:26.858 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:35:26.858 INFO:teuthology.orchestra.run.smithi008.stdout: bdev debug aio = true 2023-10-06T04:35:26.858 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug misdirected ops = true 2023-10-06T04:35:26.858 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore block size = 96636764160 2023-10-06T04:35:26.859 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore fsck on mount = True 2023-10-06T04:35:26.859 INFO:teuthology.orchestra.run.smithi008.stdout: debug bluefs = 20 2023-10-06T04:35:26.859 INFO:teuthology.orchestra.run.smithi008.stdout: debug bluestore = 20 2023-10-06T04:35:26.859 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-10-06T04:35:26.859 INFO:teuthology.orchestra.run.smithi008.stdout: debug osd = 20 2023-10-06T04:35:26.859 INFO:teuthology.orchestra.run.smithi008.stdout: debug rocksdb = 10 2023-10-06T04:35:26.859 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T04:35:26.859 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd full ratio = 0.9 2023-10-06T04:35:26.859 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd nearfull ratio = 0.8 2023-10-06T04:35:26.859 INFO:teuthology.orchestra.run.smithi008.stdout: osd failsafe full ratio = 0.95 2023-10-06T04:35:26.859 INFO:teuthology.orchestra.run.smithi008.stdout: osd objectstore = bluestore 2023-10-06T04:35:26.859 INFO:teuthology.orchestra.run.smithi008.stdout: osd op complaint time = 180 2023-10-06T04:35:26.860 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:35:26.860 INFO:teuthology.orchestra.run.smithi008.stdout:[mgr] 2023-10-06T04:35:26.860 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-10-06T04:35:26.860 INFO:teuthology.orchestra.run.smithi008.stdout: debug mgr = 20 2023-10-06T04:35:26.860 INFO:teuthology.orchestra.run.smithi008.stdout: debug mon = 20 2023-10-06T04:35:26.860 INFO:teuthology.orchestra.run.smithi008.stdout: debug auth = 20 2023-10-06T04:35:26.860 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min pgs per osd = 4 2023-10-06T04:35:26.861 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min bytes per osd = 10 2023-10-06T04:35:26.861 INFO:teuthology.orchestra.run.smithi008.stdout: mgr/telemetry/nag = false 2023-10-06T04:35:26.861 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:35:26.861 INFO:teuthology.orchestra.run.smithi008.stdout:[mon] 2023-10-06T04:35:26.861 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-10-06T04:35:26.861 INFO:teuthology.orchestra.run.smithi008.stdout: debug mon = 20 2023-10-06T04:35:26.861 INFO:teuthology.orchestra.run.smithi008.stdout: debug paxos = 20 2023-10-06T04:35:26.861 INFO:teuthology.orchestra.run.smithi008.stdout: debug auth = 20 2023-10-06T04:35:26.861 INFO:teuthology.orchestra.run.smithi008.stdout: mon data avail warn = 5 2023-10-06T04:35:26.861 INFO:teuthology.orchestra.run.smithi008.stdout: mon mgr mkfs grace = 240 2023-10-06T04:35:26.861 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min pgs per osd = 4 2023-10-06T04:35:26.861 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd reporter subtree level = osd 2023-10-06T04:35:26.862 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd prime pg temp = true 2023-10-06T04:35:26.862 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min bytes per osd = 10 2023-10-06T04:35:26.862 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:35:26.862 INFO:teuthology.orchestra.run.smithi008.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T04:35:26.862 INFO:teuthology.orchestra.run.smithi008.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T04:35:26.862 INFO:teuthology.orchestra.run.smithi008.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T04:35:26.862 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:35:26.862 INFO:teuthology.orchestra.run.smithi008.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T04:35:26.862 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T04:35:26.862 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T04:35:26.862 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:35:26.862 INFO:teuthology.orchestra.run.smithi008.stdout: # 1m isn't quite enough 2023-10-06T04:35:26.863 INFO:teuthology.orchestra.run.smithi008.stdout: mon_down_mkfs_grace = 2m 2023-10-06T04:35:26.863 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:35:26.863 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_filestore_osds = false 2023-10-06T04:35:26.863 INFO:teuthology.orchestra.run.smithi008.stdout: mon op complaint time = 120 2023-10-06T04:35:26.863 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:35:26.863 INFO:teuthology.orchestra.run.smithi008.stdout:[client] 2023-10-06T04:35:26.863 INFO:teuthology.orchestra.run.smithi008.stdout: rgw cache enabled = true 2023-10-06T04:35:26.863 INFO:teuthology.orchestra.run.smithi008.stdout: rgw enable ops log = true 2023-10-06T04:35:26.863 INFO:teuthology.orchestra.run.smithi008.stdout: rgw enable usage log = true 2023-10-06T04:35:26.863 INFO:teuthology.orchestra.run.smithi008.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T04:35:26.863 INFO:teuthology.orchestra.run.smithi008.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T04:35:26.863 INFO:teuthology.orchestra.run.smithi008.stdout: client mount timeout = 600 2023-10-06T04:35:26.864 INFO:teuthology.orchestra.run.smithi008.stdout: debug client = 20 2023-10-06T04:35:26.864 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-10-06T04:35:26.864 INFO:teuthology.orchestra.run.smithi008.stdout: pid file = "" 2023-10-06T04:35:26.864 INFO:teuthology.orchestra.run.smithi008.stdout: rados mon op timeout = 900 2023-10-06T04:35:26.864 INFO:teuthology.orchestra.run.smithi008.stdout: rados osd op timeout = 900 2023-10-06T04:35:26.864 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.a] 2023-10-06T04:35:26.864 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.b] 2023-10-06T04:35:26.864 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.c] 2023-10-06T04:35:26.864 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.a] 2023-10-06T04:35:26.864 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.c] 2023-10-06T04:35:26.864 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.b] 2023-10-06T04:35:26.864 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.d] 2023-10-06T04:35:26.864 INFO:teuthology.orchestra.run.smithi008.stdout:[mds] 2023-10-06T04:35:26.865 INFO:teuthology.orchestra.run.smithi008.stdout: debug mds = 20 2023-10-06T04:35:26.865 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-10-06T04:35:26.865 INFO:teuthology.orchestra.run.smithi008.stdout: mds debug frag = True 2023-10-06T04:35:26.865 INFO:teuthology.orchestra.run.smithi008.stdout: mds debug scatterstat = True 2023-10-06T04:35:26.865 INFO:teuthology.orchestra.run.smithi008.stdout: mds op complaint time = 180 2023-10-06T04:35:26.865 INFO:teuthology.orchestra.run.smithi008.stdout: mds verify scatter = True 2023-10-06T04:35:26.865 INFO:teuthology.orchestra.run.smithi008.stdout: osd op complaint time = 180 2023-10-06T04:35:26.865 INFO:teuthology.orchestra.run.smithi008.stdout: rados mon op timeout = 900 2023-10-06T04:35:26.865 INFO:teuthology.orchestra.run.smithi008.stdout: rados osd op timeout = 900 2023-10-06T04:35:26.867 INFO:teuthology.orchestra.run.smithi184.stdout:[global] 2023-10-06T04:35:26.867 INFO:teuthology.orchestra.run.smithi184.stdout: chdir = "" 2023-10-06T04:35:26.867 INFO:teuthology.orchestra.run.smithi184.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T04:35:26.867 INFO:teuthology.orchestra.run.smithi184.stdout: auth supported = cephx 2023-10-06T04:35:26.868 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:35:26.868 INFO:teuthology.orchestra.run.smithi184.stdout: filestore xattr use omap = true 2023-10-06T04:35:26.868 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:35:26.868 INFO:teuthology.orchestra.run.smithi184.stdout: mon clock drift allowed = 1.000 2023-10-06T04:35:26.868 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:35:26.868 INFO:teuthology.orchestra.run.smithi184.stdout: osd crush chooseleaf type = 0 2023-10-06T04:35:26.868 INFO:teuthology.orchestra.run.smithi184.stdout: auth debug = true 2023-10-06T04:35:26.868 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:35:26.868 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on old message = true 2023-10-06T04:35:26.868 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on bug = true 2023-10-06T04:35:26.868 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:35:26.868 INFO:teuthology.orchestra.run.smithi184.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T04:35:26.869 INFO:teuthology.orchestra.run.smithi184.stdout: mon pg warn max object skew = 0 2023-10-06T04:35:26.869 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:35:26.869 INFO:teuthology.orchestra.run.smithi184.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T04:35:26.869 INFO:teuthology.orchestra.run.smithi184.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T04:35:26.869 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:35:26.869 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default size = 2 2023-10-06T04:35:26.869 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:35:26.869 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow primary affinity = true 2023-10-06T04:35:26.869 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow pg remap = true 2023-10-06T04:35:26.869 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on legacy crush tunables = false 2023-10-06T04:35:26.869 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on crush straw calc version zero = false 2023-10-06T04:35:26.869 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on no sortbitwise = false 2023-10-06T04:35:26.870 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on osd down out interval zero = false 2023-10-06T04:35:26.870 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on too few osds = false 2023-10-06T04:35:26.870 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T04:35:26.870 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T04:35:26.870 INFO:teuthology.orchestra.run.smithi184.stdout: mon_allow_pool_size_one = true 2023-10-06T04:35:26.870 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:35:26.870 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T04:35:26.870 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:35:26.870 INFO:teuthology.orchestra.run.smithi184.stdout: osd default data pool replay window = 5 2023-10-06T04:35:26.870 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:35:26.870 INFO:teuthology.orchestra.run.smithi184.stdout: mon allow pool delete = true 2023-10-06T04:35:26.871 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:35:26.871 INFO:teuthology.orchestra.run.smithi184.stdout: mon cluster log file level = debug 2023-10-06T04:35:26.871 INFO:teuthology.orchestra.run.smithi184.stdout: debug asserts on shutdown = true 2023-10-06T04:35:26.871 INFO:teuthology.orchestra.run.smithi184.stdout: mon health detail to clog = false 2023-10-06T04:35:26.871 INFO:teuthology.orchestra.run.smithi184.stdout: mon host = "172.21.15.8,172.21.15.184,[v2:172.21.15.184:3301,v1:172.21.15.184:6790]" 2023-10-06T04:35:26.871 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on skipped message = False 2023-10-06T04:35:26.871 INFO:teuthology.orchestra.run.smithi184.stdout: fsid = c030d94d-df8f-49bb-8df7-07e9e557d96b 2023-10-06T04:35:26.871 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:35:26.871 INFO:teuthology.orchestra.run.smithi184.stdout:[osd] 2023-10-06T04:35:26.871 INFO:teuthology.orchestra.run.smithi184.stdout: osd journal size = 100 2023-10-06T04:35:26.871 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:35:26.871 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub load threshold = 5.0 2023-10-06T04:35:26.871 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub max interval = 600 2023-10-06T04:35:26.872 INFO:teuthology.orchestra.run.smithi184.stdout: osd mclock profile = high_recovery_ops 2023-10-06T04:35:26.872 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:35:26.872 INFO:teuthology.orchestra.run.smithi184.stdout: osd recover clone overlap = true 2023-10-06T04:35:26.872 INFO:teuthology.orchestra.run.smithi184.stdout: osd recovery max chunk = 1048576 2023-10-06T04:35:26.872 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:35:26.872 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug shutdown = true 2023-10-06T04:35:26.872 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug op order = true 2023-10-06T04:35:26.872 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug verify stray on activate = true 2023-10-06T04:35:26.872 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:35:26.872 INFO:teuthology.orchestra.run.smithi184.stdout: osd open classes on start = true 2023-10-06T04:35:26.872 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug pg log writeout = true 2023-10-06T04:35:26.872 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:35:26.873 INFO:teuthology.orchestra.run.smithi184.stdout: osd deep scrub update digest min age = 30 2023-10-06T04:35:26.873 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:35:26.873 INFO:teuthology.orchestra.run.smithi184.stdout: osd map max advance = 10 2023-10-06T04:35:26.873 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:35:26.873 INFO:teuthology.orchestra.run.smithi184.stdout: journal zero on create = true 2023-10-06T04:35:26.873 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:35:26.873 INFO:teuthology.orchestra.run.smithi184.stdout: filestore ondisk finisher threads = 3 2023-10-06T04:35:26.873 INFO:teuthology.orchestra.run.smithi184.stdout: filestore apply finisher threads = 3 2023-10-06T04:35:26.873 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:35:26.873 INFO:teuthology.orchestra.run.smithi184.stdout: bdev debug aio = true 2023-10-06T04:35:26.873 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug misdirected ops = true 2023-10-06T04:35:26.873 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore block size = 96636764160 2023-10-06T04:35:26.874 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore fsck on mount = True 2023-10-06T04:35:26.874 INFO:teuthology.orchestra.run.smithi184.stdout: debug bluefs = 20 2023-10-06T04:35:26.874 INFO:teuthology.orchestra.run.smithi184.stdout: debug bluestore = 20 2023-10-06T04:35:26.874 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-10-06T04:35:26.874 INFO:teuthology.orchestra.run.smithi184.stdout: debug osd = 20 2023-10-06T04:35:26.874 INFO:teuthology.orchestra.run.smithi184.stdout: debug rocksdb = 10 2023-10-06T04:35:26.874 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T04:35:26.874 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd full ratio = 0.9 2023-10-06T04:35:26.874 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd nearfull ratio = 0.8 2023-10-06T04:35:26.874 INFO:teuthology.orchestra.run.smithi184.stdout: osd failsafe full ratio = 0.95 2023-10-06T04:35:26.874 INFO:teuthology.orchestra.run.smithi184.stdout: osd objectstore = bluestore 2023-10-06T04:35:26.874 INFO:teuthology.orchestra.run.smithi184.stdout: osd op complaint time = 180 2023-10-06T04:35:26.874 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:35:26.875 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr] 2023-10-06T04:35:26.875 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-10-06T04:35:26.875 INFO:teuthology.orchestra.run.smithi184.stdout: debug mgr = 20 2023-10-06T04:35:26.875 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2023-10-06T04:35:26.875 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2023-10-06T04:35:26.875 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2023-10-06T04:35:26.875 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2023-10-06T04:35:26.875 INFO:teuthology.orchestra.run.smithi184.stdout: mgr/telemetry/nag = false 2023-10-06T04:35:26.875 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:35:26.875 INFO:teuthology.orchestra.run.smithi184.stdout:[mon] 2023-10-06T04:35:26.875 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-10-06T04:35:26.875 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2023-10-06T04:35:26.876 INFO:teuthology.orchestra.run.smithi184.stdout: debug paxos = 20 2023-10-06T04:35:26.876 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2023-10-06T04:35:26.876 INFO:teuthology.orchestra.run.smithi184.stdout: mon data avail warn = 5 2023-10-06T04:35:26.876 INFO:teuthology.orchestra.run.smithi184.stdout: mon mgr mkfs grace = 240 2023-10-06T04:35:26.876 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2023-10-06T04:35:26.876 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd reporter subtree level = osd 2023-10-06T04:35:26.876 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd prime pg temp = true 2023-10-06T04:35:26.876 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2023-10-06T04:35:26.876 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:35:26.876 INFO:teuthology.orchestra.run.smithi184.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T04:35:26.876 INFO:teuthology.orchestra.run.smithi184.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T04:35:26.877 INFO:teuthology.orchestra.run.smithi184.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T04:35:26.877 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:35:26.877 INFO:teuthology.orchestra.run.smithi184.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T04:35:26.877 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T04:35:26.877 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T04:35:26.877 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:35:26.877 INFO:teuthology.orchestra.run.smithi184.stdout: # 1m isn't quite enough 2023-10-06T04:35:26.877 INFO:teuthology.orchestra.run.smithi184.stdout: mon_down_mkfs_grace = 2m 2023-10-06T04:35:26.877 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:35:26.877 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_filestore_osds = false 2023-10-06T04:35:26.877 INFO:teuthology.orchestra.run.smithi184.stdout: mon op complaint time = 120 2023-10-06T04:35:26.877 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:35:26.877 INFO:teuthology.orchestra.run.smithi184.stdout:[client] 2023-10-06T04:35:26.878 INFO:teuthology.orchestra.run.smithi184.stdout: rgw cache enabled = true 2023-10-06T04:35:26.878 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable ops log = true 2023-10-06T04:35:26.878 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable usage log = true 2023-10-06T04:35:26.878 INFO:teuthology.orchestra.run.smithi184.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T04:35:26.878 INFO:teuthology.orchestra.run.smithi184.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T04:35:26.878 INFO:teuthology.orchestra.run.smithi184.stdout: client mount timeout = 600 2023-10-06T04:35:26.878 INFO:teuthology.orchestra.run.smithi184.stdout: debug client = 20 2023-10-06T04:35:26.878 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-10-06T04:35:26.878 INFO:teuthology.orchestra.run.smithi184.stdout: pid file = "" 2023-10-06T04:35:26.878 INFO:teuthology.orchestra.run.smithi184.stdout: rados mon op timeout = 900 2023-10-06T04:35:26.878 INFO:teuthology.orchestra.run.smithi184.stdout: rados osd op timeout = 900 2023-10-06T04:35:26.879 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.a] 2023-10-06T04:35:26.879 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.b] 2023-10-06T04:35:26.879 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.c] 2023-10-06T04:35:26.879 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.a] 2023-10-06T04:35:26.879 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.c] 2023-10-06T04:35:26.879 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.b] 2023-10-06T04:35:26.879 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.d] 2023-10-06T04:35:26.879 INFO:teuthology.orchestra.run.smithi184.stdout:[mds] 2023-10-06T04:35:26.879 INFO:teuthology.orchestra.run.smithi184.stdout: debug mds = 20 2023-10-06T04:35:26.879 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-10-06T04:35:26.879 INFO:teuthology.orchestra.run.smithi184.stdout: mds debug frag = True 2023-10-06T04:35:26.879 INFO:teuthology.orchestra.run.smithi184.stdout: mds debug scatterstat = True 2023-10-06T04:35:26.880 INFO:teuthology.orchestra.run.smithi184.stdout: mds op complaint time = 180 2023-10-06T04:35:26.880 INFO:teuthology.orchestra.run.smithi184.stdout: mds verify scatter = True 2023-10-06T04:35:26.880 INFO:teuthology.orchestra.run.smithi184.stdout: osd op complaint time = 180 2023-10-06T04:35:26.880 INFO:teuthology.orchestra.run.smithi184.stdout: rados mon op timeout = 900 2023-10-06T04:35:26.880 INFO:teuthology.orchestra.run.smithi184.stdout: rados osd op timeout = 900 2023-10-06T04:35:26.880 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-06T04:35:26.880 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-06T04:35:26.959 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-06T04:35:26.959 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T04:35:26.960 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-06T04:35:26.974 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T04:35:26.974 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-06T04:35:27.029 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi008.front.sepia.ceph.com 2023-10-06T04:35:27.029 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T04:35:27.029 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T04:35:27.029 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T04:35:27.104 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T04:35:27.104 DEBUG:teuthology.orchestra.run.smithi008:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:35:27.159 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi184.front.sepia.ceph.com 2023-10-06T04:35:27.159 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-06T04:35:27.159 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T04:35:27.159 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T04:35:27.193 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-06T04:35:27.193 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:35:27.248 INFO:tasks.ceph:Setting up mon nodes... 2023-10-06T04:35:27.249 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-06T04:35:27.249 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T04:35:27.299 INFO:teuthology.orchestra.run.smithi008.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T04:35:27.301 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T04:35:27.399 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T04:35:27.401 INFO:tasks.ceph:Setting up mds nodes... 2023-10-06T04:35:27.401 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T04:35:27.450 INFO:teuthology.orchestra.run.smithi008.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T04:35:27.453 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-06T04:35:27.477 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T04:35:27.567 INFO:teuthology.orchestra.run.smithi008.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T04:35:27.569 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-06T04:35:27.595 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T04:35:27.643 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T04:35:27.645 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-06T04:35:27.669 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T04:35:27.757 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T04:35:27.760 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-06T04:35:27.784 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-06T04:35:27.784 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-06T04:35:27.823 INFO:teuthology.orchestra.run.smithi008.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-06T04:35:27.836 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-06T04:35:27.916 INFO:teuthology.orchestra.run.smithi008.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-06T04:35:27.928 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-06T04:35:27.965 INFO:teuthology.orchestra.run.smithi184.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-06T04:35:27.977 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-06T04:35:28.055 INFO:teuthology.orchestra.run.smithi184.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-06T04:35:28.067 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-06T04:35:28.068 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi008.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi184.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T04:35:28.068 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-06T04:35:28.093 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T04:35:28.093 INFO:tasks.ceph:role: osd.0 2023-10-06T04:35:28.093 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi008.front.sepia.ceph.com 2023-10-06T04:35:28.093 DEBUG:teuthology.orchestra.run.smithi008:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T04:35:28.158 INFO:teuthology.orchestra.run.smithi008.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:35:28.158 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:35:28.158 INFO:teuthology.orchestra.run.smithi008.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:35:28.158 INFO:teuthology.orchestra.run.smithi008.stdout: = reflink=1 2023-10-06T04:35:28.158 INFO:teuthology.orchestra.run.smithi008.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:35:28.158 INFO:teuthology.orchestra.run.smithi008.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:35:28.158 INFO:teuthology.orchestra.run.smithi008.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:35:28.158 INFO:teuthology.orchestra.run.smithi008.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:35:28.159 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:35:28.159 INFO:teuthology.orchestra.run.smithi008.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:35:28.180 INFO:teuthology.orchestra.run.smithi008.stdout:Discarding blocks...Done. 2023-10-06T04:35:28.182 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi008.front.sepia.ceph.com -o noatime 2023-10-06T04:35:28.182 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-06T04:35:28.260 DEBUG:teuthology.orchestra.run.smithi008:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-06T04:35:28.331 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-06T04:35:28.396 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T04:35:28.397 INFO:tasks.ceph:role: osd.1 2023-10-06T04:35:28.397 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi008.front.sepia.ceph.com 2023-10-06T04:35:28.397 DEBUG:teuthology.orchestra.run.smithi008:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T04:35:28.461 INFO:teuthology.orchestra.run.smithi008.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:35:28.461 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:35:28.461 INFO:teuthology.orchestra.run.smithi008.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:35:28.461 INFO:teuthology.orchestra.run.smithi008.stdout: = reflink=1 2023-10-06T04:35:28.462 INFO:teuthology.orchestra.run.smithi008.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:35:28.462 INFO:teuthology.orchestra.run.smithi008.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:35:28.462 INFO:teuthology.orchestra.run.smithi008.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:35:28.462 INFO:teuthology.orchestra.run.smithi008.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:35:28.462 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:35:28.462 INFO:teuthology.orchestra.run.smithi008.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:35:28.484 INFO:teuthology.orchestra.run.smithi008.stdout:Discarding blocks...Done. 2023-10-06T04:35:28.485 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi008.front.sepia.ceph.com -o noatime 2023-10-06T04:35:28.485 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-06T04:35:28.563 DEBUG:teuthology.orchestra.run.smithi008:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-06T04:35:28.632 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-06T04:35:28.697 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T04:35:28.697 INFO:tasks.ceph:role: osd.2 2023-10-06T04:35:28.697 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi008.front.sepia.ceph.com 2023-10-06T04:35:28.698 DEBUG:teuthology.orchestra.run.smithi008:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T04:35:28.762 INFO:teuthology.orchestra.run.smithi008.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:35:28.762 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:35:28.762 INFO:teuthology.orchestra.run.smithi008.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:35:28.762 INFO:teuthology.orchestra.run.smithi008.stdout: = reflink=1 2023-10-06T04:35:28.762 INFO:teuthology.orchestra.run.smithi008.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:35:28.762 INFO:teuthology.orchestra.run.smithi008.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:35:28.762 INFO:teuthology.orchestra.run.smithi008.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:35:28.763 INFO:teuthology.orchestra.run.smithi008.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:35:28.763 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:35:28.763 INFO:teuthology.orchestra.run.smithi008.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:35:28.785 INFO:teuthology.orchestra.run.smithi008.stdout:Discarding blocks...Done. 2023-10-06T04:35:28.787 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi008.front.sepia.ceph.com -o noatime 2023-10-06T04:35:28.787 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-06T04:35:28.864 DEBUG:teuthology.orchestra.run.smithi008:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-06T04:35:28.933 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-06T04:35:28.998 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T04:35:28.998 INFO:tasks.ceph:role: osd.3 2023-10-06T04:35:28.998 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi008.front.sepia.ceph.com 2023-10-06T04:35:28.999 DEBUG:teuthology.orchestra.run.smithi008:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T04:35:29.063 INFO:teuthology.orchestra.run.smithi008.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:35:29.063 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:35:29.063 INFO:teuthology.orchestra.run.smithi008.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:35:29.063 INFO:teuthology.orchestra.run.smithi008.stdout: = reflink=1 2023-10-06T04:35:29.063 INFO:teuthology.orchestra.run.smithi008.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:35:29.063 INFO:teuthology.orchestra.run.smithi008.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:35:29.063 INFO:teuthology.orchestra.run.smithi008.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:35:29.063 INFO:teuthology.orchestra.run.smithi008.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:35:29.063 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:35:29.064 INFO:teuthology.orchestra.run.smithi008.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:35:29.086 INFO:teuthology.orchestra.run.smithi008.stdout:Discarding blocks...Done. 2023-10-06T04:35:29.088 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi008.front.sepia.ceph.com -o noatime 2023-10-06T04:35:29.088 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-06T04:35:29.166 DEBUG:teuthology.orchestra.run.smithi008:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-06T04:35:29.235 DEBUG:teuthology.orchestra.run.smithi008:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:35:29.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:29.325+0000 7fa819555540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-06T04:35:29.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:29.325+0000 7fa819555540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-06T04:35:29.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:29.325+0000 7fa819555540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T04:35:29.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:29.325+0000 7fa819555540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T04:35:29.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:29.325+0000 7fa819555540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T04:35:29.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:29.325+0000 7fa819555540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-06T04:35:29.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:29.847+0000 7fa819555540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:35:30.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:30.615+0000 7fa819555540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:35:31.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:31.383+0000 7fa819555540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:35:32.179 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-06T04:35:32.209 DEBUG:teuthology.orchestra.run.smithi008:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:35:32.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:32.294+0000 7ffa1eaa7540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-06T04:35:32.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:32.294+0000 7ffa1eaa7540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-06T04:35:32.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:32.294+0000 7ffa1eaa7540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T04:35:32.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:32.294+0000 7ffa1eaa7540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T04:35:32.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:32.294+0000 7ffa1eaa7540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T04:35:32.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:32.295+0000 7ffa1eaa7540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-06T04:35:32.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:32.820+0000 7ffa1eaa7540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:35:33.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:33.584+0000 7ffa1eaa7540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:35:34.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:34.348+0000 7ffa1eaa7540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:35:35.142 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-06T04:35:35.171 DEBUG:teuthology.orchestra.run.smithi008:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:35:35.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:35.254+0000 7fee0618c540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-06T04:35:35.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:35.255+0000 7fee0618c540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-06T04:35:35.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:35.255+0000 7fee0618c540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T04:35:35.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:35.255+0000 7fee0618c540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T04:35:35.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:35.255+0000 7fee0618c540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T04:35:35.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:35.255+0000 7fee0618c540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-06T04:35:35.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:35.779+0000 7fee0618c540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:35:36.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:36.541+0000 7fee0618c540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:35:37.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:37.308+0000 7fee0618c540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:35:38.111 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-06T04:35:38.141 DEBUG:teuthology.orchestra.run.smithi008:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:35:38.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:38.227+0000 7fd021ba9540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-06T04:35:38.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:38.227+0000 7fd021ba9540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-06T04:35:38.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:38.227+0000 7fd021ba9540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T04:35:38.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:38.227+0000 7fd021ba9540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T04:35:38.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:38.227+0000 7fd021ba9540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T04:35:38.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:38.228+0000 7fd021ba9540 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-06T04:35:38.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:38.750+0000 7fd021ba9540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:35:39.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:39.519+0000 7fd021ba9540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:35:40.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:40.281+0000 7fd021ba9540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:35:41.084 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-06T04:35:41.114 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-06T04:35:41.146 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T04:35:41.146 INFO:tasks.ceph:role: osd.4 2023-10-06T04:35:41.146 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi184.front.sepia.ceph.com 2023-10-06T04:35:41.146 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T04:35:41.220 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:35:41.220 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:35:41.220 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:35:41.220 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 2023-10-06T04:35:41.221 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:35:41.221 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:35:41.221 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:35:41.221 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:35:41.221 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:35:41.221 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:35:41.650 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2023-10-06T04:35:41.651 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2023-10-06T04:35:41.652 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-06T04:35:41.838 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-06T04:35:41.872 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-06T04:35:41.939 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T04:35:41.940 INFO:tasks.ceph:role: osd.5 2023-10-06T04:35:41.940 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi184.front.sepia.ceph.com 2023-10-06T04:35:41.940 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T04:35:42.012 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:35:42.013 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:35:42.013 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:35:42.013 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 2023-10-06T04:35:42.013 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:35:42.013 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:35:42.013 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:35:42.013 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:35:42.013 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:35:42.013 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:35:42.438 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2023-10-06T04:35:42.440 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2023-10-06T04:35:42.440 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-06T04:35:42.552 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-06T04:35:42.582 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-06T04:35:42.648 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T04:35:42.649 INFO:tasks.ceph:role: osd.6 2023-10-06T04:35:42.649 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi184.front.sepia.ceph.com 2023-10-06T04:35:42.649 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T04:35:42.721 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:35:42.721 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:35:42.721 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:35:42.721 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 2023-10-06T04:35:42.722 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:35:42.722 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:35:42.722 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:35:42.722 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:35:42.722 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:35:42.722 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:35:43.173 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2023-10-06T04:35:43.175 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2023-10-06T04:35:43.175 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-06T04:35:43.340 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-06T04:35:43.369 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-06T04:35:43.435 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T04:35:43.435 INFO:tasks.ceph:role: osd.7 2023-10-06T04:35:43.435 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi184.front.sepia.ceph.com 2023-10-06T04:35:43.435 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T04:35:43.506 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:35:43.506 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:35:43.507 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:35:43.507 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 2023-10-06T04:35:43.507 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:35:43.507 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:35:43.507 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:35:43.507 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:35:43.507 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:35:43.507 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:35:43.958 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2023-10-06T04:35:43.959 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2023-10-06T04:35:43.960 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-06T04:35:44.145 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-06T04:35:44.175 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:35:44.270 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:44.267+0000 7f5bf5f4d540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-06T04:35:44.270 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:44.267+0000 7f5bf5f4d540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-06T04:35:44.270 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:44.268+0000 7f5bf5f4d540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T04:35:44.271 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:44.268+0000 7f5bf5f4d540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T04:35:44.271 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:44.268+0000 7f5bf5f4d540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T04:35:44.271 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:44.268+0000 7f5bf5f4d540 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-06T04:35:44.793 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:44.792+0000 7f5bf5f4d540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:35:45.565 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:45.564+0000 7f5bf5f4d540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:35:46.329 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:46.327+0000 7f5bf5f4d540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:35:47.123 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-06T04:35:47.149 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:35:47.230 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:47.228+0000 7f4f4508e540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-06T04:35:47.230 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:47.228+0000 7f4f4508e540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-06T04:35:47.230 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:47.228+0000 7f4f4508e540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T04:35:47.231 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:47.228+0000 7f4f4508e540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T04:35:47.231 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:47.228+0000 7f4f4508e540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T04:35:47.231 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:47.229+0000 7f4f4508e540 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-06T04:35:47.751 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:47.750+0000 7f4f4508e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:35:48.519 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:48.517+0000 7f4f4508e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:35:49.281 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:49.279+0000 7f4f4508e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:35:50.077 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-06T04:35:50.143 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:35:50.225 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:50.223+0000 7f4dbb774540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-06T04:35:50.226 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:50.223+0000 7f4dbb774540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-06T04:35:50.226 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:50.223+0000 7f4dbb774540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T04:35:50.226 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:50.223+0000 7f4dbb774540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T04:35:50.226 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:50.223+0000 7f4dbb774540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T04:35:50.226 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:50.224+0000 7f4dbb774540 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-06T04:35:50.753 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:50.751+0000 7f4dbb774540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:35:51.517 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:51.516+0000 7f4dbb774540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:35:52.282 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:52.280+0000 7f4dbb774540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:35:53.083 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-06T04:35:53.151 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:35:53.237 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:53.235+0000 7f16f8a05540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-06T04:35:53.237 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:53.235+0000 7f16f8a05540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-06T04:35:53.237 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:53.235+0000 7f16f8a05540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T04:35:53.238 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:53.235+0000 7f16f8a05540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T04:35:53.238 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:53.235+0000 7f16f8a05540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T04:35:53.238 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:53.236+0000 7f16f8a05540 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-06T04:35:53.760 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:53.759+0000 7f16f8a05540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:35:54.527 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:54.526+0000 7f16f8a05540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:35:54.847 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:35:54.849 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:35:55.296 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:55.294+0000 7f16f8a05540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:35:56.091 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-06T04:35:56.115 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-06T04:35:56.116 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T04:35:56.116 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-06T04:35:56.145 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T04:35:56.146 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-06T04:35:56.213 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T04:35:56.213 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-06T04:35:56.280 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T04:35:56.280 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-06T04:35:56.347 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T04:35:56.347 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-06T04:35:56.414 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T04:35:56.414 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-06T04:35:56.480 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T04:35:56.481 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-06T04:35:56.546 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-06T04:35:56.546 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-06T04:35:56.572 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-06T04:35:56.572 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-06T04:35:56.636 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-06T04:35:56.636 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-06T04:35:56.701 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-06T04:35:56.701 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-06T04:35:56.765 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-06T04:35:56.765 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-06T04:35:56.828 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-06T04:35:56.829 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-06T04:35:56.893 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-06T04:35:56.893 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-06T04:35:56.956 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T04:35:56.957 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-06T04:35:56.973 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T04:35:56.973 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-06T04:35:57.029 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-06T04:35:57.029 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-06T04:35:57.043 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-06T04:35:57.044 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-06T04:35:57.098 INFO:tasks.ceph:Adding keys to all mons... 2023-10-06T04:35:57.098 DEBUG:teuthology.orchestra.run.smithi008:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T04:35:57.100 DEBUG:teuthology.orchestra.run.smithi184:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T04:35:57.141 INFO:teuthology.orchestra.run.smithi008.stdout:[mgr.y] 2023-10-06T04:35:57.142 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQCPjh9lZcvGERAAEw4HpYi6rEPbqrUJ63cQnA== 2023-10-06T04:35:57.142 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.a] 2023-10-06T04:35:57.142 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQCPjh9lfxDVGhAAODog98R5tHChtpDsRajf1g== 2023-10-06T04:35:57.142 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.c] 2023-10-06T04:35:57.142 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQCPjh9lMTTJIRAAZ5OosgG6Ww0R1XRro3FxoA== 2023-10-06T04:35:57.142 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.0] 2023-10-06T04:35:57.142 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQCRjh9lR6N8ExAA8eR08nn3J8yjx/qt/AC0MA== 2023-10-06T04:35:57.142 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.1] 2023-10-06T04:35:57.142 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQCUjh9lEw6WERAAw/XfcuFzx2KI/WSftn3RWA== 2023-10-06T04:35:57.142 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.2] 2023-10-06T04:35:57.143 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQCXjh9lr4Y6DxAAhWgijTbLQ6RIpa9ExGCFog== 2023-10-06T04:35:57.143 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.3] 2023-10-06T04:35:57.143 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQCajh9l6E6XDRAAkQODaPiSIQrAIoL8QfdfuA== 2023-10-06T04:35:57.143 INFO:teuthology.orchestra.run.smithi008.stdout:[mgr.x] 2023-10-06T04:35:57.143 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQCPjh9lDK28FxAA5hiKYO0UOBRgw7NFYyT3Fw== 2023-10-06T04:35:57.143 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.b] 2023-10-06T04:35:57.143 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQCPjh9lQvlKJhAAsJLmIIv6+2au3kPZENPiAw== 2023-10-06T04:35:57.143 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.d] 2023-10-06T04:35:57.143 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQCPjh9lXIYfLRAA+LYE9GjH4oZ2NueRZ4mbqw== 2023-10-06T04:35:57.143 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.4] 2023-10-06T04:35:57.143 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQCgjh9l68gEEBAAK9gsPRVukBGYujgwDrtI8Q== 2023-10-06T04:35:57.143 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.5] 2023-10-06T04:35:57.144 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQCjjh9lNa6qDRAAw4zSAfovCeD+eqNOGdj9fg== 2023-10-06T04:35:57.144 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.6] 2023-10-06T04:35:57.144 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQCmjh9lD31iDRAAerwV4nm8w7d8HFZt6LPmaA== 2023-10-06T04:35:57.144 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.7] 2023-10-06T04:35:57.144 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQCpjh9lyeQWDhAAdeVKxkbrLG13moJjKYX1vg== 2023-10-06T04:35:57.144 INFO:teuthology.orchestra.run.smithi008.stdout:[client.0] 2023-10-06T04:35:57.144 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQCPjh9lYOgNMRAA1PcvEPICqihYp7CmFpiL6g== 2023-10-06T04:35:57.144 INFO:teuthology.orchestra.run.smithi008.stdout:[client.2] 2023-10-06T04:35:57.144 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQCPjh9lLzp/NhAAbK1IxMay7cuKrtXTPc87Ng== 2023-10-06T04:35:57.144 INFO:teuthology.orchestra.run.smithi008.stdout:[client.1] 2023-10-06T04:35:57.144 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQCPjh9lt0+AORAAlUw/v+lWpy9FSAmDcSf/HA== 2023-10-06T04:35:57.144 INFO:teuthology.orchestra.run.smithi008.stdout:[client.3] 2023-10-06T04:35:57.145 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQCQjh9l+Mw/AxAA1CRME0TJ/uUeg6rskqD09A== 2023-10-06T04:35:57.161 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr.y] 2023-10-06T04:35:57.161 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQCPjh9lZcvGERAAEw4HpYi6rEPbqrUJ63cQnA== 2023-10-06T04:35:57.161 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.a] 2023-10-06T04:35:57.161 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQCPjh9lfxDVGhAAODog98R5tHChtpDsRajf1g== 2023-10-06T04:35:57.161 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.c] 2023-10-06T04:35:57.161 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQCPjh9lMTTJIRAAZ5OosgG6Ww0R1XRro3FxoA== 2023-10-06T04:35:57.161 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.0] 2023-10-06T04:35:57.161 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQCRjh9lR6N8ExAA8eR08nn3J8yjx/qt/AC0MA== 2023-10-06T04:35:57.161 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.1] 2023-10-06T04:35:57.161 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQCUjh9lEw6WERAAw/XfcuFzx2KI/WSftn3RWA== 2023-10-06T04:35:57.162 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.2] 2023-10-06T04:35:57.162 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQCXjh9lr4Y6DxAAhWgijTbLQ6RIpa9ExGCFog== 2023-10-06T04:35:57.162 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.3] 2023-10-06T04:35:57.162 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQCajh9l6E6XDRAAkQODaPiSIQrAIoL8QfdfuA== 2023-10-06T04:35:57.162 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr.x] 2023-10-06T04:35:57.162 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQCPjh9lDK28FxAA5hiKYO0UOBRgw7NFYyT3Fw== 2023-10-06T04:35:57.162 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.b] 2023-10-06T04:35:57.162 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQCPjh9lQvlKJhAAsJLmIIv6+2au3kPZENPiAw== 2023-10-06T04:35:57.162 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.d] 2023-10-06T04:35:57.162 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQCPjh9lXIYfLRAA+LYE9GjH4oZ2NueRZ4mbqw== 2023-10-06T04:35:57.162 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.4] 2023-10-06T04:35:57.163 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQCgjh9l68gEEBAAK9gsPRVukBGYujgwDrtI8Q== 2023-10-06T04:35:57.163 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.5] 2023-10-06T04:35:57.163 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQCjjh9lNa6qDRAAw4zSAfovCeD+eqNOGdj9fg== 2023-10-06T04:35:57.163 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.6] 2023-10-06T04:35:57.163 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQCmjh9lD31iDRAAerwV4nm8w7d8HFZt6LPmaA== 2023-10-06T04:35:57.163 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.7] 2023-10-06T04:35:57.163 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQCpjh9lyeQWDhAAdeVKxkbrLG13moJjKYX1vg== 2023-10-06T04:35:57.163 INFO:teuthology.orchestra.run.smithi184.stdout:[client.0] 2023-10-06T04:35:57.163 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQCPjh9lYOgNMRAA1PcvEPICqihYp7CmFpiL6g== 2023-10-06T04:35:57.163 INFO:teuthology.orchestra.run.smithi184.stdout:[client.2] 2023-10-06T04:35:57.163 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQCPjh9lLzp/NhAAbK1IxMay7cuKrtXTPc87Ng== 2023-10-06T04:35:57.163 INFO:teuthology.orchestra.run.smithi184.stdout:[client.1] 2023-10-06T04:35:57.164 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQCPjh9lt0+AORAAlUw/v+lWpy9FSAmDcSf/HA== 2023-10-06T04:35:57.164 INFO:teuthology.orchestra.run.smithi184.stdout:[client.3] 2023-10-06T04:35:57.164 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQCQjh9l+Mw/AxAA1CRME0TJ/uUeg6rskqD09A== 2023-10-06T04:35:57.165 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T04:35:57.189 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T04:35:57.252 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:35:57.255 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:35:57.305 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:35:57.308 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:35:57.358 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:35:57.360 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:35:57.408 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:35:57.411 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:35:57.462 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:35:57.469 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:35:57.518 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:35:57.522 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:35:57.574 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T04:35:57.576 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T04:35:57.624 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:35:57.627 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:35:57.679 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:35:57.681 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:35:57.731 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:35:57.733 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:35:57.780 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:35:57.782 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:35:57.830 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:35:57.832 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:35:57.880 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:35:57.882 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:35:57.929 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:35:57.931 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:35:57.982 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:35:57.984 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:35:58.034 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:35:58.036 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:35:58.087 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:35:58.089 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:35:58.139 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-06T04:35:58.139 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-06T04:35:58.165 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T04:35:58.257 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-06T04:35:58.282 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-06T04:35:58.307 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T04:35:58.398 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-06T04:35:58.422 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-06T04:35:58.487 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T04:35:58.578 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-06T04:35:58.602 DEBUG:teuthology.orchestra.run.smithi008:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:35:58.604 DEBUG:teuthology.orchestra.run.smithi184:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:35:58.657 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-06T04:35:58.657 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-06T04:35:58.657 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-06T04:35:58.661 INFO:tasks.ceph.mon.a:Started 2023-10-06T04:35:58.661 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-06T04:35:58.661 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-06T04:35:58.699 INFO:tasks.ceph.mon.b:Started 2023-10-06T04:35:58.699 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-06T04:35:58.699 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-06T04:35:58.701 INFO:tasks.ceph.mon.c:Started 2023-10-06T04:35:58.701 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-06T04:35:58.702 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-06T04:35:58.702 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-06T04:35:58.705 INFO:tasks.ceph.mgr.y:Started 2023-10-06T04:35:58.705 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-06T04:35:58.705 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-06T04:35:58.707 INFO:tasks.ceph.mgr.x:Started 2023-10-06T04:35:58.707 INFO:tasks.ceph:Setting crush tunables to default 2023-10-06T04:35:58.707 DEBUG:teuthology.orchestra.run.smithi008:> sudo ceph --cluster ceph osd crush tunables default 2023-10-06T04:35:58.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:58.827+0000 7f09f96af700 1 Processor -- start 2023-10-06T04:35:58.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:58.827+0000 7f09f96af700 1 -- start start 2023-10-06T04:35:58.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:58.828+0000 7f09f96af700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f09f4142cf0 0x7f09f40b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:35:58.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:58.828+0000 7f09f96af700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f40cf510 con 0x7f09f40b3790 2023-10-06T04:35:58.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:58.828+0000 7f09f96af700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f40ce6a0 con 0x7f09f41430c0 2023-10-06T04:35:58.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:58.828+0000 7f09f96af700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f40ce900 con 0x7f09f4142cf0 2023-10-06T04:35:58.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:58.828+0000 7f09f2ffd700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f09f4142cf0 0x7f09f40b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:35:58.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:58.828+0000 7f09f37fe700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f09f40b3790 0x7f09f40d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:56278/0 (socket says 172.21.15.8:56278) 2023-10-06T04:35:58.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:58.828+0000 7f09f2ffd700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f09f4142cf0 0x7f09f40b5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39414/0 (socket says 172.21.15.8:39414) 2023-10-06T04:35:58.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:58.828+0000 7f09f37fe700 1 -- 172.21.15.8:0/523900768 learned_addr learned my addr 172.21.15.8:0/523900768 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:35:58.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:58.828+0000 7f09f2ffd700 1 -- 172.21.15.8:0/523900768 >> v2:172.21.15.8:3300/0 conn(0x7f09f4142cf0 msgr2=0x7f09f40b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T04:35:58.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:58.828+0000 7f09f2ffd700 1 -- 172.21.15.8:0/523900768 >> v2:172.21.15.8:3300/0 conn(0x7f09f4142cf0 msgr2=0x7f09f40b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T04:35:58.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:58.828+0000 7f09f2ffd700 1 --2- 172.21.15.8:0/523900768 >> v2:172.21.15.8:3300/0 conn(0x7f09f4142cf0 0x7f09f40b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T04:35:58.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:58.828+0000 7f09f2ffd700 1 --2- 172.21.15.8:0/523900768 >> v2:172.21.15.8:3300/0 conn(0x7f09f4142cf0 0x7f09f40b5cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T04:35:59.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.003+0000 7f09f1ffb700 1 -- 172.21.15.8:0/523900768 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2068195472 0 0) 0x7f09f40cf510 con 0x7f09f40b3790 2023-10-06T04:35:59.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.003+0000 7f09f1ffb700 1 -- 172.21.15.8:0/523900768 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09e0003570 con 0x7f09f40b3790 2023-10-06T04:35:59.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.004+0000 7f09f1ffb700 1 -- 172.21.15.8:0/523900768 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2464322745 0 0) 0x7f09e0003570 con 0x7f09f40b3790 2023-10-06T04:35:59.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.004+0000 7f09f1ffb700 1 -- 172.21.15.8:0/523900768 >> v2:172.21.15.8:3300/0 conn(0x7f09f4142cf0 msgr2=0x7f09f40b5cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:35:59.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.004+0000 7f09f1ffb700 1 --2- 172.21.15.8:0/523900768 >> v2:172.21.15.8:3300/0 conn(0x7f09f4142cf0 0x7f09f40b5cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:35:59.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.004+0000 7f09f1ffb700 1 -- 172.21.15.8:0/523900768 >> v1:172.21.15.184:6789/0 conn(0x7f09f41430c0 legacy=0x7f09f40cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:35:59.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.004+0000 7f09f1ffb700 1 -- 172.21.15.8:0/523900768 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f40cebe0 con 0x7f09f40b3790 2023-10-06T04:35:59.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.004+0000 7f09f1ffb700 1 -- 172.21.15.8:0/523900768 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7f09ec0017f0 con 0x7f09f40b3790 2023-10-06T04:35:59.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.004+0000 7f09f1ffb700 1 -- 172.21.15.8:0/523900768 >> v1:172.21.15.8:6789/0 conn(0x7f09f40b3790 legacy=0x7f09f40d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:35:59.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.004+0000 7f09f1ffb700 1 --2- 172.21.15.8:0/523900768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09e0003a60 0x7f09e0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:35:59.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.004+0000 7f09f1ffb700 1 --2- 172.21.15.8:0/523900768 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f09e0004810 0x7f09e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:35:59.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.004+0000 7f09f1ffb700 1 --2- 172.21.15.8:0/523900768 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09e00052e0 0x7f09e000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:35:59.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.004+0000 7f09f1ffb700 1 -- 172.21.15.8:0/523900768 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f40ce900 con 0x7f09e0003a60 2023-10-06T04:35:59.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.004+0000 7f09f1ffb700 1 -- 172.21.15.8:0/523900768 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e000c190 con 0x7f09e00052e0 2023-10-06T04:35:59.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.004+0000 7f09f1ffb700 1 -- 172.21.15.8:0/523900768 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e000c350 con 0x7f09e0004810 2023-10-06T04:35:59.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.004+0000 7f09f2ffd700 1 --2- 172.21.15.8:0/523900768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09e0003a60 0x7f09e0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:35:59.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.005+0000 7f09f37fe700 1 --2- 172.21.15.8:0/523900768 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09e00052e0 0x7f09e000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:35:59.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.005+0000 7f09f27fc700 1 --2- 172.21.15.8:0/523900768 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f09e0004810 0x7f09e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:35:59.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.005+0000 7f09f2ffd700 1 -- 172.21.15.8:0/523900768 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f09e0004810 msgr2=0x7f09e0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:35:59.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.005+0000 7f09f2ffd700 1 --2- 172.21.15.8:0/523900768 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f09e0004810 0x7f09e0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:35:59.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.005+0000 7f09f2ffd700 1 -- 172.21.15.8:0/523900768 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09e00052e0 msgr2=0x7f09e000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:35:59.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.005+0000 7f09f2ffd700 1 --2- 172.21.15.8:0/523900768 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09e00052e0 0x7f09e000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:35:59.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.005+0000 7f09f37fe700 1 -- 172.21.15.8:0/523900768 reap_dead start 2023-10-06T04:35:59.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.005+0000 7f09f2ffd700 1 -- 172.21.15.8:0/523900768 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e0003570 con 0x7f09e0003a60 2023-10-06T04:35:59.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.005+0000 7f09f2ffd700 1 --2- 172.21.15.8:0/523900768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09e0003a60 0x7f09e0003e70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f09e400bb40 tx=0x7f09e4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f466963d266e4b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:35:59.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.005+0000 7f09f1ffb700 1 -- 172.21.15.8:0/523900768 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e4018070 con 0x7f09e0003a60 2023-10-06T04:35:59.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.005+0000 7f09f1ffb700 1 -- 172.21.15.8:0/523900768 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e400d5d0 con 0x7f09e0003a60 2023-10-06T04:35:59.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.005+0000 7f09f1ffb700 1 -- 172.21.15.8:0/523900768 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e400d990 con 0x7f09e0003a60 2023-10-06T04:35:59.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.006+0000 7f09f96af700 1 -- 172.21.15.8:0/523900768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09e0003a60 msgr2=0x7f09e0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:35:59.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.006+0000 7f09f96af700 1 --2- 172.21.15.8:0/523900768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09e0003a60 0x7f09e0003e70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f09e400bb40 tx=0x7f09e4008040 comp rx=0 tx=0).stop 2023-10-06T04:35:59.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.006+0000 7f09f96af700 1 -- 172.21.15.8:0/523900768 shutdown_connections 2023-10-06T04:35:59.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.006+0000 7f09f96af700 1 --2- 172.21.15.8:0/523900768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09e0003a60 0x7f09e0003e70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:35:59.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.006+0000 7f09f96af700 1 -- 172.21.15.8:0/523900768 >> 172.21.15.8:0/523900768 conn(0x7f09f406ed00 msgr2=0x7f09f406f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:35:59.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.006+0000 7f09f96af700 1 -- 172.21.15.8:0/523900768 shutdown_connections 2023-10-06T04:35:59.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.006+0000 7f09f96af700 1 -- 172.21.15.8:0/523900768 wait complete. 2023-10-06T04:35:59.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.007+0000 7f09f96af700 1 Processor -- start 2023-10-06T04:35:59.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.007+0000 7f09f96af700 1 -- start start 2023-10-06T04:35:59.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.008+0000 7f09f96af700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09e0003a60 0x7f09f413eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:35:59.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.008+0000 7f09f96af700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09f413f3f0 0x7f09f4169550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:35:59.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.008+0000 7f09f96af700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f09f4169a90 0x7f09f4169f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:35:59.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.008+0000 7f09f96af700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f416a450 con 0x7f09e0003a60 2023-10-06T04:35:59.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.008+0000 7f09f96af700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f413fb70 con 0x7f09f413f3f0 2023-10-06T04:35:59.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.008+0000 7f09f96af700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f413fe50 con 0x7f09f4169a90 2023-10-06T04:35:59.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.008+0000 7f09f2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09e0003a60 0x7f09f413eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:35:59.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.008+0000 7f09f2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09e0003a60 0x7f09f413eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39432/0 (socket says 172.21.15.8:39432) 2023-10-06T04:35:59.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.008+0000 7f09f2ffd700 1 -- 172.21.15.8:0/196826999 learned_addr learned my addr 172.21.15.8:0/196826999 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:35:59.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.008+0000 7f09f27fc700 1 --2- 172.21.15.8:0/196826999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09f413f3f0 0x7f09f4169550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:35:59.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.008+0000 7f09f37fe700 1 --2- 172.21.15.8:0/196826999 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f09f4169a90 0x7f09f4169f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:35:59.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.008+0000 7f09f2ffd700 1 -- 172.21.15.8:0/196826999 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f09f4169a90 msgr2=0x7f09f4169f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:35:59.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.008+0000 7f09f2ffd700 1 --2- 172.21.15.8:0/196826999 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f09f4169a90 0x7f09f4169f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:35:59.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.009+0000 7f09f2ffd700 1 -- 172.21.15.8:0/196826999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09f413f3f0 msgr2=0x7f09f4169550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:35:59.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.009+0000 7f09f2ffd700 1 --2- 172.21.15.8:0/196826999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09f413f3f0 0x7f09f4169550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:35:59.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.009+0000 7f09f2ffd700 1 -- 172.21.15.8:0/196826999 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f4140130 con 0x7f09e0003a60 2023-10-06T04:35:59.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.009+0000 7f09f2ffd700 1 --2- 172.21.15.8:0/196826999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09e0003a60 0x7f09f413eeb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f09e400d440 tx=0x7f09e401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:35:59.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.010+0000 7f09eaffd700 1 -- 172.21.15.8:0/196826999 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e401f640 con 0x7f09e0003a60 2023-10-06T04:35:59.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.010+0000 7f09eaffd700 1 -- 172.21.15.8:0/196826999 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e401f7c0 con 0x7f09e0003a60 2023-10-06T04:35:59.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.010+0000 7f09f96af700 1 -- 172.21.15.8:0/196826999 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f4140410 con 0x7f09e0003a60 2023-10-06T04:35:59.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.010+0000 7f09eaffd700 1 -- 172.21.15.8:0/196826999 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e401fb80 con 0x7f09e0003a60 2023-10-06T04:35:59.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.010+0000 7f09f96af700 1 -- 172.21.15.8:0/196826999 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f41422b0 con 0x7f09e0003a60 2023-10-06T04:35:59.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.010+0000 7f09eaffd700 1 -- 172.21.15.8:0/196826999 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f09e40146b0 con 0x7f09e0003a60 2023-10-06T04:35:59.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.010+0000 7f09eaffd700 1 -- 172.21.15.8:0/196826999 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f09e4027750 con 0x7f09e0003a60 2023-10-06T04:35:59.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.011+0000 7f09f96af700 1 -- 172.21.15.8:0/196826999 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f4140650 con 0x7f09e0003a60 2023-10-06T04:35:59.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.013+0000 7f09eaffd700 1 -- 172.21.15.8:0/196826999 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f09e40466d0 con 0x7f09e0003a60 2023-10-06T04:35:59.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.090+0000 7f09f96af700 1 -- 172.21.15.8:0/196826999 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f09f4071550 con 0x7f09e0003a60 2023-10-06T04:35:59.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.093+0000 7f09eaffd700 1 -- 172.21.15.8:0/196826999 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f09e4035020 con 0x7f09e0003a60 2023-10-06T04:35:59.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.094+0000 7f09f96af700 1 -- 172.21.15.8:0/196826999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09e0003a60 msgr2=0x7f09f413eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:35:59.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.094+0000 7f09f96af700 1 --2- 172.21.15.8:0/196826999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09e0003a60 0x7f09f413eeb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f09e400d440 tx=0x7f09e401a000 comp rx=0 tx=0).stop 2023-10-06T04:35:59.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.094+0000 7f09f96af700 1 -- 172.21.15.8:0/196826999 shutdown_connections 2023-10-06T04:35:59.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.094+0000 7f09f96af700 1 --2- 172.21.15.8:0/196826999 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f09f4169a90 0x7f09f4169f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:35:59.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.094+0000 7f09f96af700 1 --2- 172.21.15.8:0/196826999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09e0003a60 0x7f09f413eeb0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:35:59.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.094+0000 7f09f96af700 1 --2- 172.21.15.8:0/196826999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09f413f3f0 0x7f09f4169550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:35:59.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.094+0000 7f09f96af700 1 -- 172.21.15.8:0/196826999 >> 172.21.15.8:0/196826999 conn(0x7f09f406ed00 msgr2=0x7f09f40b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:35:59.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.095+0000 7f09f96af700 1 -- 172.21.15.8:0/196826999 shutdown_connections 2023-10-06T04:35:59.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:35:59.095+0000 7f09f96af700 1 -- 172.21.15.8:0/196826999 wait complete. 2023-10-06T04:35:59.098 INFO:teuthology.orchestra.run.smithi008.stderr:adjusted tunables profile to default 2023-10-06T04:35:59.112 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-06T04:35:59.112 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T04:35:59.112 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-06T04:35:59.137 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T04:35:59.138 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-06T04:35:59.202 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T04:35:59.202 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-06T04:35:59.267 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T04:35:59.267 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-06T04:35:59.332 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-06T04:35:59.333 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-06T04:35:59.358 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-06T04:35:59.358 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-06T04:35:59.422 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-06T04:35:59.422 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-06T04:35:59.487 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-06T04:35:59.487 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-06T04:35:59.551 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new cc70f2a2-57bf-4613-b938-0d6f75fa57db 0 2023-10-06T04:35:59.707 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.705+0000 7fa11985f700 1 Processor -- start 2023-10-06T04:35:59.707 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.705+0000 7fa11985f700 1 -- start start 2023-10-06T04:35:59.709 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.705+0000 7fa11985f700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa1141430c0 0x7fa1140cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:35:59.709 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.705+0000 7fa11985f700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa1140cfee0 0x7fa1140b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:35:59.709 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.705+0000 7fa11985f700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1140cf510 con 0x7fa114142cf0 2023-10-06T04:35:59.709 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.705+0000 7fa11985f700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1140ce6a0 con 0x7fa1141430c0 2023-10-06T04:35:59.709 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.705+0000 7fa11985f700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1140ce900 con 0x7fa1140cfee0 2023-10-06T04:35:59.709 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.706+0000 7fa1137fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa1140cfee0 0x7fa1140b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:35:59.709 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.706+0000 7fa1137fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa1140cfee0 0x7fa1140b3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:42550/0 (socket says 172.21.15.184:42550) 2023-10-06T04:35:59.710 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.706+0000 7fa1137fe700 1 -- 172.21.15.184:0/2911596731 learned_addr learned my addr 172.21.15.184:0/2911596731 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-10-06T04:35:59.710 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.706+0000 7fa1127fc700 1 --2- 172.21.15.184:0/2911596731 >> v2:172.21.15.8:3300/0 conn(0x7fa1141430c0 0x7fa1140cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:35:59.710 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.706+0000 7fa1137fe700 1 -- 172.21.15.184:0/2911596731 >> v2:172.21.15.8:3300/0 conn(0x7fa1141430c0 msgr2=0x7fa1140cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:35:59.710 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.706+0000 7fa1137fe700 1 --2- 172.21.15.184:0/2911596731 >> v2:172.21.15.8:3300/0 conn(0x7fa1141430c0 0x7fa1140cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:35:59.710 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.706+0000 7fa1137fe700 1 -- 172.21.15.184:0/2911596731 >> v1:172.21.15.8:6789/0 conn(0x7fa114142cf0 legacy=0x7fa1140b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:35:59.710 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.706+0000 7fa1137fe700 1 -- 172.21.15.184:0/2911596731 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1140cebe0 con 0x7fa1140cfee0 2023-10-06T04:35:59.710 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.706+0000 7fa1137fe700 1 --2- 172.21.15.184:0/2911596731 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1140cfee0 0x7fa1140b3790 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa1140afa30 tx=0x7fa10c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72915cb88078f498 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:35:59.710 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.706+0000 7fa111ffb700 1 -- 172.21.15.184:0/2911596731 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10c00e070 con 0x7fa1140cfee0 2023-10-06T04:35:59.710 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.706+0000 7fa111ffb700 1 -- 172.21.15.184:0/2911596731 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10c00ba20 con 0x7fa1140cfee0 2023-10-06T04:35:59.710 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.706+0000 7fa111ffb700 1 -- 172.21.15.184:0/2911596731 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10c0092e0 con 0x7fa1140cfee0 2023-10-06T04:35:59.710 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.707+0000 7fa11985f700 1 -- 172.21.15.184:0/2911596731 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1140cfee0 msgr2=0x7fa1140b3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:35:59.711 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.707+0000 7fa11985f700 1 --2- 172.21.15.184:0/2911596731 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1140cfee0 0x7fa1140b3790 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa1140afa30 tx=0x7fa10c009840 comp rx=0 tx=0).stop 2023-10-06T04:35:59.711 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.707+0000 7fa11985f700 1 -- 172.21.15.184:0/2911596731 shutdown_connections 2023-10-06T04:35:59.711 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.707+0000 7fa11985f700 1 --2- 172.21.15.184:0/2911596731 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1140cfee0 0x7fa1140b3790 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:35:59.711 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.707+0000 7fa11985f700 1 --2- 172.21.15.184:0/2911596731 >> v2:172.21.15.8:3300/0 conn(0x7fa1141430c0 0x7fa1140cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:35:59.711 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.707+0000 7fa11985f700 1 -- 172.21.15.184:0/2911596731 >> 172.21.15.184:0/2911596731 conn(0x7fa11406ed00 msgr2=0x7fa11406f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:35:59.711 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.707+0000 7fa11985f700 1 -- 172.21.15.184:0/2911596731 shutdown_connections 2023-10-06T04:35:59.711 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.707+0000 7fa11985f700 1 -- 172.21.15.184:0/2911596731 wait complete. 2023-10-06T04:35:59.713 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.708+0000 7fa11985f700 1 Processor -- start 2023-10-06T04:35:59.713 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.708+0000 7fa11985f700 1 -- start start 2023-10-06T04:35:59.713 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.709+0000 7fa11985f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1140cfee0 0x7fa114159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:35:59.713 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.709+0000 7fa11985f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa114142cf0 0x7fa1141589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:35:59.714 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.709+0000 7fa11985f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa1141430c0 0x7fa11415c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:35:59.714 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.709+0000 7fa11985f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa114158f10 con 0x7fa114142cf0 2023-10-06T04:35:59.714 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.709+0000 7fa11985f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11415baa0 con 0x7fa1140cfee0 2023-10-06T04:35:59.714 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.709+0000 7fa11985f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa11415cc60 con 0x7fa1141430c0 2023-10-06T04:35:59.714 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.709+0000 7fa1137fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa1141430c0 0x7fa11415c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:35:59.714 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.709+0000 7fa112ffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1140cfee0 0x7fa114159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:35:59.714 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.709+0000 7fa1137fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa1141430c0 0x7fa11415c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:59312/0 (socket says 172.21.15.184:59312) 2023-10-06T04:35:59.714 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.709+0000 7fa1137fe700 1 -- 172.21.15.184:0/2162170728 learned_addr learned my addr 172.21.15.184:0/2162170728 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-10-06T04:35:59.714 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.709+0000 7fa1127fc700 1 --2- 172.21.15.184:0/2162170728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa114142cf0 0x7fa1141589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:35:59.715 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.709+0000 7fa1137fe700 1 -- 172.21.15.184:0/2162170728 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1140cfee0 msgr2=0x7fa114159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:35:59.715 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.709+0000 7fa1137fe700 1 --2- 172.21.15.184:0/2162170728 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1140cfee0 0x7fa114159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:35:59.715 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.709+0000 7fa1137fe700 1 -- 172.21.15.184:0/2162170728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa114142cf0 msgr2=0x7fa1141589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:35:59.715 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.709+0000 7fa1137fe700 1 --2- 172.21.15.184:0/2162170728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa114142cf0 0x7fa1141589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:35:59.715 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.709+0000 7fa1137fe700 1 -- 172.21.15.184:0/2162170728 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa10c009ae0 con 0x7fa1141430c0 2023-10-06T04:35:59.715 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.709+0000 7fa112ffd700 1 --2- 172.21.15.184:0/2162170728 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1140cfee0 0x7fa114159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:35:59.715 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.710+0000 7fa1137fe700 1 --2- 172.21.15.184:0/2162170728 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa1141430c0 0x7fa11415c720 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa10c0072f0 tx=0x7fa10c018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:35:59.715 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.710+0000 7fa10affd700 1 -- 172.21.15.184:0/2162170728 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10c008b00 con 0x7fa1141430c0 2023-10-06T04:35:59.716 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.710+0000 7fa10affd700 1 -- 172.21.15.184:0/2162170728 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10c008c60 con 0x7fa1141430c0 2023-10-06T04:35:59.716 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.710+0000 7fa11985f700 1 -- 172.21.15.184:0/2162170728 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa11415cf10 con 0x7fa1141430c0 2023-10-06T04:35:59.716 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.710+0000 7fa10affd700 1 -- 172.21.15.184:0/2162170728 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10c026460 con 0x7fa1141430c0 2023-10-06T04:35:59.716 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.710+0000 7fa11985f700 1 -- 172.21.15.184:0/2162170728 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa11415b450 con 0x7fa1141430c0 2023-10-06T04:35:59.716 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.710+0000 7fa10affd700 1 -- 172.21.15.184:0/2162170728 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fa10c003040 con 0x7fa1141430c0 2023-10-06T04:35:59.717 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.710+0000 7fa10affd700 1 -- 172.21.15.184:0/2162170728 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa10c01d770 con 0x7fa1141430c0 2023-10-06T04:35:59.717 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.711+0000 7fa11985f700 1 -- 172.21.15.184:0/2162170728 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa11415bc10 con 0x7fa1141430c0 2023-10-06T04:35:59.717 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.713+0000 7fa10affd700 1 -- 172.21.15.184:0/2162170728 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fa10c021070 con 0x7fa1141430c0 2023-10-06T04:35:59.798 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.796+0000 7fa11985f700 1 -- 172.21.15.184:0/2162170728 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd new", "uuid": "cc70f2a2-57bf-4613-b938-0d6f75fa57db", "id": 0} v 0) v1 -- 0x7fa1140715b0 con 0x7fa1141430c0 2023-10-06T04:35:59.801 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.799+0000 7fa10affd700 1 -- 172.21.15.184:0/2162170728 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cc70f2a2-57bf-4613-b938-0d6f75fa57db", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa10c026db0 con 0x7fa1141430c0 2023-10-06T04:35:59.801 INFO:teuthology.orchestra.run.smithi184.stdout:0 2023-10-06T04:35:59.802 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.800+0000 7fa11985f700 1 -- 172.21.15.184:0/2162170728 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa1141430c0 msgr2=0x7fa11415c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:35:59.802 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.800+0000 7fa11985f700 1 --2- 172.21.15.184:0/2162170728 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa1141430c0 0x7fa11415c720 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa10c0072f0 tx=0x7fa10c018000 comp rx=0 tx=0).stop 2023-10-06T04:35:59.802 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.800+0000 7fa11985f700 1 -- 172.21.15.184:0/2162170728 shutdown_connections 2023-10-06T04:35:59.802 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.800+0000 7fa11985f700 1 --2- 172.21.15.184:0/2162170728 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa1141430c0 0x7fa11415c720 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:35:59.802 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.800+0000 7fa11985f700 1 --2- 172.21.15.184:0/2162170728 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1140cfee0 0x7fa114159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:35:59.803 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.800+0000 7fa11985f700 1 --2- 172.21.15.184:0/2162170728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa114142cf0 0x7fa1141589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:35:59.803 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.800+0000 7fa11985f700 1 -- 172.21.15.184:0/2162170728 >> 172.21.15.184:0/2162170728 conn(0x7fa11406ed00 msgr2=0x7fa1140afdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:35:59.803 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.800+0000 7fa11985f700 1 -- 172.21.15.184:0/2162170728 shutdown_connections 2023-10-06T04:35:59.803 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.800+0000 7fa11985f700 1 -- 172.21.15.184:0/2162170728 wait complete. 2023-10-06T04:35:59.814 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new cf050fea-43b2-42ed-b37e-fd515a7ae30d 1 2023-10-06T04:35:59.928 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.926+0000 7fb75d0e0700 1 Processor -- start 2023-10-06T04:35:59.929 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.926+0000 7fb75d0e0700 1 -- start start 2023-10-06T04:35:59.931 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.927+0000 7fb75d0e0700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb758142cf0 0x7fb7580b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:35:59.932 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.927+0000 7fb75d0e0700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb7581430c0 0x7fb7580cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:35:59.932 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.927+0000 7fb75d0e0700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7580cfee0 0x7fb7580b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:35:59.932 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.927+0000 7fb75d0e0700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7580cf510 con 0x7fb758142cf0 2023-10-06T04:35:59.932 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.927+0000 7fb75d0e0700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7580ce6a0 con 0x7fb7581430c0 2023-10-06T04:35:59.932 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.927+0000 7fb75d0e0700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7580ce900 con 0x7fb7580cfee0 2023-10-06T04:35:59.932 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.927+0000 7fb75659c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb7581430c0 0x7fb7580cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:35:59.932 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.927+0000 7fb75759e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7580cfee0 0x7fb7580b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:35:59.932 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.927+0000 7fb75659c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb7581430c0 0x7fb7580cf9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:42580/0 (socket says 172.21.15.184:42580) 2023-10-06T04:35:59.932 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.927+0000 7fb75759e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7580cfee0 0x7fb7580b3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:59322/0 (socket says 172.21.15.184:59322) 2023-10-06T04:35:59.933 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.927+0000 7fb75659c700 1 -- 172.21.15.184:0/1854566482 learned_addr learned my addr 172.21.15.184:0/1854566482 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-10-06T04:35:59.933 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.927+0000 7fb756d9d700 1 --2- 172.21.15.184:0/1854566482 >> v2:172.21.15.8:3300/0 conn(0x7fb758142cf0 0x7fb7580b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:35:59.933 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.928+0000 7fb75659c700 1 -- 172.21.15.184:0/1854566482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7580cfee0 msgr2=0x7fb7580b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:35:59.933 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.928+0000 7fb75659c700 1 --2- 172.21.15.184:0/1854566482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7580cfee0 0x7fb7580b3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:35:59.933 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.928+0000 7fb75659c700 1 -- 172.21.15.184:0/1854566482 >> v2:172.21.15.8:3300/0 conn(0x7fb758142cf0 msgr2=0x7fb7580b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:35:59.933 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.928+0000 7fb75659c700 1 --2- 172.21.15.184:0/1854566482 >> v2:172.21.15.8:3300/0 conn(0x7fb758142cf0 0x7fb7580b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:35:59.933 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.928+0000 7fb75659c700 1 -- 172.21.15.184:0/1854566482 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7580cebe0 con 0x7fb7581430c0 2023-10-06T04:35:59.933 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.928+0000 7fb75759e700 1 --2- 172.21.15.184:0/1854566482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7580cfee0 0x7fb7580b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:35:59.933 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.928+0000 7fb75659c700 1 --2- 172.21.15.184:0/1854566482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7581430c0 0x7fb7580cf9a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb7580ab440 tx=0x7fb748009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=583b69946834e387 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:35:59.934 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.928+0000 7fb755d9b700 1 -- 172.21.15.184:0/1854566482 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74800b640 con 0x7fb7581430c0 2023-10-06T04:35:59.934 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.928+0000 7fb755d9b700 1 -- 172.21.15.184:0/1854566482 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74800b7a0 con 0x7fb7581430c0 2023-10-06T04:35:59.934 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.928+0000 7fb755d9b700 1 -- 172.21.15.184:0/1854566482 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74800bb60 con 0x7fb7581430c0 2023-10-06T04:35:59.934 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.929+0000 7fb75d0e0700 1 -- 172.21.15.184:0/1854566482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7581430c0 msgr2=0x7fb7580cf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:35:59.934 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.929+0000 7fb75d0e0700 1 --2- 172.21.15.184:0/1854566482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7581430c0 0x7fb7580cf9a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb7580ab440 tx=0x7fb748009250 comp rx=0 tx=0).stop 2023-10-06T04:35:59.934 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.929+0000 7fb75d0e0700 1 -- 172.21.15.184:0/1854566482 shutdown_connections 2023-10-06T04:35:59.934 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.929+0000 7fb75d0e0700 1 --2- 172.21.15.184:0/1854566482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7580cfee0 0x7fb7580b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:35:59.934 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.929+0000 7fb75d0e0700 1 --2- 172.21.15.184:0/1854566482 >> v2:172.21.15.8:3300/0 conn(0x7fb758142cf0 0x7fb7580b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:35:59.934 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.929+0000 7fb75d0e0700 1 --2- 172.21.15.184:0/1854566482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7581430c0 0x7fb7580cf9a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:35:59.934 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.929+0000 7fb75d0e0700 1 -- 172.21.15.184:0/1854566482 >> 172.21.15.184:0/1854566482 conn(0x7fb75806ed00 msgr2=0x7fb75806f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:35:59.934 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.929+0000 7fb75d0e0700 1 -- 172.21.15.184:0/1854566482 shutdown_connections 2023-10-06T04:35:59.935 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.929+0000 7fb75d0e0700 1 -- 172.21.15.184:0/1854566482 wait complete. 2023-10-06T04:35:59.935 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.930+0000 7fb75d0e0700 1 Processor -- start 2023-10-06T04:35:59.935 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.930+0000 7fb75d0e0700 1 -- start start 2023-10-06T04:35:59.937 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.931+0000 7fb75d0e0700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7580cfee0 0x7fb75815ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:35:59.937 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.931+0000 7fb75d0e0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb758142cf0 0x7fb75813e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:35:59.937 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.931+0000 7fb75d0e0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7581430c0 0x7fb75813efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:35:59.937 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.931+0000 7fb75d0e0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75813f510 con 0x7fb758142cf0 2023-10-06T04:35:59.937 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.931+0000 7fb75d0e0700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75815b120 con 0x7fb7581430c0 2023-10-06T04:35:59.937 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.931+0000 7fb75d0e0700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb75815b400 con 0x7fb7580cfee0 2023-10-06T04:35:59.938 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.931+0000 7fb756d9d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7580cfee0 0x7fb75815ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:35:59.938 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.931+0000 7fb75759e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7581430c0 0x7fb75813efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:35:59.938 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.931+0000 7fb756d9d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7580cfee0 0x7fb75815ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:59326/0 (socket says 172.21.15.184:59326) 2023-10-06T04:35:59.938 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.931+0000 7fb75759e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7581430c0 0x7fb75813efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:42582/0 (socket says 172.21.15.184:42582) 2023-10-06T04:35:59.938 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.931+0000 7fb756d9d700 1 -- 172.21.15.184:0/1829786532 learned_addr learned my addr 172.21.15.184:0/1829786532 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-10-06T04:35:59.938 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.931+0000 7fb75659c700 1 --2- 172.21.15.184:0/1829786532 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb758142cf0 0x7fb75813e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:35:59.938 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.931+0000 7fb75759e700 1 -- 172.21.15.184:0/1829786532 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7580cfee0 msgr2=0x7fb75815ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:35:59.938 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.931+0000 7fb75759e700 1 --2- 172.21.15.184:0/1829786532 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7580cfee0 0x7fb75815ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:35:59.938 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.931+0000 7fb75759e700 1 -- 172.21.15.184:0/1829786532 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb758142cf0 msgr2=0x7fb75813e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:35:59.938 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.931+0000 7fb75759e700 1 --2- 172.21.15.184:0/1829786532 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb758142cf0 0x7fb75813e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:35:59.938 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.931+0000 7fb75759e700 1 -- 172.21.15.184:0/1829786532 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb750009a20 con 0x7fb7581430c0 2023-10-06T04:35:59.939 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.931+0000 7fb75759e700 1 --2- 172.21.15.184:0/1829786532 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7581430c0 0x7fb75813efd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb750009f10 tx=0x7fb75000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:35:59.939 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.931+0000 7fb73effd700 1 -- 172.21.15.184:0/1829786532 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75000cb70 con 0x7fb7581430c0 2023-10-06T04:35:59.939 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.931+0000 7fb73effd700 1 -- 172.21.15.184:0/1829786532 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75000f040 con 0x7fb7581430c0 2023-10-06T04:35:59.939 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.931+0000 7fb75d0e0700 1 -- 172.21.15.184:0/1829786532 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7480094f0 con 0x7fb7581430c0 2023-10-06T04:35:59.939 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.931+0000 7fb73effd700 1 -- 172.21.15.184:0/1829786532 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb750014480 con 0x7fb7581430c0 2023-10-06T04:35:59.939 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.931+0000 7fb75d0e0700 1 -- 172.21.15.184:0/1829786532 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb75815b9c0 con 0x7fb7581430c0 2023-10-06T04:35:59.939 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.931+0000 7fb73effd700 1 -- 172.21.15.184:0/1829786532 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fb750003020 con 0x7fb7581430c0 2023-10-06T04:35:59.939 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.931+0000 7fb73effd700 1 -- 172.21.15.184:0/1829786532 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7fb75001d7d0 con 0x7fb7581430c0 2023-10-06T04:35:59.939 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.932+0000 7fb75d0e0700 1 -- 172.21.15.184:0/1829786532 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb758071550 con 0x7fb7581430c0 2023-10-06T04:35:59.939 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:35:59.934+0000 7fb73effd700 1 -- 172.21.15.184:0/1829786532 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fb750018030 con 0x7fb7581430c0 2023-10-06T04:36:00.019 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.017+0000 7fb75d0e0700 1 -- 172.21.15.184:0/1829786532 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cf050fea-43b2-42ed-b37e-fd515a7ae30d", "id": 1} v 0) v1 -- 0x7fb7580ceec0 con 0x7fb7581430c0 2023-10-06T04:36:00.022 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.020+0000 7fb73effd700 1 -- 172.21.15.184:0/1829786532 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cf050fea-43b2-42ed-b37e-fd515a7ae30d", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb7500149d0 con 0x7fb7581430c0 2023-10-06T04:36:00.022 INFO:teuthology.orchestra.run.smithi184.stdout:1 2023-10-06T04:36:00.023 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.021+0000 7fb75d0e0700 1 -- 172.21.15.184:0/1829786532 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7581430c0 msgr2=0x7fb75813efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:00.024 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.021+0000 7fb75d0e0700 1 --2- 172.21.15.184:0/1829786532 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7581430c0 0x7fb75813efd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb750009f10 tx=0x7fb75000b040 comp rx=0 tx=0).stop 2023-10-06T04:36:00.024 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.021+0000 7fb75d0e0700 1 -- 172.21.15.184:0/1829786532 shutdown_connections 2023-10-06T04:36:00.024 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.021+0000 7fb75d0e0700 1 --2- 172.21.15.184:0/1829786532 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7581430c0 0x7fb75813efd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.024 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.021+0000 7fb75d0e0700 1 --2- 172.21.15.184:0/1829786532 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7580cfee0 0x7fb75815ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.024 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.021+0000 7fb75d0e0700 1 --2- 172.21.15.184:0/1829786532 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb758142cf0 0x7fb75813e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.024 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.021+0000 7fb75d0e0700 1 -- 172.21.15.184:0/1829786532 >> 172.21.15.184:0/1829786532 conn(0x7fb75806ed00 msgr2=0x7fb758070b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:00.024 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.021+0000 7fb75d0e0700 1 -- 172.21.15.184:0/1829786532 shutdown_connections 2023-10-06T04:36:00.024 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.021+0000 7fb75d0e0700 1 -- 172.21.15.184:0/1829786532 wait complete. 2023-10-06T04:36:00.035 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4 2 2023-10-06T04:36:00.149 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.147+0000 7f31a219c700 1 Processor -- start 2023-10-06T04:36:00.149 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.147+0000 7f31a219c700 1 -- start start 2023-10-06T04:36:00.152 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.148+0000 7f31a219c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f319c067bf0 0x7f319c140800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:00.152 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.148+0000 7f31a219c700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f319c140d40 0x7f319c0b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:00.152 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.148+0000 7f31a219c700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f319c141190 con 0x7f319c067820 2023-10-06T04:36:00.152 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.148+0000 7f31a219c700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f319c06b200 con 0x7f319c140d40 2023-10-06T04:36:00.152 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.148+0000 7f31a219c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319c06b4e0 con 0x7f319c067bf0 2023-10-06T04:36:00.152 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.148+0000 7f3192ffd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f319c067bf0 0x7f319c140800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:00.152 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.148+0000 7f319b7fe700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f319c067820 0x7f319c06a740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:48114/0 (socket says 172.21.15.184:48114) 2023-10-06T04:36:00.152 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.148+0000 7f319b7fe700 1 -- 172.21.15.184:0/1899061206 learned_addr learned my addr 172.21.15.184:0/1899061206 (peer_addr_for_me v1:172.21.15.184:0/0) 2023-10-06T04:36:00.152 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.149+0000 7f319bfff700 1 --2- 172.21.15.184:0/1899061206 >> v2:172.21.15.8:3300/0 conn(0x7f319c140d40 0x7f319c0b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:00.153 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.149+0000 7f319affd700 1 -- 172.21.15.184:0/1899061206 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 466687007 0 0) 0x7f319c141190 con 0x7f319c067820 2023-10-06T04:36:00.153 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.149+0000 7f319affd700 1 -- 172.21.15.184:0/1899061206 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3188003570 con 0x7f319c067820 2023-10-06T04:36:00.153 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.149+0000 7f3192ffd700 1 -- 172.21.15.184:0/1899061206 >> v2:172.21.15.8:3300/0 conn(0x7f319c140d40 msgr2=0x7f319c0b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:00.153 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.149+0000 7f3192ffd700 1 --2- 172.21.15.184:0/1899061206 >> v2:172.21.15.8:3300/0 conn(0x7f319c140d40 0x7f319c0b02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.153 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.149+0000 7f3192ffd700 1 -- 172.21.15.184:0/1899061206 >> v1:172.21.15.184:6789/0 conn(0x7f319c067820 legacy=0x7f319c06a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:00.153 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.149+0000 7f3192ffd700 1 -- 172.21.15.184:0/1899061206 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319c06b7c0 con 0x7f319c067bf0 2023-10-06T04:36:00.153 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.149+0000 7f3192ffd700 1 --2- 172.21.15.184:0/1899061206 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f319c067bf0 0x7f319c140800 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f31840098e0 tx=0x7f31840091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=757186248a7734c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:00.153 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.149+0000 7f319affd700 1 -- 172.21.15.184:0/1899061206 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3184011630 con 0x7f319c067bf0 2023-10-06T04:36:00.153 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.149+0000 7f319affd700 1 -- 172.21.15.184:0/1899061206 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3184011790 con 0x7f319c067bf0 2023-10-06T04:36:00.153 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.149+0000 7f319affd700 1 -- 172.21.15.184:0/1899061206 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3184011b30 con 0x7f319c067bf0 2023-10-06T04:36:00.153 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.150+0000 7f31a219c700 1 -- 172.21.15.184:0/1899061206 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f319c067bf0 msgr2=0x7f319c140800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:00.153 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.150+0000 7f31a219c700 1 --2- 172.21.15.184:0/1899061206 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f319c067bf0 0x7f319c140800 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f31840098e0 tx=0x7f31840091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.154 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.150+0000 7f31a219c700 1 -- 172.21.15.184:0/1899061206 shutdown_connections 2023-10-06T04:36:00.154 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.150+0000 7f31a219c700 1 --2- 172.21.15.184:0/1899061206 >> v2:172.21.15.8:3300/0 conn(0x7f319c140d40 0x7f319c0b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.154 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.150+0000 7f31a219c700 1 --2- 172.21.15.184:0/1899061206 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f319c067bf0 0x7f319c140800 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.154 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.150+0000 7f31a219c700 1 -- 172.21.15.184:0/1899061206 >> 172.21.15.184:0/1899061206 conn(0x7f319c0cd120 msgr2=0x7f319c0cd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:00.154 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.150+0000 7f31a219c700 1 -- 172.21.15.184:0/1899061206 shutdown_connections 2023-10-06T04:36:00.154 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.150+0000 7f31a219c700 1 -- 172.21.15.184:0/1899061206 wait complete. 2023-10-06T04:36:00.156 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.151+0000 7f31a219c700 1 Processor -- start 2023-10-06T04:36:00.158 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.151+0000 7f31a219c700 1 -- start start 2023-10-06T04:36:00.158 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.152+0000 7f31a219c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f319c067820 0x7f319c16cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:00.158 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.152+0000 7f31a219c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f319c067bf0 0x7f319c0c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:00.158 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.152+0000 7f31a219c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f319c140d40 0x7f319c13d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:00.159 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.152+0000 7f31a219c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319c0c45a0 con 0x7f319c140d40 2023-10-06T04:36:00.159 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.152+0000 7f31a219c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319c0c4270 con 0x7f319c067820 2023-10-06T04:36:00.159 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.152+0000 7f31a219c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319c16d3b0 con 0x7f319c067bf0 2023-10-06T04:36:00.159 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.152+0000 7f3192ffd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f319c067bf0 0x7f319c0c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:00.159 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.152+0000 7f319b7fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f319c067820 0x7f319c16cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:00.159 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.152+0000 7f3192ffd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f319c067bf0 0x7f319c0c77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:59352/0 (socket says 172.21.15.184:59352) 2023-10-06T04:36:00.159 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.152+0000 7f3192ffd700 1 -- 172.21.15.184:0/1347053087 learned_addr learned my addr 172.21.15.184:0/1347053087 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-10-06T04:36:00.159 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.152+0000 7f319b7fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f319c067820 0x7f319c16cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:42586/0 (socket says 172.21.15.184:42586) 2023-10-06T04:36:00.159 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.152+0000 7f319bfff700 1 --2- 172.21.15.184:0/1347053087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f319c140d40 0x7f319c13d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:00.160 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.152+0000 7f3192ffd700 1 -- 172.21.15.184:0/1347053087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f319c067820 msgr2=0x7f319c16cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:00.160 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.152+0000 7f3192ffd700 1 --2- 172.21.15.184:0/1347053087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f319c067820 0x7f319c16cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.160 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.152+0000 7f3192ffd700 1 -- 172.21.15.184:0/1347053087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f319c140d40 msgr2=0x7f319c13d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:00.160 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.152+0000 7f3192ffd700 1 --2- 172.21.15.184:0/1347053087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f319c140d40 0x7f319c13d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.160 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.152+0000 7f3192ffd700 1 -- 172.21.15.184:0/1347053087 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3184009420 con 0x7f319c067bf0 2023-10-06T04:36:00.160 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.152+0000 7f3192ffd700 1 --2- 172.21.15.184:0/1347053087 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f319c067bf0 0x7f319c0c77f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f319c06b620 tx=0x7f3184017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:00.160 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.152+0000 7f3193fff700 1 -- 172.21.15.184:0/1347053087 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3184000d10 con 0x7f319c067bf0 2023-10-06T04:36:00.160 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.152+0000 7f3193fff700 1 -- 172.21.15.184:0/1347053087 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3184011b10 con 0x7f319c067bf0 2023-10-06T04:36:00.160 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.152+0000 7f31a219c700 1 -- 172.21.15.184:0/1347053087 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f319c16d690 con 0x7f319c067bf0 2023-10-06T04:36:00.160 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.153+0000 7f3193fff700 1 -- 172.21.15.184:0/1347053087 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3184025660 con 0x7f319c067bf0 2023-10-06T04:36:00.160 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.153+0000 7f31a219c700 1 -- 172.21.15.184:0/1347053087 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f319c16cff0 con 0x7f319c067bf0 2023-10-06T04:36:00.161 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.153+0000 7f3193fff700 1 -- 172.21.15.184:0/1347053087 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f3184025cd0 con 0x7f319c067bf0 2023-10-06T04:36:00.161 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.153+0000 7f3193fff700 1 -- 172.21.15.184:0/1347053087 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f318402ec80 con 0x7f319c067bf0 2023-10-06T04:36:00.161 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.153+0000 7f31a219c700 1 -- 172.21.15.184:0/1347053087 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f319c0c4710 con 0x7f319c067bf0 2023-10-06T04:36:00.161 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.155+0000 7f3193fff700 1 -- 172.21.15.184:0/1347053087 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f3184033060 con 0x7f319c067bf0 2023-10-06T04:36:00.219 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-06T04:36:00.218+0000 7fab393ed180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T04:36:00.224 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-06T04:36:00.222+0000 7fce81fe0180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T04:36:00.241 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.239+0000 7f31a219c700 1 -- 172.21.15.184:0/1347053087 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4", "id": 2} v 0) v1 -- 0x7f319c071550 con 0x7f319c067bf0 2023-10-06T04:36:00.244 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.243+0000 7f3193fff700 1 -- 172.21.15.184:0/1347053087 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3184015020 con 0x7f319c067bf0 2023-10-06T04:36:00.244 INFO:teuthology.orchestra.run.smithi184.stdout:2 2023-10-06T04:36:00.245 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.244+0000 7f31a219c700 1 -- 172.21.15.184:0/1347053087 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f319c067bf0 msgr2=0x7f319c0c77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:00.246 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.244+0000 7f31a219c700 1 --2- 172.21.15.184:0/1347053087 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f319c067bf0 0x7f319c0c77f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f319c06b620 tx=0x7f3184017000 comp rx=0 tx=0).stop 2023-10-06T04:36:00.246 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.244+0000 7f31a219c700 1 -- 172.21.15.184:0/1347053087 shutdown_connections 2023-10-06T04:36:00.246 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.244+0000 7f31a219c700 1 --2- 172.21.15.184:0/1347053087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f319c140d40 0x7f319c13d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.246 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.244+0000 7f31a219c700 1 --2- 172.21.15.184:0/1347053087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f319c067820 0x7f319c16cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.246 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.244+0000 7f31a219c700 1 --2- 172.21.15.184:0/1347053087 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f319c067bf0 0x7f319c0c77f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.246 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.244+0000 7f31a219c700 1 -- 172.21.15.184:0/1347053087 >> 172.21.15.184:0/1347053087 conn(0x7f319c0cd120 msgr2=0x7f319c13f690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:00.246 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.244+0000 7f31a219c700 1 -- 172.21.15.184:0/1347053087 shutdown_connections 2023-10-06T04:36:00.246 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.244+0000 7f31a219c700 1 -- 172.21.15.184:0/1347053087 wait complete. 2023-10-06T04:36:00.257 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 0813e948-63f5-4dfb-8012-4c7fe9529654 3 2023-10-06T04:36:00.358 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-06T04:36:00.357+0000 7fab393ed180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T04:36:00.364 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-06T04:36:00.362+0000 7fce81fe0180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T04:36:00.373 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.371+0000 7f3ffc51d700 1 Processor -- start 2023-10-06T04:36:00.373 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.371+0000 7f3ffc51d700 1 -- start start 2023-10-06T04:36:00.376 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.372+0000 7f3ffc51d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ff415cab0 0x7f3ff40c6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:00.376 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.372+0000 7f3ffc51d700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ff415e270 con 0x7f3ff40af0f0 2023-10-06T04:36:00.376 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.372+0000 7f3ffc51d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ff40679e0 con 0x7f3ff415ce80 2023-10-06T04:36:00.376 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.372+0000 7f3ffc51d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff40cbf40 con 0x7f3ff415cab0 2023-10-06T04:36:00.376 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.373+0000 7f3ffa2b9700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ff415cab0 0x7f3ff40c6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:00.376 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.373+0000 7f3ffaaba700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f3ff415ce80 0x7f3ff40ca5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:48116/0 (socket says 172.21.15.184:48116) 2023-10-06T04:36:00.376 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.373+0000 7f3ffaaba700 1 -- 172.21.15.184:0/3600527377 learned_addr learned my addr 172.21.15.184:0/3600527377 (peer_addr_for_me v1:172.21.15.184:0/0) 2023-10-06T04:36:00.376 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.373+0000 7f3ffa2b9700 1 -- 172.21.15.184:0/3600527377 >> v1:172.21.15.184:6789/0 conn(0x7f3ff415ce80 legacy=0x7f3ff40ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:00.376 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.373+0000 7f3ffa2b9700 1 -- 172.21.15.184:0/3600527377 >> v1:172.21.15.8:6789/0 conn(0x7f3ff40af0f0 legacy=0x7f3ff415d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:00.377 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.373+0000 7f3ffa2b9700 1 -- 172.21.15.184:0/3600527377 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff415da50 con 0x7f3ff415cab0 2023-10-06T04:36:00.377 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.373+0000 7f3ff92b7700 1 -- 172.21.15.184:0/3600527377 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2447693760 0 0) 0x7f3ff40679e0 con 0x7f3ff415ce80 2023-10-06T04:36:00.377 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.373+0000 7f3ffa2b9700 1 --2- 172.21.15.184:0/3600527377 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ff415cab0 0x7f3ff40c6e80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8009910 tx=0x7f3fe80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bede3274e00f45cb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:00.377 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.373+0000 7f3ff92b7700 1 -- 172.21.15.184:0/3600527377 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe800b860 con 0x7f3ff415cab0 2023-10-06T04:36:00.377 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.373+0000 7f3ff92b7700 1 -- 172.21.15.184:0/3600527377 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe800b9c0 con 0x7f3ff415cab0 2023-10-06T04:36:00.377 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.373+0000 7f3ff92b7700 1 -- 172.21.15.184:0/3600527377 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe800bd60 con 0x7f3ff415cab0 2023-10-06T04:36:00.377 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.374+0000 7f3ffc51d700 1 -- 172.21.15.184:0/3600527377 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ff415cab0 msgr2=0x7f3ff40c6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:00.377 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.374+0000 7f3ffc51d700 1 --2- 172.21.15.184:0/3600527377 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ff415cab0 0x7f3ff40c6e80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8009910 tx=0x7f3fe80091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.377 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.374+0000 7f3ffc51d700 1 -- 172.21.15.184:0/3600527377 shutdown_connections 2023-10-06T04:36:00.377 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.374+0000 7f3ffc51d700 1 --2- 172.21.15.184:0/3600527377 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ff415cab0 0x7f3ff40c6e80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.378 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.374+0000 7f3ffc51d700 1 -- 172.21.15.184:0/3600527377 >> 172.21.15.184:0/3600527377 conn(0x7f3ff40cc8e0 msgr2=0x7f3ff40ccce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:00.378 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.374+0000 7f3ffc51d700 1 -- 172.21.15.184:0/3600527377 shutdown_connections 2023-10-06T04:36:00.378 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.374+0000 7f3ffc51d700 1 -- 172.21.15.184:0/3600527377 wait complete. 2023-10-06T04:36:00.380 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.375+0000 7f3ffc51d700 1 Processor -- start 2023-10-06T04:36:00.380 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.375+0000 7f3ffc51d700 1 -- start start 2023-10-06T04:36:00.380 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.376+0000 7f3ffc51d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ff40af0f0 0x7f3ff4155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:00.380 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.376+0000 7f3ffc51d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ff415cab0 0x7f3ff413ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:00.381 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.376+0000 7f3ffc51d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ff415ce80 0x7f3ff4150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:00.381 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.376+0000 7f3ffc51d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff4155810 con 0x7f3ff415ce80 2023-10-06T04:36:00.381 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.376+0000 7f3ffc51d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff41516a0 con 0x7f3ff40af0f0 2023-10-06T04:36:00.381 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.376+0000 7f3ffc51d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff4154ee0 con 0x7f3ff415cab0 2023-10-06T04:36:00.381 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.376+0000 7f3ffa2b9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ff40af0f0 0x7f3ff4155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:00.381 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.376+0000 7f3ff9ab8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ff415cab0 0x7f3ff413ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:00.381 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.376+0000 7f3ffa2b9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ff40af0f0 0x7f3ff4155ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:42602/0 (socket says 172.21.15.184:42602) 2023-10-06T04:36:00.382 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.376+0000 7f3ffa2b9700 1 -- 172.21.15.184:0/1605676920 learned_addr learned my addr 172.21.15.184:0/1605676920 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-10-06T04:36:00.382 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.376+0000 7f3ffaaba700 1 --2- 172.21.15.184:0/1605676920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ff415ce80 0x7f3ff4150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:00.382 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.376+0000 7f3ff9ab8700 1 -- 172.21.15.184:0/1605676920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ff40af0f0 msgr2=0x7f3ff4155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:00.382 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.376+0000 7f3ff9ab8700 1 --2- 172.21.15.184:0/1605676920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ff40af0f0 0x7f3ff4155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.382 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.376+0000 7f3ff9ab8700 1 -- 172.21.15.184:0/1605676920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ff415ce80 msgr2=0x7f3ff4150dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:00.382 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.376+0000 7f3ff9ab8700 1 --2- 172.21.15.184:0/1605676920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ff415ce80 0x7f3ff4150dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.382 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.376+0000 7f3ff9ab8700 1 -- 172.21.15.184:0/1605676920 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe8009420 con 0x7f3ff415cab0 2023-10-06T04:36:00.382 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.376+0000 7f3ff9ab8700 1 --2- 172.21.15.184:0/1605676920 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ff415cab0 0x7f3ff413ec60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3ff000c560 tx=0x7f3ff0007ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:00.382 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.376+0000 7f3fe67fc700 1 -- 172.21.15.184:0/1605676920 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff0011590 con 0x7f3ff415cab0 2023-10-06T04:36:00.382 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.376+0000 7f3fe67fc700 1 -- 172.21.15.184:0/1605676920 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff0011710 con 0x7f3ff415cab0 2023-10-06T04:36:00.383 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.376+0000 7f3fe67fc700 1 -- 172.21.15.184:0/1605676920 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff0011ad0 con 0x7f3ff415cab0 2023-10-06T04:36:00.383 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.376+0000 7f3ffc51d700 1 -- 172.21.15.184:0/1605676920 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ff41551c0 con 0x7f3ff415cab0 2023-10-06T04:36:00.383 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.376+0000 7f3ffc51d700 1 -- 172.21.15.184:0/1605676920 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ff413f1a0 con 0x7f3ff415cab0 2023-10-06T04:36:00.383 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.377+0000 7f3fe67fc700 1 -- 172.21.15.184:0/1605676920 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f3ff001c6c0 con 0x7f3ff415cab0 2023-10-06T04:36:00.383 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.377+0000 7f3fe67fc700 1 -- 172.21.15.184:0/1605676920 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f3ff00128c0 con 0x7f3ff415cab0 2023-10-06T04:36:00.383 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.377+0000 7f3ffc51d700 1 -- 172.21.15.184:0/1605676920 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ff4155980 con 0x7f3ff415cab0 2023-10-06T04:36:00.383 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.379+0000 7f3fe67fc700 1 -- 172.21.15.184:0/1605676920 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f3ff0017070 con 0x7f3ff415cab0 2023-10-06T04:36:00.437 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-06T04:36:00.436+0000 7fab393ed180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T04:36:00.443 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-06T04:36:00.441+0000 7fce81fe0180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T04:36:00.463 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.461+0000 7f3ffc51d700 1 -- 172.21.15.184:0/1605676920 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0813e948-63f5-4dfb-8012-4c7fe9529654", "id": 3} v 0) v1 -- 0x7f3ff4071550 con 0x7f3ff415cab0 2023-10-06T04:36:00.466 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.464+0000 7f3fe67fc700 1 -- 172.21.15.184:0/1605676920 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0813e948-63f5-4dfb-8012-4c7fe9529654", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3ff001cba0 con 0x7f3ff415cab0 2023-10-06T04:36:00.467 INFO:teuthology.orchestra.run.smithi184.stdout:3 2023-10-06T04:36:00.468 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.465+0000 7f3ffc51d700 1 -- 172.21.15.184:0/1605676920 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ff415cab0 msgr2=0x7f3ff413ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:00.468 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.465+0000 7f3ffc51d700 1 --2- 172.21.15.184:0/1605676920 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ff415cab0 0x7f3ff413ec60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3ff000c560 tx=0x7f3ff0007ec0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.468 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.466+0000 7f3ffc51d700 1 -- 172.21.15.184:0/1605676920 shutdown_connections 2023-10-06T04:36:00.468 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.466+0000 7f3ffc51d700 1 --2- 172.21.15.184:0/1605676920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ff415ce80 0x7f3ff4150dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.468 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.466+0000 7f3ffc51d700 1 --2- 172.21.15.184:0/1605676920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ff40af0f0 0x7f3ff4155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.468 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.466+0000 7f3ffc51d700 1 --2- 172.21.15.184:0/1605676920 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ff415cab0 0x7f3ff413ec60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.468 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.466+0000 7f3ffc51d700 1 -- 172.21.15.184:0/1605676920 >> 172.21.15.184:0/1605676920 conn(0x7f3ff40cc8e0 msgr2=0x7f3ff40cccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:00.468 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.466+0000 7f3ffc51d700 1 -- 172.21.15.184:0/1605676920 shutdown_connections 2023-10-06T04:36:00.468 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.466+0000 7f3ffc51d700 1 -- 172.21.15.184:0/1605676920 wait complete. 2023-10-06T04:36:00.480 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2 4 2023-10-06T04:36:00.596 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.594+0000 7fc335901700 1 Processor -- start 2023-10-06T04:36:00.596 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.594+0000 7fc335901700 1 -- start start 2023-10-06T04:36:00.599 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.595+0000 7fc335901700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc330142cf0 0x7fc3300b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:00.599 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.595+0000 7fc335901700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3301430c0 0x7fc3300cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:00.599 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.595+0000 7fc335901700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc3300cfee0 0x7fc3300b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:00.599 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.595+0000 7fc335901700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3300cf510 con 0x7fc330142cf0 2023-10-06T04:36:00.599 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.595+0000 7fc335901700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3300ce6a0 con 0x7fc3300cfee0 2023-10-06T04:36:00.599 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.595+0000 7fc335901700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3300ce900 con 0x7fc3301430c0 2023-10-06T04:36:00.599 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.595+0000 7fc32f7fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc3300cfee0 0x7fc3300b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:00.599 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.595+0000 7fc32e7fc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3301430c0 0x7fc3300cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:00.599 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.595+0000 7fc32f7fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc3300cfee0 0x7fc3300b3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:42608/0 (socket says 172.21.15.184:42608) 2023-10-06T04:36:00.599 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.595+0000 7fc32f7fe700 1 -- 172.21.15.184:0/4281329287 learned_addr learned my addr 172.21.15.184:0/4281329287 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-10-06T04:36:00.600 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.595+0000 7fc32effd700 1 --2- 172.21.15.184:0/4281329287 >> v2:172.21.15.8:3300/0 conn(0x7fc330142cf0 0x7fc3300b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:00.600 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.595+0000 7fc32e7fc700 1 -- 172.21.15.184:0/4281329287 >> v2:172.21.15.184:3300/0 conn(0x7fc3300cfee0 msgr2=0x7fc3300b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:00.600 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.595+0000 7fc32e7fc700 1 --2- 172.21.15.184:0/4281329287 >> v2:172.21.15.184:3300/0 conn(0x7fc3300cfee0 0x7fc3300b3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.600 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.595+0000 7fc32e7fc700 1 -- 172.21.15.184:0/4281329287 >> v2:172.21.15.8:3300/0 conn(0x7fc330142cf0 msgr2=0x7fc3300b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:00.600 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.595+0000 7fc32e7fc700 1 --2- 172.21.15.184:0/4281329287 >> v2:172.21.15.8:3300/0 conn(0x7fc330142cf0 0x7fc3300b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.600 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.595+0000 7fc32e7fc700 1 -- 172.21.15.184:0/4281329287 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3300cebe0 con 0x7fc3301430c0 2023-10-06T04:36:00.600 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.595+0000 7fc32f7fe700 1 --2- 172.21.15.184:0/4281329287 >> v2:172.21.15.184:3300/0 conn(0x7fc3300cfee0 0x7fc3300b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:36:00.600 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.595+0000 7fc32e7fc700 1 --2- 172.21.15.184:0/4281329287 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3301430c0 0x7fc3300cf9a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc33006fc80 tx=0x7fc3200091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6eea95169a1b5605 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:00.600 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.596+0000 7fc32dffb700 1 -- 172.21.15.184:0/4281329287 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc320011630 con 0x7fc3301430c0 2023-10-06T04:36:00.600 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.596+0000 7fc32dffb700 1 -- 172.21.15.184:0/4281329287 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3200117b0 con 0x7fc3301430c0 2023-10-06T04:36:00.600 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.596+0000 7fc32dffb700 1 -- 172.21.15.184:0/4281329287 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc320011b70 con 0x7fc3301430c0 2023-10-06T04:36:00.600 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.596+0000 7fc335901700 1 -- 172.21.15.184:0/4281329287 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3301430c0 msgr2=0x7fc3300cf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:00.601 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.596+0000 7fc335901700 1 --2- 172.21.15.184:0/4281329287 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3301430c0 0x7fc3300cf9a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc33006fc80 tx=0x7fc3200091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.601 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.596+0000 7fc335901700 1 -- 172.21.15.184:0/4281329287 shutdown_connections 2023-10-06T04:36:00.601 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.596+0000 7fc335901700 1 --2- 172.21.15.184:0/4281329287 >> v2:172.21.15.184:3300/0 conn(0x7fc3300cfee0 0x7fc3300b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.601 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.596+0000 7fc335901700 1 --2- 172.21.15.184:0/4281329287 >> v2:172.21.15.8:3300/0 conn(0x7fc330142cf0 0x7fc3300b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.601 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.596+0000 7fc335901700 1 --2- 172.21.15.184:0/4281329287 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3301430c0 0x7fc3300cf9a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.601 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.596+0000 7fc335901700 1 -- 172.21.15.184:0/4281329287 >> 172.21.15.184:0/4281329287 conn(0x7fc33006ed00 msgr2=0x7fc33006f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:00.601 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.596+0000 7fc335901700 1 -- 172.21.15.184:0/4281329287 shutdown_connections 2023-10-06T04:36:00.601 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.596+0000 7fc335901700 1 -- 172.21.15.184:0/4281329287 wait complete. 2023-10-06T04:36:00.603 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.597+0000 7fc335901700 1 Processor -- start 2023-10-06T04:36:00.603 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.598+0000 7fc335901700 1 -- start start 2023-10-06T04:36:00.604 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.598+0000 7fc335901700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3300cfee0 0x7fc33013dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:00.604 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.598+0000 7fc335901700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc330142cf0 0x7fc3300c5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:00.604 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.598+0000 7fc335901700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3301430c0 0x7fc3300b2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:00.604 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.598+0000 7fc335901700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc330159d70 con 0x7fc3300cfee0 2023-10-06T04:36:00.604 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.598+0000 7fc335901700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33015a050 con 0x7fc330142cf0 2023-10-06T04:36:00.604 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.598+0000 7fc335901700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc33015a330 con 0x7fc3301430c0 2023-10-06T04:36:00.604 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.598+0000 7fc32e7fc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc330142cf0 0x7fc3300c5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:00.604 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.598+0000 7fc32f7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3301430c0 0x7fc3300b2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:00.604 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.598+0000 7fc32e7fc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc330142cf0 0x7fc3300c5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:42622/0 (socket says 172.21.15.184:42622) 2023-10-06T04:36:00.604 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.598+0000 7fc32effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3300cfee0 0x7fc33013dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:00.604 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.598+0000 7fc32e7fc700 1 -- 172.21.15.184:0/2800846092 learned_addr learned my addr 172.21.15.184:0/2800846092 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-10-06T04:36:00.605 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.599+0000 7fc32f7fe700 1 -- 172.21.15.184:0/2800846092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc330142cf0 msgr2=0x7fc3300c5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:00.605 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.599+0000 7fc32f7fe700 1 --2- 172.21.15.184:0/2800846092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc330142cf0 0x7fc3300c5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.605 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.599+0000 7fc32f7fe700 1 -- 172.21.15.184:0/2800846092 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3300cfee0 msgr2=0x7fc33013dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:00.605 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.599+0000 7fc32f7fe700 1 --2- 172.21.15.184:0/2800846092 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3300cfee0 0x7fc33013dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.605 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.599+0000 7fc32f7fe700 1 -- 172.21.15.184:0/2800846092 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc328009ae0 con 0x7fc3301430c0 2023-10-06T04:36:00.605 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.599+0000 7fc32e7fc700 1 --2- 172.21.15.184:0/2800846092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc330142cf0 0x7fc3300c5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:36:00.605 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.599+0000 7fc32f7fe700 1 --2- 172.21.15.184:0/2800846092 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3301430c0 0x7fc3300b2250 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc328009ee0 tx=0x7fc32800b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:00.605 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.599+0000 7fc316ffd700 1 -- 172.21.15.184:0/2800846092 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32800c960 con 0x7fc3301430c0 2023-10-06T04:36:00.605 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.599+0000 7fc316ffd700 1 -- 172.21.15.184:0/2800846092 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32800f040 con 0x7fc3301430c0 2023-10-06T04:36:00.605 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.599+0000 7fc316ffd700 1 -- 172.21.15.184:0/2800846092 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32800cd30 con 0x7fc3301430c0 2023-10-06T04:36:00.605 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.599+0000 7fc335901700 1 -- 172.21.15.184:0/2800846092 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc320009420 con 0x7fc3301430c0 2023-10-06T04:36:00.605 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.599+0000 7fc335901700 1 -- 172.21.15.184:0/2800846092 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc33015a8f0 con 0x7fc3301430c0 2023-10-06T04:36:00.606 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.599+0000 7fc316ffd700 1 -- 172.21.15.184:0/2800846092 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fc328014690 con 0x7fc3301430c0 2023-10-06T04:36:00.606 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.599+0000 7fc316ffd700 1 -- 172.21.15.184:0/2800846092 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fc32801d920 con 0x7fc3301430c0 2023-10-06T04:36:00.606 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.600+0000 7fc335901700 1 -- 172.21.15.184:0/2800846092 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc330071550 con 0x7fc3301430c0 2023-10-06T04:36:00.606 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.602+0000 7fc316ffd700 1 -- 172.21.15.184:0/2800846092 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fc328014ad0 con 0x7fc3301430c0 2023-10-06T04:36:00.629 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-06T04:36:00.628+0000 7fab393ed180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T04:36:00.637 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-06T04:36:00.635+0000 7fce81fe0180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T04:36:00.684 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.682+0000 7fc335901700 1 -- 172.21.15.184:0/2800846092 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2", "id": 4} v 0) v1 -- 0x7fc3300ceec0 con 0x7fc3301430c0 2023-10-06T04:36:00.687 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.686+0000 7fc316ffd700 1 -- 172.21.15.184:0/2800846092 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc328014c70 con 0x7fc3301430c0 2023-10-06T04:36:00.688 INFO:teuthology.orchestra.run.smithi184.stdout:4 2023-10-06T04:36:00.689 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.687+0000 7fc335901700 1 -- 172.21.15.184:0/2800846092 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3301430c0 msgr2=0x7fc3300b2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:00.689 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.687+0000 7fc335901700 1 --2- 172.21.15.184:0/2800846092 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3301430c0 0x7fc3300b2250 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc328009ee0 tx=0x7fc32800b040 comp rx=0 tx=0).stop 2023-10-06T04:36:00.689 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.687+0000 7fc335901700 1 -- 172.21.15.184:0/2800846092 shutdown_connections 2023-10-06T04:36:00.689 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.687+0000 7fc335901700 1 --2- 172.21.15.184:0/2800846092 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3301430c0 0x7fc3300b2250 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.689 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.687+0000 7fc335901700 1 --2- 172.21.15.184:0/2800846092 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3300cfee0 0x7fc33013dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.689 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.687+0000 7fc335901700 1 --2- 172.21.15.184:0/2800846092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc330142cf0 0x7fc3300c5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.690 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.687+0000 7fc335901700 1 -- 172.21.15.184:0/2800846092 >> 172.21.15.184:0/2800846092 conn(0x7fc33006ed00 msgr2=0x7fc330158f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:00.690 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.687+0000 7fc335901700 1 -- 172.21.15.184:0/2800846092 shutdown_connections 2023-10-06T04:36:00.690 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.687+0000 7fc335901700 1 -- 172.21.15.184:0/2800846092 wait complete. 2023-10-06T04:36:00.701 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 1ca606c6-033a-4f50-9787-1fa3e382eb2d 5 2023-10-06T04:36:00.811 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-06T04:36:00.809+0000 7fab393ed180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T04:36:00.818 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.817+0000 7f8fed112700 1 Processor -- start 2023-10-06T04:36:00.819 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.817+0000 7f8fed112700 1 -- start start 2023-10-06T04:36:00.821 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.817+0000 7f8fed112700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f8fe8142cf0 0x7f8fe80b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:00.821 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.817+0000 7f8fed112700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8fe80b3790 0x7f8fe80b3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:00.821 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.817+0000 7f8fed112700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fe80cf510 con 0x7f8fe81430c0 2023-10-06T04:36:00.821 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.817+0000 7f8fed112700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fe80ce6a0 con 0x7f8fe80b3790 2023-10-06T04:36:00.821 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.817+0000 7f8fed112700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fe80b40d0 con 0x7f8fe8142cf0 2023-10-06T04:36:00.821 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.817+0000 7f8fe6d9d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f8fe8142cf0 0x7f8fe80b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:00.821 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.818+0000 7f8fe6d9d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f8fe8142cf0 0x7f8fe80b5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:42626/0 (socket says 172.21.15.184:42626) 2023-10-06T04:36:00.821 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.818+0000 7f8fe6d9d700 1 -- 172.21.15.184:0/1937795673 learned_addr learned my addr 172.21.15.184:0/1937795673 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-10-06T04:36:00.821 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.818+0000 7f8fe759e700 1 --2- 172.21.15.184:0/1937795673 >> v2:172.21.15.8:3300/0 conn(0x7f8fe80b3790 0x7f8fe80b3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:00.821 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.818+0000 7f8fe6d9d700 1 -- 172.21.15.184:0/1937795673 >> v2:172.21.15.8:3300/0 conn(0x7f8fe80b3790 msgr2=0x7f8fe80b3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:00.821 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.818+0000 7f8fe6d9d700 1 --2- 172.21.15.184:0/1937795673 >> v2:172.21.15.8:3300/0 conn(0x7f8fe80b3790 0x7f8fe80b3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.822 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.818+0000 7f8fe6d9d700 1 -- 172.21.15.184:0/1937795673 >> v1:172.21.15.8:6789/0 conn(0x7f8fe81430c0 legacy=0x7f8fe80cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:00.822 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.818+0000 7f8fe6d9d700 1 -- 172.21.15.184:0/1937795673 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe80ce900 con 0x7f8fe8142cf0 2023-10-06T04:36:00.822 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.818+0000 7f8fe6d9d700 1 --2- 172.21.15.184:0/1937795673 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fe8142cf0 0x7f8fe80b5cd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8089240 tx=0x7f8fdc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df11ce1e97a2e744 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:00.822 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.818+0000 7f8fe5d9b700 1 -- 172.21.15.184:0/1937795673 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc009e70 con 0x7f8fe8142cf0 2023-10-06T04:36:00.822 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.818+0000 7f8fe5d9b700 1 -- 172.21.15.184:0/1937795673 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fdc00b860 con 0x7f8fe8142cf0 2023-10-06T04:36:00.822 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.818+0000 7f8fe5d9b700 1 -- 172.21.15.184:0/1937795673 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc00bc00 con 0x7f8fe8142cf0 2023-10-06T04:36:00.822 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-06T04:36:00.819+0000 7fce81fe0180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T04:36:00.825 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.819+0000 7f8fed112700 1 -- 172.21.15.184:0/1937795673 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fe8142cf0 msgr2=0x7f8fe80b5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:00.825 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.819+0000 7f8fed112700 1 --2- 172.21.15.184:0/1937795673 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fe8142cf0 0x7f8fe80b5cd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8089240 tx=0x7f8fdc009250 comp rx=0 tx=0).stop 2023-10-06T04:36:00.825 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.819+0000 7f8fed112700 1 -- 172.21.15.184:0/1937795673 shutdown_connections 2023-10-06T04:36:00.825 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.819+0000 7f8fed112700 1 --2- 172.21.15.184:0/1937795673 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fe8142cf0 0x7f8fe80b5cd0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.826 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.819+0000 7f8fed112700 1 --2- 172.21.15.184:0/1937795673 >> v2:172.21.15.8:3300/0 conn(0x7f8fe80b3790 0x7f8fe80b3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.826 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.819+0000 7f8fed112700 1 -- 172.21.15.184:0/1937795673 >> 172.21.15.184:0/1937795673 conn(0x7f8fe806ed00 msgr2=0x7f8fe806f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:00.826 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.819+0000 7f8fed112700 1 -- 172.21.15.184:0/1937795673 shutdown_connections 2023-10-06T04:36:00.826 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.819+0000 7f8fed112700 1 -- 172.21.15.184:0/1937795673 wait complete. 2023-10-06T04:36:00.826 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.820+0000 7f8fed112700 1 Processor -- start 2023-10-06T04:36:00.826 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.820+0000 7f8fed112700 1 -- start start 2023-10-06T04:36:00.826 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.821+0000 7f8fed112700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fe80b3790 0x7f8fe80aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:00.826 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.821+0000 7f8fed112700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8fe8142cf0 0x7f8fe8158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:00.826 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.821+0000 7f8fed112700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fe81430c0 0x7f8fe80ac220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:00.826 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.821+0000 7f8fed112700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe80aeb10 con 0x7f8fe8142cf0 2023-10-06T04:36:00.826 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.821+0000 7f8fed112700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe80af4e0 con 0x7f8fe80b3790 2023-10-06T04:36:00.827 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.821+0000 7f8fed112700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe80adf40 con 0x7f8fe81430c0 2023-10-06T04:36:00.827 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.821+0000 7f8fe6d9d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fe80b3790 0x7f8fe80aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:00.827 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.821+0000 7f8fe6d9d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fe80b3790 0x7f8fe80aefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:42636/0 (socket says 172.21.15.184:42636) 2023-10-06T04:36:00.827 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.821+0000 7f8fe6d9d700 1 -- 172.21.15.184:0/1242298428 learned_addr learned my addr 172.21.15.184:0/1242298428 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-10-06T04:36:00.827 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.821+0000 7f8fe759e700 1 --2- 172.21.15.184:0/1242298428 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fe81430c0 0x7f8fe80ac220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:00.827 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.821+0000 7f8fe659c700 1 --2- 172.21.15.184:0/1242298428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8fe8142cf0 0x7f8fe8158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:00.827 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.821+0000 7f8fe6d9d700 1 -- 172.21.15.184:0/1242298428 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fe81430c0 msgr2=0x7f8fe80ac220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:00.827 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.821+0000 7f8fe6d9d700 1 --2- 172.21.15.184:0/1242298428 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fe81430c0 0x7f8fe80ac220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.827 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.821+0000 7f8fe6d9d700 1 -- 172.21.15.184:0/1242298428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8fe8142cf0 msgr2=0x7f8fe8158cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:00.827 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.821+0000 7f8fe6d9d700 1 --2- 172.21.15.184:0/1242298428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8fe8142cf0 0x7f8fe8158cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.827 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.821+0000 7f8fe6d9d700 1 -- 172.21.15.184:0/1242298428 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fdc0094f0 con 0x7f8fe80b3790 2023-10-06T04:36:00.827 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.821+0000 7f8fe6d9d700 1 --2- 172.21.15.184:0/1242298428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fe80b3790 0x7f8fe80aefa0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8fe80b4210 tx=0x7f8fdc017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:00.828 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.822+0000 7f8fceffd700 1 -- 172.21.15.184:0/1242298428 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc00b9d0 con 0x7f8fe80b3790 2023-10-06T04:36:00.828 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.822+0000 7f8fceffd700 1 -- 172.21.15.184:0/1242298428 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fdc00bb30 con 0x7f8fe80b3790 2023-10-06T04:36:00.828 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.822+0000 7f8fed112700 1 -- 172.21.15.184:0/1242298428 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fe80ae1e0 con 0x7f8fe80b3790 2023-10-06T04:36:00.828 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.822+0000 7f8fceffd700 1 -- 172.21.15.184:0/1242298428 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc025650 con 0x7f8fe80b3790 2023-10-06T04:36:00.828 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.822+0000 7f8fed112700 1 -- 172.21.15.184:0/1242298428 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe80ae7a0 con 0x7f8fe80b3790 2023-10-06T04:36:00.828 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.822+0000 7f8fceffd700 1 -- 172.21.15.184:0/1242298428 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f8fdc023070 con 0x7f8fe80b3790 2023-10-06T04:36:00.828 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.822+0000 7f8fceffd700 1 -- 172.21.15.184:0/1242298428 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f8fdc025d00 con 0x7f8fe80b3790 2023-10-06T04:36:00.828 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.823+0000 7f8fed112700 1 -- 172.21.15.184:0/1242298428 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fe80ae930 con 0x7f8fe80b3790 2023-10-06T04:36:00.828 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.825+0000 7f8fceffd700 1 -- 172.21.15.184:0/1242298428 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f8fdc015020 con 0x7f8fe80b3790 2023-10-06T04:36:00.891 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-06T04:36:00.889+0000 7fab393ed180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T04:36:00.901 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-06T04:36:00.899+0000 7fce81fe0180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T04:36:00.909 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.908+0000 7f8fed112700 1 -- 172.21.15.184:0/1242298428 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1ca606c6-033a-4f50-9787-1fa3e382eb2d", "id": 5} v 0) v1 -- 0x7f8fe80aedf0 con 0x7f8fe80b3790 2023-10-06T04:36:00.913 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.911+0000 7f8fceffd700 1 -- 172.21.15.184:0/1242298428 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1ca606c6-033a-4f50-9787-1fa3e382eb2d", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8fdc011470 con 0x7f8fe80b3790 2023-10-06T04:36:00.913 INFO:teuthology.orchestra.run.smithi184.stdout:5 2023-10-06T04:36:00.914 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.912+0000 7f8fed112700 1 -- 172.21.15.184:0/1242298428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fe80b3790 msgr2=0x7f8fe80aefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:00.914 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.912+0000 7f8fed112700 1 --2- 172.21.15.184:0/1242298428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fe80b3790 0x7f8fe80aefa0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8fe80b4210 tx=0x7f8fdc017000 comp rx=0 tx=0).stop 2023-10-06T04:36:00.914 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.912+0000 7f8fed112700 1 -- 172.21.15.184:0/1242298428 shutdown_connections 2023-10-06T04:36:00.914 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.912+0000 7f8fed112700 1 --2- 172.21.15.184:0/1242298428 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fe81430c0 0x7f8fe80ac220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.914 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.912+0000 7f8fed112700 1 --2- 172.21.15.184:0/1242298428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fe80b3790 0x7f8fe80aefa0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.914 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.912+0000 7f8fed112700 1 --2- 172.21.15.184:0/1242298428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8fe8142cf0 0x7f8fe8158cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:00.914 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.912+0000 7f8fed112700 1 -- 172.21.15.184:0/1242298428 >> 172.21.15.184:0/1242298428 conn(0x7f8fe806ed00 msgr2=0x7f8fe80b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:00.915 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.912+0000 7f8fed112700 1 -- 172.21.15.184:0/1242298428 shutdown_connections 2023-10-06T04:36:00.915 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:00.912+0000 7f8fed112700 1 -- 172.21.15.184:0/1242298428 wait complete. 2023-10-06T04:36:00.926 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4 6 2023-10-06T04:36:01.031 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-06T04:36:01.030+0000 7fab393ed180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T04:36:01.044 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.042+0000 7ffa3e54b700 1 Processor -- start 2023-10-06T04:36:01.044 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.042+0000 7ffa3e54b700 1 -- start start 2023-10-06T04:36:01.046 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.043+0000 7ffa3e54b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa380b1c70 0x7ffa380b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:01.046 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.043+0000 7ffa3e54b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ffa3815ad80 0x7ffa3815b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:01.046 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.043+0000 7ffa3e54b700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa380b2620 con 0x7ffa38156e30 2023-10-06T04:36:01.046 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.043+0000 7ffa3e54b700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa380cf370 con 0x7ffa3815ad80 2023-10-06T04:36:01.046 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.043+0000 7ffa3e54b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa380ce800 con 0x7ffa380b1c70 2023-10-06T04:36:01.046 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.043+0000 7ffa3cd48700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa380b1c70 0x7ffa380b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:01.046 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.043+0000 7ffa3dd4a700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ffa3815ad80 0x7ffa3815b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:01.046 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.043+0000 7ffa3dd4a700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ffa3815ad80 0x7ffa3815b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:42650/0 (socket says 172.21.15.184:42650) 2023-10-06T04:36:01.046 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.043+0000 7ffa3cd48700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa380b1c70 0x7ffa380b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:59402/0 (socket says 172.21.15.184:59402) 2023-10-06T04:36:01.046 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.043+0000 7ffa3dd4a700 1 -- 172.21.15.184:0/2471493102 learned_addr learned my addr 172.21.15.184:0/2471493102 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-10-06T04:36:01.047 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.043+0000 7ffa3d549700 1 --1- 172.21.15.184:0/2471493102 >> v1:172.21.15.184:6789/0 conn(0x7ffa38156e30 0x7ffa380cf800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:48122/0 (socket says 172.21.15.184:48122) 2023-10-06T04:36:01.047 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.043+0000 7ffa3cd48700 1 -- 172.21.15.184:0/2471493102 >> v2:172.21.15.184:3300/0 conn(0x7ffa3815ad80 msgr2=0x7ffa3815b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:01.047 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.043+0000 7ffa3cd48700 1 --2- 172.21.15.184:0/2471493102 >> v2:172.21.15.184:3300/0 conn(0x7ffa3815ad80 0x7ffa3815b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:01.047 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.043+0000 7ffa3cd48700 1 -- 172.21.15.184:0/2471493102 >> v1:172.21.15.184:6789/0 conn(0x7ffa38156e30 legacy=0x7ffa380cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:01.048 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.043+0000 7ffa3cd48700 1 -- 172.21.15.184:0/2471493102 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa380cea60 con 0x7ffa380b1c70 2023-10-06T04:36:01.048 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.043+0000 7ffa3dd4a700 1 --2- 172.21.15.184:0/2471493102 >> v2:172.21.15.184:3300/0 conn(0x7ffa3815ad80 0x7ffa3815b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:36:01.048 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.044+0000 7ffa3cd48700 1 --2- 172.21.15.184:0/2471493102 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa380b1c70 0x7ffa380b20e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ffa380cec50 tx=0x7ffa340091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=881af348224a81f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:01.048 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.044+0000 7ffa2ffff700 1 -- 172.21.15.184:0/2471493102 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa34011630 con 0x7ffa380b1c70 2023-10-06T04:36:01.048 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.044+0000 7ffa2ffff700 1 -- 172.21.15.184:0/2471493102 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa34011790 con 0x7ffa380b1c70 2023-10-06T04:36:01.048 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.044+0000 7ffa2ffff700 1 -- 172.21.15.184:0/2471493102 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa34011b50 con 0x7ffa380b1c70 2023-10-06T04:36:01.049 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-06T04:36:01.044+0000 7fce81fe0180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T04:36:01.051 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.044+0000 7ffa3e54b700 1 -- 172.21.15.184:0/2471493102 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa380b1c70 msgr2=0x7ffa380b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:01.052 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.044+0000 7ffa3e54b700 1 --2- 172.21.15.184:0/2471493102 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa380b1c70 0x7ffa380b20e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ffa380cec50 tx=0x7ffa340091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:01.052 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.044+0000 7ffa3e54b700 1 -- 172.21.15.184:0/2471493102 shutdown_connections 2023-10-06T04:36:01.052 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.044+0000 7ffa3e54b700 1 --2- 172.21.15.184:0/2471493102 >> v2:172.21.15.184:3300/0 conn(0x7ffa3815ad80 0x7ffa3815b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:01.052 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.044+0000 7ffa3e54b700 1 --2- 172.21.15.184:0/2471493102 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa380b1c70 0x7ffa380b20e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:01.052 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.044+0000 7ffa3e54b700 1 -- 172.21.15.184:0/2471493102 >> 172.21.15.184:0/2471493102 conn(0x7ffa3806ed00 msgr2=0x7ffa3806f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:01.052 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.044+0000 7ffa3e54b700 1 -- 172.21.15.184:0/2471493102 shutdown_connections 2023-10-06T04:36:01.052 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.044+0000 7ffa3e54b700 1 -- 172.21.15.184:0/2471493102 wait complete. 2023-10-06T04:36:01.052 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.045+0000 7ffa3e54b700 1 Processor -- start 2023-10-06T04:36:01.052 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.046+0000 7ffa3e54b700 1 -- start start 2023-10-06T04:36:01.053 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.046+0000 7ffa3e54b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa380b1c70 0x7ffa38153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:01.053 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.046+0000 7ffa3e54b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa38156e30 0x7ffa380a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:01.053 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.046+0000 7ffa3e54b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa3815ad80 0x7ffa38155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:01.053 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.046+0000 7ffa3e54b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa38154210 con 0x7ffa380b1c70 2023-10-06T04:36:01.053 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.046+0000 7ffa3e54b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3816d220 con 0x7ffa3815ad80 2023-10-06T04:36:01.054 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.046+0000 7ffa3e54b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa380aa230 con 0x7ffa38156e30 2023-10-06T04:36:01.054 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.046+0000 7ffa3cd48700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa38156e30 0x7ffa380a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:01.054 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.046+0000 7ffa3dd4a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa3815ad80 0x7ffa38155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:01.054 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.046+0000 7ffa3cd48700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa38156e30 0x7ffa380a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:59404/0 (socket says 172.21.15.184:59404) 2023-10-06T04:36:01.054 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.046+0000 7ffa3cd48700 1 -- 172.21.15.184:0/275525333 learned_addr learned my addr 172.21.15.184:0/275525333 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-10-06T04:36:01.054 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.047+0000 7ffa3d549700 1 --2- 172.21.15.184:0/275525333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa380b1c70 0x7ffa38153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:01.054 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.047+0000 7ffa3dd4a700 1 -- 172.21.15.184:0/275525333 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa38156e30 msgr2=0x7ffa380a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:01.054 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.047+0000 7ffa3dd4a700 1 --2- 172.21.15.184:0/275525333 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa38156e30 0x7ffa380a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:01.055 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.047+0000 7ffa3dd4a700 1 -- 172.21.15.184:0/275525333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa380b1c70 msgr2=0x7ffa38153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:01.055 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.047+0000 7ffa3dd4a700 1 --2- 172.21.15.184:0/275525333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa380b1c70 0x7ffa38153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:01.055 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.047+0000 7ffa3dd4a700 1 -- 172.21.15.184:0/275525333 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa30009ae0 con 0x7ffa3815ad80 2023-10-06T04:36:01.055 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.047+0000 7ffa3dd4a700 1 --2- 172.21.15.184:0/275525333 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa3815ad80 0x7ffa38155ce0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ffa30009e70 tx=0x7ffa3000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:01.055 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.047+0000 7ffa2d7fa700 1 -- 172.21.15.184:0/275525333 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa30018070 con 0x7ffa3815ad80 2023-10-06T04:36:01.055 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.047+0000 7ffa2d7fa700 1 -- 172.21.15.184:0/275525333 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3000f040 con 0x7ffa3815ad80 2023-10-06T04:36:01.055 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.047+0000 7ffa2d7fa700 1 -- 172.21.15.184:0/275525333 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3000cb00 con 0x7ffa3815ad80 2023-10-06T04:36:01.055 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.047+0000 7ffa3e54b700 1 -- 172.21.15.184:0/275525333 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa34009420 con 0x7ffa3815ad80 2023-10-06T04:36:01.055 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.047+0000 7ffa3e54b700 1 -- 172.21.15.184:0/275525333 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa3816d750 con 0x7ffa3815ad80 2023-10-06T04:36:01.055 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.047+0000 7ffa2d7fa700 1 -- 172.21.15.184:0/275525333 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7ffa30003020 con 0x7ffa3815ad80 2023-10-06T04:36:01.055 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.047+0000 7ffa2d7fa700 1 -- 172.21.15.184:0/275525333 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7ffa30014a20 con 0x7ffa3815ad80 2023-10-06T04:36:01.055 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.048+0000 7ffa3e54b700 1 -- 172.21.15.184:0/275525333 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa3804c380 con 0x7ffa3815ad80 2023-10-06T04:36:01.056 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.050+0000 7ffa2d7fa700 1 -- 172.21.15.184:0/275525333 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7ffa30014480 con 0x7ffa3815ad80 2023-10-06T04:36:01.130 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-06T04:36:01.128+0000 7fab393ed180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T04:36:01.135 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.133+0000 7ffa3e54b700 1 -- 172.21.15.184:0/275525333 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4", "id": 6} v 0) v1 -- 0x7ffa381543b0 con 0x7ffa3815ad80 2023-10-06T04:36:01.141 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.139+0000 7ffa2d7fa700 1 -- 172.21.15.184:0/275525333 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7ffa3002c0b0 con 0x7ffa3815ad80 2023-10-06T04:36:01.141 INFO:teuthology.orchestra.run.smithi184.stdout:6 2023-10-06T04:36:01.142 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.140+0000 7ffa3e54b700 1 -- 172.21.15.184:0/275525333 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa3815ad80 msgr2=0x7ffa38155ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:01.142 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.140+0000 7ffa3e54b700 1 --2- 172.21.15.184:0/275525333 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa3815ad80 0x7ffa38155ce0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ffa30009e70 tx=0x7ffa3000b040 comp rx=0 tx=0).stop 2023-10-06T04:36:01.143 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.140+0000 7ffa3e54b700 1 -- 172.21.15.184:0/275525333 shutdown_connections 2023-10-06T04:36:01.143 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.140+0000 7ffa3e54b700 1 --2- 172.21.15.184:0/275525333 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa3815ad80 0x7ffa38155ce0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:01.143 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.140+0000 7ffa3e54b700 1 --2- 172.21.15.184:0/275525333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa380b1c70 0x7ffa38153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:01.143 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.140+0000 7ffa3e54b700 1 --2- 172.21.15.184:0/275525333 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa38156e30 0x7ffa380a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:01.143 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.140+0000 7ffa3e54b700 1 -- 172.21.15.184:0/275525333 >> 172.21.15.184:0/275525333 conn(0x7ffa3806ed00 msgr2=0x7ffa38154640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:01.143 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.140+0000 7ffa3e54b700 1 -- 172.21.15.184:0/275525333 shutdown_connections 2023-10-06T04:36:01.143 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.140+0000 7ffa3e54b700 1 -- 172.21.15.184:0/275525333 wait complete. 2023-10-06T04:36:01.146 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-06T04:36:01.144+0000 7fce81fe0180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T04:36:01.154 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new ae83ff3e-7051-42dd-9067-a4c870df0356 7 2023-10-06T04:36:01.269 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.267+0000 7f7b58ca0700 1 Processor -- start 2023-10-06T04:36:01.269 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.267+0000 7f7b58ca0700 1 -- start start 2023-10-06T04:36:01.271 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.268+0000 7f7b58ca0700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7b5406df20 0x7f7b540af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:01.272 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.268+0000 7f7b58ca0700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b54068670 con 0x7f7b54155d00 2023-10-06T04:36:01.272 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.268+0000 7f7b58ca0700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b54068950 con 0x7f7b5406e2f0 2023-10-06T04:36:01.272 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.268+0000 7f7b58ca0700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b540c7a00 con 0x7f7b5406df20 2023-10-06T04:36:01.272 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.268+0000 7f7b5259c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7b5406df20 0x7f7b540af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:01.272 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.268+0000 7f7b5259c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7b5406df20 0x7f7b540af7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:42672/0 (socket says 172.21.15.184:42672) 2023-10-06T04:36:01.272 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.268+0000 7f7b5259c700 1 -- 172.21.15.184:0/3446866226 learned_addr learned my addr 172.21.15.184:0/3446866226 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-10-06T04:36:01.272 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.269+0000 7f7b5259c700 1 -- 172.21.15.184:0/3446866226 >> v1:172.21.15.184:6789/0 conn(0x7f7b5406e2f0 legacy=0x7f7b541555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:01.272 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.269+0000 7f7b5259c700 1 -- 172.21.15.184:0/3446866226 >> v1:172.21.15.8:6789/0 conn(0x7f7b54155d00 legacy=0x7f7b540c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:01.272 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.269+0000 7f7b5259c700 1 -- 172.21.15.184:0/3446866226 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b540c7ce0 con 0x7f7b5406df20 2023-10-06T04:36:01.272 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.269+0000 7f7b5259c700 1 --2- 172.21.15.184:0/3446866226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b5406df20 0x7f7b540af7d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7b480099b0 tx=0x7f7b48009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47ae78da80480ec9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:01.272 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.269+0000 7f7b5159a700 1 -- 172.21.15.184:0/3446866226 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4800b860 con 0x7f7b5406df20 2023-10-06T04:36:01.272 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.269+0000 7f7b5159a700 1 -- 172.21.15.184:0/3446866226 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4800b9c0 con 0x7f7b5406df20 2023-10-06T04:36:01.273 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.269+0000 7f7b5159a700 1 -- 172.21.15.184:0/3446866226 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4800bd60 con 0x7f7b5406df20 2023-10-06T04:36:01.273 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.270+0000 7f7b58ca0700 1 -- 172.21.15.184:0/3446866226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b5406df20 msgr2=0x7f7b540af7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:01.273 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.270+0000 7f7b58ca0700 1 --2- 172.21.15.184:0/3446866226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b5406df20 0x7f7b540af7d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7b480099b0 tx=0x7f7b48009250 comp rx=0 tx=0).stop 2023-10-06T04:36:01.273 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.270+0000 7f7b58ca0700 1 -- 172.21.15.184:0/3446866226 shutdown_connections 2023-10-06T04:36:01.273 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.270+0000 7f7b58ca0700 1 --2- 172.21.15.184:0/3446866226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b5406df20 0x7f7b540af7d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:01.273 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.270+0000 7f7b58ca0700 1 -- 172.21.15.184:0/3446866226 >> 172.21.15.184:0/3446866226 conn(0x7f7b540cc8e0 msgr2=0x7f7b540ccce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:01.273 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.270+0000 7f7b58ca0700 1 -- 172.21.15.184:0/3446866226 shutdown_connections 2023-10-06T04:36:01.273 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.270+0000 7f7b58ca0700 1 -- 172.21.15.184:0/3446866226 wait complete. 2023-10-06T04:36:01.276 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.271+0000 7f7b58ca0700 1 Processor -- start 2023-10-06T04:36:01.276 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.271+0000 7f7b58ca0700 1 -- start start 2023-10-06T04:36:01.276 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.271+0000 7f7b58ca0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b5406df20 0x7f7b540c59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:01.276 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.272+0000 7f7b58ca0700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b5406e2f0 0x7f7b5413f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:01.276 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.272+0000 7f7b58ca0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b54155d00 0x7f7b5414ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:01.276 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.272+0000 7f7b58ca0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5414b7b0 con 0x7f7b54155d00 2023-10-06T04:36:01.277 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.272+0000 7f7b58ca0700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b540c49c0 con 0x7f7b5406df20 2023-10-06T04:36:01.277 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.272+0000 7f7b58ca0700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b540c5520 con 0x7f7b5406e2f0 2023-10-06T04:36:01.277 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.272+0000 7f7b5259c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b5406df20 0x7f7b540c59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:01.277 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.272+0000 7f7b5259c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b5406df20 0x7f7b540c59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:42682/0 (socket says 172.21.15.184:42682) 2023-10-06T04:36:01.277 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.272+0000 7f7b5259c700 1 -- 172.21.15.184:0/2632727061 learned_addr learned my addr 172.21.15.184:0/2632727061 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-10-06T04:36:01.277 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.272+0000 7f7b51d9b700 1 --2- 172.21.15.184:0/2632727061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b5406e2f0 0x7f7b5413f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:01.277 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.272+0000 7f7b52d9d700 1 --2- 172.21.15.184:0/2632727061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b54155d00 0x7f7b5414ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:01.277 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.272+0000 7f7b5259c700 1 -- 172.21.15.184:0/2632727061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b5406e2f0 msgr2=0x7f7b5413f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:01.277 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.272+0000 7f7b5259c700 1 --2- 172.21.15.184:0/2632727061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b5406e2f0 0x7f7b5413f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:01.277 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.272+0000 7f7b5259c700 1 -- 172.21.15.184:0/2632727061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b54155d00 msgr2=0x7f7b5414ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:01.277 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.272+0000 7f7b5259c700 1 --2- 172.21.15.184:0/2632727061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b54155d00 0x7f7b5414ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:01.278 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.272+0000 7f7b5259c700 1 -- 172.21.15.184:0/2632727061 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b480094f0 con 0x7f7b5406df20 2023-10-06T04:36:01.278 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.272+0000 7f7b52d9d700 1 --2- 172.21.15.184:0/2632727061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b54155d00 0x7f7b5414ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:36:01.278 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.272+0000 7f7b5259c700 1 --2- 172.21.15.184:0/2632727061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b5406df20 0x7f7b540c59b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7b48006fd0 tx=0x7f7b48017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:01.278 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.272+0000 7f7b427fc700 1 -- 172.21.15.184:0/2632727061 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b48024440 con 0x7f7b5406df20 2023-10-06T04:36:01.278 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.272+0000 7f7b427fc700 1 -- 172.21.15.184:0/2632727061 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b480245a0 con 0x7f7b5406df20 2023-10-06T04:36:01.278 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.272+0000 7f7b58ca0700 1 -- 172.21.15.184:0/2632727061 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b540c4bf0 con 0x7f7b5406df20 2023-10-06T04:36:01.278 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.272+0000 7f7b427fc700 1 -- 172.21.15.184:0/2632727061 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b48024940 con 0x7f7b5406df20 2023-10-06T04:36:01.278 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.272+0000 7f7b58ca0700 1 -- 172.21.15.184:0/2632727061 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b540c51b0 con 0x7f7b5406df20 2023-10-06T04:36:01.278 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.273+0000 7f7b427fc700 1 -- 172.21.15.184:0/2632727061 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f7b4801a6a0 con 0x7f7b5406df20 2023-10-06T04:36:01.278 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.273+0000 7f7b427fc700 1 -- 172.21.15.184:0/2632727061 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f7b48023a50 con 0x7f7b5406df20 2023-10-06T04:36:01.278 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.273+0000 7f7b58ca0700 1 -- 172.21.15.184:0/2632727061 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b540c5800 con 0x7f7b5406df20 2023-10-06T04:36:01.281 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.277+0000 7f7b427fc700 1 -- 172.21.15.184:0/2632727061 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f7b48015020 con 0x7f7b5406df20 2023-10-06T04:36:01.360 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.358+0000 7f7b58ca0700 1 -- 172.21.15.184:0/2632727061 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ae83ff3e-7051-42dd-9067-a4c870df0356", "id": 7} v 0) v1 -- 0x7f7b54071550 con 0x7f7b5406df20 2023-10-06T04:36:01.369 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.367+0000 7f7b427fc700 1 -- 172.21.15.184:0/2632727061 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ae83ff3e-7051-42dd-9067-a4c870df0356", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7b48023c60 con 0x7f7b5406df20 2023-10-06T04:36:01.369 INFO:teuthology.orchestra.run.smithi184.stdout:7 2023-10-06T04:36:01.370 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.368+0000 7f7b58ca0700 1 -- 172.21.15.184:0/2632727061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b5406df20 msgr2=0x7f7b540c59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:01.370 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.368+0000 7f7b58ca0700 1 --2- 172.21.15.184:0/2632727061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b5406df20 0x7f7b540c59b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7b48006fd0 tx=0x7f7b48017000 comp rx=0 tx=0).stop 2023-10-06T04:36:01.370 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.368+0000 7f7b58ca0700 1 -- 172.21.15.184:0/2632727061 shutdown_connections 2023-10-06T04:36:01.370 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.368+0000 7f7b58ca0700 1 --2- 172.21.15.184:0/2632727061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b54155d00 0x7f7b5414ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:01.370 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.368+0000 7f7b58ca0700 1 --2- 172.21.15.184:0/2632727061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b5406df20 0x7f7b540c59b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:01.371 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.368+0000 7f7b58ca0700 1 --2- 172.21.15.184:0/2632727061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b5406e2f0 0x7f7b5413f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:01.371 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.368+0000 7f7b58ca0700 1 -- 172.21.15.184:0/2632727061 >> 172.21.15.184:0/2632727061 conn(0x7f7b540cc8e0 msgr2=0x7f7b5414c390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:01.371 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.368+0000 7f7b58ca0700 1 -- 172.21.15.184:0/2632727061 shutdown_connections 2023-10-06T04:36:01.371 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-06T04:36:01.368+0000 7f7b58ca0700 1 -- 172.21.15.184:0/2632727061 wait complete. 2023-10-06T04:36:01.381 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-06T04:36:01.381 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-06T04:36:01.383 INFO:tasks.ceph.osd.0:Started 2023-10-06T04:36:01.383 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-06T04:36:01.384 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-06T04:36:01.385 INFO:tasks.ceph.osd.1:Started 2023-10-06T04:36:01.386 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-06T04:36:01.386 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-06T04:36:01.388 INFO:tasks.ceph.osd.2:Started 2023-10-06T04:36:01.388 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-06T04:36:01.388 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-06T04:36:01.392 INFO:tasks.ceph.osd.3:Started 2023-10-06T04:36:01.392 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-06T04:36:01.392 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-06T04:36:01.394 INFO:tasks.ceph.osd.4:Started 2023-10-06T04:36:01.394 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-06T04:36:01.394 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-06T04:36:01.396 INFO:tasks.ceph.osd.5:Started 2023-10-06T04:36:01.397 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-06T04:36:01.397 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-06T04:36:01.398 INFO:tasks.ceph.osd.6:Started 2023-10-06T04:36:01.399 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-06T04:36:01.399 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-06T04:36:01.401 INFO:tasks.ceph.osd.7:Started 2023-10-06T04:36:01.401 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:36:01.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.539+0000 7fcea446f700 1 Processor -- start 2023-10-06T04:36:01.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.539+0000 7fcea446f700 1 -- start start 2023-10-06T04:36:01.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.540+0000 7fcea446f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce9c0d0aa0 0x7fce9c1649b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:01.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.540+0000 7fcea446f700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce9c0cc4c0 con 0x7fce9c0cb360 2023-10-06T04:36:01.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.540+0000 7fcea446f700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce9c0cb8b0 con 0x7fce9c0af680 2023-10-06T04:36:01.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.540+0000 7fcea446f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c15d460 con 0x7fce9c0d0aa0 2023-10-06T04:36:01.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.540+0000 7fcea1a0a700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fce9c0cb360 0x7fce9c0d0390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:56310/0 (socket says 172.21.15.8:56310) 2023-10-06T04:36:01.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.540+0000 7fcea1a0a700 1 -- 172.21.15.8:0/3492681626 learned_addr learned my addr 172.21.15.8:0/3492681626 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:01.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.540+0000 7fcea2a0c700 1 --2- 172.21.15.8:0/3492681626 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce9c0d0aa0 0x7fce9c1649b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:01.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.540+0000 7fcea1209700 1 -- 172.21.15.8:0/3492681626 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 826432914 0 0) 0x7fce9c0cc4c0 con 0x7fce9c0cb360 2023-10-06T04:36:01.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.541+0000 7fcea1209700 1 -- 172.21.15.8:0/3492681626 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce88003570 con 0x7fce9c0cb360 2023-10-06T04:36:01.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.541+0000 7fcea1209700 1 -- 172.21.15.8:0/3492681626 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1899630709 0 0) 0x7fce9c0cb8b0 con 0x7fce9c0af680 2023-10-06T04:36:01.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.541+0000 7fcea1209700 1 -- 172.21.15.8:0/3492681626 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce9c0cc4c0 con 0x7fce9c0af680 2023-10-06T04:36:01.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.541+0000 7fcea2a0c700 1 -- 172.21.15.8:0/3492681626 >> v1:172.21.15.184:6789/0 conn(0x7fce9c0af680 legacy=0x7fce9c15e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:01.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.541+0000 7fcea2a0c700 1 -- 172.21.15.8:0/3492681626 >> v1:172.21.15.8:6789/0 conn(0x7fce9c0cb360 legacy=0x7fce9c0d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:01.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.541+0000 7fcea2a0c700 1 -- 172.21.15.8:0/3492681626 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce9c0cbb90 con 0x7fce9c0d0aa0 2023-10-06T04:36:01.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.541+0000 7fcea2a0c700 1 --2- 172.21.15.8:0/3492681626 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce9c0d0aa0 0x7fce9c1649b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fce94009e90 tx=0x7fce94009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3f3e93f34df5e93 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:01.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.541+0000 7fcea1209700 1 -- 172.21.15.8:0/3492681626 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9400e070 con 0x7fce9c0d0aa0 2023-10-06T04:36:01.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.541+0000 7fcea1209700 1 -- 172.21.15.8:0/3492681626 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce9400bb80 con 0x7fce9c0d0aa0 2023-10-06T04:36:01.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.541+0000 7fcea1209700 1 -- 172.21.15.8:0/3492681626 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce94012430 con 0x7fce9c0d0aa0 2023-10-06T04:36:01.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.542+0000 7fcea446f700 1 -- 172.21.15.8:0/3492681626 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce9c0d0aa0 msgr2=0x7fce9c1649b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:01.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.542+0000 7fcea446f700 1 --2- 172.21.15.8:0/3492681626 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce9c0d0aa0 0x7fce9c1649b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fce94009e90 tx=0x7fce94009780 comp rx=0 tx=0).stop 2023-10-06T04:36:01.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.542+0000 7fcea446f700 1 -- 172.21.15.8:0/3492681626 shutdown_connections 2023-10-06T04:36:01.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.542+0000 7fcea446f700 1 --2- 172.21.15.8:0/3492681626 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce9c0d0aa0 0x7fce9c1649b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:01.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.542+0000 7fcea446f700 1 -- 172.21.15.8:0/3492681626 >> 172.21.15.8:0/3492681626 conn(0x7fce9c0633d0 msgr2=0x7fce9c0637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:01.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.542+0000 7fcea446f700 1 -- 172.21.15.8:0/3492681626 shutdown_connections 2023-10-06T04:36:01.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.542+0000 7fcea446f700 1 -- 172.21.15.8:0/3492681626 wait complete. 2023-10-06T04:36:01.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.543+0000 7fcea446f700 1 Processor -- start 2023-10-06T04:36:01.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.543+0000 7fcea446f700 1 -- start start 2023-10-06T04:36:01.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.544+0000 7fcea446f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce9c0af680 0x7fce9c158640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:01.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.544+0000 7fcea446f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce9c0cb360 0x7fce9c0b5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:01.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.544+0000 7fcea446f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce9c0d0aa0 0x7fce9c0b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:01.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.544+0000 7fcea446f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c0b57b0 con 0x7fce9c0af680 2023-10-06T04:36:01.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.544+0000 7fcea446f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c155030 con 0x7fce9c0cb360 2023-10-06T04:36:01.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.544+0000 7fcea446f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c1598c0 con 0x7fce9c0d0aa0 2023-10-06T04:36:01.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.544+0000 7fcea220b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce9c0af680 0x7fce9c158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:01.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.544+0000 7fcea220b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce9c0af680 0x7fce9c158640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39504/0 (socket says 172.21.15.8:39504) 2023-10-06T04:36:01.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.544+0000 7fcea220b700 1 -- 172.21.15.8:0/2204915953 learned_addr learned my addr 172.21.15.8:0/2204915953 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:01.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.544+0000 7fcea1a0a700 1 --2- 172.21.15.8:0/2204915953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce9c0cb360 0x7fce9c0b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:01.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.544+0000 7fcea2a0c700 1 --2- 172.21.15.8:0/2204915953 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce9c0d0aa0 0x7fce9c0b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:01.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.544+0000 7fcea220b700 1 -- 172.21.15.8:0/2204915953 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce9c0d0aa0 msgr2=0x7fce9c0b38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:01.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.544+0000 7fcea220b700 1 --2- 172.21.15.8:0/2204915953 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce9c0d0aa0 0x7fce9c0b38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:01.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.544+0000 7fcea220b700 1 -- 172.21.15.8:0/2204915953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce9c0cb360 msgr2=0x7fce9c0b5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:01.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.544+0000 7fcea220b700 1 --2- 172.21.15.8:0/2204915953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce9c0cb360 0x7fce9c0b5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:01.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.544+0000 7fcea220b700 1 -- 172.21.15.8:0/2204915953 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce94009a20 con 0x7fce9c0af680 2023-10-06T04:36:01.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.544+0000 7fcea220b700 1 --2- 172.21.15.8:0/2204915953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce9c0af680 0x7fce9c158640 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fce9800c580 tx=0x7fce98007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:01.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.544+0000 7fce8e7fc700 1 -- 172.21.15.8:0/2204915953 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce98010510 con 0x7fce9c0af680 2023-10-06T04:36:01.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.544+0000 7fce8e7fc700 1 -- 172.21.15.8:0/2204915953 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce98010670 con 0x7fce9c0af680 2023-10-06T04:36:01.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.544+0000 7fce8e7fc700 1 -- 172.21.15.8:0/2204915953 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce98010a30 con 0x7fce9c0af680 2023-10-06T04:36:01.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.544+0000 7fcea446f700 1 -- 172.21.15.8:0/2204915953 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce9c0b3e30 con 0x7fce9c0af680 2023-10-06T04:36:01.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.544+0000 7fcea446f700 1 -- 172.21.15.8:0/2204915953 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce9c158f90 con 0x7fce9c0af680 2023-10-06T04:36:01.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.545+0000 7fce8e7fc700 1 -- 172.21.15.8:0/2204915953 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fce9801b400 con 0x7fce9c0af680 2023-10-06T04:36:01.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.545+0000 7fce8e7fc700 1 -- 172.21.15.8:0/2204915953 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fce98010de0 con 0x7fce9c0af680 2023-10-06T04:36:01.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.545+0000 7fcea446f700 1 -- 172.21.15.8:0/2204915953 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce9c071550 con 0x7fce9c0af680 2023-10-06T04:36:01.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.549+0000 7fce8e7fc700 1 -- 172.21.15.8:0/2204915953 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fce9801b890 con 0x7fce9c0af680 2023-10-06T04:36:01.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.620+0000 7fcea446f700 1 -- 172.21.15.8:0/2204915953 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce9c0c71f0 con 0x7fce9c0af680 2023-10-06T04:36:01.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.620+0000 7fce8e7fc700 1 -- 172.21.15.8:0/2204915953 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fce9801ba30 con 0x7fce9c0af680 2023-10-06T04:36:01.622 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:36:01.622 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":10,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:36:01.360785+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:36:01.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.621+0000 7fcea446f700 1 -- 172.21.15.8:0/2204915953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce9c0af680 msgr2=0x7fce9c158640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:01.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.621+0000 7fcea446f700 1 --2- 172.21.15.8:0/2204915953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce9c0af680 0x7fce9c158640 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fce9800c580 tx=0x7fce98007e10 comp rx=0 tx=0).stop 2023-10-06T04:36:01.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.621+0000 7fcea446f700 1 -- 172.21.15.8:0/2204915953 shutdown_connections 2023-10-06T04:36:01.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.621+0000 7fcea446f700 1 --2- 172.21.15.8:0/2204915953 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce9c0d0aa0 0x7fce9c0b38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:01.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.621+0000 7fcea446f700 1 --2- 172.21.15.8:0/2204915953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce9c0af680 0x7fce9c158640 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:01.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.621+0000 7fcea446f700 1 --2- 172.21.15.8:0/2204915953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce9c0cb360 0x7fce9c0b5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:01.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.621+0000 7fcea446f700 1 -- 172.21.15.8:0/2204915953 >> 172.21.15.8:0/2204915953 conn(0x7fce9c0633d0 msgr2=0x7fce9c15af90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:01.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.621+0000 7fcea446f700 1 -- 172.21.15.8:0/2204915953 shutdown_connections 2023-10-06T04:36:01.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:01.621+0000 7fcea446f700 1 -- 172.21.15.8:0/2204915953 wait complete. 2023-10-06T04:36:01.635 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-06T04:36:01.635 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-06T04:36:01.683 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-06T04:36:01.682+0000 7fce81fe0180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T04:36:01.685 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-06T04:36:01.684+0000 7fab393ed180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T04:36:01.762 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-06T04:36:01.760+0000 7fce81fe0180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T04:36:01.766 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-06T04:36:01.765+0000 7fab393ed180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T04:36:01.841 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-06T04:36:01.839+0000 7fce81fe0180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T04:36:01.847 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-06T04:36:01.846+0000 7fab393ed180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T04:36:01.991 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-10-06T04:36:01.989+0000 7f177f65b540 -1 Falling back to public interface 2023-10-06T04:36:02.000 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-10-06T04:36:01.998+0000 7f890b4f6540 -1 Falling back to public interface 2023-10-06T04:36:02.006 INFO:tasks.ceph.osd.2.smithi008.stderr:2023-10-06T04:36:02.004+0000 7fd37a6d5540 -1 Falling back to public interface 2023-10-06T04:36:02.012 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-10-06T04:36:02.010+0000 7f43685fe540 -1 Falling back to public interface 2023-10-06T04:36:02.013 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-10-06T04:36:02.011+0000 7fb510548540 -1 Falling back to public interface 2023-10-06T04:36:02.015 INFO:tasks.ceph.osd.1.smithi008.stderr:2023-10-06T04:36:02.014+0000 7fb1b2a6d540 -1 Falling back to public interface 2023-10-06T04:36:02.017 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-10-06T04:36:02.015+0000 7f79d7029540 -1 Falling back to public interface 2023-10-06T04:36:02.018 INFO:tasks.ceph.osd.3.smithi008.stderr:2023-10-06T04:36:02.017+0000 7f4337e70540 -1 Falling back to public interface 2023-10-06T04:36:02.433 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-06T04:36:02.431+0000 7fce81fe0180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T04:36:02.441 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T04:36:02.450 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-06T04:36:02.449+0000 7fab393ed180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T04:36:02.551 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.550+0000 7f35fa17e700 1 Processor -- start 2023-10-06T04:36:02.551 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.550+0000 7f35fa17e700 1 -- start start 2023-10-06T04:36:02.553 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.551+0000 7f35fa17e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f35f4140a30 0x7f35f415b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:02.553 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.551+0000 7f35fa17e700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35f40c82f0 con 0x7f35f4140e00 2023-10-06T04:36:02.553 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.551+0000 7f35fa17e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35f40b05d0 con 0x7f35f40675d0 2023-10-06T04:36:02.553 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.551+0000 7f35fa17e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35f415be90 con 0x7f35f4140a30 2023-10-06T04:36:02.553 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.551+0000 7f35f2ffd700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f35f4140e00 0x7f35f40afec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:56316/0 (socket says 172.21.15.8:56316) 2023-10-06T04:36:02.553 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.551+0000 7f35f2ffd700 1 -- 172.21.15.8:0/854104072 learned_addr learned my addr 172.21.15.8:0/854104072 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:02.553 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.551+0000 7f35f37fe700 1 --2- 172.21.15.8:0/854104072 >> v2:172.21.15.184:3300/0 conn(0x7f35f4140a30 0x7f35f415b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:02.553 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.551+0000 7f35f27fc700 1 -- 172.21.15.8:0/854104072 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2000977802 0 0) 0x7f35f40c82f0 con 0x7f35f4140e00 2023-10-06T04:36:02.553 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.551+0000 7f35f27fc700 1 -- 172.21.15.8:0/854104072 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35dc003570 con 0x7f35f4140e00 2023-10-06T04:36:02.554 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.551+0000 7f35f37fe700 1 -- 172.21.15.8:0/854104072 >> v1:172.21.15.184:6789/0 conn(0x7f35f40675d0 legacy=0x7f35f40679f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:02.554 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.551+0000 7f35f37fe700 1 -- 172.21.15.8:0/854104072 >> v1:172.21.15.8:6789/0 conn(0x7f35f4140e00 legacy=0x7f35f40afec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:02.554 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.551+0000 7f35f37fe700 1 -- 172.21.15.8:0/854104072 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f406cdb0 con 0x7f35f4140a30 2023-10-06T04:36:02.554 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.551+0000 7f35f37fe700 1 --2- 172.21.15.8:0/854104072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35f4140a30 0x7f35f415b950 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f35e40098e0 tx=0x7f35e40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6fcb9cc58247591 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:02.554 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.552+0000 7f35f27fc700 1 -- 172.21.15.8:0/854104072 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e400b640 con 0x7f35f4140a30 2023-10-06T04:36:02.554 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.552+0000 7f35f27fc700 1 -- 172.21.15.8:0/854104072 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e400b7a0 con 0x7f35f4140a30 2023-10-06T04:36:02.554 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.552+0000 7f35f27fc700 1 -- 172.21.15.8:0/854104072 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e400bb40 con 0x7f35f4140a30 2023-10-06T04:36:02.555 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.552+0000 7f35fa17e700 1 -- 172.21.15.8:0/854104072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35f4140a30 msgr2=0x7f35f415b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:02.555 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.552+0000 7f35fa17e700 1 --2- 172.21.15.8:0/854104072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35f4140a30 0x7f35f415b950 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f35e40098e0 tx=0x7f35e40091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:02.555 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.552+0000 7f35fa17e700 1 -- 172.21.15.8:0/854104072 shutdown_connections 2023-10-06T04:36:02.555 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.552+0000 7f35fa17e700 1 --2- 172.21.15.8:0/854104072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35f4140a30 0x7f35f415b950 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:02.556 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.552+0000 7f35fa17e700 1 -- 172.21.15.8:0/854104072 >> 172.21.15.8:0/854104072 conn(0x7f35f40cd100 msgr2=0x7f35f40cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:02.556 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.552+0000 7f35fa17e700 1 -- 172.21.15.8:0/854104072 shutdown_connections 2023-10-06T04:36:02.556 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.552+0000 7f35fa17e700 1 -- 172.21.15.8:0/854104072 wait complete. 2023-10-06T04:36:02.556 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.553+0000 7f35fa17e700 1 Processor -- start 2023-10-06T04:36:02.556 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.553+0000 7f35fa17e700 1 -- start start 2023-10-06T04:36:02.558 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.554+0000 7f35fa17e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35f40675d0 0x7f35f40c6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:02.558 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.554+0000 7f35fa17e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f35f4140a30 0x7f35f4156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:02.558 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.554+0000 7f35fa17e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35f4140e00 0x7f35f413db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:02.558 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.554+0000 7f35fa17e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f40c6dd0 con 0x7f35f4140e00 2023-10-06T04:36:02.558 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.554+0000 7f35fa17e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f413a640 con 0x7f35f40675d0 2023-10-06T04:36:02.558 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.554+0000 7f35fa17e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f40b0b40 con 0x7f35f4140a30 2023-10-06T04:36:02.558 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.554+0000 7f35f3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35f4140e00 0x7f35f413db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:02.558 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.554+0000 7f35f3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35f4140e00 0x7f35f413db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39512/0 (socket says 172.21.15.8:39512) 2023-10-06T04:36:02.558 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.554+0000 7f35f3fff700 1 -- 172.21.15.8:0/1623593290 learned_addr learned my addr 172.21.15.8:0/1623593290 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:02.559 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.554+0000 7f35f37fe700 1 --2- 172.21.15.8:0/1623593290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35f40675d0 0x7f35f40c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:02.559 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.554+0000 7f35f2ffd700 1 --2- 172.21.15.8:0/1623593290 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f35f4140a30 0x7f35f4156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:02.559 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.555+0000 7f35f3fff700 1 -- 172.21.15.8:0/1623593290 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f35f4140a30 msgr2=0x7f35f4156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:02.559 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.555+0000 7f35f3fff700 1 --2- 172.21.15.8:0/1623593290 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f35f4140a30 0x7f35f4156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:02.559 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.555+0000 7f35f3fff700 1 -- 172.21.15.8:0/1623593290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35f40675d0 msgr2=0x7f35f40c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:02.559 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.555+0000 7f35f3fff700 1 --2- 172.21.15.8:0/1623593290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35f40675d0 0x7f35f40c6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:02.559 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.555+0000 7f35f3fff700 1 -- 172.21.15.8:0/1623593290 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e4009420 con 0x7f35f4140e00 2023-10-06T04:36:02.559 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.555+0000 7f35f3fff700 1 --2- 172.21.15.8:0/1623593290 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35f4140e00 0x7f35f413db60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f35ec00c8e0 tx=0x7f35ec001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:02.559 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.555+0000 7f35db7fe700 1 -- 172.21.15.8:0/1623593290 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec012630 con 0x7f35f4140e00 2023-10-06T04:36:02.559 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.555+0000 7f35db7fe700 1 -- 172.21.15.8:0/1623593290 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ec012790 con 0x7f35f4140e00 2023-10-06T04:36:02.560 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.555+0000 7f35fa17e700 1 -- 172.21.15.8:0/1623593290 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35f40b0e20 con 0x7f35f4140e00 2023-10-06T04:36:02.560 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.555+0000 7f35db7fe700 1 -- 172.21.15.8:0/1623593290 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec012b50 con 0x7f35f4140e00 2023-10-06T04:36:02.560 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.555+0000 7f35fa17e700 1 -- 172.21.15.8:0/1623593290 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35f40b13e0 con 0x7f35f4140e00 2023-10-06T04:36:02.560 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.555+0000 7f35db7fe700 1 -- 172.21.15.8:0/1623593290 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f35ec01b400 con 0x7f35f4140e00 2023-10-06T04:36:02.560 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.555+0000 7f35db7fe700 1 -- 172.21.15.8:0/1623593290 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f35ec01aa80 con 0x7f35f4140e00 2023-10-06T04:36:02.560 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.556+0000 7f35fa17e700 1 -- 172.21.15.8:0/1623593290 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35f413a800 con 0x7f35f4140e00 2023-10-06T04:36:02.560 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.558+0000 7f35db7fe700 1 -- 172.21.15.8:0/1623593290 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f35ec01ac40 con 0x7f35f4140e00 2023-10-06T04:36:02.573 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-06T04:36:02.570+0000 7fce81fe0180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T04:36:02.635 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-06T04:36:02.597+0000 7fab393ed180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T04:36:02.637 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.629+0000 7f35fa17e700 1 -- 172.21.15.8:0/1623593290 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35f40c7810 con 0x7f35f4140e00 2023-10-06T04:36:02.637 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.629+0000 7f35db7fe700 1 -- 172.21.15.8:0/1623593290 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f35ec01ade0 con 0x7f35f4140e00 2023-10-06T04:36:02.639 INFO:teuthology.misc.health.smithi008.stdout: 2023-10-06T04:36:02.639 INFO:teuthology.misc.health.smithi008.stdout:{"epoch":10,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:36:01.360785+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:36:02.643 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.630+0000 7f35fa17e700 1 -- 172.21.15.8:0/1623593290 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35f4140e00 msgr2=0x7f35f413db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:02.643 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.630+0000 7f35fa17e700 1 --2- 172.21.15.8:0/1623593290 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35f4140e00 0x7f35f413db60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f35ec00c8e0 tx=0x7f35ec001710 comp rx=0 tx=0).stop 2023-10-06T04:36:02.643 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.630+0000 7f35fa17e700 1 -- 172.21.15.8:0/1623593290 shutdown_connections 2023-10-06T04:36:02.643 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.630+0000 7f35fa17e700 1 --2- 172.21.15.8:0/1623593290 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35f4140e00 0x7f35f413db60 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:02.643 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.630+0000 7f35fa17e700 1 --2- 172.21.15.8:0/1623593290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35f40675d0 0x7f35f40c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:02.643 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.630+0000 7f35fa17e700 1 --2- 172.21.15.8:0/1623593290 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f35f4140a30 0x7f35f4156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:02.643 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.630+0000 7f35fa17e700 1 -- 172.21.15.8:0/1623593290 >> 172.21.15.8:0/1623593290 conn(0x7f35f40cd100 msgr2=0x7f35f40cd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:02.643 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.630+0000 7f35fa17e700 1 -- 172.21.15.8:0/1623593290 shutdown_connections 2023-10-06T04:36:02.644 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:02.630+0000 7f35fa17e700 1 -- 172.21.15.8:0/1623593290 wait complete. 2023-10-06T04:36:02.644 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-06T04:36:02.669 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-06T04:36:02.667+0000 7fce81fe0180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T04:36:02.691 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-06T04:36:02.689+0000 7fab393ed180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T04:36:02.921 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-06T04:36:02.918+0000 7fce81fe0180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T04:36:02.947 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-06T04:36:02.946+0000 7fab393ed180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T04:36:02.997 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-06T04:36:02.995+0000 7fce81fe0180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T04:36:03.028 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-06T04:36:03.027+0000 7fab393ed180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T04:36:03.841 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-06T04:36:03.839+0000 7fce81fe0180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T04:36:03.891 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-06T04:36:03.889+0000 7fab393ed180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T04:36:03.916 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-06T04:36:03.914+0000 7fce81fe0180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T04:36:03.968 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-06T04:36:03.966+0000 7fab393ed180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T04:36:03.992 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-06T04:36:03.990+0000 7fce81fe0180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T04:36:04.046 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-06T04:36:04.044+0000 7fab393ed180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T04:36:04.123 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-06T04:36:04.121+0000 7fce81fe0180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T04:36:04.184 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-06T04:36:04.183+0000 7fab393ed180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T04:36:04.210 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-06T04:36:04.208+0000 7fce81fe0180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T04:36:04.272 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-06T04:36:04.270+0000 7fab393ed180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T04:36:04.373 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-06T04:36:04.372+0000 7fce81fe0180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T04:36:04.433 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-06T04:36:04.431+0000 7fab393ed180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T04:36:04.452 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-06T04:36:04.450+0000 7fce81fe0180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T04:36:04.517 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-06T04:36:04.516+0000 7fab393ed180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T04:36:04.535 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-06T04:36:04.533+0000 7fce81fe0180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T04:36:04.595 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-06T04:36:04.594+0000 7fab393ed180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T04:36:04.609 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-06T04:36:04.607+0000 7fce81fe0180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T04:36:04.675 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-06T04:36:04.673+0000 7fab393ed180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T04:36:04.994 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-10-06T04:36:04.992+0000 7f177f65b540 -1 osd.4 0 log_to_monitors true 2023-10-06T04:36:05.488 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-10-06T04:36:05.486+0000 7f890b4f6540 -1 osd.7 0 log_to_monitors true 2023-10-06T04:36:05.515 INFO:tasks.ceph.osd.1.smithi008.stderr:2023-10-06T04:36:05.513+0000 7fb1b2a6d540 -1 osd.1 0 log_to_monitors true 2023-10-06T04:36:05.515 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-10-06T04:36:05.513+0000 7f43685fe540 -1 osd.6 0 log_to_monitors true 2023-10-06T04:36:05.517 INFO:tasks.ceph.osd.2.smithi008.stderr:2023-10-06T04:36:05.516+0000 7fd37a6d5540 -1 osd.2 0 log_to_monitors true 2023-10-06T04:36:05.528 INFO:tasks.ceph.osd.3.smithi008.stderr:2023-10-06T04:36:05.527+0000 7f4337e70540 -1 osd.3 0 log_to_monitors true 2023-10-06T04:36:05.529 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-10-06T04:36:05.527+0000 7f79d7029540 -1 osd.5 0 log_to_monitors true 2023-10-06T04:36:05.529 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-10-06T04:36:05.528+0000 7fb510548540 -1 osd.0 0 log_to_monitors true 2023-10-06T04:36:05.633 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-06T04:36:05.631+0000 7fce3b3e0700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-06T04:36:05.636 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-06T04:36:05.635+0000 7fce3b3e0700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-06T04:36:08.151 INFO:tasks.ceph.osd.2.smithi008.stderr:2023-10-06T04:36:08.150+0000 7fd3712f7700 -1 osd.2 0 waiting for initial osdmap 2023-10-06T04:36:08.158 INFO:tasks.ceph.osd.2.smithi008.stderr:2023-10-06T04:36:08.157+0000 7fd36a0ee700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:36:08.165 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-10-06T04:36:08.163+0000 7fb50716a700 -1 osd.0 0 waiting for initial osdmap 2023-10-06T04:36:08.166 INFO:tasks.ceph.osd.3.smithi008.stderr:2023-10-06T04:36:08.165+0000 7f432ea92700 -1 osd.3 0 waiting for initial osdmap 2023-10-06T04:36:08.171 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-10-06T04:36:08.170+0000 7fb4fff61700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:36:08.172 INFO:tasks.ceph.osd.3.smithi008.stderr:2023-10-06T04:36:08.170+0000 7f4327889700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:36:08.179 INFO:tasks.ceph.osd.1.smithi008.stderr:2023-10-06T04:36:08.178+0000 7fb1a968f700 -1 osd.1 0 waiting for initial osdmap 2023-10-06T04:36:08.182 INFO:tasks.ceph.osd.1.smithi008.stderr:2023-10-06T04:36:08.181+0000 7fb1a2486700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:36:08.752 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-10-06T04:36:08.749+0000 7f435f220700 -1 osd.6 0 waiting for initial osdmap 2023-10-06T04:36:08.756 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-10-06T04:36:08.755+0000 7f4358017700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:36:08.764 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-10-06T04:36:08.763+0000 7f79cdc4b700 -1 osd.5 0 waiting for initial osdmap 2023-10-06T04:36:08.769 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-10-06T04:36:08.768+0000 7f79c6a42700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:36:08.838 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-10-06T04:36:08.836+0000 7f177627d700 -1 osd.4 0 waiting for initial osdmap 2023-10-06T04:36:08.843 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-10-06T04:36:08.840+0000 7f176f074700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:36:08.844 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-10-06T04:36:08.843+0000 7f8902118700 -1 osd.7 0 waiting for initial osdmap 2023-10-06T04:36:08.849 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-10-06T04:36:08.847+0000 7f88faf0f700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:36:09.451 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T04:36:09.574 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.572+0000 7fd7f76c1700 1 Processor -- start 2023-10-06T04:36:09.574 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.573+0000 7fd7f76c1700 1 -- start start 2023-10-06T04:36:09.576 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.573+0000 7fd7f76c1700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd7f01596d0 0x7fd7f00688c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:09.576 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.573+0000 7fd7f76c1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7f00cabb0 0x7fd7f00c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:09.577 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.573+0000 7fd7f76c1700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7f00675d0 con 0x7fd7f00c1a50 2023-10-06T04:36:09.577 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.573+0000 7fd7f76c1700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7f0068430 con 0x7fd7f01596d0 2023-10-06T04:36:09.577 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.573+0000 7fd7f76c1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f0067820 con 0x7fd7f00cabb0 2023-10-06T04:36:09.577 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.574+0000 7fd7f4c5c700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fd7f00c1a50 0x7fd7f00ca4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:33982/0 (socket says 172.21.15.8:33982) 2023-10-06T04:36:09.577 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.574+0000 7fd7f4c5c700 1 -- 172.21.15.8:0/3223421095 learned_addr learned my addr 172.21.15.8:0/3223421095 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:09.577 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.574+0000 7fd7f545d700 1 --2- 172.21.15.8:0/3223421095 >> v2:172.21.15.184:3300/0 conn(0x7fd7f01596d0 0x7fd7f00688c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:09.577 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.574+0000 7fd7f5c5e700 1 --2- 172.21.15.8:0/3223421095 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7f00cabb0 0x7fd7f00c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:09.577 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.574+0000 7fd7e7fff700 1 -- 172.21.15.8:0/3223421095 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3149720398 0 0) 0x7fd7f00675d0 con 0x7fd7f00c1a50 2023-10-06T04:36:09.577 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.574+0000 7fd7e7fff700 1 -- 172.21.15.8:0/3223421095 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7dc003570 con 0x7fd7f00c1a50 2023-10-06T04:36:09.577 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.574+0000 7fd7f545d700 1 -- 172.21.15.8:0/3223421095 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7f00cabb0 msgr2=0x7fd7f00c6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:09.577 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.574+0000 7fd7f545d700 1 --2- 172.21.15.8:0/3223421095 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7f00cabb0 0x7fd7f00c6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:09.578 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.574+0000 7fd7f545d700 1 -- 172.21.15.8:0/3223421095 >> v1:172.21.15.8:6789/0 conn(0x7fd7f00c1a50 legacy=0x7fd7f00ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:09.578 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.574+0000 7fd7f545d700 1 -- 172.21.15.8:0/3223421095 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f0067b00 con 0x7fd7f01596d0 2023-10-06T04:36:09.578 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.574+0000 7fd7f5c5e700 1 --2- 172.21.15.8:0/3223421095 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7f00cabb0 0x7fd7f00c6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:36:09.578 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.574+0000 7fd7f545d700 1 --2- 172.21.15.8:0/3223421095 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7f01596d0 0x7fd7f00688c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd7e00098e0 tx=0x7fd7e00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70ca830e3b9bc7fc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:09.578 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.574+0000 7fd7e7fff700 1 -- 172.21.15.8:0/3223421095 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e0011630 con 0x7fd7f01596d0 2023-10-06T04:36:09.578 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.574+0000 7fd7e7fff700 1 -- 172.21.15.8:0/3223421095 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e0011790 con 0x7fd7f01596d0 2023-10-06T04:36:09.578 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.574+0000 7fd7e7fff700 1 -- 172.21.15.8:0/3223421095 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e0011b30 con 0x7fd7f01596d0 2023-10-06T04:36:09.578 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.575+0000 7fd7f76c1700 1 -- 172.21.15.8:0/3223421095 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7f01596d0 msgr2=0x7fd7f00688c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:09.578 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.575+0000 7fd7f76c1700 1 --2- 172.21.15.8:0/3223421095 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7f01596d0 0x7fd7f00688c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd7e00098e0 tx=0x7fd7e00091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:09.578 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.575+0000 7fd7f76c1700 1 -- 172.21.15.8:0/3223421095 shutdown_connections 2023-10-06T04:36:09.578 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.575+0000 7fd7f76c1700 1 --2- 172.21.15.8:0/3223421095 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7f01596d0 0x7fd7f00688c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:09.578 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.575+0000 7fd7f76c1700 1 --2- 172.21.15.8:0/3223421095 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7f00cabb0 0x7fd7f00c6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:09.579 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.575+0000 7fd7f76c1700 1 -- 172.21.15.8:0/3223421095 >> 172.21.15.8:0/3223421095 conn(0x7fd7f00c9340 msgr2=0x7fd7f00c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:09.579 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.575+0000 7fd7f76c1700 1 -- 172.21.15.8:0/3223421095 shutdown_connections 2023-10-06T04:36:09.579 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.575+0000 7fd7f76c1700 1 -- 172.21.15.8:0/3223421095 wait complete. 2023-10-06T04:36:09.581 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.576+0000 7fd7f76c1700 1 Processor -- start 2023-10-06T04:36:09.581 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.576+0000 7fd7f76c1700 1 -- start start 2023-10-06T04:36:09.581 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.577+0000 7fd7f76c1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7f00c1a50 0x7fd7f0155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:09.581 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.577+0000 7fd7f76c1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7f00cabb0 0x7fd7f0069990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:09.581 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.577+0000 7fd7f76c1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7f01596d0 0x7fd7f00b1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:09.581 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.577+0000 7fd7f76c1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f01699c0 con 0x7fd7f01596d0 2023-10-06T04:36:09.582 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.577+0000 7fd7f76c1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f0169c70 con 0x7fd7f00c1a50 2023-10-06T04:36:09.582 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.577+0000 7fd7f76c1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f006a370 con 0x7fd7f00cabb0 2023-10-06T04:36:09.583 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.577+0000 7fd7f5c5e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7f01596d0 0x7fd7f00b1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:09.583 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.577+0000 7fd7f5c5e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7f01596d0 0x7fd7f00b1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60876/0 (socket says 172.21.15.8:60876) 2023-10-06T04:36:09.583 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.577+0000 7fd7f5c5e700 1 -- 172.21.15.8:0/1173666744 learned_addr learned my addr 172.21.15.8:0/1173666744 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:09.583 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.577+0000 7fd7f545d700 1 --2- 172.21.15.8:0/1173666744 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7f00c1a50 0x7fd7f0155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:09.583 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.577+0000 7fd7f4c5c700 1 --2- 172.21.15.8:0/1173666744 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7f00cabb0 0x7fd7f0069990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:09.583 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.578+0000 7fd7f5c5e700 1 -- 172.21.15.8:0/1173666744 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7f00cabb0 msgr2=0x7fd7f0069990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:09.583 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.578+0000 7fd7f5c5e700 1 --2- 172.21.15.8:0/1173666744 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7f00cabb0 0x7fd7f0069990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:09.583 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.578+0000 7fd7f5c5e700 1 -- 172.21.15.8:0/1173666744 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7f00c1a50 msgr2=0x7fd7f0155690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:09.583 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.578+0000 7fd7f5c5e700 1 --2- 172.21.15.8:0/1173666744 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7f00c1a50 0x7fd7f0155690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:09.583 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.578+0000 7fd7f5c5e700 1 -- 172.21.15.8:0/1173666744 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e8009a20 con 0x7fd7f01596d0 2023-10-06T04:36:09.583 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.578+0000 7fd7f5c5e700 1 --2- 172.21.15.8:0/1173666744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7f01596d0 0x7fd7f00b1030 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd7e800ef90 tx=0x7fd7e800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:09.584 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.578+0000 7fd7e57fa700 1 -- 172.21.15.8:0/1173666744 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e800cbd0 con 0x7fd7f01596d0 2023-10-06T04:36:09.584 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.578+0000 7fd7e57fa700 1 -- 172.21.15.8:0/1173666744 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e800f040 con 0x7fd7f01596d0 2023-10-06T04:36:09.584 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.578+0000 7fd7f76c1700 1 -- 172.21.15.8:0/1173666744 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e0009420 con 0x7fd7f01596d0 2023-10-06T04:36:09.584 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.578+0000 7fd7e57fa700 1 -- 172.21.15.8:0/1173666744 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8014480 con 0x7fd7f01596d0 2023-10-06T04:36:09.584 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.578+0000 7fd7f76c1700 1 -- 172.21.15.8:0/1173666744 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f006a930 con 0x7fd7f01596d0 2023-10-06T04:36:09.584 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.579+0000 7fd7f76c1700 1 -- 172.21.15.8:0/1173666744 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7f006ab50 con 0x7fd7f01596d0 2023-10-06T04:36:09.584 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.579+0000 7fd7e57fa700 1 -- 172.21.15.8:0/1173666744 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fd7e8014870 con 0x7fd7f01596d0 2023-10-06T04:36:09.584 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.580+0000 7fd7e57fa700 1 --2- 172.21.15.8:0/1173666744 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd7d4066ea0 0x7fd7d4069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:09.584 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.580+0000 7fd7e57fa700 1 -- 172.21.15.8:0/1173666744 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7fd7e8084cc0 con 0x7fd7f01596d0 2023-10-06T04:36:09.584 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.580+0000 7fd7f545d700 1 --2- 172.21.15.8:0/1173666744 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd7d4066ea0 0x7fd7d4069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:09.585 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.580+0000 7fd7f545d700 1 --2- 172.21.15.8:0/1173666744 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd7d4066ea0 0x7fd7d4069350 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd7e00091e0 tx=0x7fd7e0017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:09.585 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.584+0000 7fd7e57fa700 1 -- 172.21.15.8:0/1173666744 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd7e8052440 con 0x7fd7f01596d0 2023-10-06T04:36:09.782 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.780+0000 7fd7f76c1700 1 -- 172.21.15.8:0/1173666744 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7f0071550 con 0x7fd7f01596d0 2023-10-06T04:36:09.782 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.781+0000 7fd7e57fa700 1 -- 172.21.15.8:0/1173666744 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10348 (secure 0 0 0) 0x7fd7e8018090 con 0x7fd7f01596d0 2023-10-06T04:36:09.782 INFO:teuthology.misc.health.smithi008.stdout: 2023-10-06T04:36:09.783 INFO:teuthology.misc.health.smithi008.stdout:{"epoch":13,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:36:09.164314+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:36:09.785 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.783+0000 7fd7f76c1700 1 -- 172.21.15.8:0/1173666744 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd7d4066ea0 msgr2=0x7fd7d4069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:09.785 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.783+0000 7fd7f76c1700 1 --2- 172.21.15.8:0/1173666744 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd7d4066ea0 0x7fd7d4069350 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd7e00091e0 tx=0x7fd7e0017000 comp rx=0 tx=0).stop 2023-10-06T04:36:09.785 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.783+0000 7fd7f76c1700 1 -- 172.21.15.8:0/1173666744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7f01596d0 msgr2=0x7fd7f00b1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:09.785 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.783+0000 7fd7f76c1700 1 --2- 172.21.15.8:0/1173666744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7f01596d0 0x7fd7f00b1030 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd7e800ef90 tx=0x7fd7e800b040 comp rx=0 tx=0).stop 2023-10-06T04:36:09.785 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.783+0000 7fd7f76c1700 1 -- 172.21.15.8:0/1173666744 shutdown_connections 2023-10-06T04:36:09.786 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.783+0000 7fd7f76c1700 1 --2- 172.21.15.8:0/1173666744 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd7d4066ea0 0x7fd7d4069350 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:09.786 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.783+0000 7fd7f76c1700 1 --2- 172.21.15.8:0/1173666744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7f01596d0 0x7fd7f00b1030 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:09.786 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.783+0000 7fd7f76c1700 1 --2- 172.21.15.8:0/1173666744 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7f00c1a50 0x7fd7f0155690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:09.786 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.783+0000 7fd7f76c1700 1 --2- 172.21.15.8:0/1173666744 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7f00cabb0 0x7fd7f0069990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:09.786 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.783+0000 7fd7f76c1700 1 -- 172.21.15.8:0/1173666744 >> 172.21.15.8:0/1173666744 conn(0x7fd7f00c9340 msgr2=0x7fd7f00c1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:09.786 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.783+0000 7fd7f76c1700 1 -- 172.21.15.8:0/1173666744 shutdown_connections 2023-10-06T04:36:09.786 INFO:teuthology.misc.health.smithi008.stderr:2023-10-06T04:36:09.783+0000 7fd7f76c1700 1 -- 172.21.15.8:0/1173666744 wait complete. 2023-10-06T04:36:09.795 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-06T04:36:09.795 INFO:tasks.ceph:Creating RBD pool 2023-10-06T04:36:09.796 DEBUG:teuthology.orchestra.run.smithi008:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-06T04:36:09.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.912+0000 7f346d42b700 1 Processor -- start 2023-10-06T04:36:09.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.912+0000 7f346d42b700 1 -- start start 2023-10-06T04:36:09.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.913+0000 7f346d42b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3468142cf0 0x7f34680b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:09.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.913+0000 7f346d42b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f34681430c0 0x7f34680cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:09.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.913+0000 7f346d42b700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34680cf510 con 0x7f34680cfee0 2023-10-06T04:36:09.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.913+0000 7f346d42b700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34680ce6a0 con 0x7f3468142cf0 2023-10-06T04:36:09.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.913+0000 7f346d42b700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34680ce900 con 0x7f34681430c0 2023-10-06T04:36:09.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.913+0000 7f3466ffd700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3468142cf0 0x7f34680b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:09.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.913+0000 7f3466ffd700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3468142cf0 0x7f34680b5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60878/0 (socket says 172.21.15.8:60878) 2023-10-06T04:36:09.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.913+0000 7f3466ffd700 1 -- 172.21.15.8:0/840234769 learned_addr learned my addr 172.21.15.8:0/840234769 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:09.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.913+0000 7f3466ffd700 1 -- 172.21.15.8:0/840234769 >> v2:172.21.15.184:3300/0 conn(0x7f34681430c0 msgr2=0x7f34680cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:09.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.913+0000 7f3466ffd700 1 --2- 172.21.15.8:0/840234769 >> v2:172.21.15.184:3300/0 conn(0x7f34681430c0 0x7f34680cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:09.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.913+0000 7f3466ffd700 1 -- 172.21.15.8:0/840234769 >> v1:172.21.15.184:6789/0 conn(0x7f34680cfee0 legacy=0x7f34680b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:09.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.913+0000 7f3466ffd700 1 -- 172.21.15.8:0/840234769 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34680cebe0 con 0x7f3468142cf0 2023-10-06T04:36:09.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.913+0000 7f3466ffd700 1 --2- 172.21.15.8:0/840234769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3468142cf0 0x7f34680b5cd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f34680ab440 tx=0x7f3458009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53b5d5f23f0c4c10 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:09.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.913+0000 7f34667fc700 1 -- 172.21.15.8:0/840234769 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345800b820 con 0x7f3468142cf0 2023-10-06T04:36:09.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.913+0000 7f34667fc700 1 -- 172.21.15.8:0/840234769 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f345800b980 con 0x7f3468142cf0 2023-10-06T04:36:09.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.913+0000 7f34667fc700 1 -- 172.21.15.8:0/840234769 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345800bd20 con 0x7f3468142cf0 2023-10-06T04:36:09.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.914+0000 7f346d42b700 1 -- 172.21.15.8:0/840234769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3468142cf0 msgr2=0x7f34680b5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:09.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.914+0000 7f346d42b700 1 --2- 172.21.15.8:0/840234769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3468142cf0 0x7f34680b5cd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f34680ab440 tx=0x7f3458009250 comp rx=0 tx=0).stop 2023-10-06T04:36:09.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.914+0000 7f346d42b700 1 -- 172.21.15.8:0/840234769 shutdown_connections 2023-10-06T04:36:09.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.914+0000 7f346d42b700 1 --2- 172.21.15.8:0/840234769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3468142cf0 0x7f34680b5cd0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:09.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.914+0000 7f346d42b700 1 --2- 172.21.15.8:0/840234769 >> v2:172.21.15.184:3300/0 conn(0x7f34681430c0 0x7f34680cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:09.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.914+0000 7f346d42b700 1 -- 172.21.15.8:0/840234769 >> 172.21.15.8:0/840234769 conn(0x7f346806ed00 msgr2=0x7f346806f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:09.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.914+0000 7f346d42b700 1 -- 172.21.15.8:0/840234769 shutdown_connections 2023-10-06T04:36:09.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.914+0000 7f346d42b700 1 -- 172.21.15.8:0/840234769 wait complete. 2023-10-06T04:36:09.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.915+0000 7f346d42b700 1 Processor -- start 2023-10-06T04:36:09.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.915+0000 7f346d42b700 1 -- start start 2023-10-06T04:36:09.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.916+0000 7f346d42b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34680cfee0 0x7f346813e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:09.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.916+0000 7f346d42b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3468142cf0 0x7f346815c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:09.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.916+0000 7f346d42b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34681430c0 0x7f3468169cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:09.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.916+0000 7f346d42b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346815afe0 con 0x7f34680cfee0 2023-10-06T04:36:09.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.916+0000 7f346d42b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346815ab50 con 0x7f3468142cf0 2023-10-06T04:36:09.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.916+0000 7f346d42b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3468159ca0 con 0x7f34681430c0 2023-10-06T04:36:09.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.916+0000 7f3466ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34680cfee0 0x7f346813e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:09.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.916+0000 7f3466ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34680cfee0 0x7f346813e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60888/0 (socket says 172.21.15.8:60888) 2023-10-06T04:36:09.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.916+0000 7f3466ffd700 1 -- 172.21.15.8:0/1704374223 learned_addr learned my addr 172.21.15.8:0/1704374223 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:09.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.916+0000 7f345e7fc700 1 --2- 172.21.15.8:0/1704374223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3468142cf0 0x7f346815c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:09.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.916+0000 7f34677fe700 1 --2- 172.21.15.8:0/1704374223 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34681430c0 0x7f3468169cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:09.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.916+0000 7f3466ffd700 1 -- 172.21.15.8:0/1704374223 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34681430c0 msgr2=0x7f3468169cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:09.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.916+0000 7f3466ffd700 1 --2- 172.21.15.8:0/1704374223 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34681430c0 0x7f3468169cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:09.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.916+0000 7f3466ffd700 1 -- 172.21.15.8:0/1704374223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3468142cf0 msgr2=0x7f346815c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:09.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.916+0000 7f3466ffd700 1 --2- 172.21.15.8:0/1704374223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3468142cf0 0x7f346815c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:09.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.916+0000 7f3466ffd700 1 -- 172.21.15.8:0/1704374223 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34580094f0 con 0x7f34680cfee0 2023-10-06T04:36:09.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.916+0000 7f3466ffd700 1 --2- 172.21.15.8:0/1704374223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34680cfee0 0x7f346813e550 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3458009290 tx=0x7f3458016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:09.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.917+0000 7f345f7fe700 1 -- 172.21.15.8:0/1704374223 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345801a460 con 0x7f34680cfee0 2023-10-06T04:36:09.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.917+0000 7f345f7fe700 1 -- 172.21.15.8:0/1704374223 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f345801a5e0 con 0x7f34680cfee0 2023-10-06T04:36:09.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.917+0000 7f346d42b700 1 -- 172.21.15.8:0/1704374223 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3468159f40 con 0x7f34680cfee0 2023-10-06T04:36:09.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.917+0000 7f345f7fe700 1 -- 172.21.15.8:0/1704374223 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345801a9a0 con 0x7f34680cfee0 2023-10-06T04:36:09.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.917+0000 7f346d42b700 1 -- 172.21.15.8:0/1704374223 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f346815a500 con 0x7f34680cfee0 2023-10-06T04:36:09.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.917+0000 7f346d42b700 1 -- 172.21.15.8:0/1704374223 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3468071550 con 0x7f34680cfee0 2023-10-06T04:36:09.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.918+0000 7f345f7fe700 1 -- 172.21.15.8:0/1704374223 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f345801ad50 con 0x7f34680cfee0 2023-10-06T04:36:09.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.918+0000 7f345f7fe700 1 --2- 172.21.15.8:0/1704374223 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3448066ea0 0x7f3448069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:09.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.918+0000 7f345f7fe700 1 -- 172.21.15.8:0/1704374223 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f34580858e0 con 0x7f34680cfee0 2023-10-06T04:36:09.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.919+0000 7f345e7fc700 1 --2- 172.21.15.8:0/1704374223 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3448066ea0 0x7f3448069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:09.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.919+0000 7f345e7fc700 1 --2- 172.21.15.8:0/1704374223 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3448066ea0 0x7f3448069350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f34680cfd80 tx=0x7f3450008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:09.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:09.923+0000 7f345f7fe700 1 -- 172.21.15.8:0/1704374223 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3458053100 con 0x7f34680cfee0 2023-10-06T04:36:10.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.118+0000 7f346d42b700 1 -- 172.21.15.8:0/1704374223 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f34680ceec0 con 0x7f34680cfee0 2023-10-06T04:36:10.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.171+0000 7f345f7fe700 1 -- 172.21.15.8:0/1704374223 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) v1 ==== 109+0+0 (secure 0 0 0) 0x7f345802a0a0 con 0x7f34680cfee0 2023-10-06T04:36:10.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.173+0000 7f346d42b700 1 -- 172.21.15.8:0/1704374223 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3448066ea0 msgr2=0x7f3448069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:10.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.173+0000 7f346d42b700 1 --2- 172.21.15.8:0/1704374223 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3448066ea0 0x7f3448069350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f34680cfd80 tx=0x7f3450008040 comp rx=0 tx=0).stop 2023-10-06T04:36:10.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.173+0000 7f346d42b700 1 -- 172.21.15.8:0/1704374223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34680cfee0 msgr2=0x7f346813e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:10.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.173+0000 7f346d42b700 1 --2- 172.21.15.8:0/1704374223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34680cfee0 0x7f346813e550 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3458009290 tx=0x7f3458016000 comp rx=0 tx=0).stop 2023-10-06T04:36:10.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.174+0000 7f346d42b700 1 -- 172.21.15.8:0/1704374223 shutdown_connections 2023-10-06T04:36:10.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.174+0000 7f346d42b700 1 --2- 172.21.15.8:0/1704374223 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3448066ea0 0x7f3448069350 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:10.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.174+0000 7f346d42b700 1 --2- 172.21.15.8:0/1704374223 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34681430c0 0x7f3468169cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:10.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.174+0000 7f346d42b700 1 --2- 172.21.15.8:0/1704374223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34680cfee0 0x7f346813e550 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:10.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.174+0000 7f346d42b700 1 --2- 172.21.15.8:0/1704374223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3468142cf0 0x7f346815c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:10.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.174+0000 7f346d42b700 1 -- 172.21.15.8:0/1704374223 >> 172.21.15.8:0/1704374223 conn(0x7f346806ed00 msgr2=0x7f346815d170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:10.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.174+0000 7f346d42b700 1 -- 172.21.15.8:0/1704374223 shutdown_connections 2023-10-06T04:36:10.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.174+0000 7f346d42b700 1 -- 172.21.15.8:0/1704374223 wait complete. 2023-10-06T04:36:10.177 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'rbd' created 2023-10-06T04:36:10.187 DEBUG:teuthology.orchestra.run.smithi008:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-06T04:36:10.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.307+0000 7f40e1a62700 1 Processor -- start 2023-10-06T04:36:10.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.307+0000 7f40e1a62700 1 -- start start 2023-10-06T04:36:10.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.307+0000 7f40e1a62700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40dc0af5a0 0x7f40dc15d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:10.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.307+0000 7f40e1a62700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f40dc0af970 0x7f40dc15a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:10.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.307+0000 7f40e1a62700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40dc0ce820 con 0x7f40dc0cce20 2023-10-06T04:36:10.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.308+0000 7f40e1a62700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40dc15e2d0 con 0x7f40dc0af970 2023-10-06T04:36:10.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.308+0000 7f40e1a62700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc15ad10 con 0x7f40dc0af5a0 2023-10-06T04:36:10.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.308+0000 7f40daffd700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f40dc0af970 0x7f40dc15a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:10.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.308+0000 7f40dbfff700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f40dc0cce20 0x7f40dc068470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:33996/0 (socket says 172.21.15.8:33996) 2023-10-06T04:36:10.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.308+0000 7f40daffd700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f40dc0af970 0x7f40dc15a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60892/0 (socket says 172.21.15.8:60892) 2023-10-06T04:36:10.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.308+0000 7f40dbfff700 1 -- 172.21.15.8:0/3163406848 learned_addr learned my addr 172.21.15.8:0/3163406848 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:10.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.308+0000 7f40db7fe700 1 --2- 172.21.15.8:0/3163406848 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40dc0af5a0 0x7f40dc15d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:10.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.308+0000 7f40daffd700 1 -- 172.21.15.8:0/3163406848 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40dc0af5a0 msgr2=0x7f40dc15d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:10.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.308+0000 7f40daffd700 1 --2- 172.21.15.8:0/3163406848 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40dc0af5a0 0x7f40dc15d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:10.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.308+0000 7f40daffd700 1 -- 172.21.15.8:0/3163406848 >> v1:172.21.15.8:6789/0 conn(0x7f40dc0cce20 legacy=0x7f40dc068470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:10.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.308+0000 7f40daffd700 1 -- 172.21.15.8:0/3163406848 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40dc15da30 con 0x7f40dc0af970 2023-10-06T04:36:10.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.308+0000 7f40daffd700 1 --2- 172.21.15.8:0/3163406848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40dc0af970 0x7f40dc15a7d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f40d00098e0 tx=0x7f40d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8722a35f499f2c9e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:10.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.308+0000 7f40da7fc700 1 -- 172.21.15.8:0/3163406848 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d000b640 con 0x7f40dc0af970 2023-10-06T04:36:10.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.308+0000 7f40da7fc700 1 -- 172.21.15.8:0/3163406848 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d000b7a0 con 0x7f40dc0af970 2023-10-06T04:36:10.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.308+0000 7f40da7fc700 1 -- 172.21.15.8:0/3163406848 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d000bb40 con 0x7f40dc0af970 2023-10-06T04:36:10.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.309+0000 7f40e1a62700 1 -- 172.21.15.8:0/3163406848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40dc0af970 msgr2=0x7f40dc15a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:10.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.309+0000 7f40e1a62700 1 --2- 172.21.15.8:0/3163406848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40dc0af970 0x7f40dc15a7d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f40d00098e0 tx=0x7f40d00091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:10.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.309+0000 7f40e1a62700 1 -- 172.21.15.8:0/3163406848 shutdown_connections 2023-10-06T04:36:10.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.309+0000 7f40e1a62700 1 --2- 172.21.15.8:0/3163406848 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40dc0af5a0 0x7f40dc15d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:10.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.309+0000 7f40e1a62700 1 --2- 172.21.15.8:0/3163406848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40dc0af970 0x7f40dc15a7d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:10.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.309+0000 7f40e1a62700 1 -- 172.21.15.8:0/3163406848 >> 172.21.15.8:0/3163406848 conn(0x7f40dc06ed00 msgr2=0x7f40dc06f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:10.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.309+0000 7f40e1a62700 1 -- 172.21.15.8:0/3163406848 shutdown_connections 2023-10-06T04:36:10.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.309+0000 7f40e1a62700 1 -- 172.21.15.8:0/3163406848 wait complete. 2023-10-06T04:36:10.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.310+0000 7f40e1a62700 1 Processor -- start 2023-10-06T04:36:10.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.310+0000 7f40e1a62700 1 -- start start 2023-10-06T04:36:10.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.311+0000 7f40e1a62700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40dc0af5a0 0x7f40dc0b4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:10.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.311+0000 7f40e1a62700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40dc0af970 0x7f40dc148fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:10.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.311+0000 7f40e1a62700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40dc0cce20 0x7f40dc0c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:10.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.311+0000 7f40e1a62700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc169d50 con 0x7f40dc0cce20 2023-10-06T04:36:10.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.311+0000 7f40e1a62700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc16a010 con 0x7f40dc0af5a0 2023-10-06T04:36:10.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.311+0000 7f40e1a62700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc16a2f0 con 0x7f40dc0af970 2023-10-06T04:36:10.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.311+0000 7f40dbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40dc0cce20 0x7f40dc0c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:10.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.311+0000 7f40dbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40dc0cce20 0x7f40dc0c74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60900/0 (socket says 172.21.15.8:60900) 2023-10-06T04:36:10.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.311+0000 7f40dbfff700 1 -- 172.21.15.8:0/3376213506 learned_addr learned my addr 172.21.15.8:0/3376213506 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:10.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.311+0000 7f40daffd700 1 --2- 172.21.15.8:0/3376213506 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40dc0af970 0x7f40dc148fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:10.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.311+0000 7f40db7fe700 1 --2- 172.21.15.8:0/3376213506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40dc0af5a0 0x7f40dc0b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:10.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.311+0000 7f40dbfff700 1 -- 172.21.15.8:0/3376213506 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40dc0af970 msgr2=0x7f40dc148fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:10.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.311+0000 7f40dbfff700 1 --2- 172.21.15.8:0/3376213506 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40dc0af970 0x7f40dc148fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:10.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.311+0000 7f40dbfff700 1 -- 172.21.15.8:0/3376213506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40dc0af5a0 msgr2=0x7f40dc0b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:10.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.311+0000 7f40dbfff700 1 --2- 172.21.15.8:0/3376213506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40dc0af5a0 0x7f40dc0b4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:10.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.311+0000 7f40dbfff700 1 -- 172.21.15.8:0/3376213506 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d0009420 con 0x7f40dc0cce20 2023-10-06T04:36:10.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.312+0000 7f40dbfff700 1 --2- 172.21.15.8:0/3376213506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40dc0cce20 0x7f40dc0c74f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f40d400cc40 tx=0x7f40d4001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:10.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.312+0000 7f40c37fe700 1 -- 172.21.15.8:0/3376213506 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d400a8b0 con 0x7f40dc0cce20 2023-10-06T04:36:10.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.312+0000 7f40c37fe700 1 -- 172.21.15.8:0/3376213506 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d400aa10 con 0x7f40dc0cce20 2023-10-06T04:36:10.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.312+0000 7f40e1a62700 1 -- 172.21.15.8:0/3376213506 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40dc16a5d0 con 0x7f40dc0cce20 2023-10-06T04:36:10.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.312+0000 7f40c37fe700 1 -- 172.21.15.8:0/3376213506 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d400add0 con 0x7f40dc0cce20 2023-10-06T04:36:10.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.312+0000 7f40e1a62700 1 -- 172.21.15.8:0/3376213506 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40dc1577a0 con 0x7f40dc0cce20 2023-10-06T04:36:10.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.313+0000 7f40e1a62700 1 -- 172.21.15.8:0/3376213506 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40dc071550 con 0x7f40dc0cce20 2023-10-06T04:36:10.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.313+0000 7f40c37fe700 1 -- 172.21.15.8:0/3376213506 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f40d4007300 con 0x7f40dc0cce20 2023-10-06T04:36:10.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.313+0000 7f40c37fe700 1 --2- 172.21.15.8:0/3376213506 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f40c8066ea0 0x7f40c8069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:10.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.314+0000 7f40c37fe700 1 -- 172.21.15.8:0/3376213506 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4809+0+0 (secure 0 0 0) 0x7f40d40843f0 con 0x7f40dc0cce20 2023-10-06T04:36:10.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.314+0000 7f40db7fe700 1 --2- 172.21.15.8:0/3376213506 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f40c8066ea0 0x7f40c8069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:10.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.314+0000 7f40db7fe700 1 --2- 172.21.15.8:0/3376213506 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f40c8066ea0 0x7f40c8069350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f40dc0cea60 tx=0x7f40cc0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:10.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.318+0000 7f40c37fe700 1 -- 172.21.15.8:0/3376213506 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f40d4051aa0 con 0x7f40dc0cce20 2023-10-06T04:36:10.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:10.509+0000 7f40e1a62700 1 -- 172.21.15.8:0/3376213506 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f40dc0ce210 con 0x7f40dc0cce20 2023-10-06T04:36:11.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.176+0000 7f40c37fe700 1 -- 172.21.15.8:0/3376213506 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v15) v1 ==== 173+0+0 (secure 0 0 0) 0x7f40d40550c0 con 0x7f40dc0cce20 2023-10-06T04:36:11.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.179+0000 7f40e1a62700 1 -- 172.21.15.8:0/3376213506 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f40c8066ea0 msgr2=0x7f40c8069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:11.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.179+0000 7f40e1a62700 1 --2- 172.21.15.8:0/3376213506 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f40c8066ea0 0x7f40c8069350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f40dc0cea60 tx=0x7f40cc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:11.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.179+0000 7f40e1a62700 1 -- 172.21.15.8:0/3376213506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40dc0cce20 msgr2=0x7f40dc0c74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:11.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.179+0000 7f40e1a62700 1 --2- 172.21.15.8:0/3376213506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40dc0cce20 0x7f40dc0c74f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f40d400cc40 tx=0x7f40d4001a50 comp rx=0 tx=0).stop 2023-10-06T04:36:11.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.179+0000 7f40e1a62700 1 -- 172.21.15.8:0/3376213506 shutdown_connections 2023-10-06T04:36:11.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.179+0000 7f40e1a62700 1 --2- 172.21.15.8:0/3376213506 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f40c8066ea0 0x7f40c8069350 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:11.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.179+0000 7f40e1a62700 1 --2- 172.21.15.8:0/3376213506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40dc0cce20 0x7f40dc0c74f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:11.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.179+0000 7f40e1a62700 1 --2- 172.21.15.8:0/3376213506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40dc0af5a0 0x7f40dc0b4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:11.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.179+0000 7f40e1a62700 1 --2- 172.21.15.8:0/3376213506 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40dc0af970 0x7f40dc148fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:11.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.179+0000 7f40e1a62700 1 -- 172.21.15.8:0/3376213506 >> 172.21.15.8:0/3376213506 conn(0x7f40dc06ed00 msgr2=0x7f40dc158240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:11.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.179+0000 7f40e1a62700 1 -- 172.21.15.8:0/3376213506 shutdown_connections 2023-10-06T04:36:11.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.179+0000 7f40e1a62700 1 -- 172.21.15.8:0/3376213506 wait complete. 2023-10-06T04:36:11.182 INFO:teuthology.orchestra.run.smithi008.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-06T04:36:11.197 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-06T04:36:11.197 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T04:36:11.197 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T04:36:11.199 INFO:tasks.ceph.mds.a:Started 2023-10-06T04:36:11.199 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T04:36:11.199 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T04:36:11.201 INFO:tasks.ceph.mds.c:Started 2023-10-06T04:36:11.202 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T04:36:11.202 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T04:36:11.205 INFO:tasks.ceph.mds.b:Started 2023-10-06T04:36:11.205 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T04:36:11.205 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T04:36:11.207 INFO:tasks.ceph.mds.d:Started 2023-10-06T04:36:11.208 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-06T04:36:11.208 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:36:11.280 INFO:tasks.ceph.mds.a.smithi008.stdout:starting mds.a at 2023-10-06T04:36:11.280 INFO:tasks.ceph.mds.c.smithi008.stdout:starting mds.c at 2023-10-06T04:36:11.283 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-10-06T04:36:11.283 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2023-10-06T04:36:11.283 INFO:tasks.ceph.mds.d.smithi184.stderr:2023-10-06T04:36:11.281+0000 7f9ba77ca700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-06T04:36:11.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.335+0000 7f3747ff4700 1 Processor -- start 2023-10-06T04:36:11.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.335+0000 7f3747ff4700 1 -- start start 2023-10-06T04:36:11.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.336+0000 7f3747ff4700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3740143090 0x7f37400cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:11.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.336+0000 7f3747ff4700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3740068df0 0x7f37400cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:11.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.336+0000 7f3747ff4700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3740069f70 con 0x7f3740142cc0 2023-10-06T04:36:11.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.336+0000 7f3747ff4700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37400cc8a0 con 0x7f3740143090 2023-10-06T04:36:11.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.336+0000 7f3747ff4700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3740069360 con 0x7f3740068df0 2023-10-06T04:36:11.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.336+0000 7f3745d90700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f3740142cc0 0x7f37400686e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34010/0 (socket says 172.21.15.8:34010) 2023-10-06T04:36:11.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.336+0000 7f374558f700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3740143090 0x7f37400cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:11.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.336+0000 7f3745d90700 1 -- 172.21.15.8:0/4261406229 learned_addr learned my addr 172.21.15.8:0/4261406229 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:11.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.337+0000 7f3746591700 1 --2- 172.21.15.8:0/4261406229 >> v2:172.21.15.184:3300/0 conn(0x7f3740068df0 0x7f37400cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:11.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.337+0000 7f374558f700 1 -- 172.21.15.8:0/4261406229 >> v2:172.21.15.184:3300/0 conn(0x7f3740068df0 msgr2=0x7f37400cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:11.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.337+0000 7f374558f700 1 --2- 172.21.15.8:0/4261406229 >> v2:172.21.15.184:3300/0 conn(0x7f3740068df0 0x7f37400cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:11.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.337+0000 7f374558f700 1 -- 172.21.15.8:0/4261406229 >> v1:172.21.15.8:6789/0 conn(0x7f3740142cc0 legacy=0x7f37400686e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:11.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.337+0000 7f374558f700 1 -- 172.21.15.8:0/4261406229 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3740069640 con 0x7f3740143090 2023-10-06T04:36:11.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.337+0000 7f3744d8e700 1 -- 172.21.15.8:0/4261406229 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 389702818 0 0) 0x7f3740069f70 con 0x7f3740142cc0 2023-10-06T04:36:11.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.337+0000 7f3746591700 1 --2- 172.21.15.8:0/4261406229 >> v2:172.21.15.184:3300/0 conn(0x7f3740068df0 0x7f37400cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:11.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.337+0000 7f374558f700 1 --2- 172.21.15.8:0/4261406229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3740143090 0x7f37400cbe20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f374006e2a0 tx=0x7f37300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a632f0b31be7e469 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:11.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.337+0000 7f3744d8e700 1 -- 172.21.15.8:0/4261406229 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373000b6b0 con 0x7f3740143090 2023-10-06T04:36:11.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.337+0000 7f3744d8e700 1 -- 172.21.15.8:0/4261406229 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373000b810 con 0x7f3740143090 2023-10-06T04:36:11.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.337+0000 7f3744d8e700 1 -- 172.21.15.8:0/4261406229 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373000bbb0 con 0x7f3740143090 2023-10-06T04:36:11.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.338+0000 7f3747ff4700 1 -- 172.21.15.8:0/4261406229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3740143090 msgr2=0x7f37400cbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:11.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.338+0000 7f3747ff4700 1 --2- 172.21.15.8:0/4261406229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3740143090 0x7f37400cbe20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f374006e2a0 tx=0x7f37300091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:11.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.338+0000 7f3747ff4700 1 -- 172.21.15.8:0/4261406229 shutdown_connections 2023-10-06T04:36:11.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.338+0000 7f3747ff4700 1 --2- 172.21.15.8:0/4261406229 >> v2:172.21.15.184:3300/0 conn(0x7f3740068df0 0x7f37400cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:11.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.338+0000 7f3747ff4700 1 --2- 172.21.15.8:0/4261406229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3740143090 0x7f37400cbe20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:11.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.338+0000 7f3747ff4700 1 -- 172.21.15.8:0/4261406229 >> 172.21.15.8:0/4261406229 conn(0x7f37400ce250 msgr2=0x7f37400ce650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:11.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.338+0000 7f3747ff4700 1 -- 172.21.15.8:0/4261406229 shutdown_connections 2023-10-06T04:36:11.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.338+0000 7f3747ff4700 1 -- 172.21.15.8:0/4261406229 wait complete. 2023-10-06T04:36:11.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.339+0000 7f3747ff4700 1 Processor -- start 2023-10-06T04:36:11.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.339+0000 7f3747ff4700 1 -- start start 2023-10-06T04:36:11.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.340+0000 7f3747ff4700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3740068df0 0x7f374015c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:11.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.340+0000 7f3747ff4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3740142cc0 0x7f37400c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:11.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.340+0000 7f3747ff4700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3740143090 0x7f374015da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:11.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.340+0000 7f3747ff4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374015c670 con 0x7f3740142cc0 2023-10-06T04:36:11.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.340+0000 7f3747ff4700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3740169a50 con 0x7f3740143090 2023-10-06T04:36:11.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.340+0000 7f3747ff4700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f374016d450 con 0x7f3740068df0 2023-10-06T04:36:11.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.340+0000 7f374558f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3740142cc0 0x7f37400c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:11.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.340+0000 7f374558f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3740142cc0 0x7f37400c7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60944/0 (socket says 172.21.15.8:60944) 2023-10-06T04:36:11.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.340+0000 7f374558f700 1 -- 172.21.15.8:0/860390584 learned_addr learned my addr 172.21.15.8:0/860390584 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:11.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.340+0000 7f3745d90700 1 --2- 172.21.15.8:0/860390584 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3740068df0 0x7f374015c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:11.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.340+0000 7f3746591700 1 --2- 172.21.15.8:0/860390584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3740143090 0x7f374015da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:11.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.340+0000 7f374558f700 1 -- 172.21.15.8:0/860390584 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3740068df0 msgr2=0x7f374015c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:11.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.340+0000 7f374558f700 1 --2- 172.21.15.8:0/860390584 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3740068df0 0x7f374015c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:11.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.340+0000 7f374558f700 1 -- 172.21.15.8:0/860390584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3740143090 msgr2=0x7f374015da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:11.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.340+0000 7f374558f700 1 --2- 172.21.15.8:0/860390584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3740143090 0x7f374015da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:11.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.340+0000 7f374558f700 1 -- 172.21.15.8:0/860390584 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3730009420 con 0x7f3740142cc0 2023-10-06T04:36:11.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.340+0000 7f374558f700 1 --2- 172.21.15.8:0/860390584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3740142cc0 0x7f37400c7f20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f374006efe0 tx=0x7f3730017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:11.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.340+0000 7f3735ffb700 1 -- 172.21.15.8:0/860390584 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373000b980 con 0x7f3740142cc0 2023-10-06T04:36:11.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.340+0000 7f3735ffb700 1 -- 172.21.15.8:0/860390584 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373000bae0 con 0x7f3740142cc0 2023-10-06T04:36:11.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.340+0000 7f3747ff4700 1 -- 172.21.15.8:0/860390584 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f374016d730 con 0x7f3740142cc0 2023-10-06T04:36:11.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.340+0000 7f3735ffb700 1 -- 172.21.15.8:0/860390584 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3730011670 con 0x7f3740142cc0 2023-10-06T04:36:11.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.341+0000 7f3747ff4700 1 -- 172.21.15.8:0/860390584 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f374016dcf0 con 0x7f3740142cc0 2023-10-06T04:36:11.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.342+0000 7f3747ff4700 1 -- 172.21.15.8:0/860390584 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3740071550 con 0x7f3740142cc0 2023-10-06T04:36:11.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.342+0000 7f3735ffb700 1 -- 172.21.15.8:0/860390584 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f3730011a60 con 0x7f3740142cc0 2023-10-06T04:36:11.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.342+0000 7f3735ffb700 1 --2- 172.21.15.8:0/860390584 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3724066ea0 0x7f3724069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:11.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.342+0000 7f3735ffb700 1 -- 172.21.15.8:0/860390584 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5195+0+0 (secure 0 0 0) 0x7f37300859f0 con 0x7f3740142cc0 2023-10-06T04:36:11.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.342+0000 7f3745d90700 1 --2- 172.21.15.8:0/860390584 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3724066ea0 0x7f3724069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:11.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.343+0000 7f3745d90700 1 --2- 172.21.15.8:0/860390584 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3724066ea0 0x7f3724069350 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f373c001360 tx=0x7f373c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:11.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.347+0000 7f3735ffb700 1 -- 172.21.15.8:0/860390584 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3730052f40 con 0x7f3740142cc0 2023-10-06T04:36:11.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.540+0000 7f3747ff4700 1 -- 172.21.15.8:0/860390584 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3740069920 con 0x7f3740142cc0 2023-10-06T04:36:11.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.541+0000 7f3735ffb700 1 -- 172.21.15.8:0/860390584 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+13618 (secure 0 0 0) 0x7f3730056560 con 0x7f3740142cc0 2023-10-06T04:36:11.542 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:36:11.542 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":15,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:36:11.171104+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:36:10.148177+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:36:10.684157+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.555871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.490505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.504578+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.517217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:05.991135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.537329+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.543232+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.443715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:36:11.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.543+0000 7f3747ff4700 1 -- 172.21.15.8:0/860390584 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3724066ea0 msgr2=0x7f3724069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:11.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.543+0000 7f3747ff4700 1 --2- 172.21.15.8:0/860390584 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3724066ea0 0x7f3724069350 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f373c001360 tx=0x7f373c009040 comp rx=0 tx=0).stop 2023-10-06T04:36:11.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.543+0000 7f3747ff4700 1 -- 172.21.15.8:0/860390584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3740142cc0 msgr2=0x7f37400c7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:11.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.543+0000 7f3747ff4700 1 --2- 172.21.15.8:0/860390584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3740142cc0 0x7f37400c7f20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f374006efe0 tx=0x7f3730017000 comp rx=0 tx=0).stop 2023-10-06T04:36:11.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.543+0000 7f3747ff4700 1 -- 172.21.15.8:0/860390584 shutdown_connections 2023-10-06T04:36:11.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.543+0000 7f3747ff4700 1 --2- 172.21.15.8:0/860390584 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3724066ea0 0x7f3724069350 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:11.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.543+0000 7f3747ff4700 1 --2- 172.21.15.8:0/860390584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3740143090 0x7f374015da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:11.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.543+0000 7f3747ff4700 1 --2- 172.21.15.8:0/860390584 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3740068df0 0x7f374015c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:11.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.543+0000 7f3747ff4700 1 --2- 172.21.15.8:0/860390584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3740142cc0 0x7f37400c7f20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:11.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.543+0000 7f3747ff4700 1 -- 172.21.15.8:0/860390584 >> 172.21.15.8:0/860390584 conn(0x7f37400ce250 msgr2=0x7f3740141d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:11.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.543+0000 7f3747ff4700 1 -- 172.21.15.8:0/860390584 shutdown_connections 2023-10-06T04:36:11.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.543+0000 7f3747ff4700 1 -- 172.21.15.8:0/860390584 wait complete. 2023-10-06T04:36:11.556 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:36:10.148177+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:36:10.684157+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {}}] 2023-10-06T04:36:11.557 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:36:11.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.677+0000 7f135c1af700 1 Processor -- start 2023-10-06T04:36:11.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.677+0000 7f135c1af700 1 -- start start 2023-10-06T04:36:11.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.678+0000 7f135c1af700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13540b3790 0x7f13540b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:11.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.678+0000 7f135c1af700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13540cf510 con 0x7f13541430c0 2023-10-06T04:36:11.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.678+0000 7f135c1af700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13540ce6a0 con 0x7f1354142cf0 2023-10-06T04:36:11.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.678+0000 7f135c1af700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13540b4110 con 0x7f13540b3790 2023-10-06T04:36:11.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.678+0000 7f135974a700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f13541430c0 0x7f13540cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34022/0 (socket says 172.21.15.8:34022) 2023-10-06T04:36:11.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.678+0000 7f135974a700 1 -- 172.21.15.8:0/1036632813 learned_addr learned my addr 172.21.15.8:0/1036632813 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:11.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.678+0000 7f135a74c700 1 --2- 172.21.15.8:0/1036632813 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13540b3790 0x7f13540b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:11.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.678+0000 7f1358f49700 1 -- 172.21.15.8:0/1036632813 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1953087867 0 0) 0x7f13540cf510 con 0x7f13541430c0 2023-10-06T04:36:11.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.678+0000 7f1358f49700 1 -- 172.21.15.8:0/1036632813 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f133c003570 con 0x7f13541430c0 2023-10-06T04:36:11.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.678+0000 7f1358f49700 1 -- 172.21.15.8:0/1036632813 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3831572278 0 0) 0x7f13540ce6a0 con 0x7f1354142cf0 2023-10-06T04:36:11.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.678+0000 7f1358f49700 1 -- 172.21.15.8:0/1036632813 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13540cf510 con 0x7f1354142cf0 2023-10-06T04:36:11.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.678+0000 7f135a74c700 1 -- 172.21.15.8:0/1036632813 >> v1:172.21.15.184:6789/0 conn(0x7f1354142cf0 legacy=0x7f13540b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:11.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.678+0000 7f135a74c700 1 -- 172.21.15.8:0/1036632813 >> v1:172.21.15.8:6789/0 conn(0x7f13541430c0 legacy=0x7f13540cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:11.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.678+0000 7f135a74c700 1 -- 172.21.15.8:0/1036632813 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13540ce900 con 0x7f13540b3790 2023-10-06T04:36:11.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.678+0000 7f135a74c700 1 --2- 172.21.15.8:0/1036632813 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13540b3790 0x7f13540b3bd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f134c009910 tx=0x7f134c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5732d3803721536 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:11.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.679+0000 7f1358f49700 1 -- 172.21.15.8:0/1036632813 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c011630 con 0x7f13540b3790 2023-10-06T04:36:11.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.679+0000 7f1358f49700 1 -- 172.21.15.8:0/1036632813 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134c011790 con 0x7f13540b3790 2023-10-06T04:36:11.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.679+0000 7f1358f49700 1 -- 172.21.15.8:0/1036632813 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c011b10 con 0x7f13540b3790 2023-10-06T04:36:11.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.679+0000 7f135c1af700 1 -- 172.21.15.8:0/1036632813 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13540b3790 msgr2=0x7f13540b3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:11.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.679+0000 7f135c1af700 1 --2- 172.21.15.8:0/1036632813 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13540b3790 0x7f13540b3bd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f134c009910 tx=0x7f134c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:11.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.679+0000 7f135c1af700 1 -- 172.21.15.8:0/1036632813 shutdown_connections 2023-10-06T04:36:11.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.679+0000 7f135c1af700 1 --2- 172.21.15.8:0/1036632813 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13540b3790 0x7f13540b3bd0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:11.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.679+0000 7f135c1af700 1 -- 172.21.15.8:0/1036632813 >> 172.21.15.8:0/1036632813 conn(0x7f135406ed00 msgr2=0x7f135406f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:11.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.679+0000 7f135c1af700 1 -- 172.21.15.8:0/1036632813 shutdown_connections 2023-10-06T04:36:11.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.679+0000 7f135c1af700 1 -- 172.21.15.8:0/1036632813 wait complete. 2023-10-06T04:36:11.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.680+0000 7f135c1af700 1 Processor -- start 2023-10-06T04:36:11.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.680+0000 7f135c1af700 1 -- start start 2023-10-06T04:36:11.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.681+0000 7f135c1af700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13540b3790 0x7f135415c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:11.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.681+0000 7f135c1af700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1354142cf0 0x7f1354141970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:11.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.681+0000 7f135c1af700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13541430c0 0x7f1354158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:11.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.681+0000 7f135c1af700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135416c880 con 0x7f13540b3790 2023-10-06T04:36:11.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.681+0000 7f135c1af700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135416d6e0 con 0x7f1354142cf0 2023-10-06T04:36:11.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.681+0000 7f135c1af700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135415cdf0 con 0x7f13541430c0 2023-10-06T04:36:11.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.681+0000 7f1359f4b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13540b3790 0x7f135415c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:11.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.681+0000 7f1359f4b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13540b3790 0x7f135415c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60956/0 (socket says 172.21.15.8:60956) 2023-10-06T04:36:11.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.681+0000 7f1359f4b700 1 -- 172.21.15.8:0/3857336760 learned_addr learned my addr 172.21.15.8:0/3857336760 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:11.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.681+0000 7f135a74c700 1 --2- 172.21.15.8:0/3857336760 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13541430c0 0x7f1354158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:11.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.681+0000 7f135974a700 1 --2- 172.21.15.8:0/3857336760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1354142cf0 0x7f1354141970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:11.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.681+0000 7f1359f4b700 1 -- 172.21.15.8:0/3857336760 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13541430c0 msgr2=0x7f1354158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:11.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.681+0000 7f1359f4b700 1 --2- 172.21.15.8:0/3857336760 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13541430c0 0x7f1354158b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:11.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.681+0000 7f1359f4b700 1 -- 172.21.15.8:0/3857336760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1354142cf0 msgr2=0x7f1354141970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:11.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.681+0000 7f1359f4b700 1 --2- 172.21.15.8:0/3857336760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1354142cf0 0x7f1354141970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:11.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.681+0000 7f1359f4b700 1 -- 172.21.15.8:0/3857336760 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f134c009420 con 0x7f13540b3790 2023-10-06T04:36:11.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.681+0000 7f1359f4b700 1 --2- 172.21.15.8:0/3857336760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13540b3790 0x7f135415c8b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f134400cb10 tx=0x7f1344002820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:11.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.682+0000 7f1351ffb700 1 -- 172.21.15.8:0/3857336760 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134400ce20 con 0x7f13540b3790 2023-10-06T04:36:11.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.682+0000 7f1351ffb700 1 -- 172.21.15.8:0/3857336760 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134400a7e0 con 0x7f13540b3790 2023-10-06T04:36:11.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.682+0000 7f135c1af700 1 -- 172.21.15.8:0/3857336760 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f135416cad0 con 0x7f13540b3790 2023-10-06T04:36:11.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.682+0000 7f1351ffb700 1 -- 172.21.15.8:0/3857336760 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134400ab80 con 0x7f13540b3790 2023-10-06T04:36:11.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.682+0000 7f135c1af700 1 -- 172.21.15.8:0/3857336760 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f135416d090 con 0x7f13540b3790 2023-10-06T04:36:11.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.683+0000 7f135c1af700 1 -- 172.21.15.8:0/3857336760 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1354071550 con 0x7f13540b3790 2023-10-06T04:36:11.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.683+0000 7f1351ffb700 1 -- 172.21.15.8:0/3857336760 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f1344012420 con 0x7f13540b3790 2023-10-06T04:36:11.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.683+0000 7f1351ffb700 1 --2- 172.21.15.8:0/3857336760 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1340066ea0 0x7f1340069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:11.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.684+0000 7f1351ffb700 1 -- 172.21.15.8:0/3857336760 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5195+0+0 (secure 0 0 0) 0x7f1344084510 con 0x7f13540b3790 2023-10-06T04:36:11.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.684+0000 7f135974a700 1 --2- 172.21.15.8:0/3857336760 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1340066ea0 0x7f1340069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:11.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.684+0000 7f135974a700 1 --2- 172.21.15.8:0/3857336760 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1340066ea0 0x7f1340069350 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f13540b4ef0 tx=0x7f1348009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:11.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.688+0000 7f1351ffb700 1 -- 172.21.15.8:0/3857336760 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1344051a60 con 0x7f13540b3790 2023-10-06T04:36:11.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.881+0000 7f135c1af700 1 -- 172.21.15.8:0/3857336760 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f13540cebe0 con 0x7f13540b3790 2023-10-06T04:36:11.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.881+0000 7f1351ffb700 1 -- 172.21.15.8:0/3857336760 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1344055080 con 0x7f13540b3790 2023-10-06T04:36:11.883 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 8 2023-10-06T04:36:11.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.883+0000 7f135c1af700 1 -- 172.21.15.8:0/3857336760 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1340066ea0 msgr2=0x7f1340069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:11.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.883+0000 7f135c1af700 1 --2- 172.21.15.8:0/3857336760 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1340066ea0 0x7f1340069350 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f13540b4ef0 tx=0x7f1348009040 comp rx=0 tx=0).stop 2023-10-06T04:36:11.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.883+0000 7f135c1af700 1 -- 172.21.15.8:0/3857336760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13540b3790 msgr2=0x7f135415c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:11.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.883+0000 7f135c1af700 1 --2- 172.21.15.8:0/3857336760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13540b3790 0x7f135415c8b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f134400cb10 tx=0x7f1344002820 comp rx=0 tx=0).stop 2023-10-06T04:36:11.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.883+0000 7f135c1af700 1 -- 172.21.15.8:0/3857336760 shutdown_connections 2023-10-06T04:36:11.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.883+0000 7f135c1af700 1 --2- 172.21.15.8:0/3857336760 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1340066ea0 0x7f1340069350 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:11.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.883+0000 7f135c1af700 1 --2- 172.21.15.8:0/3857336760 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13541430c0 0x7f1354158b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:11.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.883+0000 7f135c1af700 1 --2- 172.21.15.8:0/3857336760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13540b3790 0x7f135415c8b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:11.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.883+0000 7f135c1af700 1 --2- 172.21.15.8:0/3857336760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1354142cf0 0x7f1354141970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:11.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.883+0000 7f135c1af700 1 -- 172.21.15.8:0/3857336760 >> 172.21.15.8:0/3857336760 conn(0x7f135406ed00 msgr2=0x7f13540cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:11.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.883+0000 7f135c1af700 1 -- 172.21.15.8:0/3857336760 shutdown_connections 2023-10-06T04:36:11.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:11.883+0000 7f135c1af700 1 -- 172.21.15.8:0/3857336760 wait complete. 2023-10-06T04:36:11.896 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:36:12.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.016+0000 7fe1815f8700 1 Processor -- start 2023-10-06T04:36:12.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.016+0000 7fe1815f8700 1 -- start start 2023-10-06T04:36:12.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.017+0000 7fe1815f8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe17c1430c0 0x7fe17c0cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:12.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.017+0000 7fe1815f8700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17c0cf510 con 0x7fe17c142cf0 2023-10-06T04:36:12.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.017+0000 7fe1815f8700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17c0ce6a0 con 0x7fe17c0cfee0 2023-10-06T04:36:12.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.017+0000 7fe1815f8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c0ce900 con 0x7fe17c1430c0 2023-10-06T04:36:12.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.017+0000 7fe17affd700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe17c142cf0 0x7fe17c0b5cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34036/0 (socket says 172.21.15.8:34036) 2023-10-06T04:36:12.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.017+0000 7fe17affd700 1 -- 172.21.15.8:0/1441064339 learned_addr learned my addr 172.21.15.8:0/1441064339 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:12.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.018+0000 7fe17a7fc700 1 --2- 172.21.15.8:0/1441064339 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe17c1430c0 0x7fe17c0cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:12.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.018+0000 7fe179ffb700 1 -- 172.21.15.8:0/1441064339 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3845602131 0 0) 0x7fe17c0cf510 con 0x7fe17c142cf0 2023-10-06T04:36:12.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.018+0000 7fe179ffb700 1 -- 172.21.15.8:0/1441064339 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe168003570 con 0x7fe17c142cf0 2023-10-06T04:36:12.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.018+0000 7fe179ffb700 1 -- 172.21.15.8:0/1441064339 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2022197616 0 0) 0x7fe168003570 con 0x7fe17c142cf0 2023-10-06T04:36:12.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.018+0000 7fe179ffb700 1 -- 172.21.15.8:0/1441064339 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe17c1430c0 msgr2=0x7fe17c0cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:12.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.018+0000 7fe179ffb700 1 --2- 172.21.15.8:0/1441064339 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe17c1430c0 0x7fe17c0cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:12.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.018+0000 7fe179ffb700 1 -- 172.21.15.8:0/1441064339 >> v1:172.21.15.184:6789/0 conn(0x7fe17c0cfee0 legacy=0x7fe17c0b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:12.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.018+0000 7fe179ffb700 1 -- 172.21.15.8:0/1441064339 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17c0cebe0 con 0x7fe17c142cf0 2023-10-06T04:36:12.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.018+0000 7fe179ffb700 1 -- 172.21.15.8:0/1441064339 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7fe16c001470 con 0x7fe17c142cf0 2023-10-06T04:36:12.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.018+0000 7fe179ffb700 1 -- 172.21.15.8:0/1441064339 >> v1:172.21.15.8:6789/0 conn(0x7fe17c142cf0 legacy=0x7fe17c0b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:12.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.018+0000 7fe179ffb700 1 --2- 172.21.15.8:0/1441064339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe168003a90 0x7fe168003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:12.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.018+0000 7fe179ffb700 1 --2- 172.21.15.8:0/1441064339 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe17c1430c0 0x7fe168004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:12.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.018+0000 7fe179ffb700 1 --2- 172.21.15.8:0/1441064339 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe168004d50 0x7fe1680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:12.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.018+0000 7fe179ffb700 1 -- 172.21.15.8:0/1441064339 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c0ce900 con 0x7fe168004d50 2023-10-06T04:36:12.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.018+0000 7fe179ffb700 1 -- 172.21.15.8:0/1441064339 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe16800bba0 con 0x7fe168003a90 2023-10-06T04:36:12.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.018+0000 7fe179ffb700 1 -- 172.21.15.8:0/1441064339 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe16800bd60 con 0x7fe17c1430c0 2023-10-06T04:36:12.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.018+0000 7fe17b7fe700 1 --2- 172.21.15.8:0/1441064339 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe168004d50 0x7fe1680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:12.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.018+0000 7fe17affd700 1 --2- 172.21.15.8:0/1441064339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe168003a90 0x7fe168003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:12.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.018+0000 7fe17a7fc700 1 --2- 172.21.15.8:0/1441064339 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe17c1430c0 0x7fe168004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:12.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.018+0000 7fe17b7fe700 1 -- 172.21.15.8:0/1441064339 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe17c1430c0 msgr2=0x7fe168004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:12.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.018+0000 7fe17b7fe700 1 --2- 172.21.15.8:0/1441064339 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe17c1430c0 0x7fe168004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:12.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.018+0000 7fe17b7fe700 1 -- 172.21.15.8:0/1441064339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe168003a90 msgr2=0x7fe168003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:12.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.018+0000 7fe17b7fe700 1 --2- 172.21.15.8:0/1441064339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe168003a90 0x7fe168003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:12.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.018+0000 7fe17b7fe700 1 -- 172.21.15.8:0/1441064339 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe168003570 con 0x7fe168004d50 2023-10-06T04:36:12.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.019+0000 7fe17b7fe700 1 --2- 172.21.15.8:0/1441064339 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe168004d50 0x7fe1680051c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe174001f90 tx=0x7fe174001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446e6be8492435da server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:12.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.019+0000 7fe179ffb700 1 -- 172.21.15.8:0/1441064339 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe174001950 con 0x7fe168004d50 2023-10-06T04:36:12.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.019+0000 7fe179ffb700 1 -- 172.21.15.8:0/1441064339 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17400c8b0 con 0x7fe168004d50 2023-10-06T04:36:12.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.019+0000 7fe179ffb700 1 -- 172.21.15.8:0/1441064339 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17400cc50 con 0x7fe168004d50 2023-10-06T04:36:12.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.019+0000 7fe1815f8700 1 -- 172.21.15.8:0/1441064339 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe168004d50 msgr2=0x7fe1680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:12.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.019+0000 7fe1815f8700 1 --2- 172.21.15.8:0/1441064339 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe168004d50 0x7fe1680051c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe174001f90 tx=0x7fe174001640 comp rx=0 tx=0).stop 2023-10-06T04:36:12.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.019+0000 7fe17b7fe700 1 -- 172.21.15.8:0/1441064339 reap_dead start 2023-10-06T04:36:12.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.019+0000 7fe1815f8700 1 -- 172.21.15.8:0/1441064339 shutdown_connections 2023-10-06T04:36:12.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.019+0000 7fe1815f8700 1 -- 172.21.15.8:0/1441064339 >> 172.21.15.8:0/1441064339 conn(0x7fe17c06ed00 msgr2=0x7fe17c06f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:12.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.019+0000 7fe1815f8700 1 -- 172.21.15.8:0/1441064339 shutdown_connections 2023-10-06T04:36:12.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.019+0000 7fe1815f8700 1 -- 172.21.15.8:0/1441064339 wait complete. 2023-10-06T04:36:12.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.021+0000 7fe1815f8700 1 Processor -- start 2023-10-06T04:36:12.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.021+0000 7fe1815f8700 1 -- start start 2023-10-06T04:36:12.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.021+0000 7fe1815f8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe17c13ddc0 0x7fe17c15ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:12.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.021+0000 7fe1815f8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe17c13e190 0x7fe17c15aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:12.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.021+0000 7fe1815f8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe17c1577f0 0x7fe17c0b4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:12.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.021+0000 7fe1815f8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c140180 con 0x7fe17c13e190 2023-10-06T04:36:12.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.021+0000 7fe1815f8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c1403d0 con 0x7fe17c1577f0 2023-10-06T04:36:12.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.021+0000 7fe1815f8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c15c290 con 0x7fe17c13ddc0 2023-10-06T04:36:12.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.021+0000 7fe17a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe17c13e190 0x7fe17c15aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:12.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.021+0000 7fe17a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe17c13e190 0x7fe17c15aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60972/0 (socket says 172.21.15.8:60972) 2023-10-06T04:36:12.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.021+0000 7fe17a7fc700 1 -- 172.21.15.8:0/1326746258 learned_addr learned my addr 172.21.15.8:0/1326746258 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:12.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.022+0000 7fe17affd700 1 --2- 172.21.15.8:0/1326746258 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe17c13ddc0 0x7fe17c15ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:12.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.022+0000 7fe17b7fe700 1 --2- 172.21.15.8:0/1326746258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe17c1577f0 0x7fe17c0b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:12.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.022+0000 7fe17a7fc700 1 -- 172.21.15.8:0/1326746258 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe17c13ddc0 msgr2=0x7fe17c15ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:12.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.022+0000 7fe17a7fc700 1 --2- 172.21.15.8:0/1326746258 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe17c13ddc0 0x7fe17c15ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:12.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.022+0000 7fe17a7fc700 1 -- 172.21.15.8:0/1326746258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe17c1577f0 msgr2=0x7fe17c0b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:12.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.022+0000 7fe17a7fc700 1 --2- 172.21.15.8:0/1326746258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe17c1577f0 0x7fe17c0b4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:12.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.022+0000 7fe17a7fc700 1 -- 172.21.15.8:0/1326746258 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17c15c570 con 0x7fe17c13e190 2023-10-06T04:36:12.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.022+0000 7fe17a7fc700 1 --2- 172.21.15.8:0/1326746258 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe17c13e190 0x7fe17c15aca0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe164006ac0 tx=0x7fe1640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:12.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.022+0000 7fe172ffd700 1 -- 172.21.15.8:0/1326746258 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16400f940 con 0x7fe17c13e190 2023-10-06T04:36:12.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.022+0000 7fe172ffd700 1 -- 172.21.15.8:0/1326746258 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16400faa0 con 0x7fe17c13e190 2023-10-06T04:36:12.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.022+0000 7fe1815f8700 1 -- 172.21.15.8:0/1326746258 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe17c15b1e0 con 0x7fe17c13e190 2023-10-06T04:36:12.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.022+0000 7fe172ffd700 1 -- 172.21.15.8:0/1326746258 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16400fe20 con 0x7fe17c13e190 2023-10-06T04:36:12.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.022+0000 7fe1815f8700 1 -- 172.21.15.8:0/1326746258 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17c0b4e90 con 0x7fe17c13e190 2023-10-06T04:36:12.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.023+0000 7fe1815f8700 1 -- 172.21.15.8:0/1326746258 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17c15c0f0 con 0x7fe17c13e190 2023-10-06T04:36:12.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.023+0000 7fe172ffd700 1 -- 172.21.15.8:0/1326746258 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fe164014650 con 0x7fe17c13e190 2023-10-06T04:36:12.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.024+0000 7fe172ffd700 1 --2- 172.21.15.8:0/1326746258 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe15c066ea0 0x7fe15c069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:12.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.024+0000 7fe172ffd700 1 -- 172.21.15.8:0/1326746258 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5195+0+0 (secure 0 0 0) 0x7fe164018030 con 0x7fe17c13e190 2023-10-06T04:36:12.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.024+0000 7fe17affd700 1 --2- 172.21.15.8:0/1326746258 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe15c066ea0 0x7fe15c069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:12.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.024+0000 7fe17affd700 1 --2- 172.21.15.8:0/1326746258 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe15c066ea0 0x7fe15c069350 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe16c000e50 tx=0x7fe17c0cf480 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:12.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.028+0000 7fe172ffd700 1 -- 172.21.15.8:0/1326746258 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe17c15c0f0 con 0x7fe17c13e190 2023-10-06T04:36:12.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.227+0000 7fe1815f8700 1 -- 172.21.15.8:0/1326746258 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe17c15c0f0 con 0x7fe17c13e190 2023-10-06T04:36:12.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.227+0000 7fe172ffd700 1 -- 172.21.15.8:0/1326746258 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe17c15c0f0 con 0x7fe17c13e190 2023-10-06T04:36:12.229 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-06T04:36:12.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.229+0000 7fe1815f8700 1 -- 172.21.15.8:0/1326746258 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe15c066ea0 msgr2=0x7fe15c069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:12.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.229+0000 7fe1815f8700 1 --2- 172.21.15.8:0/1326746258 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe15c066ea0 0x7fe15c069350 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe16c000e50 tx=0x7fe17c0cf480 comp rx=0 tx=0).stop 2023-10-06T04:36:12.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.229+0000 7fe1815f8700 1 -- 172.21.15.8:0/1326746258 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe17c13e190 msgr2=0x7fe17c15aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:12.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.229+0000 7fe1815f8700 1 --2- 172.21.15.8:0/1326746258 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe17c13e190 0x7fe17c15aca0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe164006ac0 tx=0x7fe1640091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:12.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.229+0000 7fe1815f8700 1 -- 172.21.15.8:0/1326746258 shutdown_connections 2023-10-06T04:36:12.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.230+0000 7fe1815f8700 1 --2- 172.21.15.8:0/1326746258 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe15c066ea0 0x7fe15c069350 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:12.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.230+0000 7fe1815f8700 1 --2- 172.21.15.8:0/1326746258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe17c1577f0 0x7fe17c0b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:12.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.230+0000 7fe1815f8700 1 --2- 172.21.15.8:0/1326746258 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe17c13ddc0 0x7fe17c15ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:12.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.230+0000 7fe1815f8700 1 --2- 172.21.15.8:0/1326746258 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe17c13e190 0x7fe17c15aca0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:12.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.230+0000 7fe1815f8700 1 -- 172.21.15.8:0/1326746258 >> 172.21.15.8:0/1326746258 conn(0x7fe17c06ed00 msgr2=0x7fe17c068490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:12.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.230+0000 7fe1815f8700 1 -- 172.21.15.8:0/1326746258 shutdown_connections 2023-10-06T04:36:12.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.230+0000 7fe1815f8700 1 -- 172.21.15.8:0/1326746258 wait complete. 2023-10-06T04:36:12.244 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:36:12.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.364+0000 7f6854929700 1 Processor -- start 2023-10-06T04:36:12.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.364+0000 7f6854929700 1 -- start start 2023-10-06T04:36:12.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.365+0000 7f6854929700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6850153740 0x7f6850153b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:12.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.365+0000 7f6854929700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f685015d170 con 0x7f685015d8e0 2023-10-06T04:36:12.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.365+0000 7f6854929700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68500ca990 con 0x7f685015a7b0 2023-10-06T04:36:12.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.365+0000 7f6854929700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68500cac70 con 0x7f6850153740 2023-10-06T04:36:12.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.365+0000 7f684f7fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6850153740 0x7f6850153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:12.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.365+0000 7f684f7fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6850153740 0x7f6850153b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60982/0 (socket says 172.21.15.8:60982) 2023-10-06T04:36:12.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.365+0000 7f684f7fe700 1 -- 172.21.15.8:0/1383930391 learned_addr learned my addr 172.21.15.8:0/1383930391 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:12.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.365+0000 7f684f7fe700 1 -- 172.21.15.8:0/1383930391 >> v1:172.21.15.184:6789/0 conn(0x7f685015a7b0 legacy=0x7f68500cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:12.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.365+0000 7f684f7fe700 1 -- 172.21.15.8:0/1383930391 >> v1:172.21.15.8:6789/0 conn(0x7f685015d8e0 legacy=0x7f68500696c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:12.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.366+0000 7f684f7fe700 1 -- 172.21.15.8:0/1383930391 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68500caf50 con 0x7f6850153740 2023-10-06T04:36:12.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.365+0000 7f684e7fc700 1 -- 172.21.15.8:0/1383930391 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1463546882 0 0) 0x7f685015d170 con 0x7f685015d8e0 2023-10-06T04:36:12.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.366+0000 7f684f7fe700 1 --2- 172.21.15.8:0/1383930391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6850153740 0x7f6850153b10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6840009f20 tx=0x7f6840009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24321c599afea6cc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:12.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.366+0000 7f684e7fc700 1 -- 172.21.15.8:0/1383930391 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684000e070 con 0x7f6850153740 2023-10-06T04:36:12.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.366+0000 7f684e7fc700 1 -- 172.21.15.8:0/1383930391 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684000ba80 con 0x7f6850153740 2023-10-06T04:36:12.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.366+0000 7f684e7fc700 1 -- 172.21.15.8:0/1383930391 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68400092e0 con 0x7f6850153740 2023-10-06T04:36:12.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.366+0000 7f6854929700 1 -- 172.21.15.8:0/1383930391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6850153740 msgr2=0x7f6850153b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:12.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.366+0000 7f6854929700 1 --2- 172.21.15.8:0/1383930391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6850153740 0x7f6850153b10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6840009f20 tx=0x7f6840009840 comp rx=0 tx=0).stop 2023-10-06T04:36:12.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.366+0000 7f6854929700 1 -- 172.21.15.8:0/1383930391 shutdown_connections 2023-10-06T04:36:12.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.366+0000 7f6854929700 1 --2- 172.21.15.8:0/1383930391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6850153740 0x7f6850153b10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:12.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.366+0000 7f6854929700 1 -- 172.21.15.8:0/1383930391 >> 172.21.15.8:0/1383930391 conn(0x7f68500d02b0 msgr2=0x7f68500d06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:12.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.367+0000 7f6854929700 1 -- 172.21.15.8:0/1383930391 shutdown_connections 2023-10-06T04:36:12.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.367+0000 7f6854929700 1 -- 172.21.15.8:0/1383930391 wait complete. 2023-10-06T04:36:12.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.368+0000 7f6854929700 1 Processor -- start 2023-10-06T04:36:12.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.368+0000 7f6854929700 1 -- start start 2023-10-06T04:36:12.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.369+0000 7f6854929700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6850153740 0x7f6850150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:12.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.369+0000 7f6854929700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f685015a7b0 0x7f68500c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:12.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.369+0000 7f6854929700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f685015d8e0 0x7f68500c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:12.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.369+0000 7f6854929700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68500c6330 con 0x7f685015a7b0 2023-10-06T04:36:12.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.369+0000 7f6854929700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68500c6610 con 0x7f685015d8e0 2023-10-06T04:36:12.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.369+0000 7f6854929700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68500c68f0 con 0x7f6850153740 2023-10-06T04:36:12.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.369+0000 7f684effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f685015a7b0 0x7f68500c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:12.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.369+0000 7f684effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f685015a7b0 0x7f68500c95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60994/0 (socket says 172.21.15.8:60994) 2023-10-06T04:36:12.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.369+0000 7f684effd700 1 -- 172.21.15.8:0/3704563604 learned_addr learned my addr 172.21.15.8:0/3704563604 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:12.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.369+0000 7f684ffff700 1 --2- 172.21.15.8:0/3704563604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f685015d8e0 0x7f68500c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:12.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.369+0000 7f684f7fe700 1 --2- 172.21.15.8:0/3704563604 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6850153740 0x7f6850150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:12.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.369+0000 7f684effd700 1 -- 172.21.15.8:0/3704563604 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6850153740 msgr2=0x7f6850150540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:12.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.369+0000 7f684effd700 1 --2- 172.21.15.8:0/3704563604 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6850153740 0x7f6850150540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:12.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.369+0000 7f684effd700 1 -- 172.21.15.8:0/3704563604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f685015d8e0 msgr2=0x7f68500c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:12.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.369+0000 7f684effd700 1 --2- 172.21.15.8:0/3704563604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f685015d8e0 0x7f68500c9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:12.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.369+0000 7f684effd700 1 -- 172.21.15.8:0/3704563604 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6840009ae0 con 0x7f685015a7b0 2023-10-06T04:36:12.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.369+0000 7f684effd700 1 --2- 172.21.15.8:0/3704563604 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f685015a7b0 0x7f68500c95c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f683800c7c0 tx=0x7f6838007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:12.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.369+0000 7f68477fe700 1 -- 172.21.15.8:0/3704563604 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6838011590 con 0x7f685015a7b0 2023-10-06T04:36:12.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.369+0000 7f68477fe700 1 -- 172.21.15.8:0/3704563604 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68380116f0 con 0x7f685015a7b0 2023-10-06T04:36:12.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.369+0000 7f6854929700 1 -- 172.21.15.8:0/3704563604 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68500c6bd0 con 0x7f685015a7b0 2023-10-06T04:36:12.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.369+0000 7f68477fe700 1 -- 172.21.15.8:0/3704563604 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6838011ab0 con 0x7f685015a7b0 2023-10-06T04:36:12.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.369+0000 7f6854929700 1 -- 172.21.15.8:0/3704563604 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6850150a80 con 0x7f685015a7b0 2023-10-06T04:36:12.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.370+0000 7f6854929700 1 -- 172.21.15.8:0/3704563604 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68500c70f0 con 0x7f685015a7b0 2023-10-06T04:36:12.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.371+0000 7f68477fe700 1 -- 172.21.15.8:0/3704563604 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f683801b3b0 con 0x7f685015a7b0 2023-10-06T04:36:12.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.371+0000 7f68477fe700 1 --2- 172.21.15.8:0/3704563604 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6830066ea0 0x7f6830069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:12.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.372+0000 7f68477fe700 1 -- 172.21.15.8:0/3704563604 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f6838083590 con 0x7f685015a7b0 2023-10-06T04:36:12.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.372+0000 7f684f7fe700 1 --2- 172.21.15.8:0/3704563604 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6830066ea0 0x7f6830069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:12.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.372+0000 7f684f7fe700 1 --2- 172.21.15.8:0/3704563604 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6830066ea0 0x7f6830069350 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6840009880 tx=0x7f6840018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:12.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.377+0000 7f68477fe700 1 -- 172.21.15.8:0/3704563604 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f68500c70f0 con 0x7f685015a7b0 2023-10-06T04:36:12.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.623+0000 7f6854929700 1 -- 172.21.15.8:0/3704563604 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68500c70f0 con 0x7f685015a7b0 2023-10-06T04:36:12.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.623+0000 7f68477fe700 1 -- 172.21.15.8:0/3704563604 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3518 (secure 0 0 0) 0x7f68500c70f0 con 0x7f685015a7b0 2023-10-06T04:36:12.625 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:36:12.625 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/516627422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":516627422},{"type":"v1","addr":"172.21.15.8:6835","nonce":516627422}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/1078182353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1078182353},{"type":"v1","addr":"172.21.15.8:6834","nonce":1078182353}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/181555783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":181555783},{"type":"v1","addr":"172.21.15.184:6836","nonce":181555783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2590100121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":2590100121},{"type":"v1","addr":"172.21.15.184:6837","nonce":2590100121}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-06T04:36:12.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.625+0000 7f6854929700 1 -- 172.21.15.8:0/3704563604 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6830066ea0 msgr2=0x7f6830069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:12.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.625+0000 7f6854929700 1 --2- 172.21.15.8:0/3704563604 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6830066ea0 0x7f6830069350 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6840009880 tx=0x7f6840018000 comp rx=0 tx=0).stop 2023-10-06T04:36:12.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.625+0000 7f6854929700 1 -- 172.21.15.8:0/3704563604 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f685015a7b0 msgr2=0x7f68500c95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:12.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.625+0000 7f6854929700 1 --2- 172.21.15.8:0/3704563604 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f685015a7b0 0x7f68500c95c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f683800c7c0 tx=0x7f6838007f50 comp rx=0 tx=0).stop 2023-10-06T04:36:12.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.626+0000 7f6854929700 1 -- 172.21.15.8:0/3704563604 shutdown_connections 2023-10-06T04:36:12.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.626+0000 7f6854929700 1 --2- 172.21.15.8:0/3704563604 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6830066ea0 0x7f6830069350 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:12.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.626+0000 7f6854929700 1 --2- 172.21.15.8:0/3704563604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f685015d8e0 0x7f68500c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:12.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.626+0000 7f6854929700 1 --2- 172.21.15.8:0/3704563604 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6850153740 0x7f6850150540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:12.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.626+0000 7f6854929700 1 --2- 172.21.15.8:0/3704563604 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f685015a7b0 0x7f68500c95c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:12.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.626+0000 7f6854929700 1 -- 172.21.15.8:0/3704563604 >> 172.21.15.8:0/3704563604 conn(0x7f68500d02b0 msgr2=0x7f6850152f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:12.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.626+0000 7f6854929700 1 -- 172.21.15.8:0/3704563604 shutdown_connections 2023-10-06T04:36:12.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.626+0000 7f6854929700 1 -- 172.21.15.8:0/3704563604 wait complete. 2023-10-06T04:36:12.629 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 3 2023-10-06T04:36:12.639 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:36:12.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.758+0000 7fd7f872e700 1 Processor -- start 2023-10-06T04:36:12.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.758+0000 7fd7f872e700 1 -- start start 2023-10-06T04:36:12.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.759+0000 7fd7f872e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7f00af680 0x7fd7f015e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:12.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.759+0000 7fd7f872e700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7f00cc4c0 con 0x7fd7f00cb360 2023-10-06T04:36:12.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.759+0000 7fd7f872e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7f015e580 con 0x7fd7f00d0aa0 2023-10-06T04:36:12.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.759+0000 7fd7f872e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f015d460 con 0x7fd7f00af680 2023-10-06T04:36:12.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.760+0000 7fd7f5cc9700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fd7f00cb360 0x7fd7f00d0390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34048/0 (socket says 172.21.15.8:34048) 2023-10-06T04:36:12.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.760+0000 7fd7f5cc9700 1 -- 172.21.15.8:0/1984777583 learned_addr learned my addr 172.21.15.8:0/1984777583 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:12.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.760+0000 7fd7f64ca700 1 --2- 172.21.15.8:0/1984777583 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7f00af680 0x7fd7f015e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:12.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.760+0000 7fd7f54c8700 1 -- 172.21.15.8:0/1984777583 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 791501944 0 0) 0x7fd7f00cc4c0 con 0x7fd7f00cb360 2023-10-06T04:36:12.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.760+0000 7fd7f54c8700 1 -- 172.21.15.8:0/1984777583 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7d8003570 con 0x7fd7f00cb360 2023-10-06T04:36:12.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.760+0000 7fd7f54c8700 1 -- 172.21.15.8:0/1984777583 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2894224482 0 0) 0x7fd7f015e580 con 0x7fd7f00d0aa0 2023-10-06T04:36:12.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.760+0000 7fd7f54c8700 1 -- 172.21.15.8:0/1984777583 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7f00cc4c0 con 0x7fd7f00d0aa0 2023-10-06T04:36:12.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.760+0000 7fd7f54c8700 1 -- 172.21.15.8:0/1984777583 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 359229345 0 0) 0x7fd7d8003570 con 0x7fd7f00cb360 2023-10-06T04:36:12.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.760+0000 7fd7f54c8700 1 -- 172.21.15.8:0/1984777583 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7f00af680 msgr2=0x7fd7f015e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:12.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.760+0000 7fd7f54c8700 1 --2- 172.21.15.8:0/1984777583 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7f00af680 0x7fd7f015e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:12.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.760+0000 7fd7f54c8700 1 -- 172.21.15.8:0/1984777583 >> v1:172.21.15.184:6789/0 conn(0x7fd7f00d0aa0 legacy=0x7fd7f00cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:12.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.760+0000 7fd7f54c8700 1 -- 172.21.15.8:0/1984777583 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f00cb8b0 con 0x7fd7f00cb360 2023-10-06T04:36:12.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.760+0000 7fd7f54c8700 1 -- 172.21.15.8:0/1984777583 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7fd7e4001470 con 0x7fd7f00cb360 2023-10-06T04:36:12.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.760+0000 7fd7f54c8700 1 -- 172.21.15.8:0/1984777583 >> v1:172.21.15.8:6789/0 conn(0x7fd7f00cb360 legacy=0x7fd7f00d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:12.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.760+0000 7fd7f54c8700 1 --2- 172.21.15.8:0/1984777583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7d8003c20 0x7fd7d8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:12.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.760+0000 7fd7f54c8700 1 --2- 172.21.15.8:0/1984777583 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7d8004810 0x7fd7d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:12.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.760+0000 7fd7f54c8700 1 --2- 172.21.15.8:0/1984777583 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7f00af680 0x7fd7d8005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:12.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.760+0000 7fd7f54c8700 1 -- 172.21.15.8:0/1984777583 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f015d460 con 0x7fd7d8003c20 2023-10-06T04:36:12.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.760+0000 7fd7f54c8700 1 -- 172.21.15.8:0/1984777583 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d800bbf0 con 0x7fd7d8004810 2023-10-06T04:36:12.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.760+0000 7fd7f54c8700 1 -- 172.21.15.8:0/1984777583 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d800bdb0 con 0x7fd7f00af680 2023-10-06T04:36:12.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.760+0000 7fd7f64ca700 1 --2- 172.21.15.8:0/1984777583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7d8003c20 0x7fd7d8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:12.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.760+0000 7fd7f5cc9700 1 --2- 172.21.15.8:0/1984777583 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7d8004810 0x7fd7d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:12.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.760+0000 7fd7f6ccb700 1 --2- 172.21.15.8:0/1984777583 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7f00af680 0x7fd7d8005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:12.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.760+0000 7fd7f64ca700 1 -- 172.21.15.8:0/1984777583 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7f00af680 msgr2=0x7fd7d8005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:12.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.760+0000 7fd7f64ca700 1 --2- 172.21.15.8:0/1984777583 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7f00af680 0x7fd7d8005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:12.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.761+0000 7fd7f64ca700 1 -- 172.21.15.8:0/1984777583 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7d8004810 msgr2=0x7fd7d8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:12.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.761+0000 7fd7f64ca700 1 --2- 172.21.15.8:0/1984777583 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7d8004810 0x7fd7d8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:12.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.761+0000 7fd7f64ca700 1 -- 172.21.15.8:0/1984777583 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d8003570 con 0x7fd7d8003c20 2023-10-06T04:36:12.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.761+0000 7fd7f64ca700 1 --2- 172.21.15.8:0/1984777583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7d8003c20 0x7fd7d8004010 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8009c00 tx=0x7fd7e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b636604a7f11eba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:12.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.761+0000 7fd7f54c8700 1 -- 172.21.15.8:0/1984777583 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e800e710 con 0x7fd7d8003c20 2023-10-06T04:36:12.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.761+0000 7fd7f54c8700 1 -- 172.21.15.8:0/1984777583 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e800e870 con 0x7fd7d8003c20 2023-10-06T04:36:12.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.761+0000 7fd7f54c8700 1 -- 172.21.15.8:0/1984777583 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e800ec30 con 0x7fd7d8003c20 2023-10-06T04:36:12.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.761+0000 7fd7f872e700 1 -- 172.21.15.8:0/1984777583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7d8003c20 msgr2=0x7fd7d8004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:12.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.761+0000 7fd7f872e700 1 --2- 172.21.15.8:0/1984777583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7d8003c20 0x7fd7d8004010 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8009c00 tx=0x7fd7e80091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:12.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.761+0000 7fd7f6ccb700 1 -- 172.21.15.8:0/1984777583 reap_dead start 2023-10-06T04:36:12.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.761+0000 7fd7f872e700 1 -- 172.21.15.8:0/1984777583 shutdown_connections 2023-10-06T04:36:12.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.761+0000 7fd7f872e700 1 -- 172.21.15.8:0/1984777583 >> 172.21.15.8:0/1984777583 conn(0x7fd7f00633d0 msgr2=0x7fd7f00637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:12.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.761+0000 7fd7f872e700 1 -- 172.21.15.8:0/1984777583 shutdown_connections 2023-10-06T04:36:12.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.762+0000 7fd7f872e700 1 -- 172.21.15.8:0/1984777583 wait complete. 2023-10-06T04:36:12.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.763+0000 7fd7f872e700 1 Processor -- start 2023-10-06T04:36:12.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.763+0000 7fd7f872e700 1 -- start start 2023-10-06T04:36:12.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.763+0000 7fd7f872e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7d8003c20 0x7fd7f0169be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:12.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.763+0000 7fd7f872e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7f00ae7b0 0x7fd7f00c7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:12.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.763+0000 7fd7f872e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7f01592c0 0x7fd7f015d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:12.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.763+0000 7fd7f872e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f00c8d70 con 0x7fd7f00ae7b0 2023-10-06T04:36:12.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.763+0000 7fd7f872e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f00c7d80 con 0x7fd7d8003c20 2023-10-06T04:36:12.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.763+0000 7fd7f872e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f00c83d0 con 0x7fd7f01592c0 2023-10-06T04:36:12.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.763+0000 7fd7f5cc9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7f00ae7b0 0x7fd7f00c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:12.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.764+0000 7fd7f5cc9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7f00ae7b0 0x7fd7f00c7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32770/0 (socket says 172.21.15.8:32770) 2023-10-06T04:36:12.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.764+0000 7fd7f5cc9700 1 -- 172.21.15.8:0/955286695 learned_addr learned my addr 172.21.15.8:0/955286695 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:12.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.764+0000 7fd7f64ca700 1 --2- 172.21.15.8:0/955286695 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7d8003c20 0x7fd7f0169be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:12.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.764+0000 7fd7f6ccb700 1 --2- 172.21.15.8:0/955286695 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7f01592c0 0x7fd7f015d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:12.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.764+0000 7fd7f5cc9700 1 -- 172.21.15.8:0/955286695 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7f01592c0 msgr2=0x7fd7f015d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:12.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.764+0000 7fd7f5cc9700 1 --2- 172.21.15.8:0/955286695 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7f01592c0 0x7fd7f015d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:12.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.764+0000 7fd7f5cc9700 1 -- 172.21.15.8:0/955286695 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7d8003c20 msgr2=0x7fd7f0169be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:12.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.764+0000 7fd7f5cc9700 1 --2- 172.21.15.8:0/955286695 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7d8003c20 0x7fd7f0169be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:12.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.764+0000 7fd7f5cc9700 1 -- 172.21.15.8:0/955286695 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f00c86b0 con 0x7fd7f00ae7b0 2023-10-06T04:36:12.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.764+0000 7fd7f6ccb700 1 --2- 172.21.15.8:0/955286695 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7f01592c0 0x7fd7f015d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:12.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.764+0000 7fd7f5cc9700 1 --2- 172.21.15.8:0/955286695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7f00ae7b0 0x7fd7f00c7430 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd7e40073c0 tx=0x7fd7e4001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:12.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.764+0000 7fd7ee7fc700 1 -- 172.21.15.8:0/955286695 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e4007780 con 0x7fd7f00ae7b0 2023-10-06T04:36:12.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.764+0000 7fd7ee7fc700 1 -- 172.21.15.8:0/955286695 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e4000c70 con 0x7fd7f00ae7b0 2023-10-06T04:36:12.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.764+0000 7fd7ee7fc700 1 -- 172.21.15.8:0/955286695 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e400fb20 con 0x7fd7f00ae7b0 2023-10-06T04:36:12.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.764+0000 7fd7f872e700 1 -- 172.21.15.8:0/955286695 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f00c8990 con 0x7fd7f00ae7b0 2023-10-06T04:36:12.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.764+0000 7fd7f872e700 1 -- 172.21.15.8:0/955286695 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f00c7b30 con 0x7fd7f00ae7b0 2023-10-06T04:36:12.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.765+0000 7fd7f872e700 1 -- 172.21.15.8:0/955286695 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7f0071550 con 0x7fd7f00ae7b0 2023-10-06T04:36:12.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.765+0000 7fd7ee7fc700 1 -- 172.21.15.8:0/955286695 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fd7e401d460 con 0x7fd7f00ae7b0 2023-10-06T04:36:12.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.766+0000 7fd7ee7fc700 1 --2- 172.21.15.8:0/955286695 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd7dc066ea0 0x7fd7dc069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:12.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.766+0000 7fd7ee7fc700 1 -- 172.21.15.8:0/955286695 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fd7e4084250 con 0x7fd7f00ae7b0 2023-10-06T04:36:12.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.766+0000 7fd7f64ca700 1 --2- 172.21.15.8:0/955286695 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd7dc066ea0 0x7fd7dc069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:12.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.767+0000 7fd7f64ca700 1 --2- 172.21.15.8:0/955286695 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd7dc066ea0 0x7fd7dc069350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd7e80091e0 tx=0x7fd7e801a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:12.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.770+0000 7fd7ee7fc700 1 -- 172.21.15.8:0/955286695 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd7e4051790 con 0x7fd7f00ae7b0 2023-10-06T04:36:12.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.968+0000 7fd7f872e700 1 -- 172.21.15.8:0/955286695 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7f00cacd0 con 0x7fd7f00ae7b0 2023-10-06T04:36:12.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.968+0000 7fd7ee7fc700 1 -- 172.21.15.8:0/955286695 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+13613 (secure 0 0 0) 0x7fd7e4054db0 con 0x7fd7f00ae7b0 2023-10-06T04:36:12.970 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:36:12.970 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":16,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:36:12.174926+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:36:10.148177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:36:10.684157+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.555871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.490505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.504578+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.517217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:05.991135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.537329+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.543232+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.443715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:36:12.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.971+0000 7fd7f872e700 1 -- 172.21.15.8:0/955286695 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd7dc066ea0 msgr2=0x7fd7dc069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:12.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.971+0000 7fd7f872e700 1 --2- 172.21.15.8:0/955286695 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd7dc066ea0 0x7fd7dc069350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd7e80091e0 tx=0x7fd7e801a000 comp rx=0 tx=0).stop 2023-10-06T04:36:12.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.971+0000 7fd7f872e700 1 -- 172.21.15.8:0/955286695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7f00ae7b0 msgr2=0x7fd7f00c7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:12.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.971+0000 7fd7f872e700 1 --2- 172.21.15.8:0/955286695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7f00ae7b0 0x7fd7f00c7430 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd7e40073c0 tx=0x7fd7e4001d40 comp rx=0 tx=0).stop 2023-10-06T04:36:12.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.971+0000 7fd7f872e700 1 -- 172.21.15.8:0/955286695 shutdown_connections 2023-10-06T04:36:12.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.971+0000 7fd7f872e700 1 --2- 172.21.15.8:0/955286695 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd7dc066ea0 0x7fd7dc069350 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:12.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.971+0000 7fd7f872e700 1 --2- 172.21.15.8:0/955286695 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7f01592c0 0x7fd7f015d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:12.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.971+0000 7fd7f872e700 1 --2- 172.21.15.8:0/955286695 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7d8003c20 0x7fd7f0169be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:12.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.971+0000 7fd7f872e700 1 --2- 172.21.15.8:0/955286695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7f00ae7b0 0x7fd7f00c7430 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:12.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.971+0000 7fd7f872e700 1 -- 172.21.15.8:0/955286695 >> 172.21.15.8:0/955286695 conn(0x7fd7f00633d0 msgr2=0x7fd7f015a210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:12.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.971+0000 7fd7f872e700 1 -- 172.21.15.8:0/955286695 shutdown_connections 2023-10-06T04:36:12.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:12.971+0000 7fd7f872e700 1 -- 172.21.15.8:0/955286695 wait complete. 2023-10-06T04:36:12.984 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:36:10.148177+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:36:10.684157+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T04:36:12.984 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:36:13.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.108+0000 7f95fd07d700 1 Processor -- start 2023-10-06T04:36:13.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.108+0000 7f95fd07d700 1 -- start start 2023-10-06T04:36:13.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.109+0000 7f95fd07d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95f8156e30 0x7f95f80cf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:13.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.109+0000 7f95fd07d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f95f80b1c70 0x7f95f80b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:13.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.109+0000 7f95fd07d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f80b2620 con 0x7f95f815ad80 2023-10-06T04:36:13.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.109+0000 7f95fd07d700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95f80cf370 con 0x7f95f80b1c70 2023-10-06T04:36:13.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.109+0000 7f95fd07d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f80ce800 con 0x7f95f8156e30 2023-10-06T04:36:13.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.109+0000 7f95fc87c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f95f815ad80 0x7f95f815b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.8:44742/0 (socket says 172.21.15.8:44742) 2023-10-06T04:36:13.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.109+0000 7f95fc87c700 1 -- 172.21.15.8:0/3978296493 learned_addr learned my addr 172.21.15.8:0/3978296493 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:13.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.109+0000 7f95f77fe700 1 --2- 172.21.15.8:0/3978296493 >> v2:172.21.15.8:3300/0 conn(0x7f95f80b1c70 0x7f95f80b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:13.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.109+0000 7f95f7fff700 1 --2- 172.21.15.8:0/3978296493 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95f8156e30 0x7f95f80cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:13.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.109+0000 7f95f6ffd700 1 -- 172.21.15.8:0/3978296493 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3375041990 0 0) 0x7f95f80b2620 con 0x7f95f815ad80 2023-10-06T04:36:13.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.109+0000 7f95f6ffd700 1 -- 172.21.15.8:0/3978296493 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95e0003570 con 0x7f95f815ad80 2023-10-06T04:36:13.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.109+0000 7f95f7fff700 1 -- 172.21.15.8:0/3978296493 >> v2:172.21.15.8:3300/0 conn(0x7f95f80b1c70 msgr2=0x7f95f80b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:13.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.109+0000 7f95f7fff700 1 --2- 172.21.15.8:0/3978296493 >> v2:172.21.15.8:3300/0 conn(0x7f95f80b1c70 0x7f95f80b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:13.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.109+0000 7f95f7fff700 1 -- 172.21.15.8:0/3978296493 >> v1:172.21.15.184:6789/0 conn(0x7f95f815ad80 legacy=0x7f95f815b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:13.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.109+0000 7f95f7fff700 1 -- 172.21.15.8:0/3978296493 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f80cea60 con 0x7f95f8156e30 2023-10-06T04:36:13.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.110+0000 7f95f7fff700 1 --2- 172.21.15.8:0/3978296493 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95f8156e30 0x7f95f80cf800 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f95f80cec50 tx=0x7f95ec0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=893cffcc6289eeee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:13.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.110+0000 7f95f6ffd700 1 -- 172.21.15.8:0/3978296493 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec011630 con 0x7f95f8156e30 2023-10-06T04:36:13.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.110+0000 7f95f6ffd700 1 -- 172.21.15.8:0/3978296493 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ec011790 con 0x7f95f8156e30 2023-10-06T04:36:13.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.110+0000 7f95f6ffd700 1 -- 172.21.15.8:0/3978296493 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec011b50 con 0x7f95f8156e30 2023-10-06T04:36:13.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.110+0000 7f95fd07d700 1 -- 172.21.15.8:0/3978296493 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95f8156e30 msgr2=0x7f95f80cf800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:13.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.110+0000 7f95fd07d700 1 --2- 172.21.15.8:0/3978296493 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95f8156e30 0x7f95f80cf800 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f95f80cec50 tx=0x7f95ec0091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:13.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.110+0000 7f95fd07d700 1 -- 172.21.15.8:0/3978296493 shutdown_connections 2023-10-06T04:36:13.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.110+0000 7f95fd07d700 1 --2- 172.21.15.8:0/3978296493 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95f8156e30 0x7f95f80cf800 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:13.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.110+0000 7f95fd07d700 1 --2- 172.21.15.8:0/3978296493 >> v2:172.21.15.8:3300/0 conn(0x7f95f80b1c70 0x7f95f80b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:13.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.110+0000 7f95fd07d700 1 -- 172.21.15.8:0/3978296493 >> 172.21.15.8:0/3978296493 conn(0x7f95f806ed00 msgr2=0x7f95f806f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:13.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.110+0000 7f95fd07d700 1 -- 172.21.15.8:0/3978296493 shutdown_connections 2023-10-06T04:36:13.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.110+0000 7f95fd07d700 1 -- 172.21.15.8:0/3978296493 wait complete. 2023-10-06T04:36:13.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.111+0000 7f95fd07d700 1 Processor -- start 2023-10-06T04:36:13.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.112+0000 7f95fd07d700 1 -- start start 2023-10-06T04:36:13.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.112+0000 7f95fd07d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95f80b1c70 0x7f95f8158910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:13.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.112+0000 7f95fd07d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95f8156e30 0x7f95f81695f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:13.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.112+0000 7f95fd07d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95f815ad80 0x7f95f8157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:13.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.112+0000 7f95fd07d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f8158480 con 0x7f95f8156e30 2023-10-06T04:36:13.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.112+0000 7f95fd07d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f8157870 con 0x7f95f80b1c70 2023-10-06T04:36:13.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.112+0000 7f95fd07d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f8157b50 con 0x7f95f815ad80 2023-10-06T04:36:13.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.113+0000 7f95f77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95f8156e30 0x7f95f81695f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:13.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.113+0000 7f95f77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95f8156e30 0x7f95f81695f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32784/0 (socket says 172.21.15.8:32784) 2023-10-06T04:36:13.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.113+0000 7f95f77fe700 1 -- 172.21.15.8:0/244426128 learned_addr learned my addr 172.21.15.8:0/244426128 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:13.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.113+0000 7f95f7fff700 1 --2- 172.21.15.8:0/244426128 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95f80b1c70 0x7f95f8158910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:13.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.113+0000 7f95fc87c700 1 --2- 172.21.15.8:0/244426128 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95f815ad80 0x7f95f8157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:13.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.113+0000 7f95f77fe700 1 -- 172.21.15.8:0/244426128 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95f815ad80 msgr2=0x7f95f8157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:13.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.113+0000 7f95f77fe700 1 --2- 172.21.15.8:0/244426128 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95f815ad80 0x7f95f8157200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:13.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.113+0000 7f95f77fe700 1 -- 172.21.15.8:0/244426128 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95f80b1c70 msgr2=0x7f95f8158910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:13.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.113+0000 7f95f77fe700 1 --2- 172.21.15.8:0/244426128 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95f80b1c70 0x7f95f8158910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:13.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.113+0000 7f95f77fe700 1 -- 172.21.15.8:0/244426128 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ec009420 con 0x7f95f8156e30 2023-10-06T04:36:13.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.113+0000 7f95fc87c700 1 --2- 172.21.15.8:0/244426128 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95f815ad80 0x7f95f8157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:13.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.113+0000 7f95f77fe700 1 --2- 172.21.15.8:0/244426128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95f8156e30 0x7f95f81695f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f95e800ec80 tx=0x7f95e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:13.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.135+0000 7f95dffff700 1 -- 172.21.15.8:0/244426128 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e800c850 con 0x7f95f8156e30 2023-10-06T04:36:13.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.135+0000 7f95dffff700 1 -- 172.21.15.8:0/244426128 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e800c9b0 con 0x7f95f8156e30 2023-10-06T04:36:13.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.135+0000 7f95fd07d700 1 -- 172.21.15.8:0/244426128 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f8157e30 con 0x7f95f8156e30 2023-10-06T04:36:13.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.135+0000 7f95dffff700 1 -- 172.21.15.8:0/244426128 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e800cd50 con 0x7f95f8156e30 2023-10-06T04:36:13.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.135+0000 7f95fd07d700 1 -- 172.21.15.8:0/244426128 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f81599d0 con 0x7f95f8156e30 2023-10-06T04:36:13.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.136+0000 7f95fd07d700 1 -- 172.21.15.8:0/244426128 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f8158630 con 0x7f95f8156e30 2023-10-06T04:36:13.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.137+0000 7f95dffff700 1 -- 172.21.15.8:0/244426128 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f95e8013680 con 0x7f95f8156e30 2023-10-06T04:36:13.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.137+0000 7f95dffff700 1 --2- 172.21.15.8:0/244426128 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f95e4066ea0 0x7f95e4069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:13.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.137+0000 7f95dffff700 1 -- 172.21.15.8:0/244426128 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f95e8084520 con 0x7f95f8156e30 2023-10-06T04:36:13.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.137+0000 7f95f7fff700 1 --2- 172.21.15.8:0/244426128 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f95e4066ea0 0x7f95e4069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:13.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.138+0000 7f95f7fff700 1 --2- 172.21.15.8:0/244426128 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f95e4066ea0 0x7f95e4069350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f95f80cec50 tx=0x7f95ec016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:13.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.142+0000 7f95dffff700 1 -- 172.21.15.8:0/244426128 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f95f8158630 con 0x7f95f8156e30 2023-10-06T04:36:13.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.338+0000 7f95fd07d700 1 -- 172.21.15.8:0/244426128 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f95f804c380 con 0x7f95f8156e30 2023-10-06T04:36:13.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.338+0000 7f95dffff700 1 -- 172.21.15.8:0/244426128 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f95e8051a60 con 0x7f95f8156e30 2023-10-06T04:36:13.340 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 8 2023-10-06T04:36:13.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.340+0000 7f95fd07d700 1 -- 172.21.15.8:0/244426128 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f95e4066ea0 msgr2=0x7f95e4069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:13.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.340+0000 7f95fd07d700 1 --2- 172.21.15.8:0/244426128 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f95e4066ea0 0x7f95e4069350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f95f80cec50 tx=0x7f95ec016000 comp rx=0 tx=0).stop 2023-10-06T04:36:13.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.340+0000 7f95fd07d700 1 -- 172.21.15.8:0/244426128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95f8156e30 msgr2=0x7f95f81695f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:13.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.340+0000 7f95fd07d700 1 --2- 172.21.15.8:0/244426128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95f8156e30 0x7f95f81695f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f95e800ec80 tx=0x7f95e80091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:13.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.340+0000 7f95fd07d700 1 -- 172.21.15.8:0/244426128 shutdown_connections 2023-10-06T04:36:13.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.340+0000 7f95fd07d700 1 --2- 172.21.15.8:0/244426128 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f95e4066ea0 0x7f95e4069350 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:13.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.340+0000 7f95fd07d700 1 --2- 172.21.15.8:0/244426128 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95f815ad80 0x7f95f8157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:13.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.340+0000 7f95fd07d700 1 --2- 172.21.15.8:0/244426128 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95f80b1c70 0x7f95f8158910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:13.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.340+0000 7f95fd07d700 1 --2- 172.21.15.8:0/244426128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f95f8156e30 0x7f95f81695f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:13.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.340+0000 7f95fd07d700 1 -- 172.21.15.8:0/244426128 >> 172.21.15.8:0/244426128 conn(0x7f95f806ed00 msgr2=0x7f95f8154dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:13.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.340+0000 7f95fd07d700 1 -- 172.21.15.8:0/244426128 shutdown_connections 2023-10-06T04:36:13.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.340+0000 7f95fd07d700 1 -- 172.21.15.8:0/244426128 wait complete. 2023-10-06T04:36:13.354 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:36:13.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.476+0000 7fe514b34700 1 Processor -- start 2023-10-06T04:36:13.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.476+0000 7fe514b34700 1 -- start start 2023-10-06T04:36:13.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.477+0000 7fe514b34700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe51006e7a0 0x7fe51006b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:13.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.477+0000 7fe514b34700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe51006b8c0 0x7fe51013f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:13.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.477+0000 7fe514b34700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5100c84c0 0x7fe51013fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:13.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.477+0000 7fe514b34700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5100c9620 con 0x7fe51006e7a0 2023-10-06T04:36:13.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.477+0000 7fe514b34700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5100c9a40 con 0x7fe51006b8c0 2023-10-06T04:36:13.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.477+0000 7fe514b34700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe510140070 con 0x7fe5100c84c0 2023-10-06T04:36:13.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.477+0000 7fe50e59c700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe51006e7a0 0x7fe51006b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:13.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.477+0000 7fe50e59c700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe51006e7a0 0x7fe51006b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32792/0 (socket says 172.21.15.8:32792) 2023-10-06T04:36:13.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.477+0000 7fe50e59c700 1 -- 172.21.15.8:0/3128935043 learned_addr learned my addr 172.21.15.8:0/3128935043 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:13.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.478+0000 7fe50dd9b700 1 --2- 172.21.15.8:0/3128935043 >> v2:172.21.15.184:3300/0 conn(0x7fe51006b8c0 0x7fe51013f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:13.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.478+0000 7fe50ed9d700 1 --2- 172.21.15.8:0/3128935043 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5100c84c0 0x7fe51013fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:13.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.478+0000 7fe50e59c700 1 -- 172.21.15.8:0/3128935043 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5100c84c0 msgr2=0x7fe51013fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:13.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.478+0000 7fe50e59c700 1 --2- 172.21.15.8:0/3128935043 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5100c84c0 0x7fe51013fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:13.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.478+0000 7fe50e59c700 1 -- 172.21.15.8:0/3128935043 >> v2:172.21.15.184:3300/0 conn(0x7fe51006b8c0 msgr2=0x7fe51013f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:13.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.478+0000 7fe50e59c700 1 --2- 172.21.15.8:0/3128935043 >> v2:172.21.15.184:3300/0 conn(0x7fe51006b8c0 0x7fe51013f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:13.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.478+0000 7fe50e59c700 1 -- 172.21.15.8:0/3128935043 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5100c89a0 con 0x7fe51006e7a0 2023-10-06T04:36:13.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.478+0000 7fe50dd9b700 1 --2- 172.21.15.8:0/3128935043 >> v2:172.21.15.184:3300/0 conn(0x7fe51006b8c0 0x7fe51013f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:13.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.478+0000 7fe50e59c700 1 --2- 172.21.15.8:0/3128935043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe51006e7a0 0x7fe51006b380 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe510065740 tx=0x7fe508009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fcbe0f0050b7fe2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:13.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.478+0000 7fe50d59a700 1 -- 172.21.15.8:0/3128935043 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50800b820 con 0x7fe51006e7a0 2023-10-06T04:36:13.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.478+0000 7fe50d59a700 1 -- 172.21.15.8:0/3128935043 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50800b980 con 0x7fe51006e7a0 2023-10-06T04:36:13.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.478+0000 7fe50d59a700 1 -- 172.21.15.8:0/3128935043 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50800bd20 con 0x7fe51006e7a0 2023-10-06T04:36:13.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.479+0000 7fe514b34700 1 -- 172.21.15.8:0/3128935043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe51006e7a0 msgr2=0x7fe51006b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:13.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.479+0000 7fe514b34700 1 --2- 172.21.15.8:0/3128935043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe51006e7a0 0x7fe51006b380 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe510065740 tx=0x7fe508009250 comp rx=0 tx=0).stop 2023-10-06T04:36:13.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.479+0000 7fe514b34700 1 -- 172.21.15.8:0/3128935043 shutdown_connections 2023-10-06T04:36:13.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.479+0000 7fe514b34700 1 --2- 172.21.15.8:0/3128935043 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5100c84c0 0x7fe51013fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:13.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.479+0000 7fe514b34700 1 --2- 172.21.15.8:0/3128935043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe51006e7a0 0x7fe51006b380 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:13.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.479+0000 7fe514b34700 1 --2- 172.21.15.8:0/3128935043 >> v2:172.21.15.184:3300/0 conn(0x7fe51006b8c0 0x7fe51013f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:13.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.479+0000 7fe514b34700 1 -- 172.21.15.8:0/3128935043 >> 172.21.15.8:0/3128935043 conn(0x7fe5100cd120 msgr2=0x7fe5100cd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:13.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.479+0000 7fe514b34700 1 -- 172.21.15.8:0/3128935043 shutdown_connections 2023-10-06T04:36:13.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.479+0000 7fe514b34700 1 -- 172.21.15.8:0/3128935043 wait complete. 2023-10-06T04:36:13.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.480+0000 7fe514b34700 1 Processor -- start 2023-10-06T04:36:13.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.480+0000 7fe514b34700 1 -- start start 2023-10-06T04:36:13.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.481+0000 7fe514b34700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe51006b8c0 0x7fe5100afec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:13.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.481+0000 7fe514b34700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe51006e7a0 0x7fe510165530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:13.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.481+0000 7fe514b34700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5100c84c0 0x7fe5100c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:13.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.481+0000 7fe514b34700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5100c6fa0 con 0x7fe51006e7a0 2023-10-06T04:36:13.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.481+0000 7fe514b34700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe510165be0 con 0x7fe5100c84c0 2023-10-06T04:36:13.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.481+0000 7fe514b34700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe510165ec0 con 0x7fe51006b8c0 2023-10-06T04:36:13.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.481+0000 7fe50dd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe51006e7a0 0x7fe510165530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:13.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.481+0000 7fe50dd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe51006e7a0 0x7fe510165530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32804/0 (socket says 172.21.15.8:32804) 2023-10-06T04:36:13.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.481+0000 7fe50dd9b700 1 -- 172.21.15.8:0/2108155928 learned_addr learned my addr 172.21.15.8:0/2108155928 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:13.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.481+0000 7fe50e59c700 1 --2- 172.21.15.8:0/2108155928 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe51006b8c0 0x7fe5100afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:13.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.481+0000 7fe50ed9d700 1 --2- 172.21.15.8:0/2108155928 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5100c84c0 0x7fe5100c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:13.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.481+0000 7fe50dd9b700 1 -- 172.21.15.8:0/2108155928 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe51006b8c0 msgr2=0x7fe5100afec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:13.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.481+0000 7fe50dd9b700 1 --2- 172.21.15.8:0/2108155928 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe51006b8c0 0x7fe5100afec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:13.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.481+0000 7fe50dd9b700 1 -- 172.21.15.8:0/2108155928 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5100c84c0 msgr2=0x7fe5100c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:13.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.481+0000 7fe50dd9b700 1 --2- 172.21.15.8:0/2108155928 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5100c84c0 0x7fe5100c6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:13.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.481+0000 7fe50dd9b700 1 -- 172.21.15.8:0/2108155928 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5080094f0 con 0x7fe51006e7a0 2023-10-06T04:36:13.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.481+0000 7fe50ed9d700 1 --2- 172.21.15.8:0/2108155928 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5100c84c0 0x7fe5100c6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:13.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.481+0000 7fe50dd9b700 1 --2- 172.21.15.8:0/2108155928 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe51006e7a0 0x7fe510165530 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe4f800e8d0 tx=0x7fe4f8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:13.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.481+0000 7fe5067fc700 1 -- 172.21.15.8:0/2108155928 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f800ee70 con 0x7fe51006e7a0 2023-10-06T04:36:13.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.481+0000 7fe514b34700 1 -- 172.21.15.8:0/2108155928 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5101661a0 con 0x7fe51006e7a0 2023-10-06T04:36:13.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.481+0000 7fe5067fc700 1 -- 172.21.15.8:0/2108155928 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f800c5e0 con 0x7fe51006e7a0 2023-10-06T04:36:13.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.481+0000 7fe5067fc700 1 -- 172.21.15.8:0/2108155928 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f800c980 con 0x7fe51006e7a0 2023-10-06T04:36:13.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.481+0000 7fe514b34700 1 -- 172.21.15.8:0/2108155928 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5100ada10 con 0x7fe51006e7a0 2023-10-06T04:36:13.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.482+0000 7fe514b34700 1 -- 172.21.15.8:0/2108155928 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5100add80 con 0x7fe51006e7a0 2023-10-06T04:36:13.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.483+0000 7fe5067fc700 1 -- 172.21.15.8:0/2108155928 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe4f8013410 con 0x7fe51006e7a0 2023-10-06T04:36:13.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.483+0000 7fe5067fc700 1 --2- 172.21.15.8:0/2108155928 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe4f0066f30 0x7fe4f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:13.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.483+0000 7fe5067fc700 1 -- 172.21.15.8:0/2108155928 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fe4f8084570 con 0x7fe51006e7a0 2023-10-06T04:36:13.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.483+0000 7fe50e59c700 1 --2- 172.21.15.8:0/2108155928 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe4f0066f30 0x7fe4f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:13.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.484+0000 7fe50e59c700 1 --2- 172.21.15.8:0/2108155928 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe4f0066f30 0x7fe4f00693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe510065740 tx=0x7fe508019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:13.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.488+0000 7fe5067fc700 1 -- 172.21.15.8:0/2108155928 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe4f8051930 con 0x7fe51006e7a0 2023-10-06T04:36:13.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.680+0000 7fe514b34700 1 -- 172.21.15.8:0/2108155928 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe5100ad870 con 0x7fe51006e7a0 2023-10-06T04:36:13.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.681+0000 7fe5067fc700 1 -- 172.21.15.8:0/2108155928 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe5100ad870 con 0x7fe51006e7a0 2023-10-06T04:36:13.682 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-06T04:36:13.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.683+0000 7fe514b34700 1 -- 172.21.15.8:0/2108155928 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe4f0066f30 msgr2=0x7fe4f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:13.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.683+0000 7fe514b34700 1 --2- 172.21.15.8:0/2108155928 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe4f0066f30 0x7fe4f00693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe510065740 tx=0x7fe508019000 comp rx=0 tx=0).stop 2023-10-06T04:36:13.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.683+0000 7fe514b34700 1 -- 172.21.15.8:0/2108155928 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe51006e7a0 msgr2=0x7fe510165530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:13.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.683+0000 7fe514b34700 1 --2- 172.21.15.8:0/2108155928 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe51006e7a0 0x7fe510165530 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe4f800e8d0 tx=0x7fe4f8008040 comp rx=0 tx=0).stop 2023-10-06T04:36:13.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.683+0000 7fe514b34700 1 -- 172.21.15.8:0/2108155928 shutdown_connections 2023-10-06T04:36:13.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.683+0000 7fe514b34700 1 --2- 172.21.15.8:0/2108155928 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe4f0066f30 0x7fe4f00693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:13.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.683+0000 7fe514b34700 1 --2- 172.21.15.8:0/2108155928 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5100c84c0 0x7fe5100c6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:13.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.683+0000 7fe514b34700 1 --2- 172.21.15.8:0/2108155928 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe51006b8c0 0x7fe5100afec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:13.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.683+0000 7fe514b34700 1 --2- 172.21.15.8:0/2108155928 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe51006e7a0 0x7fe510165530 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:13.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.683+0000 7fe514b34700 1 -- 172.21.15.8:0/2108155928 >> 172.21.15.8:0/2108155928 conn(0x7fe5100cd120 msgr2=0x7fe51013f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:13.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.683+0000 7fe514b34700 1 -- 172.21.15.8:0/2108155928 shutdown_connections 2023-10-06T04:36:13.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.683+0000 7fe514b34700 1 -- 172.21.15.8:0/2108155928 wait complete. 2023-10-06T04:36:13.696 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T04:36:13.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.814+0000 7f3f0f8ab700 1 Processor -- start 2023-10-06T04:36:13.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.814+0000 7f3f0f8ab700 1 -- start start 2023-10-06T04:36:13.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.815+0000 7f3f0f8ab700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f080cb310 0x7f3f080675d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:13.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.815+0000 7f3f0f8ab700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3f08142850 0x7f3f08142c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:13.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.815+0000 7f3f0f8ab700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f0806ad70 con 0x7f3f080caf40 2023-10-06T04:36:13.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.815+0000 7f3f0f8ab700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f0806a760 con 0x7f3f08142850 2023-10-06T04:36:13.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.815+0000 7f3f0f8ab700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f08067f40 con 0x7f3f080cb310 2023-10-06T04:36:13.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.815+0000 7f3f0de48700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3f08142850 0x7f3f08142c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:13.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.815+0000 7f3f0ce46700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f080cb310 0x7f3f080675d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:13.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.815+0000 7f3f0d647700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f3f080caf40 0x7f3f080c7760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.8:44758/0 (socket says 172.21.15.8:44758) 2023-10-06T04:36:13.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.815+0000 7f3f0d647700 1 -- 172.21.15.8:0/637129087 learned_addr learned my addr 172.21.15.8:0/637129087 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:13.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.816+0000 7f3f0ce46700 1 -- 172.21.15.8:0/637129087 >> v2:172.21.15.184:3300/0 conn(0x7f3f08142850 msgr2=0x7f3f08142c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:13.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.816+0000 7f3f0ce46700 1 --2- 172.21.15.8:0/637129087 >> v2:172.21.15.184:3300/0 conn(0x7f3f08142850 0x7f3f08142c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:13.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.816+0000 7f3f0ce46700 1 -- 172.21.15.8:0/637129087 >> v1:172.21.15.184:6789/0 conn(0x7f3f080caf40 legacy=0x7f3f080c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:13.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.816+0000 7f3f0ce46700 1 -- 172.21.15.8:0/637129087 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0806aa00 con 0x7f3f080cb310 2023-10-06T04:36:13.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.816+0000 7f3f07fff700 1 -- 172.21.15.8:0/637129087 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3774518660 0 0) 0x7f3f0806ad70 con 0x7f3f080caf40 2023-10-06T04:36:13.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.816+0000 7f3f0de48700 1 --2- 172.21.15.8:0/637129087 >> v2:172.21.15.184:3300/0 conn(0x7f3f08142850 0x7f3f08142c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:36:13.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.816+0000 7f3f0ce46700 1 --2- 172.21.15.8:0/637129087 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f080cb310 0x7f3f080675d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3efc0098e0 tx=0x7f3efc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c961bc6a39ae13b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:13.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.816+0000 7f3f07fff700 1 -- 172.21.15.8:0/637129087 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc00b640 con 0x7f3f080cb310 2023-10-06T04:36:13.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.816+0000 7f3f07fff700 1 -- 172.21.15.8:0/637129087 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3efc00b7a0 con 0x7f3f080cb310 2023-10-06T04:36:13.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.816+0000 7f3f07fff700 1 -- 172.21.15.8:0/637129087 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc00bb40 con 0x7f3f080cb310 2023-10-06T04:36:13.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.817+0000 7f3f0f8ab700 1 -- 172.21.15.8:0/637129087 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f080cb310 msgr2=0x7f3f080675d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:13.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.817+0000 7f3f0f8ab700 1 --2- 172.21.15.8:0/637129087 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f080cb310 0x7f3f080675d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3efc0098e0 tx=0x7f3efc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:13.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.817+0000 7f3f0f8ab700 1 -- 172.21.15.8:0/637129087 shutdown_connections 2023-10-06T04:36:13.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.817+0000 7f3f0f8ab700 1 --2- 172.21.15.8:0/637129087 >> v2:172.21.15.184:3300/0 conn(0x7f3f08142850 0x7f3f08142c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:13.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.817+0000 7f3f0f8ab700 1 --2- 172.21.15.8:0/637129087 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f080cb310 0x7f3f080675d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:13.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.817+0000 7f3f0f8ab700 1 -- 172.21.15.8:0/637129087 >> 172.21.15.8:0/637129087 conn(0x7f3f080cd120 msgr2=0x7f3f080cd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:13.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.817+0000 7f3f0f8ab700 1 -- 172.21.15.8:0/637129087 shutdown_connections 2023-10-06T04:36:13.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.817+0000 7f3f0f8ab700 1 -- 172.21.15.8:0/637129087 wait complete. 2023-10-06T04:36:13.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.818+0000 7f3f0f8ab700 1 Processor -- start 2023-10-06T04:36:13.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.818+0000 7f3f0f8ab700 1 -- start start 2023-10-06T04:36:13.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.819+0000 7f3f0f8ab700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f080caf40 0x7f3f080aca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:13.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.819+0000 7f3f0f8ab700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f080cb310 0x7f3f0813f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:13.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.819+0000 7f3f0f8ab700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f08142850 0x7f3f080b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:13.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.819+0000 7f3f0f8ab700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f081400e0 con 0x7f3f08142850 2023-10-06T04:36:13.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.819+0000 7f3f0f8ab700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f080aff50 con 0x7f3f080cb310 2023-10-06T04:36:13.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.819+0000 7f3f0f8ab700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f080ad100 con 0x7f3f080caf40 2023-10-06T04:36:13.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.819+0000 7f3f0de48700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f08142850 0x7f3f080b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:13.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.819+0000 7f3f0de48700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f08142850 0x7f3f080b24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32814/0 (socket says 172.21.15.8:32814) 2023-10-06T04:36:13.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.819+0000 7f3f0de48700 1 -- 172.21.15.8:0/3234988985 learned_addr learned my addr 172.21.15.8:0/3234988985 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:13.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.819+0000 7f3f0d647700 1 --2- 172.21.15.8:0/3234988985 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f080caf40 0x7f3f080aca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:13.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.819+0000 7f3f0ce46700 1 --2- 172.21.15.8:0/3234988985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f080cb310 0x7f3f0813f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:13.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.819+0000 7f3f0de48700 1 -- 172.21.15.8:0/3234988985 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f080caf40 msgr2=0x7f3f080aca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:13.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.819+0000 7f3f0de48700 1 --2- 172.21.15.8:0/3234988985 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f080caf40 0x7f3f080aca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:13.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.819+0000 7f3f0de48700 1 -- 172.21.15.8:0/3234988985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f080cb310 msgr2=0x7f3f0813f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:13.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.819+0000 7f3f0de48700 1 --2- 172.21.15.8:0/3234988985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f080cb310 0x7f3f0813f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:13.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.819+0000 7f3f0de48700 1 -- 172.21.15.8:0/3234988985 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f00009a20 con 0x7f3f08142850 2023-10-06T04:36:13.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.819+0000 7f3f0de48700 1 --2- 172.21.15.8:0/3234988985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f08142850 0x7f3f080b24c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3f00009f20 tx=0x7f3f0000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:13.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.819+0000 7f3f057fa700 1 -- 172.21.15.8:0/3234988985 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0000cb70 con 0x7f3f08142850 2023-10-06T04:36:13.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.819+0000 7f3f057fa700 1 -- 172.21.15.8:0/3234988985 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0000f040 con 0x7f3f08142850 2023-10-06T04:36:13.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.819+0000 7f3f0f8ab700 1 -- 172.21.15.8:0/3234988985 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3efc009420 con 0x7f3f08142850 2023-10-06T04:36:13.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.819+0000 7f3f057fa700 1 -- 172.21.15.8:0/3234988985 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f00014480 con 0x7f3f08142850 2023-10-06T04:36:13.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.819+0000 7f3f0f8ab700 1 -- 172.21.15.8:0/3234988985 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f080ad6c0 con 0x7f3f08142850 2023-10-06T04:36:13.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.820+0000 7f3f0f8ab700 1 -- 172.21.15.8:0/3234988985 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f08071550 con 0x7f3f08142850 2023-10-06T04:36:13.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.821+0000 7f3f057fa700 1 -- 172.21.15.8:0/3234988985 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3f00003020 con 0x7f3f08142850 2023-10-06T04:36:13.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.821+0000 7f3f057fa700 1 --2- 172.21.15.8:0/3234988985 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3ef4066f30 0x7f3ef40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:13.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.821+0000 7f3f057fa700 1 -- 172.21.15.8:0/3234988985 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f3f00084c00 con 0x7f3f08142850 2023-10-06T04:36:13.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.821+0000 7f3f0d647700 1 --2- 172.21.15.8:0/3234988985 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3ef4066f30 0x7f3ef40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:13.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.822+0000 7f3f0d647700 1 --2- 172.21.15.8:0/3234988985 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3ef4066f30 0x7f3ef40693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8007fd0 tx=0x7f3ef8007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:13.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:13.825+0000 7f3f057fa700 1 -- 172.21.15.8:0/3234988985 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f0008b080 con 0x7f3f08142850 2023-10-06T04:36:14.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.019+0000 7f3f0f8ab700 1 -- 172.21.15.8:0/3234988985 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3f080b0090 con 0x7f3f08142850 2023-10-06T04:36:14.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.019+0000 7f3f057fa700 1 -- 172.21.15.8:0/3234988985 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+126 (secure 0 0 0) 0x7f3f00052060 con 0x7f3f08142850 2023-10-06T04:36:14.021 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:36:14.021 INFO:teuthology.orchestra.run.smithi008.stdout:[ 2023-10-06T04:36:14.021 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T04:36:14.021 INFO:teuthology.orchestra.run.smithi008.stdout: "poolnum": 1, 2023-10-06T04:36:14.021 INFO:teuthology.orchestra.run.smithi008.stdout: "poolname": "rbd" 2023-10-06T04:36:14.021 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T04:36:14.021 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T04:36:14.021 INFO:teuthology.orchestra.run.smithi008.stdout: "poolnum": 2, 2023-10-06T04:36:14.021 INFO:teuthology.orchestra.run.smithi008.stdout: "poolname": ".mgr" 2023-10-06T04:36:14.021 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T04:36:14.021 INFO:teuthology.orchestra.run.smithi008.stdout:] 2023-10-06T04:36:14.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.021+0000 7f3f0f8ab700 1 -- 172.21.15.8:0/3234988985 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3ef4066f30 msgr2=0x7f3ef40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:14.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.021+0000 7f3f0f8ab700 1 --2- 172.21.15.8:0/3234988985 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3ef4066f30 0x7f3ef40693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8007fd0 tx=0x7f3ef8007d30 comp rx=0 tx=0).stop 2023-10-06T04:36:14.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.021+0000 7f3f0f8ab700 1 -- 172.21.15.8:0/3234988985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f08142850 msgr2=0x7f3f080b24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:14.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.021+0000 7f3f0f8ab700 1 --2- 172.21.15.8:0/3234988985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f08142850 0x7f3f080b24c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3f00009f20 tx=0x7f3f0000b040 comp rx=0 tx=0).stop 2023-10-06T04:36:14.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.021+0000 7f3f0f8ab700 1 -- 172.21.15.8:0/3234988985 shutdown_connections 2023-10-06T04:36:14.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.021+0000 7f3f0f8ab700 1 --2- 172.21.15.8:0/3234988985 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3ef4066f30 0x7f3ef40693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:14.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.021+0000 7f3f0f8ab700 1 --2- 172.21.15.8:0/3234988985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f08142850 0x7f3f080b24c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:14.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.021+0000 7f3f0f8ab700 1 --2- 172.21.15.8:0/3234988985 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f080caf40 0x7f3f080aca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:14.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.021+0000 7f3f0f8ab700 1 --2- 172.21.15.8:0/3234988985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f080cb310 0x7f3f0813f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:14.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.021+0000 7f3f0f8ab700 1 -- 172.21.15.8:0/3234988985 >> 172.21.15.8:0/3234988985 conn(0x7f3f080cd120 msgr2=0x7f3f080ab8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:14.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.021+0000 7f3f0f8ab700 1 -- 172.21.15.8:0/3234988985 shutdown_connections 2023-10-06T04:36:14.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.021+0000 7f3f0f8ab700 1 -- 172.21.15.8:0/3234988985 wait complete. 2023-10-06T04:36:14.034 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T04:36:14.035 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T04:36:14.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.155+0000 7fea43430700 1 Processor -- start 2023-10-06T04:36:14.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.156+0000 7fea43430700 1 -- start start 2023-10-06T04:36:14.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.156+0000 7fea43430700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fea3c068c60 0x7fea3c0cb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:14.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.156+0000 7fea43430700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea3c0cb0f0 con 0x7fea3c068890 2023-10-06T04:36:14.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.156+0000 7fea43430700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea3c0ca520 con 0x7fea3c15bb70 2023-10-06T04:36:14.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.156+0000 7fea43430700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea3c0abdf0 con 0x7fea3c068c60 2023-10-06T04:36:14.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.157+0000 7fea409cb700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fea3c068c60 0x7fea3c0cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:14.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.157+0000 7fea411cc700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fea3c068890 0x7fea3c0ab5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34050/0 (socket says 172.21.15.8:34050) 2023-10-06T04:36:14.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.157+0000 7fea409cb700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fea3c068c60 0x7fea3c0cb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32822/0 (socket says 172.21.15.8:32822) 2023-10-06T04:36:14.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.157+0000 7fea411cc700 1 -- 172.21.15.8:0/817006280 learned_addr learned my addr 172.21.15.8:0/817006280 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:14.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.157+0000 7fea409cb700 1 -- 172.21.15.8:0/817006280 >> v1:172.21.15.184:6789/0 conn(0x7fea3c15bb70 legacy=0x7fea3c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:14.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.157+0000 7fea409cb700 1 -- 172.21.15.8:0/817006280 >> v1:172.21.15.8:6789/0 conn(0x7fea3c068890 legacy=0x7fea3c0ab5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:14.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.157+0000 7fea409cb700 1 -- 172.21.15.8:0/817006280 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea3c0ca7c0 con 0x7fea3c068c60 2023-10-06T04:36:14.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.157+0000 7fea409cb700 1 --2- 172.21.15.8:0/817006280 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea3c068c60 0x7fea3c0cb580 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fea30009940 tx=0x7fea300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86cff292e13f6bac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:14.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.157+0000 7fea3bfff700 1 -- 172.21.15.8:0/817006280 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3000b7e0 con 0x7fea3c068c60 2023-10-06T04:36:14.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.157+0000 7fea3bfff700 1 -- 172.21.15.8:0/817006280 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea3000b940 con 0x7fea3c068c60 2023-10-06T04:36:14.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.157+0000 7fea3bfff700 1 -- 172.21.15.8:0/817006280 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3000bce0 con 0x7fea3c068c60 2023-10-06T04:36:14.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.158+0000 7fea43430700 1 -- 172.21.15.8:0/817006280 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea3c068c60 msgr2=0x7fea3c0cb580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:14.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.158+0000 7fea43430700 1 --2- 172.21.15.8:0/817006280 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea3c068c60 0x7fea3c0cb580 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fea30009940 tx=0x7fea300091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:14.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.158+0000 7fea43430700 1 -- 172.21.15.8:0/817006280 shutdown_connections 2023-10-06T04:36:14.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.158+0000 7fea43430700 1 --2- 172.21.15.8:0/817006280 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea3c068c60 0x7fea3c0cb580 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:14.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.158+0000 7fea43430700 1 -- 172.21.15.8:0/817006280 >> 172.21.15.8:0/817006280 conn(0x7fea3c06dd10 msgr2=0x7fea3c06e110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:14.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.158+0000 7fea43430700 1 -- 172.21.15.8:0/817006280 shutdown_connections 2023-10-06T04:36:14.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.158+0000 7fea43430700 1 -- 172.21.15.8:0/817006280 wait complete. 2023-10-06T04:36:14.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.159+0000 7fea43430700 1 Processor -- start 2023-10-06T04:36:14.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.159+0000 7fea43430700 1 -- start start 2023-10-06T04:36:14.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.160+0000 7fea43430700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea3c068890 0x7fea3c141a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:14.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.160+0000 7fea43430700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea3c068c60 0x7fea3c157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:14.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.160+0000 7fea43430700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea3c15bb70 0x7fea3c0a8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:14.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.160+0000 7fea43430700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c141fa0 con 0x7fea3c068890 2023-10-06T04:36:14.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.160+0000 7fea43430700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c159780 con 0x7fea3c15bb70 2023-10-06T04:36:14.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.160+0000 7fea43430700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c1586e0 con 0x7fea3c068c60 2023-10-06T04:36:14.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.160+0000 7fea411cc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea3c068890 0x7fea3c141a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:14.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.160+0000 7fea411cc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea3c068890 0x7fea3c141a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32832/0 (socket says 172.21.15.8:32832) 2023-10-06T04:36:14.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.160+0000 7fea411cc700 1 -- 172.21.15.8:0/1410336099 learned_addr learned my addr 172.21.15.8:0/1410336099 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:14.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.160+0000 7fea419cd700 1 --2- 172.21.15.8:0/1410336099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea3c15bb70 0x7fea3c0a8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:14.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.160+0000 7fea409cb700 1 --2- 172.21.15.8:0/1410336099 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea3c068c60 0x7fea3c157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:14.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.160+0000 7fea411cc700 1 -- 172.21.15.8:0/1410336099 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea3c068c60 msgr2=0x7fea3c157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:14.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.160+0000 7fea411cc700 1 --2- 172.21.15.8:0/1410336099 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea3c068c60 0x7fea3c157de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:14.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.160+0000 7fea411cc700 1 -- 172.21.15.8:0/1410336099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea3c15bb70 msgr2=0x7fea3c0a8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:14.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.160+0000 7fea411cc700 1 --2- 172.21.15.8:0/1410336099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea3c15bb70 0x7fea3c0a8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:14.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.160+0000 7fea411cc700 1 -- 172.21.15.8:0/1410336099 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea30009420 con 0x7fea3c068890 2023-10-06T04:36:14.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.160+0000 7fea411cc700 1 --2- 172.21.15.8:0/1410336099 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea3c068890 0x7fea3c141a60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fea3400c7f0 tx=0x7fea34007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:14.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.160+0000 7fea397fa700 1 -- 172.21.15.8:0/1410336099 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea34005b30 con 0x7fea3c068890 2023-10-06T04:36:14.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.161+0000 7fea397fa700 1 -- 172.21.15.8:0/1410336099 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea34005cb0 con 0x7fea3c068890 2023-10-06T04:36:14.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.161+0000 7fea43430700 1 -- 172.21.15.8:0/1410336099 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea3c1589c0 con 0x7fea3c068890 2023-10-06T04:36:14.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.161+0000 7fea397fa700 1 -- 172.21.15.8:0/1410336099 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea34004a80 con 0x7fea3c068890 2023-10-06T04:36:14.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.161+0000 7fea43430700 1 -- 172.21.15.8:0/1410336099 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea3c159000 con 0x7fea3c068890 2023-10-06T04:36:14.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.161+0000 7fea43430700 1 -- 172.21.15.8:0/1410336099 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea3c071550 con 0x7fea3c068890 2023-10-06T04:36:14.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.162+0000 7fea397fa700 1 -- 172.21.15.8:0/1410336099 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fea340070f0 con 0x7fea3c068890 2023-10-06T04:36:14.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.162+0000 7fea397fa700 1 --2- 172.21.15.8:0/1410336099 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fea28066f30 0x7fea280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:14.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.162+0000 7fea397fa700 1 -- 172.21.15.8:0/1410336099 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fea34083780 con 0x7fea3c068890 2023-10-06T04:36:14.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.162+0000 7fea409cb700 1 --2- 172.21.15.8:0/1410336099 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fea28066f30 0x7fea280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:14.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.163+0000 7fea409cb700 1 --2- 172.21.15.8:0/1410336099 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fea28066f30 0x7fea280693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fea30009fd0 tx=0x7fea30017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:14.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.167+0000 7fea397fa700 1 -- 172.21.15.8:0/1410336099 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea34050c60 con 0x7fea3c068890 2023-10-06T04:36:14.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:14.360+0000 7fea43430700 1 -- 172.21.15.8:0/1410336099 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fea3c0caaa0 con 0x7fea3c068890 2023-10-06T04:36:15.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.212+0000 7fea397fa700 1 -- 172.21.15.8:0/1410336099 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7fea34018020 con 0x7fea3c068890 2023-10-06T04:36:15.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.216+0000 7fea43430700 1 -- 172.21.15.8:0/1410336099 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fea28066f30 msgr2=0x7fea280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:15.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.216+0000 7fea43430700 1 --2- 172.21.15.8:0/1410336099 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fea28066f30 0x7fea280693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fea30009fd0 tx=0x7fea30017000 comp rx=0 tx=0).stop 2023-10-06T04:36:15.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.216+0000 7fea43430700 1 -- 172.21.15.8:0/1410336099 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea3c068890 msgr2=0x7fea3c141a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:15.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.216+0000 7fea43430700 1 --2- 172.21.15.8:0/1410336099 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea3c068890 0x7fea3c141a60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fea3400c7f0 tx=0x7fea34007f70 comp rx=0 tx=0).stop 2023-10-06T04:36:15.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.217+0000 7fea43430700 1 -- 172.21.15.8:0/1410336099 shutdown_connections 2023-10-06T04:36:15.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.217+0000 7fea43430700 1 --2- 172.21.15.8:0/1410336099 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fea28066f30 0x7fea280693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:15.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.217+0000 7fea43430700 1 --2- 172.21.15.8:0/1410336099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea3c15bb70 0x7fea3c0a8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:15.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.217+0000 7fea43430700 1 --2- 172.21.15.8:0/1410336099 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea3c068890 0x7fea3c141a60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:15.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.217+0000 7fea43430700 1 --2- 172.21.15.8:0/1410336099 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea3c068c60 0x7fea3c157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:15.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.217+0000 7fea43430700 1 -- 172.21.15.8:0/1410336099 >> 172.21.15.8:0/1410336099 conn(0x7fea3c06dd10 msgr2=0x7fea3c0675d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:15.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.217+0000 7fea43430700 1 -- 172.21.15.8:0/1410336099 shutdown_connections 2023-10-06T04:36:15.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.218+0000 7fea43430700 1 -- 172.21.15.8:0/1410336099 wait complete. 2023-10-06T04:36:15.221 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_metadata' created 2023-10-06T04:36:15.236 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-10-06T04:36:15.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.366+0000 7f858e977700 1 Processor -- start 2023-10-06T04:36:15.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.367+0000 7f858e977700 1 -- start start 2023-10-06T04:36:15.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.367+0000 7f858e977700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8588142cf0 0x7f85880b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:15.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.367+0000 7f858e977700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f85881430c0 0x7f85880cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:15.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.367+0000 7f858e977700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85880cf510 con 0x7f85880cfee0 2023-10-06T04:36:15.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.367+0000 7f858e977700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85880ce6a0 con 0x7f85881430c0 2023-10-06T04:36:15.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.367+0000 7f858e977700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85880ce900 con 0x7f8588142cf0 2023-10-06T04:36:15.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.368+0000 7f8587fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8588142cf0 0x7f85880b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:15.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.368+0000 7f85877fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f85881430c0 0x7f85880cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:15.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.368+0000 7f858cf14700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f85880cfee0 0x7f85880b3790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.8:36078/0 (socket says 172.21.15.8:36078) 2023-10-06T04:36:15.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.368+0000 7f85877fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f85881430c0 0x7f85880cf9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.8:48264/0 (socket says 172.21.15.8:48264) 2023-10-06T04:36:15.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.368+0000 7f858cf14700 1 -- 172.21.15.8:0/1567369823 learned_addr learned my addr 172.21.15.8:0/1567369823 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:15.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.368+0000 7f8587fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8588142cf0 0x7f85880b5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.8:39180/0 (socket says 172.21.15.8:39180) 2023-10-06T04:36:15.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.368+0000 7f85877fe700 1 -- 172.21.15.8:0/1567369823 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8588142cf0 msgr2=0x7f85880b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:15.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.368+0000 7f85877fe700 1 --2- 172.21.15.8:0/1567369823 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8588142cf0 0x7f85880b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:15.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.368+0000 7f85877fe700 1 -- 172.21.15.8:0/1567369823 >> v1:172.21.15.184:6789/0 conn(0x7f85880cfee0 legacy=0x7f85880b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:15.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.368+0000 7f85877fe700 1 -- 172.21.15.8:0/1567369823 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85880cebe0 con 0x7f85881430c0 2023-10-06T04:36:15.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.368+0000 7f8587fff700 1 --2- 172.21.15.8:0/1567369823 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8588142cf0 0x7f85880b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:36:15.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.368+0000 7f85877fe700 1 --2- 172.21.15.8:0/1567369823 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85881430c0 0x7f85880cf9a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f857c0098e0 tx=0x7f857c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f3be71cee967023 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:15.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.368+0000 7f8586ffd700 1 -- 172.21.15.8:0/1567369823 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857c00b640 con 0x7f85881430c0 2023-10-06T04:36:15.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.368+0000 7f8586ffd700 1 -- 172.21.15.8:0/1567369823 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f857c00b7a0 con 0x7f85881430c0 2023-10-06T04:36:15.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.368+0000 7f8586ffd700 1 -- 172.21.15.8:0/1567369823 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857c00bb40 con 0x7f85881430c0 2023-10-06T04:36:15.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.369+0000 7f858e977700 1 -- 172.21.15.8:0/1567369823 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85881430c0 msgr2=0x7f85880cf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:15.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.369+0000 7f858e977700 1 --2- 172.21.15.8:0/1567369823 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85881430c0 0x7f85880cf9a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f857c0098e0 tx=0x7f857c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:15.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.369+0000 7f858e977700 1 -- 172.21.15.8:0/1567369823 shutdown_connections 2023-10-06T04:36:15.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.369+0000 7f858e977700 1 --2- 172.21.15.8:0/1567369823 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8588142cf0 0x7f85880b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:15.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.369+0000 7f858e977700 1 --2- 172.21.15.8:0/1567369823 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85881430c0 0x7f85880cf9a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:15.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.369+0000 7f858e977700 1 -- 172.21.15.8:0/1567369823 >> 172.21.15.8:0/1567369823 conn(0x7f858806ed00 msgr2=0x7f858806f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:15.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.369+0000 7f858e977700 1 -- 172.21.15.8:0/1567369823 shutdown_connections 2023-10-06T04:36:15.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.369+0000 7f858e977700 1 -- 172.21.15.8:0/1567369823 wait complete. 2023-10-06T04:36:15.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.370+0000 7f858e977700 1 Processor -- start 2023-10-06T04:36:15.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.370+0000 7f858e977700 1 -- start start 2023-10-06T04:36:15.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.371+0000 7f858e977700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85880cfee0 0x7f85880a82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:15.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.371+0000 7f858e977700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8588142cf0 0x7f85880a92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:15.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.371+0000 7f858e977700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85881430c0 0x7f85880a97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:15.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.371+0000 7f858e977700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85880af700 con 0x7f85881430c0 2023-10-06T04:36:15.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.371+0000 7f858e977700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85880ca620 con 0x7f8588142cf0 2023-10-06T04:36:15.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.371+0000 7f858e977700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85880c9a10 con 0x7f85880cfee0 2023-10-06T04:36:15.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.371+0000 7f8587fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85880cfee0 0x7f85880a82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:15.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.371+0000 7f858cf14700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85881430c0 0x7f85880a97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:15.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.371+0000 7f8587fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85880cfee0 0x7f85880a82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.8:39184/0 (socket says 172.21.15.8:39184) 2023-10-06T04:36:15.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.371+0000 7f8587fff700 1 -- 172.21.15.8:0/3951093404 learned_addr learned my addr 172.21.15.8:0/3951093404 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:15.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.371+0000 7f85877fe700 1 --2- 172.21.15.8:0/3951093404 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8588142cf0 0x7f85880a92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:15.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.371+0000 7f8587fff700 1 -- 172.21.15.8:0/3951093404 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8588142cf0 msgr2=0x7f85880a92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:15.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.371+0000 7f8587fff700 1 --2- 172.21.15.8:0/3951093404 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8588142cf0 0x7f85880a92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:15.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.371+0000 7f8587fff700 1 -- 172.21.15.8:0/3951093404 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85881430c0 msgr2=0x7f85880a97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:15.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.371+0000 7f8587fff700 1 --2- 172.21.15.8:0/3951093404 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85881430c0 0x7f85880a97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:15.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.371+0000 7f8587fff700 1 -- 172.21.15.8:0/3951093404 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8578009420 con 0x7f85880cfee0 2023-10-06T04:36:15.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.372+0000 7f8587fff700 1 --2- 172.21.15.8:0/3951093404 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85880cfee0 0x7f85880a82b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f857800ec80 tx=0x7f85780091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:15.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.372+0000 7f856ffff700 1 -- 172.21.15.8:0/3951093404 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857800c920 con 0x7f85880cfee0 2023-10-06T04:36:15.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.372+0000 7f856ffff700 1 -- 172.21.15.8:0/3951093404 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f857800ca80 con 0x7f85880cfee0 2023-10-06T04:36:15.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.372+0000 7f858e977700 1 -- 172.21.15.8:0/3951093404 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f857c009420 con 0x7f85880cfee0 2023-10-06T04:36:15.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.372+0000 7f856ffff700 1 -- 172.21.15.8:0/3951093404 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857800ce00 con 0x7f85880cfee0 2023-10-06T04:36:15.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.372+0000 7f858e977700 1 -- 172.21.15.8:0/3951093404 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85880c9fd0 con 0x7f85880cfee0 2023-10-06T04:36:15.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.373+0000 7f858e977700 1 -- 172.21.15.8:0/3951093404 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85880ca900 con 0x7f85880cfee0 2023-10-06T04:36:15.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.373+0000 7f856ffff700 1 -- 172.21.15.8:0/3951093404 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8578005a00 con 0x7f85880cfee0 2023-10-06T04:36:15.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.374+0000 7f856ffff700 1 --2- 172.21.15.8:0/3951093404 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8574066f30 0x7f85740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:15.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.374+0000 7f856ffff700 1 -- 172.21.15.8:0/3951093404 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f8578084d60 con 0x7f85880cfee0 2023-10-06T04:36:15.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.374+0000 7f85877fe700 1 --2- 172.21.15.8:0/3951093404 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8574066f30 0x7f85740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:15.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.374+0000 7f85877fe700 1 --2- 172.21.15.8:0/3951093404 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8574066f30 0x7f85740693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f857c0093f0 tx=0x7f857c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:15.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.378+0000 7f856ffff700 1 -- 172.21.15.8:0/3951093404 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8578052050 con 0x7f85880cfee0 2023-10-06T04:36:15.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:15.570+0000 7f858e977700 1 -- 172.21.15.8:0/3951093404 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f8588071550 con 0x7f85880cfee0 2023-10-06T04:36:16.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.216+0000 7f856ffff700 1 -- 172.21.15.8:0/3951093404 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7f85780170d0 con 0x7f85880cfee0 2023-10-06T04:36:16.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.223+0000 7f858e977700 1 -- 172.21.15.8:0/3951093404 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8574066f30 msgr2=0x7f85740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:16.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.223+0000 7f858e977700 1 --2- 172.21.15.8:0/3951093404 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8574066f30 0x7f85740693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f857c0093f0 tx=0x7f857c017000 comp rx=0 tx=0).stop 2023-10-06T04:36:16.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.223+0000 7f858e977700 1 -- 172.21.15.8:0/3951093404 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85880cfee0 msgr2=0x7f85880a82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:16.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.223+0000 7f858e977700 1 --2- 172.21.15.8:0/3951093404 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85880cfee0 0x7f85880a82b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f857800ec80 tx=0x7f85780091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:16.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.223+0000 7f858e977700 1 -- 172.21.15.8:0/3951093404 shutdown_connections 2023-10-06T04:36:16.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.223+0000 7f858e977700 1 --2- 172.21.15.8:0/3951093404 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8574066f30 0x7f85740693e0 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f857c0093f0 tx=0x7f857c017000 comp rx=0 tx=0).stop 2023-10-06T04:36:16.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.223+0000 7f858e977700 1 --2- 172.21.15.8:0/3951093404 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85881430c0 0x7f85880a97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:16.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.223+0000 7f858e977700 1 --2- 172.21.15.8:0/3951093404 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85880cfee0 0x7f85880a82b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:16.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.223+0000 7f858e977700 1 --2- 172.21.15.8:0/3951093404 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8588142cf0 0x7f85880a92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:16.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.223+0000 7f858e977700 1 -- 172.21.15.8:0/3951093404 >> 172.21.15.8:0/3951093404 conn(0x7f858806ed00 msgr2=0x7f8588141d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:16.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.224+0000 7f858e977700 1 -- 172.21.15.8:0/3951093404 shutdown_connections 2023-10-06T04:36:16.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.226+0000 7f858e977700 1 -- 172.21.15.8:0/3951093404 wait complete. 2023-10-06T04:36:16.238 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_data' created 2023-10-06T04:36:16.253 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T04:36:16.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.379+0000 7fb4fd86c700 1 Processor -- start 2023-10-06T04:36:16.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.379+0000 7fb4fd86c700 1 -- start start 2023-10-06T04:36:16.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.380+0000 7fb4fd86c700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb4f815b490 0x7fb4f80b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:16.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.380+0000 7fb4fd86c700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f80b2620 con 0x7fb4f80b1c70 2023-10-06T04:36:16.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.380+0000 7fb4fd86c700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f80cf370 con 0x7fb4f8156e30 2023-10-06T04:36:16.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.380+0000 7fb4fd86c700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f80ce800 con 0x7fb4f815b490 2023-10-06T04:36:16.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.380+0000 7fb4fd06b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb4f815b490 0x7fb4f80b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:16.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.380+0000 7fb4fd06b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb4f815b490 0x7fb4f80b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53688/0 (socket says 172.21.15.8:53688) 2023-10-06T04:36:16.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.380+0000 7fb4fd06b700 1 -- 172.21.15.8:0/2152394757 learned_addr learned my addr 172.21.15.8:0/2152394757 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:16.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.380+0000 7fb4f7fff700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fb4f80b1c70 0x7fb4f815ad80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:55688/0 (socket says 172.21.15.8:55688) 2023-10-06T04:36:16.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.380+0000 7fb4fd06b700 1 -- 172.21.15.8:0/2152394757 >> v1:172.21.15.184:6789/0 conn(0x7fb4f8156e30 legacy=0x7fb4f80cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:16.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.380+0000 7fb4fd06b700 1 -- 172.21.15.8:0/2152394757 >> v1:172.21.15.8:6789/0 conn(0x7fb4f80b1c70 legacy=0x7fb4f815ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:16.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.380+0000 7fb4fd06b700 1 -- 172.21.15.8:0/2152394757 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f80cea60 con 0x7fb4f815b490 2023-10-06T04:36:16.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.380+0000 7fb4f77fe700 1 -- 172.21.15.8:0/2152394757 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1249555901 0 0) 0x7fb4f80b2620 con 0x7fb4f80b1c70 2023-10-06T04:36:16.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.381+0000 7fb4fd06b700 1 --2- 172.21.15.8:0/2152394757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4f815b490 0x7fb4f80b20e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0009f20 tx=0x7fb4f0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c523c39a4972369 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:16.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.381+0000 7fb4f77fe700 1 -- 172.21.15.8:0/2152394757 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f000e070 con 0x7fb4f815b490 2023-10-06T04:36:16.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.381+0000 7fb4f77fe700 1 -- 172.21.15.8:0/2152394757 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f000ba80 con 0x7fb4f815b490 2023-10-06T04:36:16.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.381+0000 7fb4f77fe700 1 -- 172.21.15.8:0/2152394757 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f00092e0 con 0x7fb4f815b490 2023-10-06T04:36:16.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.381+0000 7fb4fd86c700 1 -- 172.21.15.8:0/2152394757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4f815b490 msgr2=0x7fb4f80b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:16.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.381+0000 7fb4fd86c700 1 --2- 172.21.15.8:0/2152394757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4f815b490 0x7fb4f80b20e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0009f20 tx=0x7fb4f0009840 comp rx=0 tx=0).stop 2023-10-06T04:36:16.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.381+0000 7fb4fd86c700 1 -- 172.21.15.8:0/2152394757 shutdown_connections 2023-10-06T04:36:16.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.381+0000 7fb4fd86c700 1 --2- 172.21.15.8:0/2152394757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4f815b490 0x7fb4f80b20e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:16.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.381+0000 7fb4fd86c700 1 -- 172.21.15.8:0/2152394757 >> 172.21.15.8:0/2152394757 conn(0x7fb4f806ed00 msgr2=0x7fb4f806f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:16.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.381+0000 7fb4fd86c700 1 -- 172.21.15.8:0/2152394757 shutdown_connections 2023-10-06T04:36:16.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.381+0000 7fb4fd86c700 1 -- 172.21.15.8:0/2152394757 wait complete. 2023-10-06T04:36:16.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.382+0000 7fb4fd86c700 1 Processor -- start 2023-10-06T04:36:16.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.383+0000 7fb4fd86c700 1 -- start start 2023-10-06T04:36:16.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.383+0000 7fb4fd86c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb4f80b1c70 0x7fb4f813ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:16.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.383+0000 7fb4fd86c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4f8156e30 0x7fb4f8157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:16.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.383+0000 7fb4fd86c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb4f815b490 0x7fb4f8157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:16.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.383+0000 7fb4fd86c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f8153a10 con 0x7fb4f8156e30 2023-10-06T04:36:16.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.383+0000 7fb4fd86c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f80af120 con 0x7fb4f80b1c70 2023-10-06T04:36:16.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.383+0000 7fb4fd86c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f80af400 con 0x7fb4f815b490 2023-10-06T04:36:16.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.383+0000 7fb4f7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4f8156e30 0x7fb4f8157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:16.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.384+0000 7fb4f7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4f8156e30 0x7fb4f8157320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53694/0 (socket says 172.21.15.8:53694) 2023-10-06T04:36:16.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.384+0000 7fb4f7fff700 1 -- 172.21.15.8:0/3360055988 learned_addr learned my addr 172.21.15.8:0/3360055988 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:16.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.384+0000 7fb4fd06b700 1 --2- 172.21.15.8:0/3360055988 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb4f815b490 0x7fb4f8157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:16.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.384+0000 7fb4fc86a700 1 --2- 172.21.15.8:0/3360055988 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb4f80b1c70 0x7fb4f813ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:16.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.384+0000 7fb4f7fff700 1 -- 172.21.15.8:0/3360055988 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb4f815b490 msgr2=0x7fb4f8157860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:16.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.384+0000 7fb4f7fff700 1 --2- 172.21.15.8:0/3360055988 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb4f815b490 0x7fb4f8157860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:16.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.384+0000 7fb4f7fff700 1 -- 172.21.15.8:0/3360055988 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb4f80b1c70 msgr2=0x7fb4f813ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:16.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.384+0000 7fb4f7fff700 1 --2- 172.21.15.8:0/3360055988 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb4f80b1c70 0x7fb4f813ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:16.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.384+0000 7fb4f7fff700 1 -- 172.21.15.8:0/3360055988 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f0009ae0 con 0x7fb4f8156e30 2023-10-06T04:36:16.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.384+0000 7fb4f7fff700 1 --2- 172.21.15.8:0/3360055988 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4f8156e30 0x7fb4f8157320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec0011e0 tx=0x7fb4ec007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:16.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.384+0000 7fb4f4ff9700 1 -- 172.21.15.8:0/3360055988 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec005a70 con 0x7fb4f8156e30 2023-10-06T04:36:16.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.384+0000 7fb4f4ff9700 1 -- 172.21.15.8:0/3360055988 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4ec005bd0 con 0x7fb4f8156e30 2023-10-06T04:36:16.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.384+0000 7fb4fd86c700 1 -- 172.21.15.8:0/3360055988 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f80af6e0 con 0x7fb4f8156e30 2023-10-06T04:36:16.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.384+0000 7fb4f4ff9700 1 -- 172.21.15.8:0/3360055988 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec0070d0 con 0x7fb4f8156e30 2023-10-06T04:36:16.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.384+0000 7fb4fd86c700 1 -- 172.21.15.8:0/3360055988 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f813f180 con 0x7fb4f8156e30 2023-10-06T04:36:16.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.385+0000 7fb4fd86c700 1 -- 172.21.15.8:0/3360055988 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f804c380 con 0x7fb4f8156e30 2023-10-06T04:36:16.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.386+0000 7fb4f4ff9700 1 -- 172.21.15.8:0/3360055988 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb4ec007480 con 0x7fb4f8156e30 2023-10-06T04:36:16.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.386+0000 7fb4f4ff9700 1 --2- 172.21.15.8:0/3360055988 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb4e4066fb0 0x7fb4e4069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:16.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.386+0000 7fb4f4ff9700 1 -- 172.21.15.8:0/3360055988 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5958+0+0 (secure 0 0 0) 0x7fb4ec083b80 con 0x7fb4f8156e30 2023-10-06T04:36:16.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.386+0000 7fb4fc86a700 1 --2- 172.21.15.8:0/3360055988 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb4e4066fb0 0x7fb4e4069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:16.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.387+0000 7fb4fc86a700 1 --2- 172.21.15.8:0/3360055988 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb4e4066fb0 0x7fb4e4069460 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb4f81580d0 tx=0x7fb4e8007ea0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:16.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.391+0000 7fb4f4ff9700 1 -- 172.21.15.8:0/3360055988 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb4ec050c50 con 0x7fb4f8156e30 2023-10-06T04:36:16.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:16.631+0000 7fb4fd86c700 1 -- 172.21.15.8:0/3360055988 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb4f80b3600 con 0x7fb4f8156e30 2023-10-06T04:36:17.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.251+0000 7fb4f4ff9700 1 -- 172.21.15.8:0/3360055988 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb4ec017070 con 0x7fb4f8156e30 2023-10-06T04:36:17.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.259+0000 7fb4fd86c700 1 -- 172.21.15.8:0/3360055988 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb4e4066fb0 msgr2=0x7fb4e4069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:17.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.259+0000 7fb4fd86c700 1 --2- 172.21.15.8:0/3360055988 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb4e4066fb0 0x7fb4e4069460 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb4f81580d0 tx=0x7fb4e8007ea0 comp rx=0 tx=0).stop 2023-10-06T04:36:17.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.259+0000 7fb4fd86c700 1 -- 172.21.15.8:0/3360055988 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4f8156e30 msgr2=0x7fb4f8157320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:17.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.259+0000 7fb4fd86c700 1 --2- 172.21.15.8:0/3360055988 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4f8156e30 0x7fb4f8157320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec0011e0 tx=0x7fb4ec007e10 comp rx=0 tx=0).stop 2023-10-06T04:36:17.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.259+0000 7fb4fd86c700 1 -- 172.21.15.8:0/3360055988 shutdown_connections 2023-10-06T04:36:17.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.259+0000 7fb4fd86c700 1 --2- 172.21.15.8:0/3360055988 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb4e4066fb0 0x7fb4e4069460 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:17.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.259+0000 7fb4fd86c700 1 --2- 172.21.15.8:0/3360055988 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb4f815b490 0x7fb4f8157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:17.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.259+0000 7fb4fd86c700 1 --2- 172.21.15.8:0/3360055988 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb4f80b1c70 0x7fb4f813ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:17.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.259+0000 7fb4fd86c700 1 --2- 172.21.15.8:0/3360055988 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4f8156e30 0x7fb4f8157320 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:17.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.259+0000 7fb4fd86c700 1 -- 172.21.15.8:0/3360055988 >> 172.21.15.8:0/3360055988 conn(0x7fb4f806ed00 msgr2=0x7fb4f815aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:17.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.259+0000 7fb4fd86c700 1 -- 172.21.15.8:0/3360055988 shutdown_connections 2023-10-06T04:36:17.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.261+0000 7fb4fd86c700 1 -- 172.21.15.8:0/3360055988 wait complete. 2023-10-06T04:36:17.264 INFO:teuthology.orchestra.run.smithi008.stderr:new fs with metadata pool 3 and data pool 4 2023-10-06T04:36:17.278 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-10-06T04:36:17.278 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-10-06T04:36:17.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.400+0000 7f8662fae700 1 Processor -- start 2023-10-06T04:36:17.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.400+0000 7f8662fae700 1 -- start start 2023-10-06T04:36:17.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.401+0000 7f8662fae700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f865c0af5a0 0x7f865c15d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:17.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.401+0000 7f8662fae700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f865c0af970 0x7f865c15a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:17.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.401+0000 7f8662fae700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f865c0cce20 0x7f865c0cd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:17.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.401+0000 7f8662fae700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f865c15e2d0 con 0x7f865c0cce20 2023-10-06T04:36:17.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.401+0000 7f8662fae700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f865c15ad10 con 0x7f865c0af5a0 2023-10-06T04:36:17.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.401+0000 7f8662fae700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f865c0ce820 con 0x7f865c0af970 2023-10-06T04:36:17.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.401+0000 7f866154b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f865c0cce20 0x7f865c0cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:17.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.401+0000 7f866154b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f865c0cce20 0x7f865c0cd260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53700/0 (socket says 172.21.15.8:53700) 2023-10-06T04:36:17.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.402+0000 7f866154b700 1 -- 172.21.15.8:0/3003885535 learned_addr learned my addr 172.21.15.8:0/3003885535 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:17.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.402+0000 7f8660d4a700 1 --2- 172.21.15.8:0/3003885535 >> v2:172.21.15.184:3300/0 conn(0x7f865c0af5a0 0x7f865c15d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:17.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.402+0000 7f865bfff700 1 --2- 172.21.15.8:0/3003885535 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f865c0af970 0x7f865c15a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:17.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.402+0000 7f866154b700 1 -- 172.21.15.8:0/3003885535 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f865c0af970 msgr2=0x7f865c15a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:17.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.402+0000 7f866154b700 1 --2- 172.21.15.8:0/3003885535 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f865c0af970 0x7f865c15a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:17.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.402+0000 7f866154b700 1 -- 172.21.15.8:0/3003885535 >> v2:172.21.15.184:3300/0 conn(0x7f865c0af5a0 msgr2=0x7f865c15d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:17.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.402+0000 7f866154b700 1 --2- 172.21.15.8:0/3003885535 >> v2:172.21.15.184:3300/0 conn(0x7f865c0af5a0 0x7f865c15d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:17.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.402+0000 7f866154b700 1 -- 172.21.15.8:0/3003885535 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865c0cd7a0 con 0x7f865c0cce20 2023-10-06T04:36:17.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.402+0000 7f866154b700 1 --2- 172.21.15.8:0/3003885535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f865c0cce20 0x7f865c0cd260 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f865c089590 tx=0x7f8654009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c1a1fa93dc1a472 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:17.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.402+0000 7f865b7fe700 1 -- 172.21.15.8:0/3003885535 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865400e070 con 0x7f865c0cce20 2023-10-06T04:36:17.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.402+0000 7f865b7fe700 1 -- 172.21.15.8:0/3003885535 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865400ba40 con 0x7f865c0cce20 2023-10-06T04:36:17.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.402+0000 7f865b7fe700 1 -- 172.21.15.8:0/3003885535 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86540092e0 con 0x7f865c0cce20 2023-10-06T04:36:17.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.403+0000 7f8662fae700 1 -- 172.21.15.8:0/3003885535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f865c0cce20 msgr2=0x7f865c0cd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:17.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.403+0000 7f8662fae700 1 --2- 172.21.15.8:0/3003885535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f865c0cce20 0x7f865c0cd260 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f865c089590 tx=0x7f8654009840 comp rx=0 tx=0).stop 2023-10-06T04:36:17.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.403+0000 7f8662fae700 1 -- 172.21.15.8:0/3003885535 shutdown_connections 2023-10-06T04:36:17.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.403+0000 7f8662fae700 1 --2- 172.21.15.8:0/3003885535 >> v2:172.21.15.184:3300/0 conn(0x7f865c0af5a0 0x7f865c15d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:17.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.403+0000 7f8662fae700 1 --2- 172.21.15.8:0/3003885535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f865c0cce20 0x7f865c0cd260 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:17.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.403+0000 7f8662fae700 1 --2- 172.21.15.8:0/3003885535 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f865c0af970 0x7f865c15a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:17.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.403+0000 7f8662fae700 1 -- 172.21.15.8:0/3003885535 >> 172.21.15.8:0/3003885535 conn(0x7f865c06ed00 msgr2=0x7f865c06f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:17.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.403+0000 7f8662fae700 1 -- 172.21.15.8:0/3003885535 shutdown_connections 2023-10-06T04:36:17.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.403+0000 7f8662fae700 1 -- 172.21.15.8:0/3003885535 wait complete. 2023-10-06T04:36:17.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.404+0000 7f8662fae700 1 Processor -- start 2023-10-06T04:36:17.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.404+0000 7f8662fae700 1 -- start start 2023-10-06T04:36:17.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.405+0000 7f8662fae700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f865c0af5a0 0x7f865c0b5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:17.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.405+0000 7f8662fae700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f865c0af970 0x7f865c14d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:17.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.405+0000 7f8662fae700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f865c0cce20 0x7f865c0c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:17.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.405+0000 7f8662fae700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865c0b60a0 con 0x7f865c0af970 2023-10-06T04:36:17.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.405+0000 7f8662fae700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865c0c7fc0 con 0x7f865c0af5a0 2023-10-06T04:36:17.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.405+0000 7f8662fae700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f865c0c7690 con 0x7f865c0cce20 2023-10-06T04:36:17.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.405+0000 7f865bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f865c0af970 0x7f865c14d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:17.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.405+0000 7f865bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f865c0af970 0x7f865c14d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53702/0 (socket says 172.21.15.8:53702) 2023-10-06T04:36:17.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.405+0000 7f865bfff700 1 -- 172.21.15.8:0/475533426 learned_addr learned my addr 172.21.15.8:0/475533426 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:17.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.405+0000 7f8660d4a700 1 --2- 172.21.15.8:0/475533426 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f865c0af5a0 0x7f865c0b5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:17.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.405+0000 7f866154b700 1 --2- 172.21.15.8:0/475533426 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f865c0cce20 0x7f865c0c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:17.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.405+0000 7f865bfff700 1 -- 172.21.15.8:0/475533426 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f865c0cce20 msgr2=0x7f865c0c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:17.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.405+0000 7f865bfff700 1 --2- 172.21.15.8:0/475533426 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f865c0cce20 0x7f865c0c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:17.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.405+0000 7f865bfff700 1 -- 172.21.15.8:0/475533426 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f865c0af5a0 msgr2=0x7f865c0b5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:17.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.405+0000 7f865bfff700 1 --2- 172.21.15.8:0/475533426 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f865c0af5a0 0x7f865c0b5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:17.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.405+0000 7f865bfff700 1 -- 172.21.15.8:0/475533426 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8654009ae0 con 0x7f865c0af970 2023-10-06T04:36:17.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.405+0000 7f865bfff700 1 --2- 172.21.15.8:0/475533426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f865c0af970 0x7f865c14d140 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f865000d860 tx=0x7f8650008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:17.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.405+0000 7f8658ff9700 1 -- 172.21.15.8:0/475533426 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86500125f0 con 0x7f865c0af970 2023-10-06T04:36:17.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.406+0000 7f8658ff9700 1 -- 172.21.15.8:0/475533426 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8650012750 con 0x7f865c0af970 2023-10-06T04:36:17.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.406+0000 7f8662fae700 1 -- 172.21.15.8:0/475533426 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f865c0c7970 con 0x7f865c0af970 2023-10-06T04:36:17.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.406+0000 7f8658ff9700 1 -- 172.21.15.8:0/475533426 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8650012af0 con 0x7f865c0af970 2023-10-06T04:36:17.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.406+0000 7f8662fae700 1 -- 172.21.15.8:0/475533426 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f865c0b5d90 con 0x7f865c0af970 2023-10-06T04:36:17.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.407+0000 7f8662fae700 1 -- 172.21.15.8:0/475533426 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f865c071550 con 0x7f865c0af970 2023-10-06T04:36:17.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.407+0000 7f8658ff9700 1 -- 172.21.15.8:0/475533426 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f865001e460 con 0x7f865c0af970 2023-10-06T04:36:17.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.407+0000 7f8658ff9700 1 --2- 172.21.15.8:0/475533426 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8648066f30 0x7f86480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:17.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.407+0000 7f8658ff9700 1 -- 172.21.15.8:0/475533426 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8650084c70 con 0x7f865c0af970 2023-10-06T04:36:17.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.408+0000 7f8660d4a700 1 --2- 172.21.15.8:0/475533426 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8648066f30 0x7f86480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:17.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.408+0000 7f8660d4a700 1 --2- 172.21.15.8:0/475533426 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8648066f30 0x7f86480693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f864c006fd0 tx=0x7f864c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:17.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.412+0000 7f8658ff9700 1 -- 172.21.15.8:0/475533426 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8650051d80 con 0x7f865c0af970 2023-10-06T04:36:17.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:17.616+0000 7f8662fae700 1 -- 172.21.15.8:0/475533426 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f865c070f10 con 0x7f865c0af970 2023-10-06T04:36:18.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.253+0000 7f8658ff9700 1 -- 172.21.15.8:0/475533426 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7f86500553a0 con 0x7f865c0af970 2023-10-06T04:36:18.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.256+0000 7f8662fae700 1 -- 172.21.15.8:0/475533426 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8648066f30 msgr2=0x7f86480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:18.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.256+0000 7f8662fae700 1 --2- 172.21.15.8:0/475533426 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8648066f30 0x7f86480693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f864c006fd0 tx=0x7f864c008040 comp rx=0 tx=0).stop 2023-10-06T04:36:18.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.256+0000 7f8662fae700 1 -- 172.21.15.8:0/475533426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f865c0af970 msgr2=0x7f865c14d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:18.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.256+0000 7f8662fae700 1 --2- 172.21.15.8:0/475533426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f865c0af970 0x7f865c14d140 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f865000d860 tx=0x7f8650008040 comp rx=0 tx=0).stop 2023-10-06T04:36:18.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.256+0000 7f8662fae700 1 -- 172.21.15.8:0/475533426 shutdown_connections 2023-10-06T04:36:18.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.256+0000 7f8662fae700 1 --2- 172.21.15.8:0/475533426 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8648066f30 0x7f86480693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:18.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.256+0000 7f8662fae700 1 --2- 172.21.15.8:0/475533426 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f865c0cce20 0x7f865c0c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:18.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.256+0000 7f8662fae700 1 --2- 172.21.15.8:0/475533426 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f865c0af5a0 0x7f865c0b5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:18.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.256+0000 7f8662fae700 1 --2- 172.21.15.8:0/475533426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f865c0af970 0x7f865c14d140 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:18.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.256+0000 7f8662fae700 1 -- 172.21.15.8:0/475533426 >> 172.21.15.8:0/475533426 conn(0x7f865c06ed00 msgr2=0x7f865c1591c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:18.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.256+0000 7f8662fae700 1 -- 172.21.15.8:0/475533426 shutdown_connections 2023-10-06T04:36:18.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.256+0000 7f8662fae700 1 -- 172.21.15.8:0/475533426 wait complete. 2023-10-06T04:36:18.272 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T04:36:18.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.400+0000 7f5490947700 1 Processor -- start 2023-10-06T04:36:18.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.400+0000 7f5490947700 1 -- start start 2023-10-06T04:36:18.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.401+0000 7f5490947700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f548c156e30 0x7f548c0cf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:18.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.401+0000 7f5490947700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f548c15b490 0x7f548c0b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:18.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.401+0000 7f5490947700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f548c0b2620 con 0x7f548c0b1c70 2023-10-06T04:36:18.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.401+0000 7f5490947700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f548c0cf370 con 0x7f548c15b490 2023-10-06T04:36:18.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.401+0000 7f5490947700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548c0ce800 con 0x7f548c156e30 2023-10-06T04:36:18.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.401+0000 7f548b59e700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f548c15b490 0x7f548c0b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:18.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.401+0000 7f548b59e700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f548c15b490 0x7f548c0b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53706/0 (socket says 172.21.15.8:53706) 2023-10-06T04:36:18.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.401+0000 7f548b59e700 1 -- 172.21.15.8:0/186298092 learned_addr learned my addr 172.21.15.8:0/186298092 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:18.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.401+0000 7f548ad9d700 1 --2- 172.21.15.8:0/186298092 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f548c156e30 0x7f548c0cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:18.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.401+0000 7f548b59e700 1 -- 172.21.15.8:0/186298092 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f548c156e30 msgr2=0x7f548c0cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:18.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.401+0000 7f548b59e700 1 --2- 172.21.15.8:0/186298092 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f548c156e30 0x7f548c0cf800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:18.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.401+0000 7f548b59e700 1 -- 172.21.15.8:0/186298092 >> v1:172.21.15.184:6789/0 conn(0x7f548c0b1c70 legacy=0x7f548c15ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:18.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.401+0000 7f548b59e700 1 -- 172.21.15.8:0/186298092 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f548c0cea60 con 0x7f548c15b490 2023-10-06T04:36:18.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.402+0000 7f548b59e700 1 --2- 172.21.15.8:0/186298092 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f548c15b490 0x7f548c0b20e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f548c0cec50 tx=0x7f5484009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd3234cd61a6284 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:18.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.402+0000 7f5489d9b700 1 -- 172.21.15.8:0/186298092 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548400e070 con 0x7f548c15b490 2023-10-06T04:36:18.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.402+0000 7f5489d9b700 1 -- 172.21.15.8:0/186298092 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548400ba20 con 0x7f548c15b490 2023-10-06T04:36:18.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.402+0000 7f5489d9b700 1 -- 172.21.15.8:0/186298092 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548400bde0 con 0x7f548c15b490 2023-10-06T04:36:18.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.402+0000 7f5490947700 1 -- 172.21.15.8:0/186298092 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f548c15b490 msgr2=0x7f548c0b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:18.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.402+0000 7f5490947700 1 --2- 172.21.15.8:0/186298092 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f548c15b490 0x7f548c0b20e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f548c0cec50 tx=0x7f5484009840 comp rx=0 tx=0).stop 2023-10-06T04:36:18.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.402+0000 7f5490947700 1 -- 172.21.15.8:0/186298092 shutdown_connections 2023-10-06T04:36:18.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.402+0000 7f5490947700 1 --2- 172.21.15.8:0/186298092 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f548c15b490 0x7f548c0b20e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:18.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.402+0000 7f5490947700 1 --2- 172.21.15.8:0/186298092 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f548c156e30 0x7f548c0cf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:18.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.402+0000 7f5490947700 1 -- 172.21.15.8:0/186298092 >> 172.21.15.8:0/186298092 conn(0x7f548c06ed00 msgr2=0x7f548c06f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:18.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.402+0000 7f5490947700 1 -- 172.21.15.8:0/186298092 shutdown_connections 2023-10-06T04:36:18.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.402+0000 7f5490947700 1 -- 172.21.15.8:0/186298092 wait complete. 2023-10-06T04:36:18.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.404+0000 7f5490947700 1 Processor -- start 2023-10-06T04:36:18.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.404+0000 7f5490947700 1 -- start start 2023-10-06T04:36:18.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.404+0000 7f5490947700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f548c0b1c70 0x7f548c142660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:18.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.404+0000 7f5490947700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f548c156e30 0x7f548c169510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:18.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.404+0000 7f5490947700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f548c15b490 0x7f548c169a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:18.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.404+0000 7f5490947700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548c16aff0 con 0x7f548c0b1c70 2023-10-06T04:36:18.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.404+0000 7f5490947700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548c0b5040 con 0x7f548c15b490 2023-10-06T04:36:18.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.404+0000 7f5490947700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548c16a6c0 con 0x7f548c156e30 2023-10-06T04:36:18.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.404+0000 7f548ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f548c0b1c70 0x7f548c142660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:18.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.404+0000 7f548ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f548c0b1c70 0x7f548c142660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53712/0 (socket says 172.21.15.8:53712) 2023-10-06T04:36:18.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.404+0000 7f548ad9d700 1 -- 172.21.15.8:0/540103812 learned_addr learned my addr 172.21.15.8:0/540103812 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:18.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.404+0000 7f548b59e700 1 --2- 172.21.15.8:0/540103812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f548c15b490 0x7f548c169a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:18.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.404+0000 7f548a59c700 1 --2- 172.21.15.8:0/540103812 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f548c156e30 0x7f548c169510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:18.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.405+0000 7f548ad9d700 1 -- 172.21.15.8:0/540103812 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f548c156e30 msgr2=0x7f548c169510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:18.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.405+0000 7f548ad9d700 1 --2- 172.21.15.8:0/540103812 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f548c156e30 0x7f548c169510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:18.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.405+0000 7f548ad9d700 1 -- 172.21.15.8:0/540103812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f548c15b490 msgr2=0x7f548c169a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:18.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.405+0000 7f548ad9d700 1 --2- 172.21.15.8:0/540103812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f548c15b490 0x7f548c169a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:18.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.405+0000 7f548ad9d700 1 -- 172.21.15.8:0/540103812 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5484009ae0 con 0x7f548c0b1c70 2023-10-06T04:36:18.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.405+0000 7f548ad9d700 1 --2- 172.21.15.8:0/540103812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f548c0b1c70 0x7f548c142660 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f547c00ec80 tx=0x7f547c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:18.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.405+0000 7f5482ffd700 1 -- 172.21.15.8:0/540103812 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c00c850 con 0x7f548c0b1c70 2023-10-06T04:36:18.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.405+0000 7f5482ffd700 1 -- 172.21.15.8:0/540103812 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547c00c9b0 con 0x7f548c0b1c70 2023-10-06T04:36:18.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.405+0000 7f5490947700 1 -- 172.21.15.8:0/540103812 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f548c16a9a0 con 0x7f548c0b1c70 2023-10-06T04:36:18.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.405+0000 7f5482ffd700 1 -- 172.21.15.8:0/540103812 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c00cd50 con 0x7f548c0b1c70 2023-10-06T04:36:18.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.405+0000 7f5490947700 1 -- 172.21.15.8:0/540103812 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f548c0b42e0 con 0x7f548c0b1c70 2023-10-06T04:36:18.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.406+0000 7f5490947700 1 -- 172.21.15.8:0/540103812 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f548c16b2d0 con 0x7f548c0b1c70 2023-10-06T04:36:18.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.407+0000 7f5482ffd700 1 -- 172.21.15.8:0/540103812 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f547c013680 con 0x7f548c0b1c70 2023-10-06T04:36:18.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.407+0000 7f5482ffd700 1 --2- 172.21.15.8:0/540103812 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f546c066f30 0x7f546c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:18.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.407+0000 7f5482ffd700 1 -- 172.21.15.8:0/540103812 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6284+0+0 (secure 0 0 0) 0x7f547c0849d0 con 0x7f548c0b1c70 2023-10-06T04:36:18.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.407+0000 7f548a59c700 1 --2- 172.21.15.8:0/540103812 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f546c066f30 0x7f546c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:18.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.408+0000 7f548a59c700 1 --2- 172.21.15.8:0/540103812 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f546c066f30 0x7f546c0693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5474003a80 tx=0x7f5474007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:18.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.411+0000 7f5482ffd700 1 -- 172.21.15.8:0/540103812 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f547c051a00 con 0x7f548c0b1c70 2023-10-06T04:36:18.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:18.605+0000 7f5490947700 1 -- 172.21.15.8:0/540103812 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f548c04c380 con 0x7f548c0b1c70 2023-10-06T04:36:20.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.265+0000 7f5482ffd700 1 -- 172.21.15.8:0/540103812 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7f547c055020 con 0x7f548c0b1c70 2023-10-06T04:36:20.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.277+0000 7f5490947700 1 -- 172.21.15.8:0/540103812 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f546c066f30 msgr2=0x7f546c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:20.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.277+0000 7f5490947700 1 --2- 172.21.15.8:0/540103812 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f546c066f30 0x7f546c0693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5474003a80 tx=0x7f5474007ec0 comp rx=0 tx=0).stop 2023-10-06T04:36:20.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.277+0000 7f5490947700 1 -- 172.21.15.8:0/540103812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f548c0b1c70 msgr2=0x7f548c142660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:20.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.277+0000 7f5490947700 1 --2- 172.21.15.8:0/540103812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f548c0b1c70 0x7f548c142660 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f547c00ec80 tx=0x7f547c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:20.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.278+0000 7f5490947700 1 -- 172.21.15.8:0/540103812 shutdown_connections 2023-10-06T04:36:20.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.278+0000 7f5490947700 1 --2- 172.21.15.8:0/540103812 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f546c066f30 0x7f546c0693e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:20.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.278+0000 7f5490947700 1 --2- 172.21.15.8:0/540103812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f548c15b490 0x7f548c169a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:20.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.278+0000 7f5490947700 1 --2- 172.21.15.8:0/540103812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f548c0b1c70 0x7f548c142660 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:20.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.278+0000 7f5490947700 1 --2- 172.21.15.8:0/540103812 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f548c156e30 0x7f548c169510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:20.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.278+0000 7f5490947700 1 -- 172.21.15.8:0/540103812 >> 172.21.15.8:0/540103812 conn(0x7f548c06ed00 msgr2=0x7f548c154f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:20.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.278+0000 7f5490947700 1 -- 172.21.15.8:0/540103812 shutdown_connections 2023-10-06T04:36:20.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.278+0000 7f5490947700 1 -- 172.21.15.8:0/540103812 wait complete. 2023-10-06T04:36:20.282 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_data_ec' created 2023-10-06T04:36:20.295 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-10-06T04:36:20.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.421+0000 7f3aac37c700 1 Processor -- start 2023-10-06T04:36:20.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.421+0000 7f3aac37c700 1 -- start start 2023-10-06T04:36:20.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.422+0000 7f3aac37c700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3aa40af5a0 0x7f3aa415d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:20.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.422+0000 7f3aac37c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3aa40cd530 0x7f3aa415a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:20.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.422+0000 7f3aac37c700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aa40ce820 con 0x7f3aa40af970 2023-10-06T04:36:20.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.422+0000 7f3aac37c700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aa415e2d0 con 0x7f3aa40af5a0 2023-10-06T04:36:20.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.422+0000 7f3aac37c700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aa415ad10 con 0x7f3aa40cd530 2023-10-06T04:36:20.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.423+0000 7f3aaa118700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3aa40af5a0 0x7f3aa415d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:20.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.423+0000 7f3aaa118700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3aa40af5a0 0x7f3aa415d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53716/0 (socket says 172.21.15.8:53716) 2023-10-06T04:36:20.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.423+0000 7f3aaa118700 1 -- 172.21.15.8:0/1580209728 learned_addr learned my addr 172.21.15.8:0/1580209728 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:20.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.423+0000 7f3aaa919700 1 --2- 172.21.15.8:0/1580209728 >> v2:172.21.15.184:3300/0 conn(0x7f3aa40cd530 0x7f3aa415a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:20.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.423+0000 7f3aaa118700 1 -- 172.21.15.8:0/1580209728 >> v2:172.21.15.184:3300/0 conn(0x7f3aa40cd530 msgr2=0x7f3aa415a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:20.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.423+0000 7f3aaa118700 1 --2- 172.21.15.8:0/1580209728 >> v2:172.21.15.184:3300/0 conn(0x7f3aa40cd530 0x7f3aa415a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:20.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.423+0000 7f3aaa118700 1 -- 172.21.15.8:0/1580209728 >> v1:172.21.15.184:6789/0 conn(0x7f3aa40af970 legacy=0x7f3aa40cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:20.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.423+0000 7f3aaa118700 1 -- 172.21.15.8:0/1580209728 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa415da30 con 0x7f3aa40af5a0 2023-10-06T04:36:20.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.423+0000 7f3aaa118700 1 --2- 172.21.15.8:0/1580209728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3aa40af5a0 0x7f3aa415d330 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3aa40ce790 tx=0x7f3a94009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65e7f1ef25daecdc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:20.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.423+0000 7f3aa9116700 1 -- 172.21.15.8:0/1580209728 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9400e070 con 0x7f3aa40af5a0 2023-10-06T04:36:20.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.423+0000 7f3aa9116700 1 -- 172.21.15.8:0/1580209728 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9400ba40 con 0x7f3aa40af5a0 2023-10-06T04:36:20.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.423+0000 7f3aa9116700 1 -- 172.21.15.8:0/1580209728 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a940092e0 con 0x7f3aa40af5a0 2023-10-06T04:36:20.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.424+0000 7f3aac37c700 1 -- 172.21.15.8:0/1580209728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3aa40af5a0 msgr2=0x7f3aa415d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:20.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.424+0000 7f3aac37c700 1 --2- 172.21.15.8:0/1580209728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3aa40af5a0 0x7f3aa415d330 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3aa40ce790 tx=0x7f3a94009840 comp rx=0 tx=0).stop 2023-10-06T04:36:20.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.424+0000 7f3aac37c700 1 -- 172.21.15.8:0/1580209728 shutdown_connections 2023-10-06T04:36:20.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.424+0000 7f3aac37c700 1 --2- 172.21.15.8:0/1580209728 >> v2:172.21.15.184:3300/0 conn(0x7f3aa40cd530 0x7f3aa415a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:20.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.424+0000 7f3aac37c700 1 --2- 172.21.15.8:0/1580209728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3aa40af5a0 0x7f3aa415d330 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:20.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.424+0000 7f3aac37c700 1 -- 172.21.15.8:0/1580209728 >> 172.21.15.8:0/1580209728 conn(0x7f3aa406ed00 msgr2=0x7f3aa406f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:20.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.424+0000 7f3aac37c700 1 -- 172.21.15.8:0/1580209728 shutdown_connections 2023-10-06T04:36:20.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.424+0000 7f3aac37c700 1 -- 172.21.15.8:0/1580209728 wait complete. 2023-10-06T04:36:20.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.425+0000 7f3aac37c700 1 Processor -- start 2023-10-06T04:36:20.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.425+0000 7f3aac37c700 1 -- start start 2023-10-06T04:36:20.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.426+0000 7f3aac37c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3aa40af5a0 0x7f3aa40b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:20.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.426+0000 7f3aac37c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3aa40af970 0x7f3aa40c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:20.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.426+0000 7f3aac37c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3aa40cd530 0x7f3aa4169d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:20.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.426+0000 7f3aac37c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa40c9030 con 0x7f3aa40af970 2023-10-06T04:36:20.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.426+0000 7f3aac37c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa40b1120 con 0x7f3aa40cd530 2023-10-06T04:36:20.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.426+0000 7f3aac37c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa40b1400 con 0x7f3aa40af5a0 2023-10-06T04:36:20.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.426+0000 7f3aa9917700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3aa40af970 0x7f3aa40c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:20.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.426+0000 7f3aa9917700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3aa40af970 0x7f3aa40c8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53724/0 (socket says 172.21.15.8:53724) 2023-10-06T04:36:20.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.426+0000 7f3aa9917700 1 -- 172.21.15.8:0/2373211237 learned_addr learned my addr 172.21.15.8:0/2373211237 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:20.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.426+0000 7f3aaa919700 1 --2- 172.21.15.8:0/2373211237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3aa40cd530 0x7f3aa4169d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:20.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.426+0000 7f3aaa118700 1 --2- 172.21.15.8:0/2373211237 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3aa40af5a0 0x7f3aa40b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:20.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.426+0000 7f3aa9917700 1 -- 172.21.15.8:0/2373211237 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3aa40af5a0 msgr2=0x7f3aa40b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:20.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.426+0000 7f3aa9917700 1 --2- 172.21.15.8:0/2373211237 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3aa40af5a0 0x7f3aa40b0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:20.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.426+0000 7f3aa9917700 1 -- 172.21.15.8:0/2373211237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3aa40cd530 msgr2=0x7f3aa4169d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:20.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.426+0000 7f3aa9917700 1 --2- 172.21.15.8:0/2373211237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3aa40cd530 0x7f3aa4169d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:20.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.426+0000 7f3aa9917700 1 -- 172.21.15.8:0/2373211237 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a94009ae0 con 0x7f3aa40af970 2023-10-06T04:36:20.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.426+0000 7f3aa9917700 1 --2- 172.21.15.8:0/2373211237 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3aa40af970 0x7f3aa40c8af0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3a9800c7c0 tx=0x7f3a98007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:20.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.426+0000 7f3aa27fc700 1 -- 172.21.15.8:0/2373211237 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a98012630 con 0x7f3aa40af970 2023-10-06T04:36:20.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.426+0000 7f3aa27fc700 1 -- 172.21.15.8:0/2373211237 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a98012790 con 0x7f3aa40af970 2023-10-06T04:36:20.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.426+0000 7f3aac37c700 1 -- 172.21.15.8:0/2373211237 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aa40b16e0 con 0x7f3aa40af970 2023-10-06T04:36:20.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.426+0000 7f3aa27fc700 1 -- 172.21.15.8:0/2373211237 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a98012b50 con 0x7f3aa40af970 2023-10-06T04:36:20.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.426+0000 7f3aac37c700 1 -- 172.21.15.8:0/2373211237 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aa40b1ca0 con 0x7f3aa40af970 2023-10-06T04:36:20.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.427+0000 7f3aac37c700 1 -- 172.21.15.8:0/2373211237 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aa4071550 con 0x7f3aa40af970 2023-10-06T04:36:20.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.428+0000 7f3aa27fc700 1 -- 172.21.15.8:0/2373211237 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3a9801b400 con 0x7f3aa40af970 2023-10-06T04:36:20.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.428+0000 7f3aa27fc700 1 --2- 172.21.15.8:0/2373211237 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3a90066f30 0x7f3a900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:20.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.428+0000 7f3aa27fc700 1 -- 172.21.15.8:0/2373211237 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f3a98084570 con 0x7f3aa40af970 2023-10-06T04:36:20.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.429+0000 7f3aaa118700 1 --2- 172.21.15.8:0/2373211237 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3a90066f30 0x7f3a900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:20.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.429+0000 7f3aaa118700 1 --2- 172.21.15.8:0/2373211237 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3a90066f30 0x7f3a900693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3a94009ea0 tx=0x7f3a94018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:20.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.433+0000 7f3aa27fc700 1 -- 172.21.15.8:0/2373211237 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3a98051310 con 0x7f3aa40af970 2023-10-06T04:36:20.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:20.626+0000 7f3aac37c700 1 -- 172.21.15.8:0/2373211237 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f3aa40ce210 con 0x7f3aa40af970 2023-10-06T04:36:21.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.272+0000 7f3aa27fc700 1 -- 172.21.15.8:0/2373211237 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3a98054930 con 0x7f3aa40af970 2023-10-06T04:36:21.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.278+0000 7f3aac37c700 1 -- 172.21.15.8:0/2373211237 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3a90066f30 msgr2=0x7f3a900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:21.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.278+0000 7f3aac37c700 1 --2- 172.21.15.8:0/2373211237 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3a90066f30 0x7f3a900693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3a94009ea0 tx=0x7f3a94018000 comp rx=0 tx=0).stop 2023-10-06T04:36:21.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.278+0000 7f3aac37c700 1 -- 172.21.15.8:0/2373211237 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3aa40af970 msgr2=0x7f3aa40c8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:21.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.278+0000 7f3aac37c700 1 --2- 172.21.15.8:0/2373211237 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3aa40af970 0x7f3aa40c8af0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3a9800c7c0 tx=0x7f3a98007f50 comp rx=0 tx=0).stop 2023-10-06T04:36:21.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.279+0000 7f3aac37c700 1 -- 172.21.15.8:0/2373211237 shutdown_connections 2023-10-06T04:36:21.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.279+0000 7f3aac37c700 1 --2- 172.21.15.8:0/2373211237 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3a90066f30 0x7f3a900693e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:21.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.279+0000 7f3aac37c700 1 --2- 172.21.15.8:0/2373211237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3aa40cd530 0x7f3aa4169d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:21.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.279+0000 7f3aac37c700 1 --2- 172.21.15.8:0/2373211237 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3aa40af5a0 0x7f3aa40b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:21.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.279+0000 7f3aac37c700 1 --2- 172.21.15.8:0/2373211237 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3aa40af970 0x7f3aa40c8af0 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3a9800c7c0 tx=0x7f3a98007f50 comp rx=0 tx=0).stop 2023-10-06T04:36:21.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.279+0000 7f3aac37c700 1 -- 172.21.15.8:0/2373211237 >> 172.21.15.8:0/2373211237 conn(0x7f3aa406ed00 msgr2=0x7f3aa40cb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:21.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.281+0000 7f3aac37c700 1 -- 172.21.15.8:0/2373211237 shutdown_connections 2023-10-06T04:36:21.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.281+0000 7f3aac37c700 1 -- 172.21.15.8:0/2373211237 wait complete. 2023-10-06T04:36:21.288 INFO:teuthology.orchestra.run.smithi008.stderr:set pool 5 allow_ec_overwrites to true 2023-10-06T04:36:21.313 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-10-06T04:36:21.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.437+0000 7feb9359e700 1 Processor -- start 2023-10-06T04:36:21.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.437+0000 7feb9359e700 1 -- start start 2023-10-06T04:36:21.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.438+0000 7feb9359e700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7feb94156e30 0x7feb940cf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:21.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.438+0000 7feb9359e700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb940cf370 con 0x7feb940b1c70 2023-10-06T04:36:21.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.438+0000 7feb9359e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb940ce800 con 0x7feb9415b490 2023-10-06T04:36:21.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.438+0000 7feb9359e700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb940cea60 con 0x7feb94156e30 2023-10-06T04:36:21.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.438+0000 7feb9259c700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7feb94156e30 0x7feb940cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:21.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.438+0000 7feb91d9b700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7feb940b1c70 0x7feb9415ad80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:55692/0 (socket says 172.21.15.8:55692) 2023-10-06T04:36:21.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.438+0000 7feb9259c700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7feb94156e30 0x7feb940cf800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53730/0 (socket says 172.21.15.8:53730) 2023-10-06T04:36:21.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.438+0000 7feb91d9b700 1 -- 172.21.15.8:0/214369143 learned_addr learned my addr 172.21.15.8:0/214369143 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:21.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.438+0000 7feb9259c700 1 -- 172.21.15.8:0/214369143 >> v1:172.21.15.184:6789/0 conn(0x7feb9415b490 legacy=0x7feb9415d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:21.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.438+0000 7feb9259c700 1 -- 172.21.15.8:0/214369143 >> v1:172.21.15.8:6789/0 conn(0x7feb940b1c70 legacy=0x7feb9415ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:21.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.438+0000 7feb9259c700 1 -- 172.21.15.8:0/214369143 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb940ced20 con 0x7feb94156e30 2023-10-06T04:36:21.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.438+0000 7feb9259c700 1 --2- 172.21.15.8:0/214369143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb94156e30 0x7feb940cf800 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feb8c0098e0 tx=0x7feb8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ba2b384bf12f6e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:21.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.439+0000 7feb9159a700 1 -- 172.21.15.8:0/214369143 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c009e80 con 0x7feb94156e30 2023-10-06T04:36:21.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.439+0000 7feb9159a700 1 -- 172.21.15.8:0/214369143 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8c00b860 con 0x7feb94156e30 2023-10-06T04:36:21.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.439+0000 7feb9159a700 1 -- 172.21.15.8:0/214369143 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c00bbe0 con 0x7feb94156e30 2023-10-06T04:36:21.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.439+0000 7feb9359e700 1 -- 172.21.15.8:0/214369143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb94156e30 msgr2=0x7feb940cf800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:21.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.439+0000 7feb9359e700 1 --2- 172.21.15.8:0/214369143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb94156e30 0x7feb940cf800 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feb8c0098e0 tx=0x7feb8c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:21.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.439+0000 7feb9359e700 1 -- 172.21.15.8:0/214369143 shutdown_connections 2023-10-06T04:36:21.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.439+0000 7feb9359e700 1 --2- 172.21.15.8:0/214369143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb94156e30 0x7feb940cf800 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:21.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.439+0000 7feb9359e700 1 -- 172.21.15.8:0/214369143 >> 172.21.15.8:0/214369143 conn(0x7feb9406ed00 msgr2=0x7feb9406f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:21.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.439+0000 7feb9359e700 1 -- 172.21.15.8:0/214369143 shutdown_connections 2023-10-06T04:36:21.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.439+0000 7feb9359e700 1 -- 172.21.15.8:0/214369143 wait complete. 2023-10-06T04:36:21.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.440+0000 7feb9359e700 1 Processor -- start 2023-10-06T04:36:21.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.440+0000 7feb9359e700 1 -- start start 2023-10-06T04:36:21.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.441+0000 7feb9359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb940b1c70 0x7feb94169830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:21.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.441+0000 7feb9359e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb94156e30 0x7feb9414ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:21.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.441+0000 7feb9359e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb9415b490 0x7feb941510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:21.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.441+0000 7feb9359e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb940b3ed0 con 0x7feb940b1c70 2023-10-06T04:36:21.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.441+0000 7feb9359e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb940b38c0 con 0x7feb9415b490 2023-10-06T04:36:21.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.441+0000 7feb9359e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9414f590 con 0x7feb94156e30 2023-10-06T04:36:21.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.441+0000 7feb9259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb940b1c70 0x7feb94169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:21.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.441+0000 7feb9259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb940b1c70 0x7feb94169830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53736/0 (socket says 172.21.15.8:53736) 2023-10-06T04:36:21.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.441+0000 7feb9259c700 1 -- 172.21.15.8:0/4122158103 learned_addr learned my addr 172.21.15.8:0/4122158103 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:21.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.441+0000 7feb91d9b700 1 --2- 172.21.15.8:0/4122158103 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb94156e30 0x7feb9414ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:21.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.441+0000 7feb92d9d700 1 --2- 172.21.15.8:0/4122158103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb9415b490 0x7feb941510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:21.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.441+0000 7feb9259c700 1 -- 172.21.15.8:0/4122158103 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb94156e30 msgr2=0x7feb9414ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:21.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.441+0000 7feb9259c700 1 --2- 172.21.15.8:0/4122158103 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb94156e30 0x7feb9414ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:21.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.441+0000 7feb9259c700 1 -- 172.21.15.8:0/4122158103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb9415b490 msgr2=0x7feb941510d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:21.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.441+0000 7feb9259c700 1 --2- 172.21.15.8:0/4122158103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb9415b490 0x7feb941510d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:21.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.442+0000 7feb9259c700 1 -- 172.21.15.8:0/4122158103 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8c009420 con 0x7feb940b1c70 2023-10-06T04:36:21.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.442+0000 7feb92d9d700 1 --2- 172.21.15.8:0/4122158103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb9415b490 0x7feb941510d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:21.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.442+0000 7feb91d9b700 1 --2- 172.21.15.8:0/4122158103 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb94156e30 0x7feb9414ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:21.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.442+0000 7feb9259c700 1 --2- 172.21.15.8:0/4122158103 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb940b1c70 0x7feb94169830 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feb940ce990 tx=0x7feb8c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:21.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.442+0000 7feb8a7fc700 1 -- 172.21.15.8:0/4122158103 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c00bb20 con 0x7feb940b1c70 2023-10-06T04:36:21.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.442+0000 7feb8a7fc700 1 -- 172.21.15.8:0/4122158103 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8c025420 con 0x7feb940b1c70 2023-10-06T04:36:21.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.442+0000 7feb9359e700 1 -- 172.21.15.8:0/4122158103 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb9414f870 con 0x7feb940b1c70 2023-10-06T04:36:21.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.442+0000 7feb8a7fc700 1 -- 172.21.15.8:0/4122158103 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c0257c0 con 0x7feb940b1c70 2023-10-06T04:36:21.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.442+0000 7feb9359e700 1 -- 172.21.15.8:0/4122158103 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb94169d70 con 0x7feb940b1c70 2023-10-06T04:36:21.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.443+0000 7feb9359e700 1 -- 172.21.15.8:0/4122158103 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb9404c380 con 0x7feb940b1c70 2023-10-06T04:36:21.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.443+0000 7feb8a7fc700 1 -- 172.21.15.8:0/4122158103 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feb8c023070 con 0x7feb940b1c70 2023-10-06T04:36:21.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.444+0000 7feb8a7fc700 1 --2- 172.21.15.8:0/4122158103 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7feb74066f30 0x7feb740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:21.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.444+0000 7feb8a7fc700 1 -- 172.21.15.8:0/4122158103 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6777+0+0 (secure 0 0 0) 0x7feb8c0860e0 con 0x7feb940b1c70 2023-10-06T04:36:21.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.444+0000 7feb91d9b700 1 --2- 172.21.15.8:0/4122158103 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7feb74066f30 0x7feb740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:21.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.444+0000 7feb91d9b700 1 --2- 172.21.15.8:0/4122158103 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7feb74066f30 0x7feb740693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7feb940b6260 tx=0x7feb7c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:21.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.448+0000 7feb8a7fc700 1 -- 172.21.15.8:0/4122158103 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feb8c052f20 con 0x7feb940b1c70 2023-10-06T04:36:21.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:21.688+0000 7feb9359e700 1 -- 172.21.15.8:0/4122158103 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7feb9415ccc0 con 0x7feb940b1c70 2023-10-06T04:36:22.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.273+0000 7feb8a7fc700 1 -- 172.21.15.8:0/4122158103 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7feb8c056540 con 0x7feb940b1c70 2023-10-06T04:36:22.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.276+0000 7feb9359e700 1 -- 172.21.15.8:0/4122158103 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7feb74066f30 msgr2=0x7feb740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:22.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.276+0000 7feb9359e700 1 --2- 172.21.15.8:0/4122158103 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7feb74066f30 0x7feb740693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7feb940b6260 tx=0x7feb7c009040 comp rx=0 tx=0).stop 2023-10-06T04:36:22.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.276+0000 7feb9359e700 1 -- 172.21.15.8:0/4122158103 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb940b1c70 msgr2=0x7feb94169830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:22.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.276+0000 7feb9359e700 1 --2- 172.21.15.8:0/4122158103 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb940b1c70 0x7feb94169830 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feb940ce990 tx=0x7feb8c017000 comp rx=0 tx=0).stop 2023-10-06T04:36:22.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.276+0000 7feb9359e700 1 -- 172.21.15.8:0/4122158103 shutdown_connections 2023-10-06T04:36:22.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.276+0000 7feb9359e700 1 --2- 172.21.15.8:0/4122158103 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7feb74066f30 0x7feb740693e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:22.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.276+0000 7feb9359e700 1 --2- 172.21.15.8:0/4122158103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb9415b490 0x7feb941510d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:22.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.276+0000 7feb9359e700 1 --2- 172.21.15.8:0/4122158103 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb940b1c70 0x7feb94169830 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:22.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.276+0000 7feb9359e700 1 --2- 172.21.15.8:0/4122158103 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb94156e30 0x7feb9414ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:22.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.276+0000 7feb9359e700 1 -- 172.21.15.8:0/4122158103 >> 172.21.15.8:0/4122158103 conn(0x7feb9406ed00 msgr2=0x7feb940d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:22.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.276+0000 7feb9359e700 1 -- 172.21.15.8:0/4122158103 shutdown_connections 2023-10-06T04:36:22.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.276+0000 7feb9359e700 1 -- 172.21.15.8:0/4122158103 wait complete. 2023-10-06T04:36:22.280 INFO:teuthology.orchestra.run.smithi008.stderr:added data pool 5 to fsmap 2023-10-06T04:36:22.293 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:36:22.303 INFO:tasks.ceph.mds.d.smithi184.stderr:2023-10-06T04:36:22.301+0000 7f9ba17be700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T04:36:22.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.415+0000 7f30d30c5700 1 Processor -- start 2023-10-06T04:36:22.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.415+0000 7f30d30c5700 1 -- start start 2023-10-06T04:36:22.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.416+0000 7f30d30c5700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30cc15a7b0 0x7f30cc153b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:22.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.416+0000 7f30d30c5700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30cc15d170 con 0x7f30cc15d8e0 2023-10-06T04:36:22.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.416+0000 7f30d30c5700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30cc0ca990 con 0x7f30cc153740 2023-10-06T04:36:22.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.416+0000 7f30d30c5700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc0cac70 con 0x7f30cc15a7b0 2023-10-06T04:36:22.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.416+0000 7f30d28c4700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f30cc15d8e0 0x7f30cc0696c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:55706/0 (socket says 172.21.15.8:55706) 2023-10-06T04:36:22.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.416+0000 7f30d28c4700 1 -- 172.21.15.8:0/2847559132 learned_addr learned my addr 172.21.15.8:0/2847559132 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:22.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.416+0000 7f30d18c2700 1 --2- 172.21.15.8:0/2847559132 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30cc15a7b0 0x7f30cc153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:22.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.416+0000 7f30d10c1700 1 -- 172.21.15.8:0/2847559132 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1527113324 0 0) 0x7f30cc15d170 con 0x7f30cc15d8e0 2023-10-06T04:36:22.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.416+0000 7f30d10c1700 1 -- 172.21.15.8:0/2847559132 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30b4003570 con 0x7f30cc15d8e0 2023-10-06T04:36:22.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.416+0000 7f30d10c1700 1 -- 172.21.15.8:0/2847559132 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 15992594 0 0) 0x7f30cc0ca990 con 0x7f30cc153740 2023-10-06T04:36:22.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.416+0000 7f30d10c1700 1 -- 172.21.15.8:0/2847559132 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30cc15d170 con 0x7f30cc153740 2023-10-06T04:36:22.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.417+0000 7f30d18c2700 1 -- 172.21.15.8:0/2847559132 >> v1:172.21.15.184:6789/0 conn(0x7f30cc153740 legacy=0x7f30cc0cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:22.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.417+0000 7f30d18c2700 1 -- 172.21.15.8:0/2847559132 >> v1:172.21.15.8:6789/0 conn(0x7f30cc15d8e0 legacy=0x7f30cc0696c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:22.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.417+0000 7f30d18c2700 1 -- 172.21.15.8:0/2847559132 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30cc0caf50 con 0x7f30cc15a7b0 2023-10-06T04:36:22.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.417+0000 7f30d18c2700 1 --2- 172.21.15.8:0/2847559132 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30cc15a7b0 0x7f30cc153b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f30c0009910 tx=0x7f30c00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=910aaa4a623bb95b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:22.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.417+0000 7f30d10c1700 1 -- 172.21.15.8:0/2847559132 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c0011630 con 0x7f30cc15a7b0 2023-10-06T04:36:22.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.417+0000 7f30d10c1700 1 -- 172.21.15.8:0/2847559132 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c0011790 con 0x7f30cc15a7b0 2023-10-06T04:36:22.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.417+0000 7f30d10c1700 1 -- 172.21.15.8:0/2847559132 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c0011b30 con 0x7f30cc15a7b0 2023-10-06T04:36:22.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.417+0000 7f30d30c5700 1 -- 172.21.15.8:0/2847559132 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30cc15a7b0 msgr2=0x7f30cc153b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:22.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.417+0000 7f30d30c5700 1 --2- 172.21.15.8:0/2847559132 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30cc15a7b0 0x7f30cc153b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f30c0009910 tx=0x7f30c00091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:22.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.417+0000 7f30d30c5700 1 -- 172.21.15.8:0/2847559132 shutdown_connections 2023-10-06T04:36:22.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.417+0000 7f30d30c5700 1 --2- 172.21.15.8:0/2847559132 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30cc15a7b0 0x7f30cc153b10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:22.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.417+0000 7f30d30c5700 1 -- 172.21.15.8:0/2847559132 >> 172.21.15.8:0/2847559132 conn(0x7f30cc0d02b0 msgr2=0x7f30cc0d06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:22.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.418+0000 7f30d30c5700 1 -- 172.21.15.8:0/2847559132 shutdown_connections 2023-10-06T04:36:22.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.418+0000 7f30d30c5700 1 -- 172.21.15.8:0/2847559132 wait complete. 2023-10-06T04:36:22.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.419+0000 7f30d30c5700 1 Processor -- start 2023-10-06T04:36:22.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.419+0000 7f30d30c5700 1 -- start start 2023-10-06T04:36:22.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.419+0000 7f30d30c5700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30cc153740 0x7f30cc0c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:22.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.419+0000 7f30d30c5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30cc15a7b0 0x7f30cc0c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:22.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.419+0000 7f30d30c5700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30cc15d8e0 0x7f30cc0b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:22.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.419+0000 7f30d30c5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc0b45a0 con 0x7f30cc15a7b0 2023-10-06T04:36:22.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.419+0000 7f30d30c5700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc0b5090 con 0x7f30cc15d8e0 2023-10-06T04:36:22.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.419+0000 7f30d30c5700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc0b47f0 con 0x7f30cc153740 2023-10-06T04:36:22.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.419+0000 7f30d18c2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30cc15a7b0 0x7f30cc0c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:22.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.419+0000 7f30d18c2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30cc15a7b0 0x7f30cc0c5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53744/0 (socket says 172.21.15.8:53744) 2023-10-06T04:36:22.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.419+0000 7f30d18c2700 1 -- 172.21.15.8:0/2346363414 learned_addr learned my addr 172.21.15.8:0/2346363414 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:22.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.420+0000 7f30d20c3700 1 --2- 172.21.15.8:0/2346363414 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30cc153740 0x7f30cc0c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:22.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.420+0000 7f30d28c4700 1 --2- 172.21.15.8:0/2346363414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30cc15d8e0 0x7f30cc0b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:22.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.420+0000 7f30d18c2700 1 -- 172.21.15.8:0/2346363414 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30cc153740 msgr2=0x7f30cc0c5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:22.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.420+0000 7f30d18c2700 1 --2- 172.21.15.8:0/2346363414 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30cc153740 0x7f30cc0c5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:22.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.420+0000 7f30d18c2700 1 -- 172.21.15.8:0/2346363414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30cc15d8e0 msgr2=0x7f30cc0b3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:22.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.420+0000 7f30d18c2700 1 --2- 172.21.15.8:0/2346363414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30cc15d8e0 0x7f30cc0b3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:22.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.420+0000 7f30d18c2700 1 -- 172.21.15.8:0/2346363414 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c0009420 con 0x7f30cc15a7b0 2023-10-06T04:36:22.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.420+0000 7f30d20c3700 1 --2- 172.21.15.8:0/2346363414 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30cc153740 0x7f30cc0c5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:22.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.420+0000 7f30d28c4700 1 --2- 172.21.15.8:0/2346363414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30cc15d8e0 0x7f30cc0b3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:22.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.420+0000 7f30d18c2700 1 --2- 172.21.15.8:0/2346363414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30cc15a7b0 0x7f30cc0c5590 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f30c0009f00 tx=0x7f30c0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:22.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.420+0000 7f30ca7fc700 1 -- 172.21.15.8:0/2346363414 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c001f070 con 0x7f30cc15a7b0 2023-10-06T04:36:22.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.420+0000 7f30ca7fc700 1 -- 172.21.15.8:0/2346363414 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c0000bc0 con 0x7f30cc15a7b0 2023-10-06T04:36:22.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.420+0000 7f30d30c5700 1 -- 172.21.15.8:0/2346363414 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30cc0b4ad0 con 0x7f30cc15a7b0 2023-10-06T04:36:22.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.420+0000 7f30ca7fc700 1 -- 172.21.15.8:0/2346363414 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c0025420 con 0x7f30cc15a7b0 2023-10-06T04:36:22.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.420+0000 7f30d30c5700 1 -- 172.21.15.8:0/2346363414 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30cc0c8460 con 0x7f30cc15a7b0 2023-10-06T04:36:22.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.421+0000 7f30d30c5700 1 -- 172.21.15.8:0/2346363414 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30cc0c8650 con 0x7f30cc15a7b0 2023-10-06T04:36:22.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.421+0000 7f30ca7fc700 1 -- 172.21.15.8:0/2346363414 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f30c0023070 con 0x7f30cc15a7b0 2023-10-06T04:36:22.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.422+0000 7f30ca7fc700 1 --2- 172.21.15.8:0/2346363414 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f30b8066f30 0x7f30b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:22.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.422+0000 7f30ca7fc700 1 -- 172.21.15.8:0/2346363414 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f30c0085d40 con 0x7f30cc15a7b0 2023-10-06T04:36:22.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.422+0000 7f30d20c3700 1 --2- 172.21.15.8:0/2346363414 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f30b8066f30 0x7f30b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:22.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.422+0000 7f30d20c3700 1 --2- 172.21.15.8:0/2346363414 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f30b8066f30 0x7f30b80693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f30bc003990 tx=0x7f30bc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:22.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.426+0000 7f30ca7fc700 1 -- 172.21.15.8:0/2346363414 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f30c0052b60 con 0x7f30cc15a7b0 2023-10-06T04:36:22.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.664+0000 7f30d30c5700 1 -- 172.21.15.8:0/2346363414 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30cc04c380 con 0x7f30cc15a7b0 2023-10-06T04:36:22.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.665+0000 7f30ca7fc700 1 -- 172.21.15.8:0/2346363414 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4587 (secure 0 0 0) 0x7f30c002a090 con 0x7f30cc15a7b0 2023-10-06T04:36:22.667 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:36:22.667 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/516627422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":516627422},{"type":"v1","addr":"172.21.15.8:6835","nonce":516627422}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/1078182353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1078182353},{"type":"v1","addr":"172.21.15.8:6834","nonce":1078182353}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/181555783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":181555783},{"type":"v1","addr":"172.21.15.184:6836","nonce":181555783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:36:16.632579+0000","modified":"2023-10-06T04:36:22.270558+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/2590100121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":2590100121},{"type":"v1","addr":"172.21.15.184:6837","nonce":2590100121}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-10-06T04:36:22.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.667+0000 7f30d30c5700 1 -- 172.21.15.8:0/2346363414 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f30b8066f30 msgr2=0x7f30b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:22.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.667+0000 7f30d30c5700 1 --2- 172.21.15.8:0/2346363414 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f30b8066f30 0x7f30b80693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f30bc003990 tx=0x7f30bc009040 comp rx=0 tx=0).stop 2023-10-06T04:36:22.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.667+0000 7f30d30c5700 1 -- 172.21.15.8:0/2346363414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30cc15a7b0 msgr2=0x7f30cc0c5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:22.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.667+0000 7f30d30c5700 1 --2- 172.21.15.8:0/2346363414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30cc15a7b0 0x7f30cc0c5590 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f30c0009f00 tx=0x7f30c0017000 comp rx=0 tx=0).stop 2023-10-06T04:36:22.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.667+0000 7f30d30c5700 1 -- 172.21.15.8:0/2346363414 shutdown_connections 2023-10-06T04:36:22.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.667+0000 7f30d30c5700 1 --2- 172.21.15.8:0/2346363414 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f30b8066f30 0x7f30b80693e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:22.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.667+0000 7f30d30c5700 1 --2- 172.21.15.8:0/2346363414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30cc15d8e0 0x7f30cc0b3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:22.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.667+0000 7f30d30c5700 1 --2- 172.21.15.8:0/2346363414 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30cc153740 0x7f30cc0c5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:22.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.667+0000 7f30d30c5700 1 --2- 172.21.15.8:0/2346363414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30cc15a7b0 0x7f30cc0c5590 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:22.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.667+0000 7f30d30c5700 1 -- 172.21.15.8:0/2346363414 >> 172.21.15.8:0/2346363414 conn(0x7f30cc0d02b0 msgr2=0x7f30cc0cec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:22.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.667+0000 7f30d30c5700 1 -- 172.21.15.8:0/2346363414 shutdown_connections 2023-10-06T04:36:22.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.667+0000 7f30d30c5700 1 -- 172.21.15.8:0/2346363414 wait complete. 2023-10-06T04:36:22.671 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 7 2023-10-06T04:36:22.681 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:36:22.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.800+0000 7fc942538700 1 Processor -- start 2023-10-06T04:36:22.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.800+0000 7fc942538700 1 -- start start 2023-10-06T04:36:22.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.801+0000 7fc942538700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc93c0cb360 0x7fc93c0d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:22.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.801+0000 7fc942538700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc93c0cc4c0 con 0x7fc93c0d08d0 2023-10-06T04:36:22.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.801+0000 7fc942538700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc93c0cb8b0 con 0x7fc93c0af680 2023-10-06T04:36:22.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.801+0000 7fc942538700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c15d460 con 0x7fc93c0cb360 2023-10-06T04:36:22.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.801+0000 7fc940ad5700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fc93c0d08d0 0x7fc93c0cc950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:55710/0 (socket says 172.21.15.8:55710) 2023-10-06T04:36:22.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.801+0000 7fc940ad5700 1 -- 172.21.15.8:0/122022387 learned_addr learned my addr 172.21.15.8:0/122022387 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:22.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.801+0000 7fc93b7fe700 1 --2- 172.21.15.8:0/122022387 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc93c0cb360 0x7fc93c0d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:22.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.801+0000 7fc93affd700 1 -- 172.21.15.8:0/122022387 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3270181830 0 0) 0x7fc93c0cc4c0 con 0x7fc93c0d08d0 2023-10-06T04:36:22.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.801+0000 7fc93affd700 1 -- 172.21.15.8:0/122022387 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc928003570 con 0x7fc93c0d08d0 2023-10-06T04:36:22.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.801+0000 7fc93affd700 1 -- 172.21.15.8:0/122022387 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 313771225 0 0) 0x7fc928003570 con 0x7fc93c0d08d0 2023-10-06T04:36:22.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.801+0000 7fc93affd700 1 -- 172.21.15.8:0/122022387 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc93c0cb360 msgr2=0x7fc93c0d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:22.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.801+0000 7fc93affd700 1 --2- 172.21.15.8:0/122022387 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc93c0cb360 0x7fc93c0d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:22.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.801+0000 7fc93affd700 1 -- 172.21.15.8:0/122022387 >> v1:172.21.15.184:6789/0 conn(0x7fc93c0af680 legacy=0x7fc93c15e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:22.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.801+0000 7fc93affd700 1 -- 172.21.15.8:0/122022387 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc93c0cbb90 con 0x7fc93c0d08d0 2023-10-06T04:36:22.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.801+0000 7fc93affd700 1 -- 172.21.15.8:0/122022387 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7fc9340017f0 con 0x7fc93c0d08d0 2023-10-06T04:36:22.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.801+0000 7fc93affd700 1 -- 172.21.15.8:0/122022387 >> v1:172.21.15.8:6789/0 conn(0x7fc93c0d08d0 legacy=0x7fc93c0cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:22.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.801+0000 7fc93affd700 1 --2- 172.21.15.8:0/122022387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc928003a90 0x7fc928003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:22.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.802+0000 7fc93affd700 1 --2- 172.21.15.8:0/122022387 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc928004810 0x7fc928004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:22.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.802+0000 7fc93affd700 1 --2- 172.21.15.8:0/122022387 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc93c0cb360 0x7fc9280051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:22.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.802+0000 7fc93affd700 1 -- 172.21.15.8:0/122022387 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c15d460 con 0x7fc928003a90 2023-10-06T04:36:22.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.802+0000 7fc93affd700 1 -- 172.21.15.8:0/122022387 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92800bb60 con 0x7fc928004810 2023-10-06T04:36:22.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.802+0000 7fc93affd700 1 -- 172.21.15.8:0/122022387 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc92800bd20 con 0x7fc93c0cb360 2023-10-06T04:36:22.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.802+0000 7fc93bfff700 1 --2- 172.21.15.8:0/122022387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc928003a90 0x7fc928003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:22.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.802+0000 7fc93b7fe700 1 --2- 172.21.15.8:0/122022387 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc928004810 0x7fc928004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:22.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.802+0000 7fc940ad5700 1 --2- 172.21.15.8:0/122022387 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc93c0cb360 0x7fc9280051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:22.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.802+0000 7fc93bfff700 1 -- 172.21.15.8:0/122022387 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc93c0cb360 msgr2=0x7fc9280051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:22.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.802+0000 7fc93bfff700 1 --2- 172.21.15.8:0/122022387 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc93c0cb360 0x7fc9280051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:22.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.802+0000 7fc93bfff700 1 -- 172.21.15.8:0/122022387 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc928004810 msgr2=0x7fc928004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:22.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.802+0000 7fc93bfff700 1 --2- 172.21.15.8:0/122022387 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc928004810 0x7fc928004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:22.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.802+0000 7fc93bfff700 1 -- 172.21.15.8:0/122022387 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc928003570 con 0x7fc928003a90 2023-10-06T04:36:22.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.802+0000 7fc93bfff700 1 --2- 172.21.15.8:0/122022387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc928003a90 0x7fc928003ea0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc9240018b0 tx=0x7fc924007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aa6f6e5649b8e4d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:22.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.802+0000 7fc93affd700 1 -- 172.21.15.8:0/122022387 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc924012420 con 0x7fc928003a90 2023-10-06T04:36:22.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.802+0000 7fc93affd700 1 -- 172.21.15.8:0/122022387 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc924012580 con 0x7fc928003a90 2023-10-06T04:36:22.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.802+0000 7fc93affd700 1 -- 172.21.15.8:0/122022387 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc924012920 con 0x7fc928003a90 2023-10-06T04:36:22.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.803+0000 7fc942538700 1 -- 172.21.15.8:0/122022387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc928003a90 msgr2=0x7fc928003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:22.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.803+0000 7fc942538700 1 --2- 172.21.15.8:0/122022387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc928003a90 0x7fc928003ea0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc9240018b0 tx=0x7fc924007d30 comp rx=0 tx=0).stop 2023-10-06T04:36:22.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.803+0000 7fc940ad5700 1 -- 172.21.15.8:0/122022387 reap_dead start 2023-10-06T04:36:22.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.803+0000 7fc942538700 1 -- 172.21.15.8:0/122022387 shutdown_connections 2023-10-06T04:36:22.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.803+0000 7fc942538700 1 -- 172.21.15.8:0/122022387 >> 172.21.15.8:0/122022387 conn(0x7fc93c0633d0 msgr2=0x7fc93c0637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:22.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.803+0000 7fc942538700 1 -- 172.21.15.8:0/122022387 shutdown_connections 2023-10-06T04:36:22.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.803+0000 7fc942538700 1 -- 172.21.15.8:0/122022387 wait complete. 2023-10-06T04:36:22.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.804+0000 7fc942538700 1 Processor -- start 2023-10-06T04:36:22.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.804+0000 7fc942538700 1 -- start start 2023-10-06T04:36:22.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.805+0000 7fc942538700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc928003a90 0x7fc93c14ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:22.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.805+0000 7fc942538700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc93c0c9fc0 0x7fc93c15fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:22.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.805+0000 7fc942538700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc93c160410 0x7fc93c14b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:22.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.805+0000 7fc942538700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c15fa40 con 0x7fc93c160410 2023-10-06T04:36:22.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.805+0000 7fc942538700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c15ee30 con 0x7fc93c0c9fc0 2023-10-06T04:36:22.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.805+0000 7fc942538700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c15f110 con 0x7fc928003a90 2023-10-06T04:36:22.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.805+0000 7fc940ad5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc93c160410 0x7fc93c14b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:22.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.805+0000 7fc940ad5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc93c160410 0x7fc93c14b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53764/0 (socket says 172.21.15.8:53764) 2023-10-06T04:36:22.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.805+0000 7fc940ad5700 1 -- 172.21.15.8:0/3720479966 learned_addr learned my addr 172.21.15.8:0/3720479966 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:22.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.805+0000 7fc93b7fe700 1 --2- 172.21.15.8:0/3720479966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc93c0c9fc0 0x7fc93c15fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:22.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.805+0000 7fc93bfff700 1 --2- 172.21.15.8:0/3720479966 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc928003a90 0x7fc93c14ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:22.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.805+0000 7fc940ad5700 1 -- 172.21.15.8:0/3720479966 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc928003a90 msgr2=0x7fc93c14ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:22.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.805+0000 7fc940ad5700 1 --2- 172.21.15.8:0/3720479966 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc928003a90 0x7fc93c14ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:22.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.805+0000 7fc940ad5700 1 -- 172.21.15.8:0/3720479966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc93c0c9fc0 msgr2=0x7fc93c15fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:22.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.805+0000 7fc940ad5700 1 --2- 172.21.15.8:0/3720479966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc93c0c9fc0 0x7fc93c15fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:22.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.805+0000 7fc940ad5700 1 -- 172.21.15.8:0/3720479966 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc93c15f3f0 con 0x7fc93c160410 2023-10-06T04:36:22.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.805+0000 7fc93bfff700 1 --2- 172.21.15.8:0/3720479966 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc928003a90 0x7fc93c14ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:22.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.805+0000 7fc940ad5700 1 --2- 172.21.15.8:0/3720479966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc93c160410 0x7fc93c14b3b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc93c0b21d0 tx=0x7fc9340021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:22.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.805+0000 7fc933fff700 1 -- 172.21.15.8:0/3720479966 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc934007b60 con 0x7fc93c160410 2023-10-06T04:36:22.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.805+0000 7fc933fff700 1 -- 172.21.15.8:0/3720479966 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93400ace0 con 0x7fc93c160410 2023-10-06T04:36:22.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.806+0000 7fc942538700 1 -- 172.21.15.8:0/3720479966 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc93c15f6d0 con 0x7fc93c160410 2023-10-06T04:36:22.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.806+0000 7fc933fff700 1 -- 172.21.15.8:0/3720479966 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc934013640 con 0x7fc93c160410 2023-10-06T04:36:22.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.806+0000 7fc942538700 1 -- 172.21.15.8:0/3720479966 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc93c0ca430 con 0x7fc93c160410 2023-10-06T04:36:22.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.807+0000 7fc942538700 1 -- 172.21.15.8:0/3720479966 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc93c071550 con 0x7fc93c160410 2023-10-06T04:36:22.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.807+0000 7fc933fff700 1 -- 172.21.15.8:0/3720479966 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc934013a70 con 0x7fc93c160410 2023-10-06T04:36:22.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.807+0000 7fc933fff700 1 --2- 172.21.15.8:0/3720479966 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc91c066f30 0x7fc91c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:22.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.807+0000 7fc933fff700 1 -- 172.21.15.8:0/3720479966 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fc934085140 con 0x7fc93c160410 2023-10-06T04:36:22.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.808+0000 7fc93bfff700 1 --2- 172.21.15.8:0/3720479966 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc91c066f30 0x7fc91c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:22.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.808+0000 7fc93bfff700 1 --2- 172.21.15.8:0/3720479966 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc91c066f30 0x7fc91c0693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc924001010 tx=0x7fc924015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:22.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:22.812+0000 7fc933fff700 1 -- 172.21.15.8:0/3720479966 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc934051f60 con 0x7fc93c160410 2023-10-06T04:36:23.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.007+0000 7fc942538700 1 -- 172.21.15.8:0/3720479966 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc93c15fb80 con 0x7fc93c160410 2023-10-06T04:36:23.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.008+0000 7fc933fff700 1 -- 172.21.15.8:0/3720479966 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18659 (secure 0 0 0) 0x7fc934055580 con 0x7fc93c160410 2023-10-06T04:36:23.011 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:36:23.011 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":25,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:36:21.690266+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:36:10.148177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:36:10.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:36:14.390671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:36:15.601089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:36:19.291300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.555871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.490505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.504578+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.517217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:05.991135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.537329+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.543232+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.443715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:36:23.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.009+0000 7fc942538700 1 -- 172.21.15.8:0/3720479966 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc91c066f30 msgr2=0x7fc91c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:23.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.010+0000 7fc942538700 1 --2- 172.21.15.8:0/3720479966 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc91c066f30 0x7fc91c0693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc924001010 tx=0x7fc924015000 comp rx=0 tx=0).stop 2023-10-06T04:36:23.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.010+0000 7fc942538700 1 -- 172.21.15.8:0/3720479966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc93c160410 msgr2=0x7fc93c14b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:23.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.010+0000 7fc942538700 1 --2- 172.21.15.8:0/3720479966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc93c160410 0x7fc93c14b3b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc93c0b21d0 tx=0x7fc9340021d0 comp rx=0 tx=0).stop 2023-10-06T04:36:23.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.010+0000 7fc942538700 1 -- 172.21.15.8:0/3720479966 shutdown_connections 2023-10-06T04:36:23.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.010+0000 7fc942538700 1 --2- 172.21.15.8:0/3720479966 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc91c066f30 0x7fc91c0693e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:23.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.010+0000 7fc942538700 1 --2- 172.21.15.8:0/3720479966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc93c160410 0x7fc93c14b3b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:23.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.010+0000 7fc942538700 1 --2- 172.21.15.8:0/3720479966 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc928003a90 0x7fc93c14ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:23.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.010+0000 7fc942538700 1 --2- 172.21.15.8:0/3720479966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc93c0c9fc0 0x7fc93c15fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:23.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.010+0000 7fc942538700 1 -- 172.21.15.8:0/3720479966 >> 172.21.15.8:0/3720479966 conn(0x7fc93c0633d0 msgr2=0x7fc93c0b02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:23.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.010+0000 7fc942538700 1 -- 172.21.15.8:0/3720479966 shutdown_connections 2023-10-06T04:36:23.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.010+0000 7fc942538700 1 -- 172.21.15.8:0/3720479966 wait complete. 2023-10-06T04:36:23.025 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:36:23.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.141+0000 7f14f2021700 1 Processor -- start 2023-10-06T04:36:23.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.141+0000 7f14f2021700 1 -- start start 2023-10-06T04:36:23.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.142+0000 7f14f2021700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14ec0d0aa0 0x7f14ec1649b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:23.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.142+0000 7f14f2021700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14ec0cc4c0 con 0x7f14ec0af680 2023-10-06T04:36:23.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.142+0000 7f14f2021700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14ec0cb8b0 con 0x7f14ec0cb360 2023-10-06T04:36:23.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.142+0000 7f14f2021700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec15d460 con 0x7f14ec0d0aa0 2023-10-06T04:36:23.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.142+0000 7f14eb7fe700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f14ec0af680 0x7f14ec15e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:55720/0 (socket says 172.21.15.8:55720) 2023-10-06T04:36:23.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.142+0000 7f14eb7fe700 1 -- 172.21.15.8:0/68944639 learned_addr learned my addr 172.21.15.8:0/68944639 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:23.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.142+0000 7f14ebfff700 1 --2- 172.21.15.8:0/68944639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14ec0d0aa0 0x7f14ec1649b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:23.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.142+0000 7f14ea7fc700 1 -- 172.21.15.8:0/68944639 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 207217111 0 0) 0x7f14ec0cc4c0 con 0x7f14ec0af680 2023-10-06T04:36:23.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.143+0000 7f14ea7fc700 1 -- 172.21.15.8:0/68944639 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14d4003570 con 0x7f14ec0af680 2023-10-06T04:36:23.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.143+0000 7f14ea7fc700 1 -- 172.21.15.8:0/68944639 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2652613986 0 0) 0x7f14d4003570 con 0x7f14ec0af680 2023-10-06T04:36:23.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.143+0000 7f14ea7fc700 1 -- 172.21.15.8:0/68944639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14ec0d0aa0 msgr2=0x7f14ec1649b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:23.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.143+0000 7f14ea7fc700 1 --2- 172.21.15.8:0/68944639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14ec0d0aa0 0x7f14ec1649b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:23.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.143+0000 7f14ea7fc700 1 -- 172.21.15.8:0/68944639 >> v1:172.21.15.184:6789/0 conn(0x7f14ec0cb360 legacy=0x7f14ec0d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:23.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.143+0000 7f14ea7fc700 1 -- 172.21.15.8:0/68944639 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ec0cbb90 con 0x7f14ec0af680 2023-10-06T04:36:23.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.143+0000 7f14ea7fc700 1 -- 172.21.15.8:0/68944639 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7f14dc001470 con 0x7f14ec0af680 2023-10-06T04:36:23.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.143+0000 7f14ea7fc700 1 -- 172.21.15.8:0/68944639 >> v1:172.21.15.8:6789/0 conn(0x7f14ec0af680 legacy=0x7f14ec15e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:23.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.143+0000 7f14ea7fc700 1 --2- 172.21.15.8:0/68944639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14ec0d0aa0 0x7f14d4003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:23.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.143+0000 7f14ea7fc700 1 --2- 172.21.15.8:0/68944639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14d4003fd0 0x7f14d4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:23.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.143+0000 7f14ea7fc700 1 --2- 172.21.15.8:0/68944639 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14d4004d50 0x7f14d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:23.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.143+0000 7f14ea7fc700 1 -- 172.21.15.8:0/68944639 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec15d460 con 0x7f14d4003fd0 2023-10-06T04:36:23.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.143+0000 7f14ea7fc700 1 -- 172.21.15.8:0/68944639 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d400bb40 con 0x7f14d4004d50 2023-10-06T04:36:23.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.143+0000 7f14ea7fc700 1 -- 172.21.15.8:0/68944639 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d400bd00 con 0x7f14ec0d0aa0 2023-10-06T04:36:23.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.143+0000 7f14eb7fe700 1 --2- 172.21.15.8:0/68944639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14ec0d0aa0 0x7f14d4003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:23.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.143+0000 7f14eaffd700 1 --2- 172.21.15.8:0/68944639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14d4003fd0 0x7f14d4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:23.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.143+0000 7f14ebfff700 1 --2- 172.21.15.8:0/68944639 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14d4004d50 0x7f14d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:23.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.143+0000 7f14eaffd700 1 -- 172.21.15.8:0/68944639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14ec0d0aa0 msgr2=0x7f14d4003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:23.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.143+0000 7f14eaffd700 1 --2- 172.21.15.8:0/68944639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14ec0d0aa0 0x7f14d4003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:23.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.143+0000 7f14eaffd700 1 -- 172.21.15.8:0/68944639 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14d4004d50 msgr2=0x7f14d40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:23.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.143+0000 7f14eaffd700 1 --2- 172.21.15.8:0/68944639 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14d4004d50 0x7f14d40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:23.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.143+0000 7f14eaffd700 1 -- 172.21.15.8:0/68944639 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d4003570 con 0x7f14d4003fd0 2023-10-06T04:36:23.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.143+0000 7f14eaffd700 1 --2- 172.21.15.8:0/68944639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14d4003fd0 0x7f14d4004810 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f14e00019a0 tx=0x7f14e0007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d80ae50008b75d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:23.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.144+0000 7f14ea7fc700 1 -- 172.21.15.8:0/68944639 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e000c5d0 con 0x7f14d4003fd0 2023-10-06T04:36:23.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.144+0000 7f14ea7fc700 1 -- 172.21.15.8:0/68944639 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e000c750 con 0x7f14d4003fd0 2023-10-06T04:36:23.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.144+0000 7f14ea7fc700 1 -- 172.21.15.8:0/68944639 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e000cb10 con 0x7f14d4003fd0 2023-10-06T04:36:23.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.144+0000 7f14f2021700 1 -- 172.21.15.8:0/68944639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14d4003fd0 msgr2=0x7f14d4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:23.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.144+0000 7f14f2021700 1 --2- 172.21.15.8:0/68944639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14d4003fd0 0x7f14d4004810 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f14e00019a0 tx=0x7f14e0007d10 comp rx=0 tx=0).stop 2023-10-06T04:36:23.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.144+0000 7f14ebfff700 1 -- 172.21.15.8:0/68944639 reap_dead start 2023-10-06T04:36:23.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.144+0000 7f14f2021700 1 -- 172.21.15.8:0/68944639 shutdown_connections 2023-10-06T04:36:23.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.144+0000 7f14f2021700 1 -- 172.21.15.8:0/68944639 >> 172.21.15.8:0/68944639 conn(0x7f14ec0633d0 msgr2=0x7f14ec0637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:23.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.144+0000 7f14f2021700 1 -- 172.21.15.8:0/68944639 shutdown_connections 2023-10-06T04:36:23.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.144+0000 7f14f2021700 1 -- 172.21.15.8:0/68944639 wait complete. 2023-10-06T04:36:23.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.145+0000 7f14f2021700 1 Processor -- start 2023-10-06T04:36:23.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.146+0000 7f14f2021700 1 -- start start 2023-10-06T04:36:23.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.146+0000 7f14f2021700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14d4003fd0 0x7f14ec0c7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:23.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.146+0000 7f14f2021700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14ec1584d0 0x7f14ec0c6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:23.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.146+0000 7f14f2021700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14ec16ae80 0x7f14ec0afa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:23.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.146+0000 7f14f2021700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec148330 con 0x7f14d4003fd0 2023-10-06T04:36:23.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.146+0000 7f14f2021700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec158d80 con 0x7f14ec16ae80 2023-10-06T04:36:23.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.146+0000 7f14f2021700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec1699b0 con 0x7f14ec1584d0 2023-10-06T04:36:23.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.146+0000 7f14eb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14d4003fd0 0x7f14ec0c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:23.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.146+0000 7f14eb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14d4003fd0 0x7f14ec0c7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53780/0 (socket says 172.21.15.8:53780) 2023-10-06T04:36:23.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.146+0000 7f14eb7fe700 1 -- 172.21.15.8:0/2882666226 learned_addr learned my addr 172.21.15.8:0/2882666226 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:23.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.146+0000 7f14ebfff700 1 --2- 172.21.15.8:0/2882666226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14ec16ae80 0x7f14ec0afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:23.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.146+0000 7f14eaffd700 1 --2- 172.21.15.8:0/2882666226 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14ec1584d0 0x7f14ec0c6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:23.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.147+0000 7f14eb7fe700 1 -- 172.21.15.8:0/2882666226 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14ec1584d0 msgr2=0x7f14ec0c6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:23.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.147+0000 7f14eb7fe700 1 --2- 172.21.15.8:0/2882666226 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14ec1584d0 0x7f14ec0c6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:23.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.147+0000 7f14eb7fe700 1 -- 172.21.15.8:0/2882666226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14ec16ae80 msgr2=0x7f14ec0afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:23.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.147+0000 7f14eb7fe700 1 --2- 172.21.15.8:0/2882666226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14ec16ae80 0x7f14ec0afa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:23.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.147+0000 7f14eb7fe700 1 -- 172.21.15.8:0/2882666226 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ec0c7b30 con 0x7f14d4003fd0 2023-10-06T04:36:23.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.147+0000 7f14eb7fe700 1 --2- 172.21.15.8:0/2882666226 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14d4003fd0 0x7f14ec0c7430 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f14dc0073c0 tx=0x7f14ec069610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:23.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.147+0000 7f14d37fe700 1 -- 172.21.15.8:0/2882666226 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc018030 con 0x7f14d4003fd0 2023-10-06T04:36:23.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.147+0000 7f14d37fe700 1 -- 172.21.15.8:0/2882666226 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14dc0077a0 con 0x7f14d4003fd0 2023-10-06T04:36:23.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.147+0000 7f14f2021700 1 -- 172.21.15.8:0/2882666226 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14ec0c7e10 con 0x7f14d4003fd0 2023-10-06T04:36:23.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.147+0000 7f14d37fe700 1 -- 172.21.15.8:0/2882666226 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc00fa80 con 0x7f14d4003fd0 2023-10-06T04:36:23.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.147+0000 7f14f2021700 1 -- 172.21.15.8:0/2882666226 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14ec169c10 con 0x7f14d4003fd0 2023-10-06T04:36:23.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.148+0000 7f14f2021700 1 -- 172.21.15.8:0/2882666226 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14ec0c8310 con 0x7f14d4003fd0 2023-10-06T04:36:23.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.148+0000 7f14d37fe700 1 -- 172.21.15.8:0/2882666226 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f14dc01b070 con 0x7f14d4003fd0 2023-10-06T04:36:23.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.149+0000 7f14d37fe700 1 --2- 172.21.15.8:0/2882666226 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f14d8066f60 0x7f14d8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:23.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.149+0000 7f14d37fe700 1 -- 172.21.15.8:0/2882666226 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f14dc019070 con 0x7f14d4003fd0 2023-10-06T04:36:23.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.149+0000 7f14eaffd700 1 --2- 172.21.15.8:0/2882666226 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f14d8066f60 0x7f14d8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:23.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.149+0000 7f14eaffd700 1 --2- 172.21.15.8:0/2882666226 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f14d8066f60 0x7f14d8069410 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f14e0008fd0 tx=0x7f14e0015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:23.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.153+0000 7f14d37fe700 1 -- 172.21.15.8:0/2882666226 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f14dc051500 con 0x7f14d4003fd0 2023-10-06T04:36:23.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.346+0000 7f14f2021700 1 -- 172.21.15.8:0/2882666226 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14ec0b11b0 con 0x7f14d4003fd0 2023-10-06T04:36:23.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.347+0000 7f14d37fe700 1 -- 172.21.15.8:0/2882666226 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f14dc00fdf0 con 0x7f14d4003fd0 2023-10-06T04:36:23.350 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:36:23.350 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":25,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:36:21.690266+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:36:10.148177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:36:10.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:36:14.390671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:36:15.601089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:36:19.291300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.555871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.490505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.504578+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.517217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:05.991135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.537329+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.543232+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.443715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:36:23.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.349+0000 7f14f2021700 1 -- 172.21.15.8:0/2882666226 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f14d8066f60 msgr2=0x7f14d8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:23.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.349+0000 7f14f2021700 1 --2- 172.21.15.8:0/2882666226 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f14d8066f60 0x7f14d8069410 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f14e0008fd0 tx=0x7f14e0015000 comp rx=0 tx=0).stop 2023-10-06T04:36:23.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.349+0000 7f14f2021700 1 -- 172.21.15.8:0/2882666226 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14d4003fd0 msgr2=0x7f14ec0c7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:23.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.349+0000 7f14f2021700 1 --2- 172.21.15.8:0/2882666226 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14d4003fd0 0x7f14ec0c7430 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f14dc0073c0 tx=0x7f14ec069610 comp rx=0 tx=0).stop 2023-10-06T04:36:23.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.349+0000 7f14f2021700 1 -- 172.21.15.8:0/2882666226 shutdown_connections 2023-10-06T04:36:23.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.349+0000 7f14f2021700 1 --2- 172.21.15.8:0/2882666226 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f14d8066f60 0x7f14d8069410 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:23.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.349+0000 7f14f2021700 1 --2- 172.21.15.8:0/2882666226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14ec16ae80 0x7f14ec0afa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:23.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.349+0000 7f14f2021700 1 --2- 172.21.15.8:0/2882666226 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14d4003fd0 0x7f14ec0c7430 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:23.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.349+0000 7f14f2021700 1 --2- 172.21.15.8:0/2882666226 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14ec1584d0 0x7f14ec0c6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:23.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.349+0000 7f14f2021700 1 -- 172.21.15.8:0/2882666226 >> 172.21.15.8:0/2882666226 conn(0x7f14ec0633d0 msgr2=0x7f14ec0ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:23.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.349+0000 7f14f2021700 1 -- 172.21.15.8:0/2882666226 shutdown_connections 2023-10-06T04:36:23.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.349+0000 7f14f2021700 1 -- 172.21.15.8:0/2882666226 wait complete. 2023-10-06T04:36:23.380 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:36:23.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.496+0000 7f66b07e2700 1 Processor -- start 2023-10-06T04:36:23.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.496+0000 7f66b07e2700 1 -- start start 2023-10-06T04:36:23.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.497+0000 7f66b07e2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66a80af680 0x7f66a815e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:23.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.497+0000 7f66b07e2700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a80cc4c0 con 0x7f66a80d0aa0 2023-10-06T04:36:23.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.497+0000 7f66b07e2700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a815e580 con 0x7f66a80cb360 2023-10-06T04:36:23.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.497+0000 7f66b07e2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a815d460 con 0x7f66a80af680 2023-10-06T04:36:23.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.497+0000 7f66aed7f700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f66a80d0aa0 0x7f66a80cc950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:55722/0 (socket says 172.21.15.8:55722) 2023-10-06T04:36:23.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.497+0000 7f66aed7f700 1 -- 172.21.15.8:0/3663182400 learned_addr learned my addr 172.21.15.8:0/3663182400 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:23.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.497+0000 7f66ad57c700 1 -- 172.21.15.8:0/3663182400 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1262174571 0 0) 0x7f66a80cc4c0 con 0x7f66a80d0aa0 2023-10-06T04:36:23.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.497+0000 7f66ae57e700 1 --2- 172.21.15.8:0/3663182400 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66a80af680 0x7f66a815e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:23.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.497+0000 7f66ad57c700 1 -- 172.21.15.8:0/3663182400 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6694003570 con 0x7f66a80d0aa0 2023-10-06T04:36:23.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.498+0000 7f66ad57c700 1 -- 172.21.15.8:0/3663182400 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3954434273 0 0) 0x7f6694003570 con 0x7f66a80d0aa0 2023-10-06T04:36:23.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.498+0000 7f66ad57c700 1 -- 172.21.15.8:0/3663182400 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66a80af680 msgr2=0x7f66a815e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:23.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.498+0000 7f66ad57c700 1 --2- 172.21.15.8:0/3663182400 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66a80af680 0x7f66a815e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:23.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.498+0000 7f66ad57c700 1 -- 172.21.15.8:0/3663182400 >> v1:172.21.15.184:6789/0 conn(0x7f66a80cb360 legacy=0x7f66a80d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:23.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.498+0000 7f66ad57c700 1 -- 172.21.15.8:0/3663182400 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a80cb8b0 con 0x7f66a80d0aa0 2023-10-06T04:36:23.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.498+0000 7f66ad57c700 1 -- 172.21.15.8:0/3663182400 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7f66a00017f0 con 0x7f66a80d0aa0 2023-10-06T04:36:23.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.498+0000 7f66ad57c700 1 -- 172.21.15.8:0/3663182400 >> v1:172.21.15.8:6789/0 conn(0x7f66a80d0aa0 legacy=0x7f66a80cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:23.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.498+0000 7f66ad57c700 1 --2- 172.21.15.8:0/3663182400 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66a80af680 0x7f6694003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:23.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.498+0000 7f66ad57c700 1 --2- 172.21.15.8:0/3663182400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6694004010 0x7f6694004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:23.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.498+0000 7f66ad57c700 1 --2- 172.21.15.8:0/3663182400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6694004d50 0x7f66940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:23.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.498+0000 7f66ad57c700 1 -- 172.21.15.8:0/3663182400 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a815d460 con 0x7f6694004010 2023-10-06T04:36:23.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.498+0000 7f66ad57c700 1 -- 172.21.15.8:0/3663182400 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669400bbf0 con 0x7f6694004d50 2023-10-06T04:36:23.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.498+0000 7f66ad57c700 1 -- 172.21.15.8:0/3663182400 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669400bdb0 con 0x7f66a80af680 2023-10-06T04:36:23.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.498+0000 7f66add7d700 1 --2- 172.21.15.8:0/3663182400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6694004010 0x7f6694004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:23.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.498+0000 7f66ae57e700 1 --2- 172.21.15.8:0/3663182400 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66a80af680 0x7f6694003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:23.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.498+0000 7f66aed7f700 1 --2- 172.21.15.8:0/3663182400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6694004d50 0x7f66940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:23.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.498+0000 7f66add7d700 1 -- 172.21.15.8:0/3663182400 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66a80af680 msgr2=0x7f6694003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:23.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.498+0000 7f66add7d700 1 --2- 172.21.15.8:0/3663182400 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66a80af680 0x7f6694003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:23.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.498+0000 7f66add7d700 1 -- 172.21.15.8:0/3663182400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6694004d50 msgr2=0x7f66940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:23.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.498+0000 7f66add7d700 1 --2- 172.21.15.8:0/3663182400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6694004d50 0x7f66940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:23.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.498+0000 7f66add7d700 1 -- 172.21.15.8:0/3663182400 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6694003570 con 0x7f6694004010 2023-10-06T04:36:23.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.498+0000 7f66aed7f700 1 --2- 172.21.15.8:0/3663182400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6694004d50 0x7f66940051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:23.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.498+0000 7f66add7d700 1 --2- 172.21.15.8:0/3663182400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6694004010 0x7f6694004810 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f669c001880 tx=0x7f669c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be18fff73e38743a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:23.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.498+0000 7f66ad57c700 1 -- 172.21.15.8:0/3663182400 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669c012420 con 0x7f6694004010 2023-10-06T04:36:23.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.498+0000 7f66ad57c700 1 -- 172.21.15.8:0/3663182400 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669c012580 con 0x7f6694004010 2023-10-06T04:36:23.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.498+0000 7f66ad57c700 1 -- 172.21.15.8:0/3663182400 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669c012920 con 0x7f6694004010 2023-10-06T04:36:23.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.499+0000 7f66b07e2700 1 -- 172.21.15.8:0/3663182400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6694004010 msgr2=0x7f6694004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:23.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.499+0000 7f66b07e2700 1 --2- 172.21.15.8:0/3663182400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6694004010 0x7f6694004810 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f669c001880 tx=0x7f669c007d30 comp rx=0 tx=0).stop 2023-10-06T04:36:23.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.499+0000 7f66aed7f700 1 -- 172.21.15.8:0/3663182400 reap_dead start 2023-10-06T04:36:23.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.499+0000 7f66b07e2700 1 -- 172.21.15.8:0/3663182400 shutdown_connections 2023-10-06T04:36:23.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.499+0000 7f66b07e2700 1 -- 172.21.15.8:0/3663182400 >> 172.21.15.8:0/3663182400 conn(0x7f66a80633d0 msgr2=0x7f66a80637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:23.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.499+0000 7f66b07e2700 1 -- 172.21.15.8:0/3663182400 shutdown_connections 2023-10-06T04:36:23.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.499+0000 7f66b07e2700 1 -- 172.21.15.8:0/3663182400 wait complete. 2023-10-06T04:36:23.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.500+0000 7f66b07e2700 1 Processor -- start 2023-10-06T04:36:23.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.500+0000 7f66b07e2700 1 -- start start 2023-10-06T04:36:23.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.501+0000 7f66b07e2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6694004010 0x7f66a80c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:23.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.501+0000 7f66b07e2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66a80c3d80 0x7f66a815a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:23.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.501+0000 7f66b07e2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66a80b41a0 0x7f66a80b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:23.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.501+0000 7f66b07e2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a80b4b50 con 0x7f66a80c3d80 2023-10-06T04:36:23.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.501+0000 7f66b07e2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a80c7230 con 0x7f66a80b41a0 2023-10-06T04:36:23.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.501+0000 7f66b07e2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a80ca1b0 con 0x7f6694004010 2023-10-06T04:36:23.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.501+0000 7f66add7d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66a80c3d80 0x7f66a815a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:23.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.501+0000 7f66add7d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66a80c3d80 0x7f66a815a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53798/0 (socket says 172.21.15.8:53798) 2023-10-06T04:36:23.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.501+0000 7f66ae57e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6694004010 0x7f66a80c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:23.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.501+0000 7f66add7d700 1 -- 172.21.15.8:0/1168040462 learned_addr learned my addr 172.21.15.8:0/1168040462 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:23.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.501+0000 7f66aed7f700 1 --2- 172.21.15.8:0/1168040462 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66a80b41a0 0x7f66a80b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:23.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.501+0000 7f66add7d700 1 -- 172.21.15.8:0/1168040462 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6694004010 msgr2=0x7f66a80c9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:23.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.501+0000 7f66add7d700 1 --2- 172.21.15.8:0/1168040462 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6694004010 0x7f66a80c9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:23.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.501+0000 7f66add7d700 1 -- 172.21.15.8:0/1168040462 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66a80b41a0 msgr2=0x7f66a80b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:23.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.501+0000 7f66add7d700 1 --2- 172.21.15.8:0/1168040462 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66a80b41a0 0x7f66a80b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:23.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.501+0000 7f66add7d700 1 -- 172.21.15.8:0/1168040462 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a815a930 con 0x7f66a80c3d80 2023-10-06T04:36:23.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.501+0000 7f66add7d700 1 --2- 172.21.15.8:0/1168040462 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66a80c3d80 0x7f66a815a3f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f66940057d0 tx=0x7f669c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:23.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.502+0000 7f669a7fc700 1 -- 172.21.15.8:0/1168040462 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669c01e6e0 con 0x7f66a80c3d80 2023-10-06T04:36:23.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.502+0000 7f669a7fc700 1 -- 172.21.15.8:0/1168040462 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669c01e880 con 0x7f66a80c3d80 2023-10-06T04:36:23.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.502+0000 7f66b07e2700 1 -- 172.21.15.8:0/1168040462 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a80c6900 con 0x7f66a80c3d80 2023-10-06T04:36:23.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.502+0000 7f669a7fc700 1 -- 172.21.15.8:0/1168040462 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669c01ec40 con 0x7f66a80c3d80 2023-10-06T04:36:23.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.502+0000 7f66b07e2700 1 -- 172.21.15.8:0/1168040462 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a80c6ec0 con 0x7f66a80c3d80 2023-10-06T04:36:23.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.503+0000 7f66b07e2700 1 -- 172.21.15.8:0/1168040462 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a80c7430 con 0x7f66a80c3d80 2023-10-06T04:36:23.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.503+0000 7f669a7fc700 1 -- 172.21.15.8:0/1168040462 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f669c019030 con 0x7f66a80c3d80 2023-10-06T04:36:23.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.503+0000 7f669a7fc700 1 --2- 172.21.15.8:0/1168040462 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f668c066f30 0x7f668c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:23.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.504+0000 7f669a7fc700 1 -- 172.21.15.8:0/1168040462 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f669c085d30 con 0x7f66a80c3d80 2023-10-06T04:36:23.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.504+0000 7f66ae57e700 1 --2- 172.21.15.8:0/1168040462 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f668c066f30 0x7f668c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:23.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.504+0000 7f66ae57e700 1 --2- 172.21.15.8:0/1168040462 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f668c066f30 0x7f668c0693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f66a4006f00 tx=0x7f66a40091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:23.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.508+0000 7f669a7fc700 1 -- 172.21.15.8:0/1168040462 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f66a80c7430 con 0x7f66a80c3d80 2023-10-06T04:36:23.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.746+0000 7f66b07e2700 1 -- 172.21.15.8:0/1168040462 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f66a80c7430 con 0x7f66a80c3d80 2023-10-06T04:36:23.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.746+0000 7f669a7fc700 1 -- 172.21.15.8:0/1168040462 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4587 (secure 0 0 0) 0x7f66a80c7430 con 0x7f66a80c3d80 2023-10-06T04:36:23.749 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:36:23.749 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/516627422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":516627422},{"type":"v1","addr":"172.21.15.8:6835","nonce":516627422}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/1078182353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1078182353},{"type":"v1","addr":"172.21.15.8:6834","nonce":1078182353}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/181555783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":181555783},{"type":"v1","addr":"172.21.15.184:6836","nonce":181555783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:36:16.632579+0000","modified":"2023-10-06T04:36:22.270558+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/2590100121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":2590100121},{"type":"v1","addr":"172.21.15.184:6837","nonce":2590100121}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-10-06T04:36:23.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.748+0000 7f66b07e2700 1 -- 172.21.15.8:0/1168040462 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f668c066f30 msgr2=0x7f668c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:23.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.748+0000 7f66b07e2700 1 --2- 172.21.15.8:0/1168040462 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f668c066f30 0x7f668c0693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f66a4006f00 tx=0x7f66a40091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:23.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.748+0000 7f66b07e2700 1 -- 172.21.15.8:0/1168040462 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66a80c3d80 msgr2=0x7f66a815a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:23.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.748+0000 7f66b07e2700 1 --2- 172.21.15.8:0/1168040462 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66a80c3d80 0x7f66a815a3f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f66940057d0 tx=0x7f669c015000 comp rx=0 tx=0).stop 2023-10-06T04:36:23.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.748+0000 7f66b07e2700 1 -- 172.21.15.8:0/1168040462 shutdown_connections 2023-10-06T04:36:23.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.748+0000 7f66b07e2700 1 --2- 172.21.15.8:0/1168040462 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f668c066f30 0x7f668c0693e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:23.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.748+0000 7f66b07e2700 1 --2- 172.21.15.8:0/1168040462 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66a80b41a0 0x7f66a80b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:23.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.748+0000 7f66b07e2700 1 --2- 172.21.15.8:0/1168040462 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6694004010 0x7f66a80c9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:23.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.748+0000 7f66b07e2700 1 --2- 172.21.15.8:0/1168040462 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66a80c3d80 0x7f66a815a3f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:23.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.748+0000 7f66b07e2700 1 -- 172.21.15.8:0/1168040462 >> 172.21.15.8:0/1168040462 conn(0x7f66a80633d0 msgr2=0x7f66a80cea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:23.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.748+0000 7f66b07e2700 1 -- 172.21.15.8:0/1168040462 shutdown_connections 2023-10-06T04:36:23.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.749+0000 7f66b07e2700 1 -- 172.21.15.8:0/1168040462 wait complete. 2023-10-06T04:36:23.753 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 7 2023-10-06T04:36:23.763 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:36:23.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.879+0000 7f0edab57700 1 Processor -- start 2023-10-06T04:36:23.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.879+0000 7f0edab57700 1 -- start start 2023-10-06T04:36:23.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.880+0000 7f0edab57700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0ed40af680 0x7f0ed415e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:23.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.880+0000 7f0edab57700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed40cc4c0 con 0x7f0ed40d0aa0 2023-10-06T04:36:23.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.880+0000 7f0edab57700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed415e580 con 0x7f0ed40cb360 2023-10-06T04:36:23.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.880+0000 7f0edab57700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed415d460 con 0x7f0ed40af680 2023-10-06T04:36:23.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.880+0000 7f0ed88f3700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0ed40af680 0x7f0ed415e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:23.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.880+0000 7f0ed90f4700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f0ed40d0aa0 0x7f0ed40cc950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:55730/0 (socket says 172.21.15.8:55730) 2023-10-06T04:36:23.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.880+0000 7f0ed90f4700 1 -- 172.21.15.8:0/3023895546 learned_addr learned my addr 172.21.15.8:0/3023895546 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:23.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.881+0000 7f0ed88f3700 1 -- 172.21.15.8:0/3023895546 >> v1:172.21.15.184:6789/0 conn(0x7f0ed40cb360 legacy=0x7f0ed40d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:23.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.881+0000 7f0ed88f3700 1 -- 172.21.15.8:0/3023895546 >> v1:172.21.15.8:6789/0 conn(0x7f0ed40d0aa0 legacy=0x7f0ed40cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:23.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.881+0000 7f0ed37fe700 1 -- 172.21.15.8:0/3023895546 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 709337522 0 0) 0x7f0ed40cc4c0 con 0x7f0ed40d0aa0 2023-10-06T04:36:23.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.881+0000 7f0ed88f3700 1 -- 172.21.15.8:0/3023895546 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed40cb8b0 con 0x7f0ed40af680 2023-10-06T04:36:23.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.881+0000 7f0ed88f3700 1 --2- 172.21.15.8:0/3023895546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ed40af680 0x7f0ed415e040 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc009e60 tx=0x7f0ecc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b09333335dc2e9b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:23.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.881+0000 7f0ed37fe700 1 -- 172.21.15.8:0/3023895546 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc00e070 con 0x7f0ed40af680 2023-10-06T04:36:23.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.881+0000 7f0ed37fe700 1 -- 172.21.15.8:0/3023895546 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ecc00bbf0 con 0x7f0ed40af680 2023-10-06T04:36:23.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.881+0000 7f0ed37fe700 1 -- 172.21.15.8:0/3023895546 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc012430 con 0x7f0ed40af680 2023-10-06T04:36:23.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.881+0000 7f0edab57700 1 -- 172.21.15.8:0/3023895546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ed40af680 msgr2=0x7f0ed415e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:23.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.881+0000 7f0edab57700 1 --2- 172.21.15.8:0/3023895546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ed40af680 0x7f0ed415e040 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc009e60 tx=0x7f0ecc009780 comp rx=0 tx=0).stop 2023-10-06T04:36:23.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.881+0000 7f0edab57700 1 -- 172.21.15.8:0/3023895546 shutdown_connections 2023-10-06T04:36:23.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.881+0000 7f0edab57700 1 --2- 172.21.15.8:0/3023895546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ed40af680 0x7f0ed415e040 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:23.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.881+0000 7f0edab57700 1 -- 172.21.15.8:0/3023895546 >> 172.21.15.8:0/3023895546 conn(0x7f0ed40633d0 msgr2=0x7f0ed40637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:23.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.881+0000 7f0edab57700 1 -- 172.21.15.8:0/3023895546 shutdown_connections 2023-10-06T04:36:23.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.881+0000 7f0edab57700 1 -- 172.21.15.8:0/3023895546 wait complete. 2023-10-06T04:36:23.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.883+0000 7f0edab57700 1 Processor -- start 2023-10-06T04:36:23.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.883+0000 7f0edab57700 1 -- start start 2023-10-06T04:36:23.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.883+0000 7f0edab57700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ed40af680 0x7f0ed4154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:23.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.883+0000 7f0edab57700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ed40cb360 0x7f0ed40c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:23.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.883+0000 7f0edab57700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ed40d0aa0 0x7f0ed40c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:23.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.883+0000 7f0edab57700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed4160110 con 0x7f0ed40cb360 2023-10-06T04:36:23.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.883+0000 7f0edab57700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed4155150 con 0x7f0ed40af680 2023-10-06T04:36:23.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.883+0000 7f0edab57700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed40ca290 con 0x7f0ed40d0aa0 2023-10-06T04:36:23.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.884+0000 7f0ed3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ed40cb360 0x7f0ed40c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:23.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.884+0000 7f0ed3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ed40cb360 0x7f0ed40c9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53818/0 (socket says 172.21.15.8:53818) 2023-10-06T04:36:23.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.884+0000 7f0ed3fff700 1 -- 172.21.15.8:0/2164228385 learned_addr learned my addr 172.21.15.8:0/2164228385 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:23.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.884+0000 7f0ed88f3700 1 --2- 172.21.15.8:0/2164228385 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ed40af680 0x7f0ed4154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:23.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.884+0000 7f0ed90f4700 1 --2- 172.21.15.8:0/2164228385 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ed40d0aa0 0x7f0ed40c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:23.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.884+0000 7f0ed3fff700 1 -- 172.21.15.8:0/2164228385 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ed40d0aa0 msgr2=0x7f0ed40c7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:23.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.884+0000 7f0ed3fff700 1 --2- 172.21.15.8:0/2164228385 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ed40d0aa0 0x7f0ed40c7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:23.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.884+0000 7f0ed3fff700 1 -- 172.21.15.8:0/2164228385 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ed40af680 msgr2=0x7f0ed4154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:23.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.884+0000 7f0ed3fff700 1 --2- 172.21.15.8:0/2164228385 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ed40af680 0x7f0ed4154c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:23.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.884+0000 7f0ed3fff700 1 -- 172.21.15.8:0/2164228385 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ecc009a20 con 0x7f0ed40cb360 2023-10-06T04:36:23.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.884+0000 7f0ed88f3700 1 --2- 172.21.15.8:0/2164228385 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ed40af680 0x7f0ed4154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:23.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.884+0000 7f0ed3fff700 1 --2- 172.21.15.8:0/2164228385 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ed40cb360 0x7f0ed40c9d50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0ec800c5d0 tx=0x7f0ec8007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:23.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.884+0000 7f0ed0ff9700 1 -- 172.21.15.8:0/2164228385 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8011590 con 0x7f0ed40cb360 2023-10-06T04:36:23.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.884+0000 7f0ed0ff9700 1 -- 172.21.15.8:0/2164228385 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec8011710 con 0x7f0ed40cb360 2023-10-06T04:36:23.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.884+0000 7f0edab57700 1 -- 172.21.15.8:0/2164228385 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed415f490 con 0x7f0ed40cb360 2023-10-06T04:36:23.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.884+0000 7f0ed0ff9700 1 -- 172.21.15.8:0/2164228385 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8011ad0 con 0x7f0ed40cb360 2023-10-06T04:36:23.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.884+0000 7f0edab57700 1 -- 172.21.15.8:0/2164228385 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed415fa50 con 0x7f0ed40cb360 2023-10-06T04:36:23.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.885+0000 7f0edab57700 1 -- 172.21.15.8:0/2164228385 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed40b11b0 con 0x7f0ed40cb360 2023-10-06T04:36:23.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.886+0000 7f0ed0ff9700 1 -- 172.21.15.8:0/2164228385 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ec801c460 con 0x7f0ed40cb360 2023-10-06T04:36:23.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.886+0000 7f0ed0ff9700 1 --2- 172.21.15.8:0/2164228385 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f0ec0066f30 0x7f0ec00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:23.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.886+0000 7f0ed0ff9700 1 -- 172.21.15.8:0/2164228385 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0ec8084730 con 0x7f0ed40cb360 2023-10-06T04:36:23.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.886+0000 7f0ed88f3700 1 --2- 172.21.15.8:0/2164228385 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f0ec0066f30 0x7f0ec00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:23.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.887+0000 7f0ed88f3700 1 --2- 172.21.15.8:0/2164228385 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f0ec0066f30 0x7f0ec00693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc0099f0 tx=0x7f0ecc018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:23.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:23.890+0000 7f0ed0ff9700 1 -- 172.21.15.8:0/2164228385 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ec8051550 con 0x7f0ed40cb360 2023-10-06T04:36:24.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.084+0000 7f0edab57700 1 -- 172.21.15.8:0/2164228385 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ed4160250 con 0x7f0ed40cb360 2023-10-06T04:36:24.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.085+0000 7f0ed0ff9700 1 -- 172.21.15.8:0/2164228385 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f0ec8054b70 con 0x7f0ed40cb360 2023-10-06T04:36:24.088 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:36:24.088 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":25,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:36:21.690266+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:36:10.148177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:36:10.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:36:14.390671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:36:15.601089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:36:19.291300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.555871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.490505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.504578+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.517217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:05.991135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.537329+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.543232+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.443715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:36:24.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.087+0000 7f0edab57700 1 -- 172.21.15.8:0/2164228385 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f0ec0066f30 msgr2=0x7f0ec00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:24.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.087+0000 7f0edab57700 1 --2- 172.21.15.8:0/2164228385 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f0ec0066f30 0x7f0ec00693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc0099f0 tx=0x7f0ecc018000 comp rx=0 tx=0).stop 2023-10-06T04:36:24.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.087+0000 7f0edab57700 1 -- 172.21.15.8:0/2164228385 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ed40cb360 msgr2=0x7f0ed40c9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:24.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.087+0000 7f0edab57700 1 --2- 172.21.15.8:0/2164228385 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ed40cb360 0x7f0ed40c9d50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0ec800c5d0 tx=0x7f0ec8007f60 comp rx=0 tx=0).stop 2023-10-06T04:36:24.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.087+0000 7f0edab57700 1 -- 172.21.15.8:0/2164228385 shutdown_connections 2023-10-06T04:36:24.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.087+0000 7f0edab57700 1 --2- 172.21.15.8:0/2164228385 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f0ec0066f30 0x7f0ec00693e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.087+0000 7f0edab57700 1 --2- 172.21.15.8:0/2164228385 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ed40d0aa0 0x7f0ed40c7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.087+0000 7f0edab57700 1 --2- 172.21.15.8:0/2164228385 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ed40af680 0x7f0ed4154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.087+0000 7f0edab57700 1 --2- 172.21.15.8:0/2164228385 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ed40cb360 0x7f0ed40c9d50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.087+0000 7f0edab57700 1 -- 172.21.15.8:0/2164228385 >> 172.21.15.8:0/2164228385 conn(0x7f0ed40633d0 msgr2=0x7f0ed40b0170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:24.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.087+0000 7f0edab57700 1 -- 172.21.15.8:0/2164228385 shutdown_connections 2023-10-06T04:36:24.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.087+0000 7f0edab57700 1 -- 172.21.15.8:0/2164228385 wait complete. 2023-10-06T04:36:24.505 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T04:36:16.632579+0000', 'modified': '2023-10-06T04:36:22.270558+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4284}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4284': {'gid': 4284, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.184:6837/2590100121', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6835', 'nonce': 2590100121}, {'type': 'v1', 'addr': '172.21.15.184:6837', 'nonce': 2590100121}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 1} 2023-10-06T04:36:24.505 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T04:36:24.505 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-06T04:36:24.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.624+0000 7f293245c700 1 Processor -- start 2023-10-06T04:36:24.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.624+0000 7f293245c700 1 -- start start 2023-10-06T04:36:24.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.625+0000 7f293245c700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f292c0af410 0x7f292c0cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:24.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.625+0000 7f293245c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f292c0af7e0 0x7f292c0ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:24.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.625+0000 7f293245c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f292c0cd2f0 0x7f292c068470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:24.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.625+0000 7f293245c700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f292c15e260 con 0x7f292c0af410 2023-10-06T04:36:24.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.625+0000 7f293245c700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f292c15ddd0 con 0x7f292c0cd2f0 2023-10-06T04:36:24.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.625+0000 7f293245c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f292c15d4a0 con 0x7f292c0af7e0 2023-10-06T04:36:24.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.625+0000 7f292bfff700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f292c0af410 0x7f292c0cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:24.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.625+0000 7f292bfff700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f292c0af410 0x7f292c0cb3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38238/0 (socket says 172.21.15.8:38238) 2023-10-06T04:36:24.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.625+0000 7f292bfff700 1 -- 172.21.15.8:0/1985343986 learned_addr learned my addr 172.21.15.8:0/1985343986 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:24.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.625+0000 7f292b7fe700 1 --2- 172.21.15.8:0/1985343986 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f292c0af7e0 0x7f292c0ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:24.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.625+0000 7f292bfff700 1 -- 172.21.15.8:0/1985343986 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f292c0af7e0 msgr2=0x7f292c0ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:24.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.625+0000 7f29309f9700 1 --2- 172.21.15.8:0/1985343986 >> v2:172.21.15.184:3300/0 conn(0x7f292c0cd2f0 0x7f292c068470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:24.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.625+0000 7f292bfff700 1 --2- 172.21.15.8:0/1985343986 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f292c0af7e0 0x7f292c0ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.625+0000 7f292bfff700 1 -- 172.21.15.8:0/1985343986 >> v2:172.21.15.184:3300/0 conn(0x7f292c0cd2f0 msgr2=0x7f292c068470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:24.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.625+0000 7f292bfff700 1 --2- 172.21.15.8:0/1985343986 >> v2:172.21.15.184:3300/0 conn(0x7f292c0cd2f0 0x7f292c068470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.625+0000 7f292bfff700 1 -- 172.21.15.8:0/1985343986 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f292c15d780 con 0x7f292c0af410 2023-10-06T04:36:24.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.625+0000 7f292b7fe700 1 --2- 172.21.15.8:0/1985343986 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f292c0af7e0 0x7f292c0ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:36:24.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.625+0000 7f29309f9700 1 --2- 172.21.15.8:0/1985343986 >> v2:172.21.15.184:3300/0 conn(0x7f292c0cd2f0 0x7f292c068470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:36:24.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.625+0000 7f292bfff700 1 --2- 172.21.15.8:0/1985343986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f292c0af410 0x7f292c0cb3a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f292c089560 tx=0x7f2920009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f59cd0e2be3c58b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:24.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.625+0000 7f292affd700 1 -- 172.21.15.8:0/1985343986 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292000b8f0 con 0x7f292c0af410 2023-10-06T04:36:24.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.625+0000 7f292affd700 1 -- 172.21.15.8:0/1985343986 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292000ba50 con 0x7f292c0af410 2023-10-06T04:36:24.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.625+0000 7f292affd700 1 -- 172.21.15.8:0/1985343986 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292000bdf0 con 0x7f292c0af410 2023-10-06T04:36:24.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.626+0000 7f293245c700 1 -- 172.21.15.8:0/1985343986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f292c0af410 msgr2=0x7f292c0cb3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:24.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.626+0000 7f293245c700 1 --2- 172.21.15.8:0/1985343986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f292c0af410 0x7f292c0cb3a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f292c089560 tx=0x7f2920009250 comp rx=0 tx=0).stop 2023-10-06T04:36:24.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.626+0000 7f293245c700 1 -- 172.21.15.8:0/1985343986 shutdown_connections 2023-10-06T04:36:24.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.626+0000 7f293245c700 1 --2- 172.21.15.8:0/1985343986 >> v2:172.21.15.184:3300/0 conn(0x7f292c0cd2f0 0x7f292c068470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.626+0000 7f293245c700 1 --2- 172.21.15.8:0/1985343986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f292c0af410 0x7f292c0cb3a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.626+0000 7f293245c700 1 --2- 172.21.15.8:0/1985343986 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f292c0af7e0 0x7f292c0ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.626+0000 7f293245c700 1 -- 172.21.15.8:0/1985343986 >> 172.21.15.8:0/1985343986 conn(0x7f292c069890 msgr2=0x7f292c069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:24.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.626+0000 7f293245c700 1 -- 172.21.15.8:0/1985343986 shutdown_connections 2023-10-06T04:36:24.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.626+0000 7f293245c700 1 -- 172.21.15.8:0/1985343986 wait complete. 2023-10-06T04:36:24.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.627+0000 7f293245c700 1 Processor -- start 2023-10-06T04:36:24.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.627+0000 7f293245c700 1 -- start start 2023-10-06T04:36:24.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.628+0000 7f293245c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f292c0af410 0x7f292c14c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:24.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.628+0000 7f293245c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f292c0af7e0 0x7f292c169e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:24.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.628+0000 7f293245c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f292c0cd2f0 0x7f292c0b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:24.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.628+0000 7f293245c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292c0b0dc0 con 0x7f292c0af410 2023-10-06T04:36:24.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.628+0000 7f293245c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292c0b01b0 con 0x7f292c0cd2f0 2023-10-06T04:36:24.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.628+0000 7f293245c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f292c0b0490 con 0x7f292c0af7e0 2023-10-06T04:36:24.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.628+0000 7f292bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f292c0af410 0x7f292c14c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:24.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.628+0000 7f292bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f292c0af410 0x7f292c14c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38244/0 (socket says 172.21.15.8:38244) 2023-10-06T04:36:24.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.628+0000 7f292bfff700 1 -- 172.21.15.8:0/3583183612 learned_addr learned my addr 172.21.15.8:0/3583183612 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:24.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.628+0000 7f292b7fe700 1 --2- 172.21.15.8:0/3583183612 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f292c0af7e0 0x7f292c169e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:24.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.628+0000 7f29309f9700 1 --2- 172.21.15.8:0/3583183612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f292c0cd2f0 0x7f292c0b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:24.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.628+0000 7f292bfff700 1 -- 172.21.15.8:0/3583183612 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f292c0af7e0 msgr2=0x7f292c169e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:24.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.628+0000 7f292bfff700 1 --2- 172.21.15.8:0/3583183612 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f292c0af7e0 0x7f292c169e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.628+0000 7f292bfff700 1 -- 172.21.15.8:0/3583183612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f292c0cd2f0 msgr2=0x7f292c0b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:24.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.628+0000 7f292bfff700 1 --2- 172.21.15.8:0/3583183612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f292c0cd2f0 0x7f292c0b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.628+0000 7f292bfff700 1 -- 172.21.15.8:0/3583183612 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29200094f0 con 0x7f292c0af410 2023-10-06T04:36:24.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.629+0000 7f292bfff700 1 --2- 172.21.15.8:0/3583183612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f292c0af410 0x7f292c14c7d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f292c0891d0 tx=0x7f2920017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:24.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.629+0000 7f2913fff700 1 -- 172.21.15.8:0/3583183612 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2920024440 con 0x7f292c0af410 2023-10-06T04:36:24.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.629+0000 7f2913fff700 1 -- 172.21.15.8:0/3583183612 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29200245a0 con 0x7f292c0af410 2023-10-06T04:36:24.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.629+0000 7f293245c700 1 -- 172.21.15.8:0/3583183612 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f292c0b0770 con 0x7f292c0af410 2023-10-06T04:36:24.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.629+0000 7f2913fff700 1 -- 172.21.15.8:0/3583183612 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2920024960 con 0x7f292c0af410 2023-10-06T04:36:24.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.629+0000 7f293245c700 1 -- 172.21.15.8:0/3583183612 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f292c14cd10 con 0x7f292c0af410 2023-10-06T04:36:24.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.630+0000 7f2913fff700 1 -- 172.21.15.8:0/3583183612 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f292001a420 con 0x7f292c0af410 2023-10-06T04:36:24.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.631+0000 7f2913fff700 1 --2- 172.21.15.8:0/3583183612 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2918066f30 0x7f29180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:24.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.631+0000 7f2913fff700 1 -- 172.21.15.8:0/3583183612 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f2920086630 con 0x7f292c0af410 2023-10-06T04:36:24.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.631+0000 7f292b7fe700 1 --2- 172.21.15.8:0/3583183612 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2918066f30 0x7f29180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:24.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.631+0000 7f292b7fe700 1 --2- 172.21.15.8:0/3583183612 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2918066f30 0x7f29180693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f292c0b1e40 tx=0x7f291c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:24.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.633+0000 7f293b754b80 1 Processor -- start 2023-10-06T04:36:24.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.633+0000 7f293b754b80 1 -- start start 2023-10-06T04:36:24.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.634+0000 7f293b754b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56377c5b5a90 0x56377c5b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:24.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.634+0000 7f293b754b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56377c5719a0 0x56377c56e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:24.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.634+0000 7f293b754b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56377c56fbd0 0x56377c56eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:24.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.634+0000 7f293b754b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56377c4eec80 con 0x56377c56fbd0 2023-10-06T04:36:24.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.634+0000 7f293b754b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56377c4c5a70 con 0x56377c5b5a90 2023-10-06T04:36:24.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.634+0000 7f293b754b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x56377c4c3270 con 0x56377c5719a0 2023-10-06T04:36:24.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.634+0000 7f29309f9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56377c56fbd0 0x56377c56eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:24.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.634+0000 7f29309f9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56377c56fbd0 0x56377c56eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38250/0 (socket says 172.21.15.8:38250) 2023-10-06T04:36:24.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.634+0000 7f29309f9700 1 -- 172.21.15.8:0/2890401868 learned_addr learned my addr 172.21.15.8:0/2890401868 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:24.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.634+0000 7f292bfff700 1 --2- 172.21.15.8:0/2890401868 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56377c5b5a90 0x56377c5b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:24.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.634+0000 7f292b7fe700 1 --2- 172.21.15.8:0/2890401868 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56377c5719a0 0x56377c56e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:24.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.634+0000 7f29309f9700 1 -- 172.21.15.8:0/2890401868 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56377c5719a0 msgr2=0x56377c56e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:24.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.634+0000 7f29309f9700 1 --2- 172.21.15.8:0/2890401868 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56377c5719a0 0x56377c56e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.634+0000 7f29309f9700 1 -- 172.21.15.8:0/2890401868 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56377c5b5a90 msgr2=0x56377c5b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:24.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.634+0000 7f29309f9700 1 --2- 172.21.15.8:0/2890401868 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56377c5b5a90 0x56377c5b5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.634+0000 7f29309f9700 1 -- 172.21.15.8:0/2890401868 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56377c359270 con 0x56377c56fbd0 2023-10-06T04:36:24.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.634+0000 7f292b7fe700 1 --2- 172.21.15.8:0/2890401868 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56377c5719a0 0x56377c56e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:24.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.634+0000 7f292bfff700 1 --2- 172.21.15.8:0/2890401868 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56377c5b5a90 0x56377c5b5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:24.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.634+0000 7f29309f9700 1 --2- 172.21.15.8:0/2890401868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56377c56fbd0 0x56377c56eac0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f292400f5f0 tx=0x7f29240077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fb1abdf14517c75 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:24.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.634+0000 7f29117fa700 1 -- 172.21.15.8:0/2890401868 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292400a580 con 0x56377c56fbd0 2023-10-06T04:36:24.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.634+0000 7f29117fa700 1 -- 172.21.15.8:0/2890401868 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292400a6e0 con 0x56377c56fbd0 2023-10-06T04:36:24.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.634+0000 7f29117fa700 1 -- 172.21.15.8:0/2890401868 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292400aa60 con 0x56377c56fbd0 2023-10-06T04:36:24.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.635+0000 7f293b754b80 1 -- 172.21.15.8:0/2890401868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56377c56fbd0 msgr2=0x56377c56eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:24.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.635+0000 7f293b754b80 1 --2- 172.21.15.8:0/2890401868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56377c56fbd0 0x56377c56eac0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f292400f5f0 tx=0x7f29240077a0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.635+0000 7f293b754b80 1 -- 172.21.15.8:0/2890401868 shutdown_connections 2023-10-06T04:36:24.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.635+0000 7f293b754b80 1 --2- 172.21.15.8:0/2890401868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56377c56fbd0 0x56377c56eac0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.635+0000 7f293b754b80 1 --2- 172.21.15.8:0/2890401868 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56377c5b5a90 0x56377c5b5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.635+0000 7f293b754b80 1 --2- 172.21.15.8:0/2890401868 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56377c5719a0 0x56377c56e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.635+0000 7f293b754b80 1 -- 172.21.15.8:0/2890401868 >> 172.21.15.8:0/2890401868 conn(0x56377c570070 msgr2=0x56377c570440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:24.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.635+0000 7f293b754b80 1 -- 172.21.15.8:0/2890401868 shutdown_connections 2023-10-06T04:36:24.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.635+0000 7f293b754b80 1 -- 172.21.15.8:0/2890401868 wait complete. 2023-10-06T04:36:24.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.636+0000 7f293b754b80 1 -- start start 2023-10-06T04:36:24.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.636+0000 7f293b754b80 1 Processor -- start 2023-10-06T04:36:24.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.636+0000 7f293b754b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56377c56fbd0 0x56377c59e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:24.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.636+0000 7f293b754b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56377c5719a0 0x56377c598670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:24.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.637+0000 7f293b754b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56377c5b5a90 0x56377c5b28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:24.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.637+0000 7f293b754b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56377c4bf060 con 0x56377c5719a0 2023-10-06T04:36:24.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.637+0000 7f293b754b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56377c46a890 con 0x56377c5b5a90 2023-10-06T04:36:24.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.637+0000 7f293b754b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x56377c485ea0 con 0x56377c56fbd0 2023-10-06T04:36:24.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.637+0000 7f293b754b80 10 client.0 _ll_register_callbacks cb 0x56377c35bf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:36:24.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.637+0000 7f292b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56377c5719a0 0x56377c598670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:24.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.637+0000 7f292b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56377c5719a0 0x56377c598670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38260/0 (socket says 172.21.15.8:38260) 2023-10-06T04:36:24.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.637+0000 7f292b7fe700 1 -- 172.21.15.8:0/878720398 learned_addr learned my addr 172.21.15.8:0/878720398 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:24.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.637+0000 7f292bfff700 1 --2- 172.21.15.8:0/878720398 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56377c56fbd0 0x56377c59e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:24.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.637+0000 7f29309f9700 1 --2- 172.21.15.8:0/878720398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56377c5b5a90 0x56377c5b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:24.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.637+0000 7f292b7fe700 1 -- 172.21.15.8:0/878720398 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56377c56fbd0 msgr2=0x56377c59e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:24.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.637+0000 7f292b7fe700 1 --2- 172.21.15.8:0/878720398 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56377c56fbd0 0x56377c59e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.637+0000 7f292b7fe700 1 -- 172.21.15.8:0/878720398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56377c5b5a90 msgr2=0x56377c5b28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:24.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.637+0000 7f292b7fe700 1 --2- 172.21.15.8:0/878720398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56377c5b5a90 0x56377c5b28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.637+0000 7f292b7fe700 1 -- 172.21.15.8:0/878720398 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2924007dc0 con 0x56377c5719a0 2023-10-06T04:36:24.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.637+0000 7f292b7fe700 1 --2- 172.21.15.8:0/878720398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56377c5719a0 0x56377c598670 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f291c015b80 tx=0x7f291c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=466a52b0c30d8758 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:24.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.637+0000 7f290a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T04:36:24.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.637+0000 7f290a7fc700 1 -- 172.21.15.8:0/878720398 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291c013630 con 0x56377c5719a0 2023-10-06T04:36:24.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.637+0000 7f290a7fc700 1 -- 172.21.15.8:0/878720398 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f291c01a040 con 0x56377c5719a0 2023-10-06T04:36:24.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.637+0000 7f293b754b80 1 -- 172.21.15.8:0/878720398 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56377c563690 con 0x56377c5719a0 2023-10-06T04:36:24.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.637+0000 7f290a7fc700 1 -- 172.21.15.8:0/878720398 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f291c0139a0 con 0x56377c5719a0 2023-10-06T04:36:24.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.637+0000 7f293b754b80 10 client.4437 fetch_fsmap learned FSMap version 7 2023-10-06T04:36:24.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.637+0000 7f293b754b80 1 -- 172.21.15.8:0/878720398 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x56377c2fbfe0 con 0x56377c5719a0 2023-10-06T04:36:24.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.638+0000 7f290a7fc700 1 -- 172.21.15.8:0/878720398 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56377c563690 con 0x56377c5719a0 2023-10-06T04:36:24.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.638+0000 7f290a7fc700 1 -- 172.21.15.8:0/878720398 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 7) v1 ==== 3108+0+0 (secure 0 0 0) 0x7f291c013b00 con 0x56377c5719a0 2023-10-06T04:36:24.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.638+0000 7f293b754b80 10 client.4437 fetch_fsmap finished waiting for FSMap version 7 2023-10-06T04:36:24.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.638+0000 7f293b754b80 10 client.4437 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T04:36:24.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.638+0000 7f293b754b80 20 client.4437 populate_metadata read hostname 'smithi008' 2023-10-06T04:36:24.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.638+0000 7f293b754b80 1 --2- 172.21.15.8:0/878720398 >> [v2:172.21.15.184:6835/2590100121,v1:172.21.15.184:6837/2590100121] conn(0x56377c5b8e50 0x56377c5b9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:24.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.638+0000 7f293b754b80 4 client.4437 mds_command: new command op to 4284 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T04:36:24.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.638+0000 7f293b754b80 1 -- 172.21.15.8:0/878720398 --> [v2:172.21.15.184:6835/2590100121,v1:172.21.15.184:6837/2590100121] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56377c5405c0 con 0x56377c5b8e50 2023-10-06T04:36:24.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.638+0000 7f292bfff700 1 --2- 172.21.15.8:0/878720398 >> [v2:172.21.15.184:6835/2590100121,v1:172.21.15.184:6837/2590100121] conn(0x56377c5b8e50 0x56377c5b9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:24.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.638+0000 7f290a7fc700 10 client.4437 ms_handle_connect on v2:172.21.15.184:6835/2590100121 2023-10-06T04:36:24.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.638+0000 7f292bfff700 1 --2- 172.21.15.8:0/878720398 >> [v2:172.21.15.184:6835/2590100121,v1:172.21.15.184:6837/2590100121] conn(0x56377c5b8e50 0x56377c5b9220 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60eedb18bf2a8a41 server_cookie=6e70d843ab4bce3 in_seq=0 out_seq=0 2023-10-06T04:36:24.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.639+0000 7f290a7fc700 1 -- 172.21.15.8:0/878720398 <== mds.0 v2:172.21.15.184:6835/2590100121 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x56377c5405c0 con 0x56377c5b8e50 2023-10-06T04:36:24.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.639+0000 7f290a7fc700 10 client.4437 handle_command_reply: tid=0 2023-10-06T04:36:24.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.639+0000 7f293b754b80 1 client.4437 shutdown 2023-10-06T04:36:24.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.639+0000 7f293b754b80 1 -- 172.21.15.8:0/878720398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56377c5719a0 msgr2=0x56377c598670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:24.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.639+0000 7f293b754b80 1 --2- 172.21.15.8:0/878720398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56377c5719a0 0x56377c598670 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f291c015b80 tx=0x7f291c017000 comp rx=0 tx=0).stop 2023-10-06T04:36:24.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.639+0000 7f293b754b80 1 -- 172.21.15.8:0/878720398 shutdown_connections 2023-10-06T04:36:24.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.639+0000 7f293b754b80 1 --2- 172.21.15.8:0/878720398 >> [v2:172.21.15.184:6835/2590100121,v1:172.21.15.184:6837/2590100121] conn(0x56377c5b8e50 0x56377c5b9220 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.639+0000 7f293b754b80 1 --2- 172.21.15.8:0/878720398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56377c5b5a90 0x56377c5b28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.639+0000 7f293b754b80 1 --2- 172.21.15.8:0/878720398 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56377c56fbd0 0x56377c59e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.639+0000 7f293b754b80 1 --2- 172.21.15.8:0/878720398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56377c5719a0 0x56377c598670 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.639+0000 7f290a7fc700 0 client.4437 ms_handle_reset on v2:172.21.15.184:6835/2590100121 2023-10-06T04:36:24.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.639+0000 7f293b754b80 1 -- 172.21.15.8:0/878720398 >> 172.21.15.8:0/878720398 conn(0x56377c570070 msgr2=0x56377c56b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:24.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.639+0000 7f293b754b80 1 -- 172.21.15.8:0/878720398 shutdown_connections 2023-10-06T04:36:24.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.639+0000 7f293b754b80 1 -- 172.21.15.8:0/878720398 wait complete. 2023-10-06T04:36:24.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.640+0000 7f293b754b80 20 client.4437 trim_cache size 0 max 16384 2023-10-06T04:36:24.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.656+0000 7f293b754b80 1 Processor -- start 2023-10-06T04:36:24.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.657+0000 7f293b754b80 1 -- start start 2023-10-06T04:36:24.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.657+0000 7f293b754b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56377c56fbd0 0x56377c56af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:24.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.657+0000 7f293b754b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56377c5719a0 0x56377c56b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:24.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.657+0000 7f293b754b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56377c5b5a90 0x56377c56bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:24.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.657+0000 7f293b754b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56377c341e30 con 0x56377c56fbd0 2023-10-06T04:36:24.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.657+0000 7f293b754b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56377c563400 con 0x56377c5719a0 2023-10-06T04:36:24.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.657+0000 7f293b754b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x56377c569350 con 0x56377c5b5a90 2023-10-06T04:36:24.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.657+0000 7f292bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56377c56fbd0 0x56377c56af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:24.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.657+0000 7f292bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56377c56fbd0 0x56377c56af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38268/0 (socket says 172.21.15.8:38268) 2023-10-06T04:36:24.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.657+0000 7f292bfff700 1 -- 172.21.15.8:0/1920032092 learned_addr learned my addr 172.21.15.8:0/1920032092 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:24.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.658+0000 7f292b7fe700 1 --2- 172.21.15.8:0/1920032092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56377c5719a0 0x56377c56b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:24.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.658+0000 7f29309f9700 1 --2- 172.21.15.8:0/1920032092 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56377c5b5a90 0x56377c56bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:24.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.658+0000 7f292bfff700 1 -- 172.21.15.8:0/1920032092 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56377c5b5a90 msgr2=0x56377c56bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:24.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.658+0000 7f292bfff700 1 --2- 172.21.15.8:0/1920032092 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56377c5b5a90 0x56377c56bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.658+0000 7f292bfff700 1 -- 172.21.15.8:0/1920032092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56377c5719a0 msgr2=0x56377c56b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:24.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.658+0000 7f292bfff700 1 --2- 172.21.15.8:0/1920032092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56377c5719a0 0x56377c56b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.658+0000 7f292bfff700 1 -- 172.21.15.8:0/1920032092 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56377c48d780 con 0x56377c56fbd0 2023-10-06T04:36:24.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.658+0000 7f292bfff700 1 --2- 172.21.15.8:0/1920032092 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56377c56fbd0 0x56377c56af10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2920084790 tx=0x7f2920008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0b9be636221184 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:24.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.658+0000 7f2911ffb700 1 -- 172.21.15.8:0/1920032092 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2920057810 con 0x56377c56fbd0 2023-10-06T04:36:24.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.658+0000 7f2911ffb700 1 -- 172.21.15.8:0/1920032092 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2920057110 con 0x56377c56fbd0 2023-10-06T04:36:24.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.658+0000 7f2911ffb700 1 -- 172.21.15.8:0/1920032092 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292005a360 con 0x56377c56fbd0 2023-10-06T04:36:24.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.658+0000 7f293b754b80 1 -- 172.21.15.8:0/1920032092 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56377c56fbd0 msgr2=0x56377c56af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:24.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.658+0000 7f293b754b80 1 --2- 172.21.15.8:0/1920032092 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56377c56fbd0 0x56377c56af10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2920084790 tx=0x7f2920008040 comp rx=0 tx=0).stop 2023-10-06T04:36:24.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.659+0000 7f293b754b80 1 -- 172.21.15.8:0/1920032092 shutdown_connections 2023-10-06T04:36:24.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.659+0000 7f293b754b80 1 --2- 172.21.15.8:0/1920032092 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56377c5b5a90 0x56377c56bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.659+0000 7f293b754b80 1 --2- 172.21.15.8:0/1920032092 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56377c56fbd0 0x56377c56af10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.659+0000 7f293b754b80 1 --2- 172.21.15.8:0/1920032092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56377c5719a0 0x56377c56b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.659+0000 7f293b754b80 1 -- 172.21.15.8:0/1920032092 >> 172.21.15.8:0/1920032092 conn(0x56377c570070 msgr2=0x56377c5b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:24.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.659+0000 7f293b754b80 1 -- 172.21.15.8:0/1920032092 shutdown_connections 2023-10-06T04:36:24.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.659+0000 7f293b754b80 1 -- 172.21.15.8:0/1920032092 wait complete. 2023-10-06T04:36:24.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.659+0000 7f293b754b80 1 -- start start 2023-10-06T04:36:24.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.659+0000 7f293b754b80 1 Processor -- start 2023-10-06T04:36:24.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.660+0000 7f293b754b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56377c56fbd0 0x56377c597040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:24.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.660+0000 7f293b754b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56377c5719a0 0x56377c5b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:24.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.660+0000 7f293b754b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56377c5b5a90 0x56377c594e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:24.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.660+0000 7f293b754b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56377c5abc10 con 0x56377c5b5a90 2023-10-06T04:36:24.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.660+0000 7f293b754b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56377c597ac0 con 0x56377c56fbd0 2023-10-06T04:36:24.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.660+0000 7f293b754b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x56377c5abe00 con 0x56377c5719a0 2023-10-06T04:36:24.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.660+0000 7f293b754b80 10 client.0 _ll_register_callbacks cb 0x56377c35bf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:36:24.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.660+0000 7f29309f9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56377c5b5a90 0x56377c594e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:24.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.660+0000 7f29309f9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56377c5b5a90 0x56377c594e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38272/0 (socket says 172.21.15.8:38272) 2023-10-06T04:36:24.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.660+0000 7f29309f9700 1 -- 172.21.15.8:0/2504790252 learned_addr learned my addr 172.21.15.8:0/2504790252 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:24.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.660+0000 7f292bfff700 1 --2- 172.21.15.8:0/2504790252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56377c56fbd0 0x56377c597040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:24.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.660+0000 7f292b7fe700 1 --2- 172.21.15.8:0/2504790252 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56377c5719a0 0x56377c5b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:24.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.660+0000 7f29309f9700 1 -- 172.21.15.8:0/2504790252 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56377c5719a0 msgr2=0x56377c5b35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:24.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.660+0000 7f29309f9700 1 --2- 172.21.15.8:0/2504790252 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56377c5719a0 0x56377c5b35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.660+0000 7f29309f9700 1 -- 172.21.15.8:0/2504790252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56377c56fbd0 msgr2=0x56377c597040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:24.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.660+0000 7f29309f9700 1 --2- 172.21.15.8:0/2504790252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56377c56fbd0 0x56377c597040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.660+0000 7f29309f9700 1 -- 172.21.15.8:0/2504790252 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f292c14cd10 con 0x56377c5b5a90 2023-10-06T04:36:24.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.660+0000 7f292b7fe700 1 --2- 172.21.15.8:0/2504790252 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56377c5719a0 0x56377c5b35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:24.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.661+0000 7f29309f9700 1 --2- 172.21.15.8:0/2504790252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56377c5b5a90 0x56377c594e20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x56377c571ef0 tx=0x7f292401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81026f2509965f92 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:24.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.661+0000 7f290a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T04:36:24.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.661+0000 7f290a7fc700 1 -- 172.21.15.8:0/2504790252 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29240032f0 con 0x56377c5b5a90 2023-10-06T04:36:24.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.661+0000 7f293b754b80 1 -- 172.21.15.8:0/2504790252 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f292400a6e0 con 0x56377c5b5a90 2023-10-06T04:36:24.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.661+0000 7f290a7fc700 1 -- 172.21.15.8:0/2504790252 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f2924007bd0 con 0x56377c5b5a90 2023-10-06T04:36:24.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.661+0000 7f290a7fc700 1 -- 172.21.15.8:0/2504790252 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f292400ae90 con 0x56377c5b5a90 2023-10-06T04:36:24.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.661+0000 7f293b754b80 10 client.4443 fetch_fsmap learned FSMap version 7 2023-10-06T04:36:24.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.661+0000 7f293b754b80 1 -- 172.21.15.8:0/2504790252 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x56377c474470 con 0x56377c5b5a90 2023-10-06T04:36:24.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.661+0000 7f290a7fc700 1 -- 172.21.15.8:0/2504790252 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292400a6e0 con 0x56377c5b5a90 2023-10-06T04:36:24.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.661+0000 7f290a7fc700 1 -- 172.21.15.8:0/2504790252 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 7) v1 ==== 3108+0+0 (secure 0 0 0) 0x7f2924017830 con 0x56377c5b5a90 2023-10-06T04:36:24.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.661+0000 7f293b754b80 10 client.4443 fetch_fsmap finished waiting for FSMap version 7 2023-10-06T04:36:24.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.661+0000 7f293b754b80 10 client.4443 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T04:36:24.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.661+0000 7f293b754b80 20 client.4443 populate_metadata read hostname 'smithi008' 2023-10-06T04:36:24.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.661+0000 7f293b754b80 1 --2- 172.21.15.8:0/2504790252 >> [v2:172.21.15.184:6835/2590100121,v1:172.21.15.184:6837/2590100121] conn(0x56377c5ae9e0 0x56377c595360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:24.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.661+0000 7f293b754b80 4 client.4443 mds_command: new command op to 4284 tid=0[{"prefix": "status"}] 2023-10-06T04:36:24.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.661+0000 7f293b754b80 1 -- 172.21.15.8:0/2504790252 --> [v2:172.21.15.184:6835/2590100121,v1:172.21.15.184:6837/2590100121] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56377c461e00 con 0x56377c5ae9e0 2023-10-06T04:36:24.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.661+0000 7f292bfff700 1 --2- 172.21.15.8:0/2504790252 >> [v2:172.21.15.184:6835/2590100121,v1:172.21.15.184:6837/2590100121] conn(0x56377c5ae9e0 0x56377c595360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:24.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.662+0000 7f290a7fc700 10 client.4443 ms_handle_connect on v2:172.21.15.184:6835/2590100121 2023-10-06T04:36:24.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.662+0000 7f292bfff700 1 --2- 172.21.15.8:0/2504790252 >> [v2:172.21.15.184:6835/2590100121,v1:172.21.15.184:6837/2590100121] conn(0x56377c5ae9e0 0x56377c595360 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=341652047a6cbb87 server_cookie=f5de2d13c34e121e in_seq=0 out_seq=0 2023-10-06T04:36:24.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.662+0000 7f290a7fc700 1 -- 172.21.15.8:0/2504790252 <== mds.0 v2:172.21.15.184:6835/2590100121 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x56377c461e00 con 0x56377c5ae9e0 2023-10-06T04:36:24.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.662+0000 7f290a7fc700 10 client.4443 handle_command_reply: tid=0 2023-10-06T04:36:24.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.662+0000 7f293b754b80 1 client.4443 shutdown 2023-10-06T04:36:24.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.662+0000 7f293b754b80 1 -- 172.21.15.8:0/2504790252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56377c5b5a90 msgr2=0x56377c594e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:24.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.662+0000 7f293b754b80 1 --2- 172.21.15.8:0/2504790252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56377c5b5a90 0x56377c594e20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x56377c571ef0 tx=0x7f292401a000 comp rx=0 tx=0).stop 2023-10-06T04:36:24.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.662+0000 7f293b754b80 1 -- 172.21.15.8:0/2504790252 shutdown_connections 2023-10-06T04:36:24.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.662+0000 7f293b754b80 1 --2- 172.21.15.8:0/2504790252 >> [v2:172.21.15.184:6835/2590100121,v1:172.21.15.184:6837/2590100121] conn(0x56377c5ae9e0 0x56377c595360 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.662+0000 7f293b754b80 1 --2- 172.21.15.8:0/2504790252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56377c5b5a90 0x56377c594e20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.662+0000 7f293b754b80 1 --2- 172.21.15.8:0/2504790252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56377c56fbd0 0x56377c597040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.662+0000 7f290a7fc700 0 client.4443 ms_handle_reset on v2:172.21.15.184:6835/2590100121 2023-10-06T04:36:24.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.662+0000 7f293b754b80 1 --2- 172.21.15.8:0/2504790252 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56377c5719a0 0x56377c5b35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.662+0000 7f293b754b80 1 -- 172.21.15.8:0/2504790252 >> 172.21.15.8:0/2504790252 conn(0x56377c570070 msgr2=0x56377c5b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:24.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.662+0000 7f293b754b80 1 -- 172.21.15.8:0/2504790252 shutdown_connections 2023-10-06T04:36:24.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.662+0000 7f293b754b80 1 -- 172.21.15.8:0/2504790252 wait complete. 2023-10-06T04:36:24.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.662+0000 7f293b754b80 20 client.4443 trim_cache size 0 max 16384 2023-10-06T04:36:24.673 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T04:36:24.674 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "c030d94d-df8f-49bb-8df7-07e9e557d96b", 2023-10-06T04:36:24.674 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 0, 2023-10-06T04:36:24.674 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 4284, 2023-10-06T04:36:24.674 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-10-06T04:36:24.674 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-10-06T04:36:24.674 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-10-06T04:36:24.674 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 7.4180584639999996, 2023-10-06T04:36:24.674 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 7, 2023-10-06T04:36:24.674 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 25, 2023-10-06T04:36:24.674 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 24, 2023-10-06T04:36:24.674 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 13.379655494 2023-10-06T04:36:24.675 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T04:36:24.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.663+0000 7f293245c700 1 -- 172.21.15.8:0/3583183612 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2918066f30 msgr2=0x7f29180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:24.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.663+0000 7f293245c700 1 --2- 172.21.15.8:0/3583183612 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2918066f30 0x7f29180693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f292c0b1e40 tx=0x7f291c008040 comp rx=0 tx=0).stop 2023-10-06T04:36:24.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.663+0000 7f293245c700 1 -- 172.21.15.8:0/3583183612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f292c0af410 msgr2=0x7f292c14c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:24.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.663+0000 7f293245c700 1 --2- 172.21.15.8:0/3583183612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f292c0af410 0x7f292c14c7d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f292c0891d0 tx=0x7f2920017000 comp rx=0 tx=0).stop 2023-10-06T04:36:24.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.663+0000 7f293245c700 1 -- 172.21.15.8:0/3583183612 shutdown_connections 2023-10-06T04:36:24.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.663+0000 7f293245c700 1 --2- 172.21.15.8:0/3583183612 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2918066f30 0x7f29180693e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.663+0000 7f293245c700 1 --2- 172.21.15.8:0/3583183612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f292c0cd2f0 0x7f292c0b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.663+0000 7f293245c700 1 --2- 172.21.15.8:0/3583183612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f292c0af410 0x7f292c14c7d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.663+0000 7f293245c700 1 --2- 172.21.15.8:0/3583183612 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f292c0af7e0 0x7f292c169e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.663+0000 7f293245c700 1 -- 172.21.15.8:0/3583183612 >> 172.21.15.8:0/3583183612 conn(0x7f292c069890 msgr2=0x7f292c0c63d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:24.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.663+0000 7f293245c700 1 -- 172.21.15.8:0/3583183612 shutdown_connections 2023-10-06T04:36:24.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.663+0000 7f293245c700 1 -- 172.21.15.8:0/3583183612 wait complete. 2023-10-06T04:36:24.678 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:36:24.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.795+0000 7f449ae3c700 1 Processor -- start 2023-10-06T04:36:24.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.795+0000 7f449ae3c700 1 -- start start 2023-10-06T04:36:24.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.796+0000 7f449ae3c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44940c7630 0x7f44940c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:24.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.796+0000 7f449ae3c700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44940c7fb0 con 0x7f44940c99a0 2023-10-06T04:36:24.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.796+0000 7f449ae3c700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4494157540 con 0x7f4494157170 2023-10-06T04:36:24.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.796+0000 7f449ae3c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44940c9e20 con 0x7f44940c7630 2023-10-06T04:36:24.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.796+0000 7f448bfff700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f44940c99a0 0x7f449415a4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34510/0 (socket says 172.21.15.8:34510) 2023-10-06T04:36:24.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.796+0000 7f448bfff700 1 -- 172.21.15.8:0/1228503596 learned_addr learned my addr 172.21.15.8:0/1228503596 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:24.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.796+0000 7f44993d9700 1 --2- 172.21.15.8:0/1228503596 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44940c7630 0x7f44940c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:24.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.796+0000 7f448b7fe700 1 -- 172.21.15.8:0/1228503596 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2849042008 0 0) 0x7f44940c7fb0 con 0x7f44940c99a0 2023-10-06T04:36:24.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.796+0000 7f448b7fe700 1 -- 172.21.15.8:0/1228503596 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f447c003570 con 0x7f44940c99a0 2023-10-06T04:36:24.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.796+0000 7f448b7fe700 1 -- 172.21.15.8:0/1228503596 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2667604170 0 0) 0x7f447c003570 con 0x7f44940c99a0 2023-10-06T04:36:24.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.796+0000 7f448b7fe700 1 -- 172.21.15.8:0/1228503596 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44940c7630 msgr2=0x7f44940c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:24.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.796+0000 7f448b7fe700 1 --2- 172.21.15.8:0/1228503596 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44940c7630 0x7f44940c7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.796+0000 7f448b7fe700 1 -- 172.21.15.8:0/1228503596 >> v1:172.21.15.184:6789/0 conn(0x7f4494157170 legacy=0x7f449415da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:24.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.796+0000 7f448b7fe700 1 -- 172.21.15.8:0/1228503596 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44940ca030 con 0x7f44940c99a0 2023-10-06T04:36:24.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.796+0000 7f448b7fe700 1 -- 172.21.15.8:0/1228503596 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7f4484001470 con 0x7f44940c99a0 2023-10-06T04:36:24.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.796+0000 7f448b7fe700 1 -- 172.21.15.8:0/1228503596 >> v1:172.21.15.8:6789/0 conn(0x7f44940c99a0 legacy=0x7f449415a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:24.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.796+0000 7f448b7fe700 1 --2- 172.21.15.8:0/1228503596 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f447c003a90 0x7f447c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:24.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.796+0000 7f448b7fe700 1 --2- 172.21.15.8:0/1228503596 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44940c7630 0x7f447c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:24.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.796+0000 7f448b7fe700 1 --2- 172.21.15.8:0/1228503596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f447c004d50 0x7f447c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:24.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.796+0000 7f448b7fe700 1 -- 172.21.15.8:0/1228503596 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44940c9e20 con 0x7f447c004d50 2023-10-06T04:36:24.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.796+0000 7f448b7fe700 1 -- 172.21.15.8:0/1228503596 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447c00bb70 con 0x7f447c003a90 2023-10-06T04:36:24.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.796+0000 7f448b7fe700 1 -- 172.21.15.8:0/1228503596 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f447c00bd30 con 0x7f44940c7630 2023-10-06T04:36:24.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.796+0000 7f44993d9700 1 --2- 172.21.15.8:0/1228503596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f447c004d50 0x7f447c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:24.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.796+0000 7f4498bd8700 1 --2- 172.21.15.8:0/1228503596 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f447c003a90 0x7f447c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:24.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.797+0000 7f448bfff700 1 --2- 172.21.15.8:0/1228503596 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44940c7630 0x7f447c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:24.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.797+0000 7f44993d9700 1 -- 172.21.15.8:0/1228503596 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44940c7630 msgr2=0x7f447c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:24.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.797+0000 7f44993d9700 1 --2- 172.21.15.8:0/1228503596 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44940c7630 0x7f447c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.797+0000 7f44993d9700 1 -- 172.21.15.8:0/1228503596 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f447c003a90 msgr2=0x7f447c003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:24.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.797+0000 7f44993d9700 1 --2- 172.21.15.8:0/1228503596 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f447c003a90 0x7f447c003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.797+0000 7f44993d9700 1 -- 172.21.15.8:0/1228503596 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f447c003570 con 0x7f447c004d50 2023-10-06T04:36:24.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.797+0000 7f44993d9700 1 --2- 172.21.15.8:0/1228503596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f447c004d50 0x7f447c0051c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f448c009c00 tx=0x7f448c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f126b02082fd05 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:24.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.797+0000 7f448b7fe700 1 -- 172.21.15.8:0/1228503596 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c00e710 con 0x7f447c004d50 2023-10-06T04:36:24.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.797+0000 7f448b7fe700 1 -- 172.21.15.8:0/1228503596 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448c00e870 con 0x7f447c004d50 2023-10-06T04:36:24.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.797+0000 7f448b7fe700 1 -- 172.21.15.8:0/1228503596 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c00ec30 con 0x7f447c004d50 2023-10-06T04:36:24.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.798+0000 7f449ae3c700 1 -- 172.21.15.8:0/1228503596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f447c004d50 msgr2=0x7f447c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:24.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.798+0000 7f449ae3c700 1 --2- 172.21.15.8:0/1228503596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f447c004d50 0x7f447c0051c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f448c009c00 tx=0x7f448c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.798+0000 7f44993d9700 1 -- 172.21.15.8:0/1228503596 reap_dead start 2023-10-06T04:36:24.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.798+0000 7f449ae3c700 1 -- 172.21.15.8:0/1228503596 shutdown_connections 2023-10-06T04:36:24.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.798+0000 7f449ae3c700 1 -- 172.21.15.8:0/1228503596 >> 172.21.15.8:0/1228503596 conn(0x7f44940686e0 msgr2=0x7f4494068ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:24.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.798+0000 7f449ae3c700 1 -- 172.21.15.8:0/1228503596 shutdown_connections 2023-10-06T04:36:24.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.798+0000 7f449ae3c700 1 -- 172.21.15.8:0/1228503596 wait complete. 2023-10-06T04:36:24.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.799+0000 7f449ae3c700 1 Processor -- start 2023-10-06T04:36:24.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.799+0000 7f449ae3c700 1 -- start start 2023-10-06T04:36:24.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.800+0000 7f449ae3c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f449414d640 0x7f44940c0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:24.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.800+0000 7f449ae3c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4494155590 0x7f449406eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:24.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.800+0000 7f449ae3c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f449406f0c0 0x7f44941515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:24.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.800+0000 7f449ae3c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449406f530 con 0x7f449414d640 2023-10-06T04:36:24.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.800+0000 7f449ae3c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44941531b0 con 0x7f4494155590 2023-10-06T04:36:24.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.800+0000 7f449ae3c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4494152880 con 0x7f449406f0c0 2023-10-06T04:36:24.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.800+0000 7f4498bd8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f449414d640 0x7f44940c0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:24.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.800+0000 7f4498bd8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f449414d640 0x7f44940c0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38292/0 (socket says 172.21.15.8:38292) 2023-10-06T04:36:24.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.800+0000 7f4498bd8700 1 -- 172.21.15.8:0/2018001131 learned_addr learned my addr 172.21.15.8:0/2018001131 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:24.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.800+0000 7f448bfff700 1 --2- 172.21.15.8:0/2018001131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4494155590 0x7f449406eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:24.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.800+0000 7f44993d9700 1 --2- 172.21.15.8:0/2018001131 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f449406f0c0 0x7f44941515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:24.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.800+0000 7f4498bd8700 1 -- 172.21.15.8:0/2018001131 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f449406f0c0 msgr2=0x7f44941515c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:24.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.800+0000 7f4498bd8700 1 --2- 172.21.15.8:0/2018001131 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f449406f0c0 0x7f44941515c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.800+0000 7f4498bd8700 1 -- 172.21.15.8:0/2018001131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4494155590 msgr2=0x7f449406eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:24.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.800+0000 7f4498bd8700 1 --2- 172.21.15.8:0/2018001131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4494155590 0x7f449406eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:24.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.800+0000 7f4498bd8700 1 -- 172.21.15.8:0/2018001131 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4494152b60 con 0x7f449414d640 2023-10-06T04:36:24.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.800+0000 7f448bfff700 1 --2- 172.21.15.8:0/2018001131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4494155590 0x7f449406eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:24.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.800+0000 7f4498bd8700 1 --2- 172.21.15.8:0/2018001131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f449414d640 0x7f44940c0af0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f449000ebc0 tx=0x7f4490001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:24.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.800+0000 7f4488ff9700 1 -- 172.21.15.8:0/2018001131 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449000c8e0 con 0x7f449414d640 2023-10-06T04:36:24.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.800+0000 7f4488ff9700 1 -- 172.21.15.8:0/2018001131 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449000ca40 con 0x7f449414d640 2023-10-06T04:36:24.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.800+0000 7f449ae3c700 1 -- 172.21.15.8:0/2018001131 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4494152e40 con 0x7f449414d640 2023-10-06T04:36:24.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.800+0000 7f4488ff9700 1 -- 172.21.15.8:0/2018001131 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449000ce00 con 0x7f449414d640 2023-10-06T04:36:24.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.800+0000 7f449ae3c700 1 -- 172.21.15.8:0/2018001131 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44940c11b0 con 0x7f449414d640 2023-10-06T04:36:24.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.801+0000 7f449ae3c700 1 -- 172.21.15.8:0/2018001131 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4494071550 con 0x7f449414d640 2023-10-06T04:36:24.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.802+0000 7f4488ff9700 1 -- 172.21.15.8:0/2018001131 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4490015640 con 0x7f449414d640 2023-10-06T04:36:24.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.802+0000 7f4488ff9700 1 --2- 172.21.15.8:0/2018001131 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4480066f30 0x7f44800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:24.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.802+0000 7f4488ff9700 1 -- 172.21.15.8:0/2018001131 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f44900850f0 con 0x7f449414d640 2023-10-06T04:36:24.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.802+0000 7f448bfff700 1 --2- 172.21.15.8:0/2018001131 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4480066f30 0x7f44800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:24.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.803+0000 7f448bfff700 1 --2- 172.21.15.8:0/2018001131 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4480066f30 0x7f44800693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f44840015a0 tx=0x7f4484006040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:24.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:24.807+0000 7f4488ff9700 1 -- 172.21.15.8:0/2018001131 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4490051f10 con 0x7f449414d640 2023-10-06T04:36:24.933 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:36:24.936 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:36:25.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:25.045+0000 7f449ae3c700 1 -- 172.21.15.8:0/2018001131 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4494153490 con 0x7f449414d640 2023-10-06T04:36:25.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:25.046+0000 7f4488ff9700 1 -- 172.21.15.8:0/2018001131 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f4490055530 con 0x7f449414d640 2023-10-06T04:36:25.049 INFO:teuthology.orchestra.run.smithi008.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T04:36:25.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:25.048+0000 7f449ae3c700 1 -- 172.21.15.8:0/2018001131 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4480066f30 msgr2=0x7f44800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:25.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:25.048+0000 7f449ae3c700 1 --2- 172.21.15.8:0/2018001131 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4480066f30 0x7f44800693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f44840015a0 tx=0x7f4484006040 comp rx=0 tx=0).stop 2023-10-06T04:36:25.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:25.048+0000 7f449ae3c700 1 -- 172.21.15.8:0/2018001131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f449414d640 msgr2=0x7f44940c0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:25.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:25.048+0000 7f449ae3c700 1 --2- 172.21.15.8:0/2018001131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f449414d640 0x7f44940c0af0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f449000ebc0 tx=0x7f4490001670 comp rx=0 tx=0).stop 2023-10-06T04:36:25.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:25.048+0000 7f449ae3c700 1 -- 172.21.15.8:0/2018001131 shutdown_connections 2023-10-06T04:36:25.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:25.048+0000 7f449ae3c700 1 --2- 172.21.15.8:0/2018001131 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4480066f30 0x7f44800693e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:25.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:25.048+0000 7f449ae3c700 1 --2- 172.21.15.8:0/2018001131 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f449406f0c0 0x7f44941515c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:25.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:25.048+0000 7f449ae3c700 1 --2- 172.21.15.8:0/2018001131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f449414d640 0x7f44940c0af0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:25.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:25.048+0000 7f449ae3c700 1 --2- 172.21.15.8:0/2018001131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4494155590 0x7f449406eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:25.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:25.048+0000 7f449ae3c700 1 -- 172.21.15.8:0/2018001131 >> 172.21.15.8:0/2018001131 conn(0x7f44940686e0 msgr2=0x7f449415c570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:25.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:25.048+0000 7f449ae3c700 1 -- 172.21.15.8:0/2018001131 shutdown_connections 2023-10-06T04:36:25.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:25.048+0000 7f449ae3c700 1 -- 172.21.15.8:0/2018001131 wait complete. 2023-10-06T04:36:25.063 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T04:36:25.063 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:36:25.063 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi008.front.sepia.ceph.com 2023-10-06T04:36:25.063 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-10-06T04:36:25.063 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-06T04:36:25.063 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T04:36:25.063 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T04:36:25.063 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:36:25.064 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-10-06T04:36:25.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:25.064 DEBUG:teuthology.orchestra.run.smithi008:> ip addr 2023-10-06T04:36:25.079 INFO:teuthology.orchestra.run.smithi008.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:36:25.080 INFO:teuthology.orchestra.run.smithi008.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:36:25.080 INFO:teuthology.orchestra.run.smithi008.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:36:25.080 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:25.080 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 ::1/128 scope host 2023-10-06T04:36:25.080 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:25.080 INFO:teuthology.orchestra.run.smithi008.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:36:25.080 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2e brd ff:ff:ff:ff:ff:ff 2023-10-06T04:36:25.080 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f0 2023-10-06T04:36:25.081 INFO:teuthology.orchestra.run.smithi008.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:36:25.081 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2f brd ff:ff:ff:ff:ff:ff 2023-10-06T04:36:25.081 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f1 2023-10-06T04:36:25.081 INFO:teuthology.orchestra.run.smithi008.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:36:25.081 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:fe brd ff:ff:ff:ff:ff:ff 2023-10-06T04:36:25.081 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f0 2023-10-06T04:36:25.081 INFO:teuthology.orchestra.run.smithi008.stdout: inet 172.21.15.8/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T04:36:25.081 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft 42495sec preferred_lft 42495sec 2023-10-06T04:36:25.082 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::ae1f:6bff:fef8:25fe/64 scope link 2023-10-06T04:36:25.082 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:25.082 INFO:teuthology.orchestra.run.smithi008.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:36:25.082 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:ff brd ff:ff:ff:ff:ff:ff 2023-10-06T04:36:25.082 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f1 2023-10-06T04:36:25.082 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T04:36:25.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:25.083 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-10-06T04:36:25.083 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-10-06T04:36:25.083 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link add name ceph-brx type bridge 2023-10-06T04:36:25.083 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip addr flush dev ceph-brx 2023-10-06T04:36:25.083 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set ceph-brx up 2023-10-06T04:36:25.083 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T04:36:25.083 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-10-06T04:36:25.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:25.249 DEBUG:teuthology.orchestra.run.smithi008:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:36:25.295 INFO:teuthology.orchestra.run.smithi008.stdout:1 2023-10-06T04:36:25.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:25.297 DEBUG:teuthology.orchestra.run.smithi008:> route 2023-10-06T04:36:25.326 INFO:teuthology.orchestra.run.smithi008.stdout:Kernel IP routing table 2023-10-06T04:36:25.327 INFO:teuthology.orchestra.run.smithi008.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:36:25.327 INFO:teuthology.orchestra.run.smithi008.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T04:36:25.327 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T04:36:25.327 INFO:teuthology.orchestra.run.smithi008.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:36:25.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:25.328 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-10-06T04:36:25.328 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-10-06T04:36:25.328 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T04:36:25.328 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T04:36:25.328 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T04:36:25.328 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-10-06T04:36:25.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:25.595 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2023-10-06T04:36:25.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:25.611 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list-id 2023-10-06T04:36:25.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:25.665 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-10-06T04:36:25.665 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-10-06T04:36:25.665 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-06T04:36:25.665 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-10-06T04:36:25.666 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-10-06T04:36:25.756 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-10-06T04:36:25.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:25.757 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-10-06T04:36:25.757 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-10-06T04:36:25.757 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-10-06T04:36:25.757 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T04:36:25.757 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-10-06T04:36:25.757 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-10-06T04:36:25.757 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-10-06T04:36:25.757 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-10-06T04:36:25.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:25.946 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-10-06T04:36:25.946 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-10-06T04:36:25.946 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set brx.0 up 2023-10-06T04:36:25.946 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T04:36:25.946 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-10-06T04:36:26.039 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-10-06T04:36:26.040 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:36:26.040 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-10-06T04:36:26.055 INFO:teuthology.orchestra.run.smithi008.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-10-06T04:36:26.055 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:36:26.055 DEBUG:teuthology.orchestra.run.smithi008:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-10-06T04:36:26.110 DEBUG:teuthology.orchestra.run.smithi008:> sudo modprobe fuse 2023-10-06T04:36:26.176 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T04:36:26.176 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T04:36:26.241 INFO:teuthology.orchestra.run.smithi008.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T04:36:26.242 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T04:36:26.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:36:26.243 DEBUG:teuthology.orchestra.run.smithi008:> ls /sys/fs/fuse/connections 2023-10-06T04:36:26.299 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T04:36:26.299 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-10-06T04:36:26.342 DEBUG:teuthology.orchestra.run.smithi008:> sudo modprobe fuse 2023-10-06T04:36:26.366 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T04:36:26.367 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T04:36:26.433 INFO:teuthology.orchestra.run.smithi008.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T04:36:26.434 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T04:36:26.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:36:26.435 DEBUG:teuthology.orchestra.run.smithi008:> ls /sys/fs/fuse/connections 2023-10-06T04:36:26.436 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi008.stderr:2023-10-06T04:36:26.432+0000 7fdc7093a540 -1 init, newargv = 0x556f0971a570 newargc=15 2023-10-06T04:36:26.436 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi008.stderr:ceph-fuse[97758]: starting ceph client 2023-10-06T04:36:26.441 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi008.stderr:ceph-fuse[97758]: starting fuse 2023-10-06T04:36:26.455 INFO:teuthology.orchestra.run.smithi008.stdout:46 2023-10-06T04:36:26.455 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T04:36:26.456 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:36:26.456 DEBUG:teuthology.orchestra.run.smithi008:> import glob 2023-10-06T04:36:26.456 DEBUG:teuthology.orchestra.run.smithi008:> import re 2023-10-06T04:36:26.456 DEBUG:teuthology.orchestra.run.smithi008:> import os 2023-10-06T04:36:26.456 DEBUG:teuthology.orchestra.run.smithi008:> import subprocess 2023-10-06T04:36:26.456 DEBUG:teuthology.orchestra.run.smithi008:> 2023-10-06T04:36:26.456 DEBUG:teuthology.orchestra.run.smithi008:> def _find_admin_socket(client_name): 2023-10-06T04:36:26.456 DEBUG:teuthology.orchestra.run.smithi008:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-10-06T04:36:26.457 DEBUG:teuthology.orchestra.run.smithi008:> files = glob.glob(asok_path) 2023-10-06T04:36:26.457 DEBUG:teuthology.orchestra.run.smithi008:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-10-06T04:36:26.457 DEBUG:teuthology.orchestra.run.smithi008:> 2023-10-06T04:36:26.457 DEBUG:teuthology.orchestra.run.smithi008:> # Given a non-glob path, it better be there 2023-10-06T04:36:26.457 DEBUG:teuthology.orchestra.run.smithi008:> if "*" not in asok_path: 2023-10-06T04:36:26.457 DEBUG:teuthology.orchestra.run.smithi008:> assert(len(files) == 1) 2023-10-06T04:36:26.457 DEBUG:teuthology.orchestra.run.smithi008:> return files[0] 2023-10-06T04:36:26.457 DEBUG:teuthology.orchestra.run.smithi008:> 2023-10-06T04:36:26.457 DEBUG:teuthology.orchestra.run.smithi008:> for f in files: 2023-10-06T04:36:26.458 DEBUG:teuthology.orchestra.run.smithi008:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T04:36:26.458 DEBUG:teuthology.orchestra.run.smithi008:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T04:36:26.458 DEBUG:teuthology.orchestra.run.smithi008:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T04:36:26.458 DEBUG:teuthology.orchestra.run.smithi008:> contents = proc_f.read() 2023-10-06T04:36:26.458 DEBUG:teuthology.orchestra.run.smithi008:> if mountpoint in contents: 2023-10-06T04:36:26.458 DEBUG:teuthology.orchestra.run.smithi008:> return f 2023-10-06T04:36:26.458 DEBUG:teuthology.orchestra.run.smithi008:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T04:36:26.458 DEBUG:teuthology.orchestra.run.smithi008:> 2023-10-06T04:36:26.458 DEBUG:teuthology.orchestra.run.smithi008:> print(_find_admin_socket("client.admin")) 2023-10-06T04:36:26.458 DEBUG:teuthology.orchestra.run.smithi008:> ' 2023-10-06T04:36:26.578 INFO:teuthology.orchestra.run.smithi008.stdout:/var/run/ceph/ceph-client.admin.97758.asok 2023-10-06T04:36:26.760 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.97758.asok 2023-10-06T04:36:26.760 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:36:26.760 DEBUG:teuthology.orchestra.run.smithi008:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.97758.asok status 2023-10-06T04:36:26.915 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T04:36:26.915 INFO:teuthology.orchestra.run.smithi008.stdout: "metadata": { 2023-10-06T04:36:26.916 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T04:36:26.916 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T04:36:26.916 INFO:teuthology.orchestra.run.smithi008.stdout: "entity_id": "admin", 2023-10-06T04:36:26.916 INFO:teuthology.orchestra.run.smithi008.stdout: "hostname": "smithi008", 2023-10-06T04:36:26.916 INFO:teuthology.orchestra.run.smithi008.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-10-06T04:36:26.916 INFO:teuthology.orchestra.run.smithi008.stdout: "pid": "97758", 2023-10-06T04:36:26.916 INFO:teuthology.orchestra.run.smithi008.stdout: "root": "/" 2023-10-06T04:36:26.916 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T04:36:26.916 INFO:teuthology.orchestra.run.smithi008.stdout: "dentry_count": 0, 2023-10-06T04:36:26.916 INFO:teuthology.orchestra.run.smithi008.stdout: "dentry_pinned_count": 0, 2023-10-06T04:36:26.916 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 4455, 2023-10-06T04:36:26.917 INFO:teuthology.orchestra.run.smithi008.stdout: "inst": { 2023-10-06T04:36:26.917 INFO:teuthology.orchestra.run.smithi008.stdout: "name": { 2023-10-06T04:36:26.917 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "client", 2023-10-06T04:36:26.917 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4455 2023-10-06T04:36:26.917 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T04:36:26.917 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": { 2023-10-06T04:36:26.917 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2023-10-06T04:36:26.917 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "192.168.0.1:0", 2023-10-06T04:36:26.917 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 2999816218 2023-10-06T04:36:26.917 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T04:36:26.917 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T04:36:26.917 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": { 2023-10-06T04:36:26.918 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2023-10-06T04:36:26.918 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "192.168.0.1:0", 2023-10-06T04:36:26.918 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 2999816218 2023-10-06T04:36:26.918 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T04:36:26.918 INFO:teuthology.orchestra.run.smithi008.stdout: "inst_str": "client.4455 192.168.0.1:0/2999816218", 2023-10-06T04:36:26.918 INFO:teuthology.orchestra.run.smithi008.stdout: "addr_str": "192.168.0.1:0/2999816218", 2023-10-06T04:36:26.918 INFO:teuthology.orchestra.run.smithi008.stdout: "inode_count": 1, 2023-10-06T04:36:26.918 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_epoch": 7, 2023-10-06T04:36:26.918 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_epoch": 25, 2023-10-06T04:36:26.918 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_epoch_barrier": 0, 2023-10-06T04:36:26.918 INFO:teuthology.orchestra.run.smithi008.stdout: "blocklisted": false, 2023-10-06T04:36:26.918 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs" 2023-10-06T04:36:26.919 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T04:36:26.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:36:26.925 DEBUG:teuthology.orchestra.run.smithi008:> stat --file-system '--printf=%T 2023-10-06T04:36:26.925 DEBUG:teuthology.orchestra.run.smithi008:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-10-06T04:36:26.941 INFO:teuthology.orchestra.run.smithi008.stdout:fuseblk 2023-10-06T04:36:26.941 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-10-06T04:36:26.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:36:26.941 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-10-06T04:36:27.007 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:36:27.007 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-10-06T04:36:27.103 INFO:teuthology.orchestra.run.smithi008.stdout:# file: . 2023-10-06T04:36:27.103 INFO:teuthology.orchestra.run.smithi008.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-10-06T04:36:27.103 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:36:27.104 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi008.front.sepia.ceph.com... 2023-10-06T04:36:27.104 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:36:27.104 DEBUG:teuthology.orchestra.run.smithi008:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-10-06T04:36:27.142 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi008.stderr:ceph-fuse[97758]: fuse finished with error 0 and tester_r 0 2023-10-06T04:36:27.143 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T04:36:27.225 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi008.front.sepia.ceph.com 2023-10-06T04:36:27.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:27.226 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-10-06T04:36:27.241 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:36:27.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.397+0000 7fdacb964700 1 Processor -- start 2023-10-06T04:36:27.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.398+0000 7fdacb964700 1 -- start start 2023-10-06T04:36:27.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.398+0000 7fdacb964700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fdac406c430 0x7fdac40aee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:27.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.398+0000 7fdacb964700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac40aa390 con 0x7fdac406c060 2023-10-06T04:36:27.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.398+0000 7fdacb964700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac40a9a60 con 0x7fdac415ce10 2023-10-06T04:36:27.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.398+0000 7fdacb964700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac40ae350 con 0x7fdac406c430 2023-10-06T04:36:27.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.399+0000 7fdac9700700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fdac406c060 0x7fdac415c700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34516/0 (socket says 172.21.15.8:34516) 2023-10-06T04:36:27.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.399+0000 7fdac9700700 1 -- 172.21.15.8:0/2821578994 learned_addr learned my addr 172.21.15.8:0/2821578994 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:27.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.399+0000 7fdac9f01700 1 --2- 172.21.15.8:0/2821578994 >> v2:172.21.15.184:3300/0 conn(0x7fdac406c430 0x7fdac40aee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:27.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.399+0000 7fdac3fff700 1 -- 172.21.15.8:0/2821578994 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3962443488 0 0) 0x7fdac40aa390 con 0x7fdac406c060 2023-10-06T04:36:27.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.399+0000 7fdac3fff700 1 -- 172.21.15.8:0/2821578994 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdaac003570 con 0x7fdac406c060 2023-10-06T04:36:27.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.399+0000 7fdac3fff700 1 -- 172.21.15.8:0/2821578994 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1939996495 0 0) 0x7fdaac003570 con 0x7fdac406c060 2023-10-06T04:36:27.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.399+0000 7fdac3fff700 1 -- 172.21.15.8:0/2821578994 >> v2:172.21.15.184:3300/0 conn(0x7fdac406c430 msgr2=0x7fdac40aee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:27.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.399+0000 7fdac3fff700 1 --2- 172.21.15.8:0/2821578994 >> v2:172.21.15.184:3300/0 conn(0x7fdac406c430 0x7fdac40aee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:27.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.399+0000 7fdac3fff700 1 -- 172.21.15.8:0/2821578994 >> v1:172.21.15.184:6789/0 conn(0x7fdac415ce10 legacy=0x7fdac40aa820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:27.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.399+0000 7fdac3fff700 1 -- 172.21.15.8:0/2821578994 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac40a9d40 con 0x7fdac406c060 2023-10-06T04:36:27.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.399+0000 7fdac3fff700 1 -- 172.21.15.8:0/2821578994 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7fdabc0017f0 con 0x7fdac406c060 2023-10-06T04:36:27.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.399+0000 7fdac3fff700 1 -- 172.21.15.8:0/2821578994 >> v1:172.21.15.8:6789/0 conn(0x7fdac406c060 legacy=0x7fdac415c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:27.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.399+0000 7fdac3fff700 1 --2- 172.21.15.8:0/2821578994 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdaac003a60 0x7fdaac003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:27.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.399+0000 7fdac3fff700 1 --2- 172.21.15.8:0/2821578994 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdaac004810 0x7fdaac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:27.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.399+0000 7fdac3fff700 1 --2- 172.21.15.8:0/2821578994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdaac0051c0 0x7fdaac00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:27.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.399+0000 7fdac3fff700 1 -- 172.21.15.8:0/2821578994 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac40ae350 con 0x7fdaac0051c0 2023-10-06T04:36:27.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.399+0000 7fdac3fff700 1 -- 172.21.15.8:0/2821578994 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac00c0e0 con 0x7fdaac003a60 2023-10-06T04:36:27.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.399+0000 7fdac3fff700 1 -- 172.21.15.8:0/2821578994 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac00c2a0 con 0x7fdaac004810 2023-10-06T04:36:27.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.399+0000 7fdac9f01700 1 --2- 172.21.15.8:0/2821578994 >> v2:172.21.15.184:3300/0 conn(0x7fdac406c430 0x7fdac40aee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:36:27.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.399+0000 7fdac9700700 1 --2- 172.21.15.8:0/2821578994 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdaac003a60 0x7fdaac003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:27.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.399+0000 7fdac9f01700 1 --2- 172.21.15.8:0/2821578994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdaac0051c0 0x7fdaac00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:27.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.399+0000 7fdac8eff700 1 --2- 172.21.15.8:0/2821578994 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdaac004810 0x7fdaac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:27.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.400+0000 7fdac9f01700 1 -- 172.21.15.8:0/2821578994 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdaac004810 msgr2=0x7fdaac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:27.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.400+0000 7fdac9f01700 1 --2- 172.21.15.8:0/2821578994 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdaac004810 0x7fdaac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:27.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.400+0000 7fdac9f01700 1 -- 172.21.15.8:0/2821578994 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdaac003a60 msgr2=0x7fdaac003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:27.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.400+0000 7fdac9f01700 1 --2- 172.21.15.8:0/2821578994 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdaac003a60 0x7fdaac003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:27.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.400+0000 7fdac9f01700 1 -- 172.21.15.8:0/2821578994 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaac003570 con 0x7fdaac0051c0 2023-10-06T04:36:27.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.400+0000 7fdac9f01700 1 -- 172.21.15.8:0/2821578994 reap_dead start 2023-10-06T04:36:27.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.400+0000 7fdac9f01700 1 --2- 172.21.15.8:0/2821578994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdaac0051c0 0x7fdaac00ba60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdab4009db0 tx=0x7fdab40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c098d7d862a5427b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:27.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.400+0000 7fdac3fff700 1 -- 172.21.15.8:0/2821578994 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab4009740 con 0x7fdaac0051c0 2023-10-06T04:36:27.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.400+0000 7fdac3fff700 1 -- 172.21.15.8:0/2821578994 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab400e920 con 0x7fdaac0051c0 2023-10-06T04:36:27.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.400+0000 7fdac3fff700 1 -- 172.21.15.8:0/2821578994 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab400ecc0 con 0x7fdaac0051c0 2023-10-06T04:36:27.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.401+0000 7fdacb964700 1 -- 172.21.15.8:0/2821578994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdaac0051c0 msgr2=0x7fdaac00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:27.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.401+0000 7fdacb964700 1 --2- 172.21.15.8:0/2821578994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdaac0051c0 0x7fdaac00ba60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdab4009db0 tx=0x7fdab40091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:27.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.401+0000 7fdacb964700 1 -- 172.21.15.8:0/2821578994 shutdown_connections 2023-10-06T04:36:27.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.401+0000 7fdacb964700 1 --2- 172.21.15.8:0/2821578994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdaac0051c0 0x7fdaac00ba60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:27.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.401+0000 7fdacb964700 1 -- 172.21.15.8:0/2821578994 >> 172.21.15.8:0/2821578994 conn(0x7fdac406e900 msgr2=0x7fdac406ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:27.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.401+0000 7fdacb964700 1 -- 172.21.15.8:0/2821578994 shutdown_connections 2023-10-06T04:36:27.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.401+0000 7fdacb964700 1 -- 172.21.15.8:0/2821578994 wait complete. 2023-10-06T04:36:27.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.402+0000 7fdacb964700 1 Processor -- start 2023-10-06T04:36:27.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.402+0000 7fdacb964700 1 -- start start 2023-10-06T04:36:27.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.403+0000 7fdacb964700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdaac0051c0 0x7fdac4152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:27.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.403+0000 7fdacb964700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdac4158f60 0x7fdac41593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:27.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.403+0000 7fdacb964700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdac4169790 0x7fdac4169c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:27.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.403+0000 7fdacb964700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac416a140 con 0x7fdaac0051c0 2023-10-06T04:36:27.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.403+0000 7fdacb964700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac4158ad0 con 0x7fdac4169790 2023-10-06T04:36:27.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.403+0000 7fdacb964700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac4157f00 con 0x7fdac4158f60 2023-10-06T04:36:27.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.403+0000 7fdac9700700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdaac0051c0 0x7fdac4152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:27.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.403+0000 7fdac9700700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdaac0051c0 0x7fdac4152780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38300/0 (socket says 172.21.15.8:38300) 2023-10-06T04:36:27.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.403+0000 7fdac9700700 1 -- 172.21.15.8:0/701101438 learned_addr learned my addr 172.21.15.8:0/701101438 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:27.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.404+0000 7fdac8eff700 1 --2- 172.21.15.8:0/701101438 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdac4158f60 0x7fdac41593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:27.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.404+0000 7fdac9f01700 1 --2- 172.21.15.8:0/701101438 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdac4169790 0x7fdac4169c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:27.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.404+0000 7fdac9700700 1 -- 172.21.15.8:0/701101438 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdac4158f60 msgr2=0x7fdac41593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:27.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.404+0000 7fdac9700700 1 --2- 172.21.15.8:0/701101438 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdac4158f60 0x7fdac41593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:27.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.404+0000 7fdac9700700 1 -- 172.21.15.8:0/701101438 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdac4169790 msgr2=0x7fdac4169c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:27.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.404+0000 7fdac9700700 1 --2- 172.21.15.8:0/701101438 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdac4169790 0x7fdac4169c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:27.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.404+0000 7fdac9700700 1 -- 172.21.15.8:0/701101438 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac41581a0 con 0x7fdaac0051c0 2023-10-06T04:36:27.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.404+0000 7fdac9f01700 1 --2- 172.21.15.8:0/701101438 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdac4169790 0x7fdac4169c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:27.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.404+0000 7fdac9700700 1 --2- 172.21.15.8:0/701101438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdaac0051c0 0x7fdac4152780 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdabc007a90 tx=0x7fdabc0021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:27.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.404+0000 7fdac17fa700 1 -- 172.21.15.8:0/701101438 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc00ad90 con 0x7fdaac0051c0 2023-10-06T04:36:27.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.404+0000 7fdac17fa700 1 -- 172.21.15.8:0/701101438 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdabc0133f0 con 0x7fdaac0051c0 2023-10-06T04:36:27.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.404+0000 7fdacb964700 1 -- 172.21.15.8:0/701101438 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac4158480 con 0x7fdaac0051c0 2023-10-06T04:36:27.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.404+0000 7fdac17fa700 1 -- 172.21.15.8:0/701101438 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc0137b0 con 0x7fdaac0051c0 2023-10-06T04:36:27.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.404+0000 7fdacb964700 1 -- 172.21.15.8:0/701101438 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac4152cc0 con 0x7fdaac0051c0 2023-10-06T04:36:27.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.405+0000 7fdacb964700 1 -- 172.21.15.8:0/701101438 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac4071550 con 0x7fdaac0051c0 2023-10-06T04:36:27.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.405+0000 7fdac17fa700 1 -- 172.21.15.8:0/701101438 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdabc013b20 con 0x7fdaac0051c0 2023-10-06T04:36:27.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.406+0000 7fdac17fa700 1 --2- 172.21.15.8:0/701101438 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fdab0066f30 0x7fdab00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:27.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.406+0000 7fdac17fa700 1 -- 172.21.15.8:0/701101438 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fdabc0855d0 con 0x7fdaac0051c0 2023-10-06T04:36:27.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.406+0000 7fdac8eff700 1 --2- 172.21.15.8:0/701101438 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fdab0066f30 0x7fdab00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:27.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.407+0000 7fdac8eff700 1 --2- 172.21.15.8:0/701101438 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fdab0066f30 0x7fdab00693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdac40cc3b0 tx=0x7fdab8007d10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:27.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.410+0000 7fdac17fa700 1 -- 172.21.15.8:0/701101438 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdabc052350 con 0x7fdaac0051c0 2023-10-06T04:36:27.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.612+0000 7fdacb964700 1 -- 172.21.15.8:0/701101438 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdac4063970 con 0x7fdaac0051c0 2023-10-06T04:36:27.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.613+0000 7fdac17fa700 1 -- 172.21.15.8:0/701101438 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18659 (secure 0 0 0) 0x7fdabc055970 con 0x7fdaac0051c0 2023-10-06T04:36:27.616 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:36:27.616 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":25,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:36:21.690266+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:36:10.148177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:36:10.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:36:14.390671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:36:15.601089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:36:19.291300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.555871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.490505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.504578+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.517217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:05.991135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.537329+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.543232+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.443715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:36:27.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.615+0000 7fdacb964700 1 -- 172.21.15.8:0/701101438 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fdab0066f30 msgr2=0x7fdab00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:27.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.615+0000 7fdacb964700 1 --2- 172.21.15.8:0/701101438 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fdab0066f30 0x7fdab00693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdac40cc3b0 tx=0x7fdab8007d10 comp rx=0 tx=0).stop 2023-10-06T04:36:27.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.615+0000 7fdacb964700 1 -- 172.21.15.8:0/701101438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdaac0051c0 msgr2=0x7fdac4152780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:27.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.615+0000 7fdacb964700 1 --2- 172.21.15.8:0/701101438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdaac0051c0 0x7fdac4152780 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdabc007a90 tx=0x7fdabc0021f0 comp rx=0 tx=0).stop 2023-10-06T04:36:27.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.615+0000 7fdacb964700 1 -- 172.21.15.8:0/701101438 shutdown_connections 2023-10-06T04:36:27.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.615+0000 7fdacb964700 1 --2- 172.21.15.8:0/701101438 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fdab0066f30 0x7fdab00693e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:27.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.615+0000 7fdacb964700 1 --2- 172.21.15.8:0/701101438 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdac4169790 0x7fdac4169c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:27.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.615+0000 7fdacb964700 1 --2- 172.21.15.8:0/701101438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdaac0051c0 0x7fdac4152780 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:27.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.615+0000 7fdacb964700 1 --2- 172.21.15.8:0/701101438 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdac4158f60 0x7fdac41593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:27.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.615+0000 7fdacb964700 1 -- 172.21.15.8:0/701101438 >> 172.21.15.8:0/701101438 conn(0x7fdac406e900 msgr2=0x7fdac40b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:27.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.615+0000 7fdacb964700 1 -- 172.21.15.8:0/701101438 shutdown_connections 2023-10-06T04:36:27.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.615+0000 7fdacb964700 1 -- 172.21.15.8:0/701101438 wait complete. 2023-10-06T04:36:27.631 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:36:27.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.748+0000 7fa561354700 1 Processor -- start 2023-10-06T04:36:27.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.748+0000 7fa561354700 1 -- start start 2023-10-06T04:36:27.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.749+0000 7fa561354700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa55c0d0aa0 0x7fa55c1649b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:27.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.749+0000 7fa561354700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa55c0cc4c0 con 0x7fa55c0af680 2023-10-06T04:36:27.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.749+0000 7fa561354700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa55c0cb8b0 con 0x7fa55c0cb360 2023-10-06T04:36:27.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.749+0000 7fa561354700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c15d460 con 0x7fa55c0d0aa0 2023-10-06T04:36:27.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.749+0000 7fa55affd700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fa55c0af680 0x7fa55c15e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34524/0 (socket says 172.21.15.8:34524) 2023-10-06T04:36:27.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.749+0000 7fa55affd700 1 -- 172.21.15.8:0/2681170751 learned_addr learned my addr 172.21.15.8:0/2681170751 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:27.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.750+0000 7fa55b7fe700 1 --2- 172.21.15.8:0/2681170751 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa55c0d0aa0 0x7fa55c1649b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:27.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.750+0000 7fa559ffb700 1 -- 172.21.15.8:0/2681170751 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1469556153 0 0) 0x7fa55c0cc4c0 con 0x7fa55c0af680 2023-10-06T04:36:27.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.750+0000 7fa559ffb700 1 -- 172.21.15.8:0/2681170751 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa548003570 con 0x7fa55c0af680 2023-10-06T04:36:27.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.750+0000 7fa559ffb700 1 -- 172.21.15.8:0/2681170751 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3496886573 0 0) 0x7fa55c0cb8b0 con 0x7fa55c0cb360 2023-10-06T04:36:27.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.750+0000 7fa559ffb700 1 -- 172.21.15.8:0/2681170751 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa55c0cc4c0 con 0x7fa55c0cb360 2023-10-06T04:36:27.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.750+0000 7fa559ffb700 1 -- 172.21.15.8:0/2681170751 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1023140567 0 0) 0x7fa548003570 con 0x7fa55c0af680 2023-10-06T04:36:27.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.750+0000 7fa559ffb700 1 -- 172.21.15.8:0/2681170751 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa55c0d0aa0 msgr2=0x7fa55c1649b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:27.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.750+0000 7fa559ffb700 1 --2- 172.21.15.8:0/2681170751 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa55c0d0aa0 0x7fa55c1649b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:27.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.750+0000 7fa559ffb700 1 -- 172.21.15.8:0/2681170751 >> v1:172.21.15.184:6789/0 conn(0x7fa55c0cb360 legacy=0x7fa55c0d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:27.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.750+0000 7fa559ffb700 1 -- 172.21.15.8:0/2681170751 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c0cbb90 con 0x7fa55c0af680 2023-10-06T04:36:27.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.750+0000 7fa559ffb700 1 -- 172.21.15.8:0/2681170751 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7fa554001470 con 0x7fa55c0af680 2023-10-06T04:36:27.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.750+0000 7fa559ffb700 1 -- 172.21.15.8:0/2681170751 >> v1:172.21.15.8:6789/0 conn(0x7fa55c0af680 legacy=0x7fa55c15e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:27.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.750+0000 7fa559ffb700 1 --2- 172.21.15.8:0/2681170751 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa548003c20 0x7fa548004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:27.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.750+0000 7fa559ffb700 1 --2- 172.21.15.8:0/2681170751 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa548004810 0x7fa548004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:27.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.750+0000 7fa559ffb700 1 --2- 172.21.15.8:0/2681170751 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5480051c0 0x7fa54800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:27.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.750+0000 7fa559ffb700 1 -- 172.21.15.8:0/2681170751 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c15d460 con 0x7fa548004810 2023-10-06T04:36:27.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.750+0000 7fa559ffb700 1 -- 172.21.15.8:0/2681170751 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54800c020 con 0x7fa548003c20 2023-10-06T04:36:27.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.750+0000 7fa559ffb700 1 -- 172.21.15.8:0/2681170751 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa54800c1e0 con 0x7fa5480051c0 2023-10-06T04:36:27.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.750+0000 7fa55b7fe700 1 --2- 172.21.15.8:0/2681170751 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa55c0d0aa0 0x7fa55c1649b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:36:27.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.750+0000 7fa55a7fc700 1 --2- 172.21.15.8:0/2681170751 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa548004810 0x7fa548004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:27.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.750+0000 7fa55affd700 1 --2- 172.21.15.8:0/2681170751 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa548003c20 0x7fa548004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:27.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.750+0000 7fa55b7fe700 1 --2- 172.21.15.8:0/2681170751 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5480051c0 0x7fa54800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:27.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.750+0000 7fa55a7fc700 1 -- 172.21.15.8:0/2681170751 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5480051c0 msgr2=0x7fa54800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:27.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.750+0000 7fa55a7fc700 1 --2- 172.21.15.8:0/2681170751 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5480051c0 0x7fa54800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:27.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.750+0000 7fa55a7fc700 1 -- 172.21.15.8:0/2681170751 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa548003c20 msgr2=0x7fa548004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:27.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.750+0000 7fa55a7fc700 1 --2- 172.21.15.8:0/2681170751 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa548003c20 0x7fa548004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:27.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.751+0000 7fa55a7fc700 1 -- 172.21.15.8:0/2681170751 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa548003570 con 0x7fa548004810 2023-10-06T04:36:27.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.751+0000 7fa55a7fc700 1 --2- 172.21.15.8:0/2681170751 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa548004810 0x7fa548004c80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa544001a10 tx=0x7fa544007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e247c2f4a185326b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:27.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.751+0000 7fa559ffb700 1 -- 172.21.15.8:0/2681170751 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54400c5d0 con 0x7fa548004810 2023-10-06T04:36:27.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.751+0000 7fa559ffb700 1 -- 172.21.15.8:0/2681170751 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54400c730 con 0x7fa548004810 2023-10-06T04:36:27.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.751+0000 7fa559ffb700 1 -- 172.21.15.8:0/2681170751 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54400cad0 con 0x7fa548004810 2023-10-06T04:36:27.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.751+0000 7fa561354700 1 -- 172.21.15.8:0/2681170751 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa548004810 msgr2=0x7fa548004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:27.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.751+0000 7fa561354700 1 --2- 172.21.15.8:0/2681170751 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa548004810 0x7fa548004c80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa544001a10 tx=0x7fa544007d30 comp rx=0 tx=0).stop 2023-10-06T04:36:27.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.751+0000 7fa55b7fe700 1 -- 172.21.15.8:0/2681170751 reap_dead start 2023-10-06T04:36:27.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.751+0000 7fa561354700 1 -- 172.21.15.8:0/2681170751 shutdown_connections 2023-10-06T04:36:27.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.751+0000 7fa561354700 1 -- 172.21.15.8:0/2681170751 >> 172.21.15.8:0/2681170751 conn(0x7fa55c0633d0 msgr2=0x7fa55c0637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:27.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.751+0000 7fa561354700 1 -- 172.21.15.8:0/2681170751 shutdown_connections 2023-10-06T04:36:27.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.751+0000 7fa561354700 1 -- 172.21.15.8:0/2681170751 wait complete. 2023-10-06T04:36:27.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.753+0000 7fa561354700 1 Processor -- start 2023-10-06T04:36:27.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.753+0000 7fa561354700 1 -- start start 2023-10-06T04:36:27.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.753+0000 7fa561354700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa548004810 0x7fa55c0c4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:27.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.753+0000 7fa561354700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa55c15c730 0x7fa55c169de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:27.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.753+0000 7fa561354700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa55c0c3d50 0x7fa55c0c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:27.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.753+0000 7fa561354700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c0af260 con 0x7fa548004810 2023-10-06T04:36:27.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.753+0000 7fa561354700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c0c7d90 con 0x7fa55c15c730 2023-10-06T04:36:27.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.753+0000 7fa561354700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c0c74d0 con 0x7fa55c0c3d50 2023-10-06T04:36:27.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.753+0000 7fa55affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa548004810 0x7fa55c0c4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:27.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.754+0000 7fa55affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa548004810 0x7fa55c0c4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38314/0 (socket says 172.21.15.8:38314) 2023-10-06T04:36:27.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.754+0000 7fa55affd700 1 -- 172.21.15.8:0/1841672671 learned_addr learned my addr 172.21.15.8:0/1841672671 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:27.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.754+0000 7fa55b7fe700 1 --2- 172.21.15.8:0/1841672671 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa55c0c3d50 0x7fa55c0c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:27.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.754+0000 7fa55a7fc700 1 --2- 172.21.15.8:0/1841672671 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa55c15c730 0x7fa55c169de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:27.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.754+0000 7fa55affd700 1 -- 172.21.15.8:0/1841672671 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa55c0c3d50 msgr2=0x7fa55c0c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:27.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.754+0000 7fa55affd700 1 --2- 172.21.15.8:0/1841672671 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa55c0c3d50 0x7fa55c0c61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:27.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.754+0000 7fa55affd700 1 -- 172.21.15.8:0/1841672671 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa55c15c730 msgr2=0x7fa55c169de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:27.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.754+0000 7fa55affd700 1 --2- 172.21.15.8:0/1841672671 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa55c15c730 0x7fa55c169de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:27.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.754+0000 7fa55affd700 1 -- 172.21.15.8:0/1841672671 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c0c7740 con 0x7fa548004810 2023-10-06T04:36:27.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.754+0000 7fa55a7fc700 1 --2- 172.21.15.8:0/1841672671 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa55c15c730 0x7fa55c169de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:36:27.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.754+0000 7fa55b7fe700 1 --2- 172.21.15.8:0/1841672671 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa55c0c3d50 0x7fa55c0c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:36:27.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.754+0000 7fa55affd700 1 --2- 172.21.15.8:0/1841672671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa548004810 0x7fa55c0c4f10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa5540073c0 tx=0x7fa55c069610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:27.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.754+0000 7fa552ffd700 1 -- 172.21.15.8:0/1841672671 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55400f8d0 con 0x7fa548004810 2023-10-06T04:36:27.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.754+0000 7fa552ffd700 1 -- 172.21.15.8:0/1841672671 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55400fa50 con 0x7fa548004810 2023-10-06T04:36:27.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.754+0000 7fa561354700 1 -- 172.21.15.8:0/1841672671 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa55c0c7a20 con 0x7fa548004810 2023-10-06T04:36:27.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.754+0000 7fa552ffd700 1 -- 172.21.15.8:0/1841672671 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55400fe10 con 0x7fa548004810 2023-10-06T04:36:27.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.754+0000 7fa561354700 1 -- 172.21.15.8:0/1841672671 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa55c0c5520 con 0x7fa548004810 2023-10-06T04:36:27.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.755+0000 7fa561354700 1 -- 172.21.15.8:0/1841672671 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa55c071550 con 0x7fa548004810 2023-10-06T04:36:27.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.756+0000 7fa552ffd700 1 -- 172.21.15.8:0/1841672671 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa5540135c0 con 0x7fa548004810 2023-10-06T04:36:27.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.756+0000 7fa552ffd700 1 --2- 172.21.15.8:0/1841672671 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa53c066f30 0x7fa53c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:27.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.756+0000 7fa552ffd700 1 -- 172.21.15.8:0/1841672671 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa5540846f0 con 0x7fa548004810 2023-10-06T04:36:27.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.756+0000 7fa55a7fc700 1 --2- 172.21.15.8:0/1841672671 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa53c066f30 0x7fa53c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:27.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.757+0000 7fa55a7fc700 1 --2- 172.21.15.8:0/1841672671 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa53c066f30 0x7fa53c0693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa55c0c5450 tx=0x7fa544015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:27.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.760+0000 7fa552ffd700 1 -- 172.21.15.8:0/1841672671 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa554051510 con 0x7fa548004810 2023-10-06T04:36:27.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.953+0000 7fa561354700 1 -- 172.21.15.8:0/1841672671 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa55c0c6f10 con 0x7fa548004810 2023-10-06T04:36:27.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.954+0000 7fa552ffd700 1 -- 172.21.15.8:0/1841672671 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18659 (secure 0 0 0) 0x7fa55401a090 con 0x7fa548004810 2023-10-06T04:36:27.957 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:36:27.957 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":25,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:36:21.690266+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:36:10.148177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:36:10.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:36:14.390671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:36:15.601089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:36:19.291300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.555871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.490505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.504578+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.517217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:05.991135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.537329+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.543232+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.443715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:36:27.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.956+0000 7fa561354700 1 -- 172.21.15.8:0/1841672671 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa53c066f30 msgr2=0x7fa53c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:27.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.956+0000 7fa561354700 1 --2- 172.21.15.8:0/1841672671 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa53c066f30 0x7fa53c0693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa55c0c5450 tx=0x7fa544015000 comp rx=0 tx=0).stop 2023-10-06T04:36:27.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.956+0000 7fa561354700 1 -- 172.21.15.8:0/1841672671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa548004810 msgr2=0x7fa55c0c4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:27.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.956+0000 7fa561354700 1 --2- 172.21.15.8:0/1841672671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa548004810 0x7fa55c0c4f10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa5540073c0 tx=0x7fa55c069610 comp rx=0 tx=0).stop 2023-10-06T04:36:27.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.956+0000 7fa561354700 1 -- 172.21.15.8:0/1841672671 shutdown_connections 2023-10-06T04:36:27.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.956+0000 7fa561354700 1 --2- 172.21.15.8:0/1841672671 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa53c066f30 0x7fa53c0693e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:27.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.956+0000 7fa561354700 1 --2- 172.21.15.8:0/1841672671 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa55c0c3d50 0x7fa55c0c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:27.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.956+0000 7fa561354700 1 --2- 172.21.15.8:0/1841672671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa548004810 0x7fa55c0c4f10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:27.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.956+0000 7fa561354700 1 --2- 172.21.15.8:0/1841672671 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa55c15c730 0x7fa55c169de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:27.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.956+0000 7fa561354700 1 -- 172.21.15.8:0/1841672671 >> 172.21.15.8:0/1841672671 conn(0x7fa55c0633d0 msgr2=0x7fa55c0cfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:27.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.956+0000 7fa561354700 1 -- 172.21.15.8:0/1841672671 shutdown_connections 2023-10-06T04:36:27.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:27.956+0000 7fa561354700 1 -- 172.21.15.8:0/1841672671 wait complete. 2023-10-06T04:36:27.972 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T04:36:28.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.091+0000 7f5a4a79f700 1 Processor -- start 2023-10-06T04:36:28.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.091+0000 7f5a4a79f700 1 -- start start 2023-10-06T04:36:28.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.092+0000 7f5a4a79f700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5a44156e30 0x7f5a440cf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:28.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.092+0000 7f5a4a79f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a440b1c70 0x7f5a440b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:28.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.092+0000 7f5a4a79f700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a440b2620 con 0x7f5a4415ad80 2023-10-06T04:36:28.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.092+0000 7f5a4a79f700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a440cf370 con 0x7f5a44156e30 2023-10-06T04:36:28.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.092+0000 7f5a4a79f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a440ce800 con 0x7f5a440b1c70 2023-10-06T04:36:28.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.092+0000 7f5a4979d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5a44156e30 0x7f5a440cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:28.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.092+0000 7f5a49f9e700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f5a4415ad80 0x7f5a4415b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34528/0 (socket says 172.21.15.8:34528) 2023-10-06T04:36:28.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.092+0000 7f5a4979d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5a44156e30 0x7f5a440cf800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38324/0 (socket says 172.21.15.8:38324) 2023-10-06T04:36:28.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.092+0000 7f5a49f9e700 1 -- 172.21.15.8:0/3720616482 learned_addr learned my addr 172.21.15.8:0/3720616482 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:28.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.092+0000 7f5a48f9c700 1 --2- 172.21.15.8:0/3720616482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a440b1c70 0x7f5a440b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:28.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.092+0000 7f5a4979d700 1 -- 172.21.15.8:0/3720616482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a440b1c70 msgr2=0x7f5a440b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:28.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.092+0000 7f5a4979d700 1 --2- 172.21.15.8:0/3720616482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a440b1c70 0x7f5a440b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:28.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.092+0000 7f5a4979d700 1 -- 172.21.15.8:0/3720616482 >> v1:172.21.15.8:6789/0 conn(0x7f5a4415ad80 legacy=0x7f5a4415b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:28.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.092+0000 7f5a4979d700 1 -- 172.21.15.8:0/3720616482 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a440cea60 con 0x7f5a44156e30 2023-10-06T04:36:28.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.092+0000 7f5a43fff700 1 -- 172.21.15.8:0/3720616482 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1629996798 0 0) 0x7f5a440b2620 con 0x7f5a4415ad80 2023-10-06T04:36:28.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.092+0000 7f5a4979d700 1 --2- 172.21.15.8:0/3720616482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5a44156e30 0x7f5a440cf800 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5a440cec50 tx=0x7f5a3c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd4882901201d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:28.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.092+0000 7f5a43fff700 1 -- 172.21.15.8:0/3720616482 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c016070 con 0x7f5a44156e30 2023-10-06T04:36:28.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.093+0000 7f5a43fff700 1 -- 172.21.15.8:0/3720616482 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3c00bc30 con 0x7f5a44156e30 2023-10-06T04:36:28.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.093+0000 7f5a43fff700 1 -- 172.21.15.8:0/3720616482 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c00e070 con 0x7f5a44156e30 2023-10-06T04:36:28.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.093+0000 7f5a4a79f700 1 -- 172.21.15.8:0/3720616482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5a44156e30 msgr2=0x7f5a440cf800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:28.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.093+0000 7f5a4a79f700 1 --2- 172.21.15.8:0/3720616482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5a44156e30 0x7f5a440cf800 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5a440cec50 tx=0x7f5a3c009780 comp rx=0 tx=0).stop 2023-10-06T04:36:28.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.093+0000 7f5a4a79f700 1 -- 172.21.15.8:0/3720616482 shutdown_connections 2023-10-06T04:36:28.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.093+0000 7f5a4a79f700 1 --2- 172.21.15.8:0/3720616482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5a44156e30 0x7f5a440cf800 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:28.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.093+0000 7f5a4a79f700 1 --2- 172.21.15.8:0/3720616482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a440b1c70 0x7f5a440b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:28.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.093+0000 7f5a4a79f700 1 -- 172.21.15.8:0/3720616482 >> 172.21.15.8:0/3720616482 conn(0x7f5a4406ed00 msgr2=0x7f5a4406f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:28.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.093+0000 7f5a4a79f700 1 -- 172.21.15.8:0/3720616482 shutdown_connections 2023-10-06T04:36:28.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.093+0000 7f5a4a79f700 1 -- 172.21.15.8:0/3720616482 wait complete. 2023-10-06T04:36:28.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.094+0000 7f5a4a79f700 1 Processor -- start 2023-10-06T04:36:28.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.094+0000 7f5a4a79f700 1 -- start start 2023-10-06T04:36:28.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.095+0000 7f5a4a79f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a440b1c70 0x7f5a4416a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:28.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.095+0000 7f5a4a79f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5a44156e30 0x7f5a440a7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:28.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.095+0000 7f5a4a79f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a4415ad80 0x7f5a4416b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:28.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.095+0000 7f5a4a79f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a440a8080 con 0x7f5a44156e30 2023-10-06T04:36:28.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.095+0000 7f5a4a79f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4416a660 con 0x7f5a440b1c70 2023-10-06T04:36:28.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.095+0000 7f5a4a79f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4416a940 con 0x7f5a4415ad80 2023-10-06T04:36:28.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.095+0000 7f5a48f9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5a44156e30 0x7f5a440a7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:28.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.095+0000 7f5a48f9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5a44156e30 0x7f5a440a7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38332/0 (socket says 172.21.15.8:38332) 2023-10-06T04:36:28.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.095+0000 7f5a48f9c700 1 -- 172.21.15.8:0/1656380519 learned_addr learned my addr 172.21.15.8:0/1656380519 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:28.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.095+0000 7f5a4979d700 1 --2- 172.21.15.8:0/1656380519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a440b1c70 0x7f5a4416a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:28.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.095+0000 7f5a49f9e700 1 --2- 172.21.15.8:0/1656380519 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a4415ad80 0x7f5a4416b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:28.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.096+0000 7f5a48f9c700 1 -- 172.21.15.8:0/1656380519 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a4415ad80 msgr2=0x7f5a4416b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:28.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.096+0000 7f5a48f9c700 1 --2- 172.21.15.8:0/1656380519 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a4415ad80 0x7f5a4416b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:28.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.096+0000 7f5a48f9c700 1 -- 172.21.15.8:0/1656380519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a440b1c70 msgr2=0x7f5a4416a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:28.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.096+0000 7f5a48f9c700 1 --2- 172.21.15.8:0/1656380519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a440b1c70 0x7f5a4416a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:28.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.096+0000 7f5a48f9c700 1 -- 172.21.15.8:0/1656380519 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3c009a20 con 0x7f5a44156e30 2023-10-06T04:36:28.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.096+0000 7f5a48f9c700 1 --2- 172.21.15.8:0/1656380519 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5a44156e30 0x7f5a440a7b40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5a3800d860 tx=0x7f5a38008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:28.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.096+0000 7f5a417fa700 1 -- 172.21.15.8:0/1656380519 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a380125f0 con 0x7f5a44156e30 2023-10-06T04:36:28.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.096+0000 7f5a417fa700 1 -- 172.21.15.8:0/1656380519 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a38012750 con 0x7f5a44156e30 2023-10-06T04:36:28.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.096+0000 7f5a4a79f700 1 -- 172.21.15.8:0/1656380519 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a4416ac20 con 0x7f5a44156e30 2023-10-06T04:36:28.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.096+0000 7f5a417fa700 1 -- 172.21.15.8:0/1656380519 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a38012b10 con 0x7f5a44156e30 2023-10-06T04:36:28.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.096+0000 7f5a4a79f700 1 -- 172.21.15.8:0/1656380519 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a440a8a90 con 0x7f5a44156e30 2023-10-06T04:36:28.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.097+0000 7f5a4a79f700 1 -- 172.21.15.8:0/1656380519 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a4404c380 con 0x7f5a44156e30 2023-10-06T04:36:28.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.097+0000 7f5a417fa700 1 -- 172.21.15.8:0/1656380519 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a3801e460 con 0x7f5a44156e30 2023-10-06T04:36:28.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.098+0000 7f5a417fa700 1 --2- 172.21.15.8:0/1656380519 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5a30066f30 0x7f5a300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:28.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.098+0000 7f5a417fa700 1 -- 172.21.15.8:0/1656380519 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f5a38084eb0 con 0x7f5a44156e30 2023-10-06T04:36:28.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.098+0000 7f5a4979d700 1 --2- 172.21.15.8:0/1656380519 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5a30066f30 0x7f5a300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:28.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.098+0000 7f5a4979d700 1 --2- 172.21.15.8:0/1656380519 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5a30066f30 0x7f5a300693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5a440cec50 tx=0x7f5a3c018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:28.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.102+0000 7f5a417fa700 1 -- 172.21.15.8:0/1656380519 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a38055760 con 0x7f5a44156e30 2023-10-06T04:36:28.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.342+0000 7f5a4a79f700 1 -- 172.21.15.8:0/1656380519 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5a440b1170 con 0x7f5a44156e30 2023-10-06T04:36:28.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.691+0000 7f5a417fa700 1 -- 172.21.15.8:0/1656380519 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5a380552f0 con 0x7f5a44156e30 2023-10-06T04:36:28.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.693+0000 7f5a4a79f700 1 -- 172.21.15.8:0/1656380519 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5a30066f30 msgr2=0x7f5a300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:28.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.693+0000 7f5a4a79f700 1 --2- 172.21.15.8:0/1656380519 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5a30066f30 0x7f5a300693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5a440cec50 tx=0x7f5a3c018000 comp rx=0 tx=0).stop 2023-10-06T04:36:28.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.693+0000 7f5a4a79f700 1 -- 172.21.15.8:0/1656380519 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5a44156e30 msgr2=0x7f5a440a7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:28.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.693+0000 7f5a4a79f700 1 --2- 172.21.15.8:0/1656380519 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5a44156e30 0x7f5a440a7b40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5a3800d860 tx=0x7f5a38008040 comp rx=0 tx=0).stop 2023-10-06T04:36:28.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.694+0000 7f5a4a79f700 1 -- 172.21.15.8:0/1656380519 shutdown_connections 2023-10-06T04:36:28.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.694+0000 7f5a4a79f700 1 --2- 172.21.15.8:0/1656380519 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5a30066f30 0x7f5a300693e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:28.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.694+0000 7f5a4a79f700 1 --2- 172.21.15.8:0/1656380519 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a4415ad80 0x7f5a4416b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:28.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.694+0000 7f5a4a79f700 1 --2- 172.21.15.8:0/1656380519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a440b1c70 0x7f5a4416a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:28.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.694+0000 7f5a4a79f700 1 --2- 172.21.15.8:0/1656380519 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5a44156e30 0x7f5a440a7b40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:28.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.694+0000 7f5a4a79f700 1 -- 172.21.15.8:0/1656380519 >> 172.21.15.8:0/1656380519 conn(0x7f5a4406ed00 msgr2=0x7f5a44153d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:28.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.694+0000 7f5a4a79f700 1 -- 172.21.15.8:0/1656380519 shutdown_connections 2023-10-06T04:36:28.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.694+0000 7f5a4a79f700 1 -- 172.21.15.8:0/1656380519 wait complete. 2023-10-06T04:36:28.709 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T04:36:28.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.831+0000 7f0548d0f700 1 Processor -- start 2023-10-06T04:36:28.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.831+0000 7f0548d0f700 1 -- start start 2023-10-06T04:36:28.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.832+0000 7f0548d0f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05440c89e0 0x7f05440aee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:28.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.832+0000 7f0548d0f700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0544156aa0 0x7f05440c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:28.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.832+0000 7f0548d0f700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05440ca4a0 con 0x7f05440c8360 2023-10-06T04:36:28.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.832+0000 7f0548d0f700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05440684d0 con 0x7f0544156aa0 2023-10-06T04:36:28.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.832+0000 7f0548d0f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05440af390 con 0x7f05440c89e0 2023-10-06T04:36:28.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.832+0000 7f0542d9d700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f05440c8360 0x7f05440675d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34530/0 (socket says 172.21.15.8:34530) 2023-10-06T04:36:28.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.832+0000 7f0541d9b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0544156aa0 0x7f05440c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:28.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.833+0000 7f0542d9d700 1 -- 172.21.15.8:0/4158962783 learned_addr learned my addr 172.21.15.8:0/4158962783 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:28.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.833+0000 7f054259c700 1 --2- 172.21.15.8:0/4158962783 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05440c89e0 0x7f05440aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:28.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.833+0000 7f0541d9b700 1 -- 172.21.15.8:0/4158962783 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05440c89e0 msgr2=0x7f05440aee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:28.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.833+0000 7f0541d9b700 1 --2- 172.21.15.8:0/4158962783 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05440c89e0 0x7f05440aee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:28.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.833+0000 7f0541d9b700 1 -- 172.21.15.8:0/4158962783 >> v1:172.21.15.8:6789/0 conn(0x7f05440c8360 legacy=0x7f05440675d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:28.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.833+0000 7f0541d9b700 1 -- 172.21.15.8:0/4158962783 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0544156fd0 con 0x7f0544156aa0 2023-10-06T04:36:28.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.833+0000 7f054159a700 1 -- 172.21.15.8:0/4158962783 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 465815061 0 0) 0x7f05440ca4a0 con 0x7f05440c8360 2023-10-06T04:36:28.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.833+0000 7f0541d9b700 1 --2- 172.21.15.8:0/4158962783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0544156aa0 0x7f05440c7e20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f052c0098e0 tx=0x7f052c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316069a29bed666b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:28.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.833+0000 7f054159a700 1 -- 172.21.15.8:0/4158962783 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c009e80 con 0x7f0544156aa0 2023-10-06T04:36:28.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.833+0000 7f054159a700 1 -- 172.21.15.8:0/4158962783 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052c00b860 con 0x7f0544156aa0 2023-10-06T04:36:28.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.833+0000 7f054159a700 1 -- 172.21.15.8:0/4158962783 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c00bbe0 con 0x7f0544156aa0 2023-10-06T04:36:28.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.834+0000 7f0548d0f700 1 -- 172.21.15.8:0/4158962783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0544156aa0 msgr2=0x7f05440c7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:28.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.834+0000 7f0548d0f700 1 --2- 172.21.15.8:0/4158962783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0544156aa0 0x7f05440c7e20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f052c0098e0 tx=0x7f052c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:28.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.834+0000 7f0548d0f700 1 -- 172.21.15.8:0/4158962783 shutdown_connections 2023-10-06T04:36:28.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.834+0000 7f0548d0f700 1 --2- 172.21.15.8:0/4158962783 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05440c89e0 0x7f05440aee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:28.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.834+0000 7f0548d0f700 1 --2- 172.21.15.8:0/4158962783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0544156aa0 0x7f05440c7e20 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:28.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.834+0000 7f0548d0f700 1 -- 172.21.15.8:0/4158962783 >> 172.21.15.8:0/4158962783 conn(0x7f05440cc8e0 msgr2=0x7f05440ccce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:28.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.834+0000 7f0548d0f700 1 -- 172.21.15.8:0/4158962783 shutdown_connections 2023-10-06T04:36:28.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.834+0000 7f0548d0f700 1 -- 172.21.15.8:0/4158962783 wait complete. 2023-10-06T04:36:28.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.835+0000 7f0548d0f700 1 Processor -- start 2023-10-06T04:36:28.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.835+0000 7f0548d0f700 1 -- start start 2023-10-06T04:36:28.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.836+0000 7f0548d0f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05440c8360 0x7f05441477d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:28.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.836+0000 7f0548d0f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05440c89e0 0x7f05440ca930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:28.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.836+0000 7f0548d0f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0544156aa0 0x7f05440cae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:28.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.836+0000 7f0548d0f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0544147d10 con 0x7f05440c89e0 2023-10-06T04:36:28.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.836+0000 7f0548d0f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0544169c20 con 0x7f05440c8360 2023-10-06T04:36:28.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.836+0000 7f0548d0f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0544169ec0 con 0x7f0544156aa0 2023-10-06T04:36:28.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.836+0000 7f0541d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05440c89e0 0x7f05440ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:28.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.836+0000 7f0541d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05440c89e0 0x7f05440ca930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38340/0 (socket says 172.21.15.8:38340) 2023-10-06T04:36:28.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.836+0000 7f0541d9b700 1 -- 172.21.15.8:0/1242540896 learned_addr learned my addr 172.21.15.8:0/1242540896 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:28.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.836+0000 7f054259c700 1 --2- 172.21.15.8:0/1242540896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05440c8360 0x7f05441477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:28.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.836+0000 7f0542d9d700 1 --2- 172.21.15.8:0/1242540896 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0544156aa0 0x7f05440cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:28.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.836+0000 7f0541d9b700 1 -- 172.21.15.8:0/1242540896 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0544156aa0 msgr2=0x7f05440cae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:28.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.836+0000 7f0541d9b700 1 --2- 172.21.15.8:0/1242540896 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0544156aa0 0x7f05440cae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:28.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.836+0000 7f0541d9b700 1 -- 172.21.15.8:0/1242540896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05440c8360 msgr2=0x7f05441477d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:28.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.836+0000 7f0541d9b700 1 --2- 172.21.15.8:0/1242540896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05440c8360 0x7f05441477d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:28.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.836+0000 7f0541d9b700 1 -- 172.21.15.8:0/1242540896 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052c009420 con 0x7f05440c89e0 2023-10-06T04:36:28.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.836+0000 7f0541d9b700 1 --2- 172.21.15.8:0/1242540896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05440c89e0 0x7f05440ca930 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f054406eec0 tx=0x7f052c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:28.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.836+0000 7f053a7fc700 1 -- 172.21.15.8:0/1242540896 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c00bbe0 con 0x7f05440c89e0 2023-10-06T04:36:28.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.836+0000 7f053a7fc700 1 -- 172.21.15.8:0/1242540896 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052c011420 con 0x7f05440c89e0 2023-10-06T04:36:28.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.836+0000 7f0548d0f700 1 -- 172.21.15.8:0/1242540896 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f054416a1a0 con 0x7f05440c89e0 2023-10-06T04:36:28.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.837+0000 7f053a7fc700 1 -- 172.21.15.8:0/1242540896 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c0117c0 con 0x7f05440c89e0 2023-10-06T04:36:28.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.837+0000 7f0548d0f700 1 -- 172.21.15.8:0/1242540896 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f054416a760 con 0x7f05440c89e0 2023-10-06T04:36:28.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.837+0000 7f0548d0f700 1 -- 172.21.15.8:0/1242540896 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f054416a980 con 0x7f05440c89e0 2023-10-06T04:36:28.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.838+0000 7f053a7fc700 1 -- 172.21.15.8:0/1242540896 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f052c011b70 con 0x7f05440c89e0 2023-10-06T04:36:28.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.838+0000 7f053a7fc700 1 --2- 172.21.15.8:0/1242540896 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f0524066f30 0x7f05240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:28.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.838+0000 7f053a7fc700 1 -- 172.21.15.8:0/1242540896 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f052c0863f0 con 0x7f05440c89e0 2023-10-06T04:36:28.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.839+0000 7f054259c700 1 --2- 172.21.15.8:0/1242540896 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f0524066f30 0x7f05240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:28.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.839+0000 7f054259c700 1 --2- 172.21.15.8:0/1242540896 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f0524066f30 0x7f05240693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0544158030 tx=0x7f053c0097c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:28.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:28.843+0000 7f053a7fc700 1 -- 172.21.15.8:0/1242540896 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f052c053170 con 0x7f05440c89e0 2023-10-06T04:36:29.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.079+0000 7f0548d0f700 1 -- 172.21.15.8:0/1242540896 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0544071550 con 0x7f05440c89e0 2023-10-06T04:36:29.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.753+0000 7f053a7fc700 1 -- 172.21.15.8:0/1242540896 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f052c056790 con 0x7f05440c89e0 2023-10-06T04:36:29.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.756+0000 7f0548d0f700 1 -- 172.21.15.8:0/1242540896 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f0524066f30 msgr2=0x7f05240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:29.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.756+0000 7f0548d0f700 1 --2- 172.21.15.8:0/1242540896 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f0524066f30 0x7f05240693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0544158030 tx=0x7f053c0097c0 comp rx=0 tx=0).stop 2023-10-06T04:36:29.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.756+0000 7f0548d0f700 1 -- 172.21.15.8:0/1242540896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05440c89e0 msgr2=0x7f05440ca930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:29.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.756+0000 7f0548d0f700 1 --2- 172.21.15.8:0/1242540896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05440c89e0 0x7f05440ca930 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f054406eec0 tx=0x7f052c017000 comp rx=0 tx=0).stop 2023-10-06T04:36:29.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.756+0000 7f0548d0f700 1 -- 172.21.15.8:0/1242540896 shutdown_connections 2023-10-06T04:36:29.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.756+0000 7f0548d0f700 1 --2- 172.21.15.8:0/1242540896 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f0524066f30 0x7f05240693e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:29.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.756+0000 7f0548d0f700 1 --2- 172.21.15.8:0/1242540896 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0544156aa0 0x7f05440cae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:29.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.756+0000 7f0548d0f700 1 --2- 172.21.15.8:0/1242540896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05440c8360 0x7f05441477d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:29.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.756+0000 7f0548d0f700 1 --2- 172.21.15.8:0/1242540896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05440c89e0 0x7f05440ca930 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:29.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.756+0000 7f0548d0f700 1 -- 172.21.15.8:0/1242540896 >> 172.21.15.8:0/1242540896 conn(0x7f05440cc8e0 msgr2=0x7f05440b17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:29.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.756+0000 7f0548d0f700 1 -- 172.21.15.8:0/1242540896 shutdown_connections 2023-10-06T04:36:29.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.756+0000 7f0548d0f700 1 -- 172.21.15.8:0/1242540896 wait complete. 2023-10-06T04:36:29.773 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:36:29.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.894+0000 7fa6198a3700 1 Processor -- start 2023-10-06T04:36:29.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.894+0000 7fa6198a3700 1 -- start start 2023-10-06T04:36:29.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.895+0000 7fa6198a3700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa614157170 0x7fa61406aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:29.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.895+0000 7fa6198a3700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa614157540 0x7fa61415aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:29.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.895+0000 7fa6198a3700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa61415b430 0x7fa6140c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:29.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.895+0000 7fa6198a3700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa61406aa40 con 0x7fa61415b430 2023-10-06T04:36:29.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.895+0000 7fa6198a3700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa61415b940 con 0x7fa614157540 2023-10-06T04:36:29.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.895+0000 7fa6198a3700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa61415bc20 con 0x7fa614157170 2023-10-06T04:36:29.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.895+0000 7fa6137fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa61415b430 0x7fa6140c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:29.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.896+0000 7fa6137fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa61415b430 0x7fa6140c9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38352/0 (socket says 172.21.15.8:38352) 2023-10-06T04:36:29.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.896+0000 7fa6137fe700 1 -- 172.21.15.8:0/2758494175 learned_addr learned my addr 172.21.15.8:0/2758494175 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:29.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.896+0000 7fa612ffd700 1 --2- 172.21.15.8:0/2758494175 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa614157170 0x7fa61406aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:29.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.896+0000 7fa6127fc700 1 --2- 172.21.15.8:0/2758494175 >> v2:172.21.15.184:3300/0 conn(0x7fa614157540 0x7fa61415aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:29.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.896+0000 7fa6137fe700 1 -- 172.21.15.8:0/2758494175 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa614157170 msgr2=0x7fa61406aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:29.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.896+0000 7fa6137fe700 1 --2- 172.21.15.8:0/2758494175 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa614157170 0x7fa61406aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:29.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.896+0000 7fa6137fe700 1 -- 172.21.15.8:0/2758494175 >> v2:172.21.15.184:3300/0 conn(0x7fa614157540 msgr2=0x7fa61415aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:29.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.896+0000 7fa6137fe700 1 --2- 172.21.15.8:0/2758494175 >> v2:172.21.15.184:3300/0 conn(0x7fa614157540 0x7fa61415aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:29.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.896+0000 7fa6137fe700 1 -- 172.21.15.8:0/2758494175 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61406a6d0 con 0x7fa61415b430 2023-10-06T04:36:29.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.896+0000 7fa6137fe700 1 --2- 172.21.15.8:0/2758494175 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa61415b430 0x7fa6140c9a70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa6140cab70 tx=0x7fa604009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f23ad3b620ed7a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:29.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.896+0000 7fa611ffb700 1 -- 172.21.15.8:0/2758494175 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60400e070 con 0x7fa61415b430 2023-10-06T04:36:29.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.896+0000 7fa611ffb700 1 -- 172.21.15.8:0/2758494175 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60400ba50 con 0x7fa61415b430 2023-10-06T04:36:29.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.896+0000 7fa611ffb700 1 -- 172.21.15.8:0/2758494175 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6040092e0 con 0x7fa61415b430 2023-10-06T04:36:29.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.897+0000 7fa6198a3700 1 -- 172.21.15.8:0/2758494175 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa61415b430 msgr2=0x7fa6140c9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:29.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.897+0000 7fa6198a3700 1 --2- 172.21.15.8:0/2758494175 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa61415b430 0x7fa6140c9a70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa6140cab70 tx=0x7fa604009840 comp rx=0 tx=0).stop 2023-10-06T04:36:29.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.897+0000 7fa6198a3700 1 -- 172.21.15.8:0/2758494175 shutdown_connections 2023-10-06T04:36:29.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.897+0000 7fa6198a3700 1 --2- 172.21.15.8:0/2758494175 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa61415b430 0x7fa6140c9a70 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:29.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.897+0000 7fa6198a3700 1 --2- 172.21.15.8:0/2758494175 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa614157170 0x7fa61406aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:29.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.897+0000 7fa6198a3700 1 --2- 172.21.15.8:0/2758494175 >> v2:172.21.15.184:3300/0 conn(0x7fa614157540 0x7fa61415aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:29.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.897+0000 7fa6198a3700 1 -- 172.21.15.8:0/2758494175 >> 172.21.15.8:0/2758494175 conn(0x7fa6140686e0 msgr2=0x7fa614068ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:29.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.897+0000 7fa6198a3700 1 -- 172.21.15.8:0/2758494175 shutdown_connections 2023-10-06T04:36:29.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.897+0000 7fa6198a3700 1 -- 172.21.15.8:0/2758494175 wait complete. 2023-10-06T04:36:29.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.898+0000 7fa6198a3700 1 Processor -- start 2023-10-06T04:36:29.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.898+0000 7fa6198a3700 1 -- start start 2023-10-06T04:36:29.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.899+0000 7fa6198a3700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa614157170 0x7fa6141542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:29.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.899+0000 7fa6198a3700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa614157540 0x7fa6140abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:29.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.899+0000 7fa6198a3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa61415b430 0x7fa6140cc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:29.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.899+0000 7fa6198a3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6140ad710 con 0x7fa61415b430 2023-10-06T04:36:29.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.899+0000 7fa6198a3700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6140c80f0 con 0x7fa614157540 2023-10-06T04:36:29.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.899+0000 7fa6198a3700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6140c83b0 con 0x7fa614157170 2023-10-06T04:36:29.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.899+0000 7fa6137fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa61415b430 0x7fa6140cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:29.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.899+0000 7fa6137fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa61415b430 0x7fa6140cc330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38360/0 (socket says 172.21.15.8:38360) 2023-10-06T04:36:29.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.899+0000 7fa6137fe700 1 -- 172.21.15.8:0/1303912143 learned_addr learned my addr 172.21.15.8:0/1303912143 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:29.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.899+0000 7fa612ffd700 1 --2- 172.21.15.8:0/1303912143 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa614157170 0x7fa6141542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:29.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.899+0000 7fa6127fc700 1 --2- 172.21.15.8:0/1303912143 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa614157540 0x7fa6140abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:29.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.899+0000 7fa6137fe700 1 -- 172.21.15.8:0/1303912143 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa614157170 msgr2=0x7fa6141542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:29.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.899+0000 7fa6137fe700 1 --2- 172.21.15.8:0/1303912143 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa614157170 0x7fa6141542e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:29.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.899+0000 7fa6137fe700 1 -- 172.21.15.8:0/1303912143 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa614157540 msgr2=0x7fa6140abbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:29.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.899+0000 7fa6137fe700 1 --2- 172.21.15.8:0/1303912143 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa614157540 0x7fa6140abbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:29.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.899+0000 7fa6137fe700 1 -- 172.21.15.8:0/1303912143 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa604009ae0 con 0x7fa61415b430 2023-10-06T04:36:29.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.899+0000 7fa6127fc700 1 --2- 172.21.15.8:0/1303912143 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa614157540 0x7fa6140abbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:36:29.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.899+0000 7fa6137fe700 1 --2- 172.21.15.8:0/1303912143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa61415b430 0x7fa6140cc330 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa604012000 tx=0x7fa604018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:29.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.899+0000 7fa60affd700 1 -- 172.21.15.8:0/1303912143 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6040032f0 con 0x7fa61415b430 2023-10-06T04:36:29.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.900+0000 7fa60affd700 1 -- 172.21.15.8:0/1303912143 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa604008e80 con 0x7fa61415b430 2023-10-06T04:36:29.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.900+0000 7fa6198a3700 1 -- 172.21.15.8:0/1303912143 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6140c8690 con 0x7fa61415b430 2023-10-06T04:36:29.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.900+0000 7fa60affd700 1 -- 172.21.15.8:0/1303912143 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6040256b0 con 0x7fa61415b430 2023-10-06T04:36:29.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.900+0000 7fa6198a3700 1 -- 172.21.15.8:0/1303912143 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa614154820 con 0x7fa61415b430 2023-10-06T04:36:29.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.900+0000 7fa6198a3700 1 -- 172.21.15.8:0/1303912143 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa614071550 con 0x7fa61415b430 2023-10-06T04:36:29.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.901+0000 7fa60affd700 1 -- 172.21.15.8:0/1303912143 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa604003040 con 0x7fa61415b430 2023-10-06T04:36:29.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.901+0000 7fa60affd700 1 --2- 172.21.15.8:0/1303912143 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa5f4066f30 0x7fa5f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:29.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.901+0000 7fa60affd700 1 -- 172.21.15.8:0/1303912143 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa604086060 con 0x7fa61415b430 2023-10-06T04:36:29.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.901+0000 7fa612ffd700 1 --2- 172.21.15.8:0/1303912143 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa5f4066f30 0x7fa5f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:29.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.902+0000 7fa612ffd700 1 --2- 172.21.15.8:0/1303912143 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa5f4066f30 0x7fa5f40693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa60c006fd0 tx=0x7fa60c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:29.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:29.906+0000 7fa60affd700 1 -- 172.21.15.8:0/1303912143 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa604052f30 con 0x7fa61415b430 2023-10-06T04:36:30.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.146+0000 7fa6198a3700 1 -- 172.21.15.8:0/1303912143 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa61406b410 con 0x7fa61415b430 2023-10-06T04:36:30.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.146+0000 7fa60affd700 1 -- 172.21.15.8:0/1303912143 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4587 (secure 0 0 0) 0x7fa604009940 con 0x7fa61415b430 2023-10-06T04:36:30.149 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:36:30.149 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/516627422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":516627422},{"type":"v1","addr":"172.21.15.8:6835","nonce":516627422}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/1078182353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1078182353},{"type":"v1","addr":"172.21.15.8:6834","nonce":1078182353}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/181555783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":181555783},{"type":"v1","addr":"172.21.15.184:6836","nonce":181555783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:36:16.632579+0000","modified":"2023-10-06T04:36:29.752096+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/2590100121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":2590100121},{"type":"v1","addr":"172.21.15.184:6837","nonce":2590100121}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:36:30.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.148+0000 7fa6198a3700 1 -- 172.21.15.8:0/1303912143 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa5f4066f30 msgr2=0x7fa5f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:30.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.148+0000 7fa6198a3700 1 --2- 172.21.15.8:0/1303912143 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa5f4066f30 0x7fa5f40693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa60c006fd0 tx=0x7fa60c008040 comp rx=0 tx=0).stop 2023-10-06T04:36:30.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.148+0000 7fa6198a3700 1 -- 172.21.15.8:0/1303912143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa61415b430 msgr2=0x7fa6140cc330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:30.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.148+0000 7fa6198a3700 1 --2- 172.21.15.8:0/1303912143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa61415b430 0x7fa6140cc330 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa604012000 tx=0x7fa604018000 comp rx=0 tx=0).stop 2023-10-06T04:36:30.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.148+0000 7fa6198a3700 1 -- 172.21.15.8:0/1303912143 shutdown_connections 2023-10-06T04:36:30.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.148+0000 7fa6198a3700 1 --2- 172.21.15.8:0/1303912143 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa5f4066f30 0x7fa5f40693e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:30.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.148+0000 7fa6198a3700 1 --2- 172.21.15.8:0/1303912143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa61415b430 0x7fa6140cc330 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:30.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.148+0000 7fa6198a3700 1 --2- 172.21.15.8:0/1303912143 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa614157170 0x7fa6141542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:30.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.148+0000 7fa6198a3700 1 --2- 172.21.15.8:0/1303912143 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa614157540 0x7fa6140abbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:30.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.148+0000 7fa6198a3700 1 -- 172.21.15.8:0/1303912143 >> 172.21.15.8:0/1303912143 conn(0x7fa6140686e0 msgr2=0x7fa6141567a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:30.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.148+0000 7fa6198a3700 1 -- 172.21.15.8:0/1303912143 shutdown_connections 2023-10-06T04:36:30.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.148+0000 7fa6198a3700 1 -- 172.21.15.8:0/1303912143 wait complete. 2023-10-06T04:36:30.152 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 9 2023-10-06T04:36:30.163 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:36:30.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.280+0000 7fec02ef4700 1 Processor -- start 2023-10-06T04:36:30.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.280+0000 7fec02ef4700 1 -- start start 2023-10-06T04:36:30.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.280+0000 7fec02ef4700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7febfc0af680 0x7febfc15e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:30.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.280+0000 7fec02ef4700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febfc0d0aa0 0x7febfc0cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:30.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.280+0000 7fec02ef4700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febfc0cc4c0 con 0x7febfc0cb360 2023-10-06T04:36:30.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.280+0000 7fec02ef4700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febfc15d460 con 0x7febfc0af680 2023-10-06T04:36:30.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.280+0000 7fec02ef4700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febfc15e580 con 0x7febfc0d0aa0 2023-10-06T04:36:30.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.281+0000 7febfbfff700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7febfc0cb360 0x7febfc0d0390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34546/0 (socket says 172.21.15.8:34546) 2023-10-06T04:36:30.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.281+0000 7febfbfff700 1 -- 172.21.15.8:0/2998832005 learned_addr learned my addr 172.21.15.8:0/2998832005 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:30.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.281+0000 7fec00c90700 1 --2- 172.21.15.8:0/2998832005 >> v2:172.21.15.184:3300/0 conn(0x7febfc0af680 0x7febfc15e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:30.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.281+0000 7fec01491700 1 --2- 172.21.15.8:0/2998832005 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febfc0d0aa0 0x7febfc0cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:30.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.281+0000 7febfb7fe700 1 -- 172.21.15.8:0/2998832005 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2575365218 0 0) 0x7febfc0cc4c0 con 0x7febfc0cb360 2023-10-06T04:36:30.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.281+0000 7febfb7fe700 1 -- 172.21.15.8:0/2998832005 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febe8003570 con 0x7febfc0cb360 2023-10-06T04:36:30.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.281+0000 7febfb7fe700 1 -- 172.21.15.8:0/2998832005 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3463428745 0 0) 0x7febe8003570 con 0x7febfc0cb360 2023-10-06T04:36:30.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.281+0000 7febfb7fe700 1 -- 172.21.15.8:0/2998832005 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febfc0d0aa0 msgr2=0x7febfc0cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:30.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.281+0000 7febfb7fe700 1 --2- 172.21.15.8:0/2998832005 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febfc0d0aa0 0x7febfc0cc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:30.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.281+0000 7febfb7fe700 1 -- 172.21.15.8:0/2998832005 >> v2:172.21.15.184:3300/0 conn(0x7febfc0af680 msgr2=0x7febfc15e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:30.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.281+0000 7febfb7fe700 1 --2- 172.21.15.8:0/2998832005 >> v2:172.21.15.184:3300/0 conn(0x7febfc0af680 0x7febfc15e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:30.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.281+0000 7febfb7fe700 1 -- 172.21.15.8:0/2998832005 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febfc0cb8b0 con 0x7febfc0cb360 2023-10-06T04:36:30.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.281+0000 7febfb7fe700 1 -- 172.21.15.8:0/2998832005 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7febe4001470 con 0x7febfc0cb360 2023-10-06T04:36:30.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.281+0000 7febfb7fe700 1 -- 172.21.15.8:0/2998832005 >> v1:172.21.15.8:6789/0 conn(0x7febfc0cb360 legacy=0x7febfc0d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:30.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.281+0000 7febfb7fe700 1 --2- 172.21.15.8:0/2998832005 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febfc0d0aa0 0x7febe8003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:30.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.281+0000 7febfb7fe700 1 --2- 172.21.15.8:0/2998832005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7febe8003fe0 0x7febe8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:30.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.281+0000 7febfb7fe700 1 --2- 172.21.15.8:0/2998832005 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febe8004d50 0x7febe80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:30.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.281+0000 7febfb7fe700 1 -- 172.21.15.8:0/2998832005 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febfc15d460 con 0x7febe8003fe0 2023-10-06T04:36:30.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.281+0000 7febfb7fe700 1 -- 172.21.15.8:0/2998832005 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febfc15e580 con 0x7febe8004d50 2023-10-06T04:36:30.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.281+0000 7febfb7fe700 1 -- 172.21.15.8:0/2998832005 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe800ba90 con 0x7febfc0d0aa0 2023-10-06T04:36:30.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.281+0000 7fec00c90700 1 --2- 172.21.15.8:0/2998832005 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febfc0d0aa0 0x7febe8003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:30.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.281+0000 7febfbfff700 1 --2- 172.21.15.8:0/2998832005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7febe8003fe0 0x7febe8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:30.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.281+0000 7fec01491700 1 --2- 172.21.15.8:0/2998832005 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febe8004d50 0x7febe80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:30.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.282+0000 7febfbfff700 1 -- 172.21.15.8:0/2998832005 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febfc0d0aa0 msgr2=0x7febe8003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:30.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.282+0000 7febfbfff700 1 --2- 172.21.15.8:0/2998832005 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febfc0d0aa0 0x7febe8003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:30.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.282+0000 7febfbfff700 1 -- 172.21.15.8:0/2998832005 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febe8004d50 msgr2=0x7febe80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:30.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.282+0000 7febfbfff700 1 --2- 172.21.15.8:0/2998832005 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febe8004d50 0x7febe80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:30.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.282+0000 7febfbfff700 1 -- 172.21.15.8:0/2998832005 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe8003570 con 0x7febe8003fe0 2023-10-06T04:36:30.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.282+0000 7febfbfff700 1 --2- 172.21.15.8:0/2998832005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7febe8003fe0 0x7febe8004810 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7febe400c3c0 tx=0x7febfc069610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e26b55d46010f2c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:30.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.282+0000 7febfb7fe700 1 -- 172.21.15.8:0/2998832005 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe400cc30 con 0x7febe8003fe0 2023-10-06T04:36:30.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.282+0000 7febfb7fe700 1 -- 172.21.15.8:0/2998832005 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe400cdd0 con 0x7febe8003fe0 2023-10-06T04:36:30.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.282+0000 7febfb7fe700 1 -- 172.21.15.8:0/2998832005 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe4005b70 con 0x7febe8003fe0 2023-10-06T04:36:30.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.283+0000 7fec02ef4700 1 -- 172.21.15.8:0/2998832005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7febe8003fe0 msgr2=0x7febe8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:30.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.283+0000 7fec02ef4700 1 --2- 172.21.15.8:0/2998832005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7febe8003fe0 0x7febe8004810 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7febe400c3c0 tx=0x7febfc069610 comp rx=0 tx=0).stop 2023-10-06T04:36:30.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.283+0000 7fec01491700 1 -- 172.21.15.8:0/2998832005 reap_dead start 2023-10-06T04:36:30.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.283+0000 7fec02ef4700 1 -- 172.21.15.8:0/2998832005 shutdown_connections 2023-10-06T04:36:30.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.283+0000 7fec02ef4700 1 -- 172.21.15.8:0/2998832005 >> 172.21.15.8:0/2998832005 conn(0x7febfc0633d0 msgr2=0x7febfc0637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:30.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.283+0000 7fec02ef4700 1 -- 172.21.15.8:0/2998832005 shutdown_connections 2023-10-06T04:36:30.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.283+0000 7fec02ef4700 1 -- 172.21.15.8:0/2998832005 wait complete. 2023-10-06T04:36:30.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.284+0000 7fec02ef4700 1 Processor -- start 2023-10-06T04:36:30.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.284+0000 7fec02ef4700 1 -- start start 2023-10-06T04:36:30.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.285+0000 7fec02ef4700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febe8003fe0 0x7febfc0ca110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:30.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.285+0000 7fec02ef4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7febfc16a180 0x7febfc16a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:30.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.285+0000 7fec02ef4700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febfc16ab30 0x7febfc0b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:30.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.285+0000 7fec02ef4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febfc0c83d0 con 0x7febfc16a180 2023-10-06T04:36:30.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.285+0000 7fec02ef4700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febfc0c9710 con 0x7febfc16ab30 2023-10-06T04:36:30.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.285+0000 7fec02ef4700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febfc0c8670 con 0x7febe8003fe0 2023-10-06T04:36:30.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.285+0000 7febfbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7febfc16a180 0x7febfc16a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:30.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.285+0000 7febfbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7febfc16a180 0x7febfc16a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38374/0 (socket says 172.21.15.8:38374) 2023-10-06T04:36:30.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.285+0000 7febfbfff700 1 -- 172.21.15.8:0/171769761 learned_addr learned my addr 172.21.15.8:0/171769761 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:30.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.285+0000 7fec00c90700 1 --2- 172.21.15.8:0/171769761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febe8003fe0 0x7febfc0ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:30.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.285+0000 7fec01491700 1 --2- 172.21.15.8:0/171769761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febfc16ab30 0x7febfc0b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:30.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.285+0000 7febfbfff700 1 -- 172.21.15.8:0/171769761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febe8003fe0 msgr2=0x7febfc0ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:30.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.285+0000 7febfbfff700 1 --2- 172.21.15.8:0/171769761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febe8003fe0 0x7febfc0ca110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:30.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.285+0000 7febfbfff700 1 -- 172.21.15.8:0/171769761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febfc16ab30 msgr2=0x7febfc0b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:30.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.285+0000 7febfbfff700 1 --2- 172.21.15.8:0/171769761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febfc16ab30 0x7febfc0b31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:30.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.285+0000 7febfbfff700 1 -- 172.21.15.8:0/171769761 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febfc0c8950 con 0x7febfc16a180 2023-10-06T04:36:30.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.285+0000 7fec00c90700 1 --2- 172.21.15.8:0/171769761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febe8003fe0 0x7febfc0ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:36:30.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.285+0000 7febfbfff700 1 --2- 172.21.15.8:0/171769761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7febfc16a180 0x7febfc16a5f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7febe4011000 tx=0x7febe4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:30.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.285+0000 7febf8ff9700 1 -- 172.21.15.8:0/171769761 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe400cc30 con 0x7febfc16a180 2023-10-06T04:36:30.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.285+0000 7febf8ff9700 1 -- 172.21.15.8:0/171769761 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe400c9e0 con 0x7febfc16a180 2023-10-06T04:36:30.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.285+0000 7fec02ef4700 1 -- 172.21.15.8:0/171769761 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febfc0c8c30 con 0x7febfc16a180 2023-10-06T04:36:30.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.285+0000 7febf8ff9700 1 -- 172.21.15.8:0/171769761 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe4007550 con 0x7febfc16a180 2023-10-06T04:36:30.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.285+0000 7fec02ef4700 1 -- 172.21.15.8:0/171769761 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febfc0c91f0 con 0x7febfc16a180 2023-10-06T04:36:30.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.286+0000 7fec02ef4700 1 -- 172.21.15.8:0/171769761 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febfc071550 con 0x7febfc16a180 2023-10-06T04:36:30.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.288+0000 7febf8ff9700 1 -- 172.21.15.8:0/171769761 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7febe4019030 con 0x7febfc16a180 2023-10-06T04:36:30.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.288+0000 7febf8ff9700 1 --2- 172.21.15.8:0/171769761 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7febdc066f30 0x7febdc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:30.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.288+0000 7febf8ff9700 1 -- 172.21.15.8:0/171769761 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7febe40864f0 con 0x7febfc16a180 2023-10-06T04:36:30.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.288+0000 7fec00c90700 1 --2- 172.21.15.8:0/171769761 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7febdc066f30 0x7febdc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:30.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.289+0000 7fec00c90700 1 --2- 172.21.15.8:0/171769761 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7febdc066f30 0x7febdc0693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7febf40099f0 tx=0x7febf400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:30.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.291+0000 7febf8ff9700 1 -- 172.21.15.8:0/171769761 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7febe4053390 con 0x7febfc16a180 2023-10-06T04:36:30.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.486+0000 7fec02ef4700 1 -- 172.21.15.8:0/171769761 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7febfc0c83d0 con 0x7febfc16a180 2023-10-06T04:36:30.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.487+0000 7febf8ff9700 1 -- 172.21.15.8:0/171769761 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18659 (secure 0 0 0) 0x7febe40569b0 con 0x7febfc16a180 2023-10-06T04:36:30.489 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:36:30.489 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":25,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:36:21.690266+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:36:10.148177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:36:10.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:36:14.390671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:36:15.601089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:36:19.291300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.555871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.490505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.504578+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.517217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:05.991135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.537329+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.543232+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.443715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:36:30.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.489+0000 7fec02ef4700 1 -- 172.21.15.8:0/171769761 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7febdc066f30 msgr2=0x7febdc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:30.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.489+0000 7fec02ef4700 1 --2- 172.21.15.8:0/171769761 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7febdc066f30 0x7febdc0693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7febf40099f0 tx=0x7febf400b040 comp rx=0 tx=0).stop 2023-10-06T04:36:30.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.489+0000 7fec02ef4700 1 -- 172.21.15.8:0/171769761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7febfc16a180 msgr2=0x7febfc16a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:30.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.489+0000 7fec02ef4700 1 --2- 172.21.15.8:0/171769761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7febfc16a180 0x7febfc16a5f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7febe4011000 tx=0x7febe4015000 comp rx=0 tx=0).stop 2023-10-06T04:36:30.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.489+0000 7fec02ef4700 1 -- 172.21.15.8:0/171769761 shutdown_connections 2023-10-06T04:36:30.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.489+0000 7fec02ef4700 1 --2- 172.21.15.8:0/171769761 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7febdc066f30 0x7febdc0693e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:30.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.489+0000 7fec02ef4700 1 --2- 172.21.15.8:0/171769761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febfc16ab30 0x7febfc0b31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:30.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.489+0000 7fec02ef4700 1 --2- 172.21.15.8:0/171769761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febe8003fe0 0x7febfc0ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:30.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.489+0000 7fec02ef4700 1 --2- 172.21.15.8:0/171769761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7febfc16a180 0x7febfc16a5f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:30.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.489+0000 7fec02ef4700 1 -- 172.21.15.8:0/171769761 >> 172.21.15.8:0/171769761 conn(0x7febfc0633d0 msgr2=0x7febfc0cf300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:30.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.489+0000 7fec02ef4700 1 -- 172.21.15.8:0/171769761 shutdown_connections 2023-10-06T04:36:30.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.489+0000 7fec02ef4700 1 -- 172.21.15.8:0/171769761 wait complete. 2023-10-06T04:36:30.504 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T04:36:30.504 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:36:30.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.620+0000 7f411f41f700 1 Processor -- start 2023-10-06T04:36:30.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.621+0000 7f411f41f700 1 -- start start 2023-10-06T04:36:30.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.621+0000 7f411f41f700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4118157170 0x7f41180c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:30.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.621+0000 7f411f41f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f41180c7630 0x7f41180c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:30.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.621+0000 7f411f41f700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41180c7fb0 con 0x7f411815da90 2023-10-06T04:36:30.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.621+0000 7f411f41f700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4118157540 con 0x7f4118157170 2023-10-06T04:36:30.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.621+0000 7f411f41f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41180ca030 con 0x7f41180c7630 2023-10-06T04:36:30.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.622+0000 7f411d1bb700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4118157170 0x7f41180c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:30.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.622+0000 7f411c9ba700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f411815da90 0x7f411815a4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34558/0 (socket says 172.21.15.8:34558) 2023-10-06T04:36:30.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.622+0000 7f411c9ba700 1 -- 172.21.15.8:0/3640604474 learned_addr learned my addr 172.21.15.8:0/3640604474 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:30.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.622+0000 7f411d1bb700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4118157170 0x7f41180c99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38384/0 (socket says 172.21.15.8:38384) 2023-10-06T04:36:30.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.622+0000 7f411d9bc700 1 --2- 172.21.15.8:0/3640604474 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f41180c7630 0x7f41180c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:30.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.622+0000 7f411d1bb700 1 -- 172.21.15.8:0/3640604474 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f41180c7630 msgr2=0x7f41180c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:30.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.622+0000 7f411d1bb700 1 --2- 172.21.15.8:0/3640604474 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f41180c7630 0x7f41180c7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:30.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.622+0000 7f411d1bb700 1 -- 172.21.15.8:0/3640604474 >> v1:172.21.15.8:6789/0 conn(0x7f411815da90 legacy=0x7f411815a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:30.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.622+0000 7f411d1bb700 1 -- 172.21.15.8:0/3640604474 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41180ca310 con 0x7f4118157170 2023-10-06T04:36:30.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.622+0000 7f4117fff700 1 -- 172.21.15.8:0/3640604474 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1061914048 0 0) 0x7f41180c7fb0 con 0x7f411815da90 2023-10-06T04:36:30.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.622+0000 7f411d1bb700 1 --2- 172.21.15.8:0/3640604474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4118157170 0x7f41180c99a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f41100098e0 tx=0x7f41100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a10504341c9c8563 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:30.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.622+0000 7f4117fff700 1 -- 172.21.15.8:0/3640604474 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4110009e80 con 0x7f4118157170 2023-10-06T04:36:30.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.622+0000 7f4117fff700 1 -- 172.21.15.8:0/3640604474 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411000b860 con 0x7f4118157170 2023-10-06T04:36:30.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.622+0000 7f4117fff700 1 -- 172.21.15.8:0/3640604474 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411000bbe0 con 0x7f4118157170 2023-10-06T04:36:30.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.623+0000 7f411f41f700 1 -- 172.21.15.8:0/3640604474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4118157170 msgr2=0x7f41180c99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:30.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.623+0000 7f411f41f700 1 --2- 172.21.15.8:0/3640604474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4118157170 0x7f41180c99a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f41100098e0 tx=0x7f41100091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:30.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.623+0000 7f411f41f700 1 -- 172.21.15.8:0/3640604474 shutdown_connections 2023-10-06T04:36:30.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.623+0000 7f411f41f700 1 --2- 172.21.15.8:0/3640604474 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f41180c7630 0x7f41180c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:30.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.623+0000 7f411f41f700 1 --2- 172.21.15.8:0/3640604474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4118157170 0x7f41180c99a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:30.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.623+0000 7f411f41f700 1 -- 172.21.15.8:0/3640604474 >> 172.21.15.8:0/3640604474 conn(0x7f41180686e0 msgr2=0x7f4118068ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:30.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.623+0000 7f411f41f700 1 -- 172.21.15.8:0/3640604474 shutdown_connections 2023-10-06T04:36:30.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.623+0000 7f411f41f700 1 -- 172.21.15.8:0/3640604474 wait complete. 2023-10-06T04:36:30.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.624+0000 7f411f41f700 1 Processor -- start 2023-10-06T04:36:30.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.624+0000 7f411f41f700 1 -- start start 2023-10-06T04:36:30.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.625+0000 7f411f41f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f41180c7630 0x7f41180b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:30.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.625+0000 7f411f41f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4118157170 0x7f41181695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:30.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.625+0000 7f411f41f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f411815da90 0x7f4118169b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:30.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.625+0000 7f411f41f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411816ace0 con 0x7f411815da90 2023-10-06T04:36:30.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.625+0000 7f411f41f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41180cabc0 con 0x7f4118157170 2023-10-06T04:36:30.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.625+0000 7f411f41f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41180c0870 con 0x7f41180c7630 2023-10-06T04:36:30.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.625+0000 7f411d9bc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f411815da90 0x7f4118169b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:30.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.625+0000 7f411d9bc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f411815da90 0x7f4118169b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38392/0 (socket says 172.21.15.8:38392) 2023-10-06T04:36:30.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.625+0000 7f411d9bc700 1 -- 172.21.15.8:0/3160589805 learned_addr learned my addr 172.21.15.8:0/3160589805 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:30.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.625+0000 7f411d1bb700 1 --2- 172.21.15.8:0/3160589805 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f41180c7630 0x7f41180b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:30.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.625+0000 7f411c9ba700 1 --2- 172.21.15.8:0/3160589805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4118157170 0x7f41181695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:30.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.625+0000 7f411d9bc700 1 -- 172.21.15.8:0/3160589805 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f41180c7630 msgr2=0x7f41180b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:30.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.625+0000 7f411d9bc700 1 --2- 172.21.15.8:0/3160589805 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f41180c7630 0x7f41180b24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:30.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.625+0000 7f411d9bc700 1 -- 172.21.15.8:0/3160589805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4118157170 msgr2=0x7f41181695e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:30.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.625+0000 7f411d9bc700 1 --2- 172.21.15.8:0/3160589805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4118157170 0x7f41181695e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:30.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.625+0000 7f411d9bc700 1 -- 172.21.15.8:0/3160589805 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4110009420 con 0x7f411815da90 2023-10-06T04:36:30.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.626+0000 7f411d9bc700 1 --2- 172.21.15.8:0/3160589805 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f411815da90 0x7f4118169b20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4108009fa0 tx=0x7f4108009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:30.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.626+0000 7f41157fa700 1 -- 172.21.15.8:0/3160589805 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410800ebc0 con 0x7f411815da90 2023-10-06T04:36:30.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.626+0000 7f41157fa700 1 -- 172.21.15.8:0/3160589805 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f410800ed20 con 0x7f411815da90 2023-10-06T04:36:30.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.626+0000 7f411f41f700 1 -- 172.21.15.8:0/3160589805 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41180c2f60 con 0x7f411815da90 2023-10-06T04:36:30.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.626+0000 7f41157fa700 1 -- 172.21.15.8:0/3160589805 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4108014670 con 0x7f411815da90 2023-10-06T04:36:30.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.626+0000 7f411f41f700 1 -- 172.21.15.8:0/3160589805 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41180c3800 con 0x7f411815da90 2023-10-06T04:36:30.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.627+0000 7f411f41f700 1 -- 172.21.15.8:0/3160589805 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4118071550 con 0x7f411815da90 2023-10-06T04:36:30.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.627+0000 7f41157fa700 1 -- 172.21.15.8:0/3160589805 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f41080149e0 con 0x7f411815da90 2023-10-06T04:36:30.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.628+0000 7f41157fa700 1 --2- 172.21.15.8:0/3160589805 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4104066f30 0x7f41040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:30.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.628+0000 7f41157fa700 1 -- 172.21.15.8:0/3160589805 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4108085020 con 0x7f411815da90 2023-10-06T04:36:30.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.628+0000 7f411d1bb700 1 --2- 172.21.15.8:0/3160589805 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4104066f30 0x7f41040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:30.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.628+0000 7f411d1bb700 1 --2- 172.21.15.8:0/3160589805 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4104066f30 0x7f41040693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f41100091e0 tx=0x7f4110017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:30.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.632+0000 7f41157fa700 1 -- 172.21.15.8:0/3160589805 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4108051e40 con 0x7f411815da90 2023-10-06T04:36:30.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.822+0000 7f411f41f700 1 -- 172.21.15.8:0/3160589805 --> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f41180c7410 con 0x7f4104066f30 2023-10-06T04:36:30.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.833+0000 7f41157fa700 1 -- 172.21.15.8:0/3160589805 <== mgr.4105 v2:172.21.15.184:6832/90283 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367523 (secure 0 0 0) 0x7f41180c7410 con 0x7f4104066f30 2023-10-06T04:36:30.840 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:36:30.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.836+0000 7f411f41f700 1 -- 172.21.15.8:0/3160589805 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4104066f30 msgr2=0x7f41040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:30.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.836+0000 7f411f41f700 1 --2- 172.21.15.8:0/3160589805 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4104066f30 0x7f41040693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f41100091e0 tx=0x7f4110017000 comp rx=0 tx=0).stop 2023-10-06T04:36:30.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.836+0000 7f411f41f700 1 -- 172.21.15.8:0/3160589805 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f411815da90 msgr2=0x7f4118169b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:30.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.836+0000 7f411f41f700 1 --2- 172.21.15.8:0/3160589805 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f411815da90 0x7f4118169b20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4108009fa0 tx=0x7f4108009900 comp rx=0 tx=0).stop 2023-10-06T04:36:30.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.836+0000 7f411f41f700 1 -- 172.21.15.8:0/3160589805 shutdown_connections 2023-10-06T04:36:30.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.836+0000 7f411f41f700 1 --2- 172.21.15.8:0/3160589805 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4104066f30 0x7f41040693e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:30.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.836+0000 7f411f41f700 1 --2- 172.21.15.8:0/3160589805 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f411815da90 0x7f4118169b20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:30.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.836+0000 7f411f41f700 1 --2- 172.21.15.8:0/3160589805 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f41180c7630 0x7f41180b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:30.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.836+0000 7f411f41f700 1 --2- 172.21.15.8:0/3160589805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4118157170 0x7f41181695e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:30.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.836+0000 7f411f41f700 1 -- 172.21.15.8:0/3160589805 >> 172.21.15.8:0/3160589805 conn(0x7f41180686e0 msgr2=0x7f4118155a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:30.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.836+0000 7f411f41f700 1 -- 172.21.15.8:0/3160589805 shutdown_connections 2023-10-06T04:36:30.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:30.836+0000 7f411f41f700 1 -- 172.21.15.8:0/3160589805 wait complete. 2023-10-06T04:36:30.845 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-06T04:36:30.851 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-10-06T04:36:30.633294+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594852,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381596,"kb_used_data":3292,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593124,"statfs":{"total":773094113280,"available":770655358976,"internally_reserved":0,"allocated":3371008,"data_stored":2062434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2178,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.356605"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.272647+0000","last_change":"2023-10-06T04:36:17.255009+0000","last_active":"2023-10-06T04:36:21.272647+0000","last_peered":"2023-10-06T04:36:21.272647+0000","last_clean":"2023-10-06T04:36:21.272647+0000","last_became_active":"2023-10-06T04:36:17.254704+0000","last_became_peered":"2023-10-06T04:36:17.254704+0000","last_unstale":"2023-10-06T04:36:21.272647+0000","last_undegraded":"2023-10-06T04:36:21.272647+0000","last_fullsized":"2023-10-06T04:36:21.272647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:45:34.132581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291077+0000","last_change":"2023-10-06T04:36:17.256537+0000","last_active":"2023-10-06T04:36:21.291077+0000","last_peered":"2023-10-06T04:36:21.291077+0000","last_clean":"2023-10-06T04:36:21.291077+0000","last_became_active":"2023-10-06T04:36:17.256004+0000","last_became_peered":"2023-10-06T04:36:17.256004+0000","last_unstale":"2023-10-06T04:36:21.291077+0000","last_undegraded":"2023-10-06T04:36:21.291077+0000","last_fullsized":"2023-10-06T04:36:21.291077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:02.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.281626+0000","last_change":"2023-10-06T04:36:17.251532+0000","last_active":"2023-10-06T04:36:21.281626+0000","last_peered":"2023-10-06T04:36:21.281626+0000","last_clean":"2023-10-06T04:36:21.281626+0000","last_became_active":"2023-10-06T04:36:17.250378+0000","last_became_peered":"2023-10-06T04:36:17.250378+0000","last_unstale":"2023-10-06T04:36:21.281626+0000","last_undegraded":"2023-10-06T04:36:21.281626+0000","last_fullsized":"2023-10-06T04:36:21.281626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:10.868173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.283431+0000","last_change":"2023-10-06T04:36:17.256131+0000","last_active":"2023-10-06T04:36:21.283431+0000","last_peered":"2023-10-06T04:36:21.283431+0000","last_clean":"2023-10-06T04:36:21.283431+0000","last_became_active":"2023-10-06T04:36:17.255865+0000","last_became_peered":"2023-10-06T04:36:17.255865+0000","last_unstale":"2023-10-06T04:36:21.283431+0000","last_undegraded":"2023-10-06T04:36:21.283431+0000","last_fullsized":"2023-10-06T04:36:21.283431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:40.502199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.284418+0000","last_change":"2023-10-06T04:36:17.247145+0000","last_active":"2023-10-06T04:36:21.284418+0000","last_peered":"2023-10-06T04:36:21.284418+0000","last_clean":"2023-10-06T04:36:21.284418+0000","last_became_active":"2023-10-06T04:36:17.246879+0000","last_became_peered":"2023-10-06T04:36:17.246879+0000","last_unstale":"2023-10-06T04:36:21.284418+0000","last_undegraded":"2023-10-06T04:36:21.284418+0000","last_fullsized":"2023-10-06T04:36:21.284418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:23:08.806295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280687+0000","last_change":"2023-10-06T04:36:17.252945+0000","last_active":"2023-10-06T04:36:21.280687+0000","last_peered":"2023-10-06T04:36:21.280687+0000","last_clean":"2023-10-06T04:36:21.280687+0000","last_became_active":"2023-10-06T04:36:17.252697+0000","last_became_peered":"2023-10-06T04:36:17.252697+0000","last_unstale":"2023-10-06T04:36:21.280687+0000","last_undegraded":"2023-10-06T04:36:21.280687+0000","last_fullsized":"2023-10-06T04:36:21.280687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:56.005620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291321+0000","last_change":"2023-10-06T04:36:17.259179+0000","last_active":"2023-10-06T04:36:21.291321+0000","last_peered":"2023-10-06T04:36:21.291321+0000","last_clean":"2023-10-06T04:36:21.291321+0000","last_became_active":"2023-10-06T04:36:17.258896+0000","last_became_peered":"2023-10-06T04:36:17.258896+0000","last_unstale":"2023-10-06T04:36:21.291321+0000","last_undegraded":"2023-10-06T04:36:21.291321+0000","last_fullsized":"2023-10-06T04:36:21.291321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:06.137894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.290396+0000","last_change":"2023-10-06T04:36:17.251370+0000","last_active":"2023-10-06T04:36:21.290396+0000","last_peered":"2023-10-06T04:36:21.290396+0000","last_clean":"2023-10-06T04:36:21.290396+0000","last_became_active":"2023-10-06T04:36:17.251111+0000","last_became_peered":"2023-10-06T04:36:17.251111+0000","last_unstale":"2023-10-06T04:36:21.290396+0000","last_undegraded":"2023-10-06T04:36:21.290396+0000","last_fullsized":"2023-10-06T04:36:21.290396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:01:35.146203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276077+0000","last_change":"2023-10-06T04:36:17.247564+0000","last_active":"2023-10-06T04:36:21.276077+0000","last_peered":"2023-10-06T04:36:21.276077+0000","last_clean":"2023-10-06T04:36:21.276077+0000","last_became_active":"2023-10-06T04:36:17.247306+0000","last_became_peered":"2023-10-06T04:36:17.247306+0000","last_unstale":"2023-10-06T04:36:21.276077+0000","last_undegraded":"2023-10-06T04:36:21.276077+0000","last_fullsized":"2023-10-06T04:36:21.276077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:02.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291293+0000","last_change":"2023-10-06T04:36:17.256706+0000","last_active":"2023-10-06T04:36:21.291293+0000","last_peered":"2023-10-06T04:36:21.291293+0000","last_clean":"2023-10-06T04:36:21.291293+0000","last_became_active":"2023-10-06T04:36:17.256322+0000","last_became_peered":"2023-10-06T04:36:17.256322+0000","last_unstale":"2023-10-06T04:36:21.291293+0000","last_undegraded":"2023-10-06T04:36:21.291293+0000","last_fullsized":"2023-10-06T04:36:21.291293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:23:08.806295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.281544+0000","last_change":"2023-10-06T04:36:17.266725+0000","last_active":"2023-10-06T04:36:21.281544+0000","last_peered":"2023-10-06T04:36:21.281544+0000","last_clean":"2023-10-06T04:36:21.281544+0000","last_became_active":"2023-10-06T04:36:17.266037+0000","last_became_peered":"2023-10-06T04:36:17.266037+0000","last_unstale":"2023-10-06T04:36:21.281544+0000","last_undegraded":"2023-10-06T04:36:21.281544+0000","last_fullsized":"2023-10-06T04:36:21.281544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:35.000504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.272228+0000","last_change":"2023-10-06T04:36:17.244295+0000","last_active":"2023-10-06T04:36:21.272228+0000","last_peered":"2023-10-06T04:36:21.272228+0000","last_clean":"2023-10-06T04:36:21.272228+0000","last_became_active":"2023-10-06T04:36:17.244029+0000","last_became_peered":"2023-10-06T04:36:17.244029+0000","last_unstale":"2023-10-06T04:36:21.272228+0000","last_undegraded":"2023-10-06T04:36:21.272228+0000","last_fullsized":"2023-10-06T04:36:21.272228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:11.610976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.272361+0000","last_change":"2023-10-06T04:36:17.247080+0000","last_active":"2023-10-06T04:36:21.272361+0000","last_peered":"2023-10-06T04:36:21.272361+0000","last_clean":"2023-10-06T04:36:21.272361+0000","last_became_active":"2023-10-06T04:36:17.246794+0000","last_became_peered":"2023-10-06T04:36:17.246794+0000","last_unstale":"2023-10-06T04:36:21.272361+0000","last_undegraded":"2023-10-06T04:36:21.272361+0000","last_fullsized":"2023-10-06T04:36:21.272361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:13.150215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291383+0000","last_change":"2023-10-06T04:36:17.258372+0000","last_active":"2023-10-06T04:36:21.291383+0000","last_peered":"2023-10-06T04:36:21.291383+0000","last_clean":"2023-10-06T04:36:21.291383+0000","last_became_active":"2023-10-06T04:36:17.258116+0000","last_became_peered":"2023-10-06T04:36:17.258116+0000","last_unstale":"2023-10-06T04:36:21.291383+0000","last_undegraded":"2023-10-06T04:36:21.291383+0000","last_fullsized":"2023-10-06T04:36:21.291383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:15.884489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291099+0000","last_change":"2023-10-06T04:36:17.259309+0000","last_active":"2023-10-06T04:36:21.291099+0000","last_peered":"2023-10-06T04:36:21.291099+0000","last_clean":"2023-10-06T04:36:21.291099+0000","last_became_active":"2023-10-06T04:36:17.259048+0000","last_became_peered":"2023-10-06T04:36:17.259048+0000","last_unstale":"2023-10-06T04:36:21.291099+0000","last_undegraded":"2023-10-06T04:36:21.291099+0000","last_fullsized":"2023-10-06T04:36:21.291099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:03.209071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280262+0000","last_change":"2023-10-06T04:36:17.248671+0000","last_active":"2023-10-06T04:36:21.280262+0000","last_peered":"2023-10-06T04:36:21.280262+0000","last_clean":"2023-10-06T04:36:21.280262+0000","last_became_active":"2023-10-06T04:36:17.248389+0000","last_became_peered":"2023-10-06T04:36:17.248389+0000","last_unstale":"2023-10-06T04:36:21.280262+0000","last_undegraded":"2023-10-06T04:36:21.280262+0000","last_fullsized":"2023-10-06T04:36:21.280262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:32.568497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276165+0000","last_change":"2023-10-06T04:36:17.253794+0000","last_active":"2023-10-06T04:36:21.276165+0000","last_peered":"2023-10-06T04:36:21.276165+0000","last_clean":"2023-10-06T04:36:21.276165+0000","last_became_active":"2023-10-06T04:36:17.253556+0000","last_became_peered":"2023-10-06T04:36:17.253556+0000","last_unstale":"2023-10-06T04:36:21.276165+0000","last_undegraded":"2023-10-06T04:36:21.276165+0000","last_fullsized":"2023-10-06T04:36:21.276165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:53.436742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.281355+0000","last_change":"2023-10-06T04:36:17.248844+0000","last_active":"2023-10-06T04:36:21.281355+0000","last_peered":"2023-10-06T04:36:21.281355+0000","last_clean":"2023-10-06T04:36:21.281355+0000","last_became_active":"2023-10-06T04:36:17.248564+0000","last_became_peered":"2023-10-06T04:36:17.248564+0000","last_unstale":"2023-10-06T04:36:21.281355+0000","last_undegraded":"2023-10-06T04:36:21.281355+0000","last_fullsized":"2023-10-06T04:36:21.281355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:09:48.312479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.272565+0000","last_change":"2023-10-06T04:36:17.250339+0000","last_active":"2023-10-06T04:36:21.272565+0000","last_peered":"2023-10-06T04:36:21.272565+0000","last_clean":"2023-10-06T04:36:21.272565+0000","last_became_active":"2023-10-06T04:36:17.250051+0000","last_became_peered":"2023-10-06T04:36:17.250051+0000","last_unstale":"2023-10-06T04:36:21.272565+0000","last_undegraded":"2023-10-06T04:36:21.272565+0000","last_fullsized":"2023-10-06T04:36:21.272565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:43.576906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280996+0000","last_change":"2023-10-06T04:36:17.250606+0000","last_active":"2023-10-06T04:36:21.280996+0000","last_peered":"2023-10-06T04:36:21.280996+0000","last_clean":"2023-10-06T04:36:21.280996+0000","last_became_active":"2023-10-06T04:36:17.250295+0000","last_became_peered":"2023-10-06T04:36:17.250295+0000","last_unstale":"2023-10-06T04:36:21.280996+0000","last_undegraded":"2023-10-06T04:36:21.280996+0000","last_fullsized":"2023-10-06T04:36:21.280996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:52.945703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.292940+0000","last_change":"2023-10-06T04:36:17.260489+0000","last_active":"2023-10-06T04:36:21.292940+0000","last_peered":"2023-10-06T04:36:21.292940+0000","last_clean":"2023-10-06T04:36:21.292940+0000","last_became_active":"2023-10-06T04:36:17.259923+0000","last_became_peered":"2023-10-06T04:36:17.259923+0000","last_unstale":"2023-10-06T04:36:21.292940+0000","last_undegraded":"2023-10-06T04:36:21.292940+0000","last_fullsized":"2023-10-06T04:36:21.292940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:53.436742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.278618+0000","last_change":"2023-10-06T04:36:17.248545+0000","last_active":"2023-10-06T04:36:21.278618+0000","last_peered":"2023-10-06T04:36:21.278618+0000","last_clean":"2023-10-06T04:36:21.278618+0000","last_became_active":"2023-10-06T04:36:17.248276+0000","last_became_peered":"2023-10-06T04:36:17.248276+0000","last_unstale":"2023-10-06T04:36:21.278618+0000","last_undegraded":"2023-10-06T04:36:21.278618+0000","last_fullsized":"2023-10-06T04:36:21.278618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:35:27.605631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276071+0000","last_change":"2023-10-06T04:36:17.252822+0000","last_active":"2023-10-06T04:36:21.276071+0000","last_peered":"2023-10-06T04:36:21.276071+0000","last_clean":"2023-10-06T04:36:21.276071+0000","last_became_active":"2023-10-06T04:36:17.252543+0000","last_became_peered":"2023-10-06T04:36:17.252543+0000","last_unstale":"2023-10-06T04:36:21.276071+0000","last_undegraded":"2023-10-06T04:36:21.276071+0000","last_fullsized":"2023-10-06T04:36:21.276071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:12.881884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.290615+0000","last_change":"2023-10-06T04:36:17.260460+0000","last_active":"2023-10-06T04:36:21.290615+0000","last_peered":"2023-10-06T04:36:21.290615+0000","last_clean":"2023-10-06T04:36:21.290615+0000","last_became_active":"2023-10-06T04:36:17.260121+0000","last_became_peered":"2023-10-06T04:36:17.260121+0000","last_unstale":"2023-10-06T04:36:21.290615+0000","last_undegraded":"2023-10-06T04:36:21.290615+0000","last_fullsized":"2023-10-06T04:36:21.290615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:02.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276878+0000","last_change":"2023-10-06T04:36:17.252219+0000","last_active":"2023-10-06T04:36:21.276878+0000","last_peered":"2023-10-06T04:36:21.276878+0000","last_clean":"2023-10-06T04:36:21.276878+0000","last_became_active":"2023-10-06T04:36:17.251409+0000","last_became_peered":"2023-10-06T04:36:17.251409+0000","last_unstale":"2023-10-06T04:36:21.276878+0000","last_undegraded":"2023-10-06T04:36:21.276878+0000","last_fullsized":"2023-10-06T04:36:21.276878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:23:08.806295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.279778+0000","last_change":"2023-10-06T04:36:17.246611+0000","last_active":"2023-10-06T04:36:21.279778+0000","last_peered":"2023-10-06T04:36:21.279778+0000","last_clean":"2023-10-06T04:36:21.279778+0000","last_became_active":"2023-10-06T04:36:17.246330+0000","last_became_peered":"2023-10-06T04:36:17.246330+0000","last_unstale":"2023-10-06T04:36:21.279778+0000","last_undegraded":"2023-10-06T04:36:21.279778+0000","last_fullsized":"2023-10-06T04:36:21.279778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:33.859609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291627+0000","last_change":"2023-10-06T04:36:17.257554+0000","last_active":"2023-10-06T04:36:21.291627+0000","last_peered":"2023-10-06T04:36:21.291627+0000","last_clean":"2023-10-06T04:36:21.291627+0000","last_became_active":"2023-10-06T04:36:17.256991+0000","last_became_peered":"2023-10-06T04:36:17.256991+0000","last_unstale":"2023-10-06T04:36:21.291627+0000","last_undegraded":"2023-10-06T04:36:21.291627+0000","last_fullsized":"2023-10-06T04:36:21.291627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:53.436742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.299304+0000","last_change":"2023-10-06T04:36:21.295618+0000","last_active":"2023-10-06T04:36:21.299304+0000","last_peered":"2023-10-06T04:36:21.299304+0000","last_clean":"2023-10-06T04:36:21.299304+0000","last_became_active":"2023-10-06T04:36:21.295184+0000","last_became_peered":"2023-10-06T04:36:21.295184+0000","last_unstale":"2023-10-06T04:36:21.299304+0000","last_undegraded":"2023-10-06T04:36:21.299304+0000","last_fullsized":"2023-10-06T04:36:21.299304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:20:30.698636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280678+0000","last_change":"2023-10-06T04:36:16.230697+0000","last_active":"2023-10-06T04:36:21.280678+0000","last_peered":"2023-10-06T04:36:21.280678+0000","last_clean":"2023-10-06T04:36:21.280678+0000","last_became_active":"2023-10-06T04:36:16.230463+0000","last_became_peered":"2023-10-06T04:36:16.230463+0000","last_unstale":"2023-10-06T04:36:21.280678+0000","last_undegraded":"2023-10-06T04:36:21.280678+0000","last_fullsized":"2023-10-06T04:36:21.280678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:42.572631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.279718+0000","last_change":"2023-10-06T04:36:17.250531+0000","last_active":"2023-10-06T04:36:21.279718+0000","last_peered":"2023-10-06T04:36:21.279718+0000","last_clean":"2023-10-06T04:36:21.279718+0000","last_became_active":"2023-10-06T04:36:17.250025+0000","last_became_peered":"2023-10-06T04:36:17.250025+0000","last_unstale":"2023-10-06T04:36:21.279718+0000","last_undegraded":"2023-10-06T04:36:21.279718+0000","last_fullsized":"2023-10-06T04:36:21.279718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:14.615096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.303903+0000","last_change":"2023-10-06T04:36:21.293815+0000","last_active":"2023-10-06T04:36:21.303903+0000","last_peered":"2023-10-06T04:36:21.303903+0000","last_clean":"2023-10-06T04:36:21.303903+0000","last_became_active":"2023-10-06T04:36:21.292202+0000","last_became_peered":"2023-10-06T04:36:21.292202+0000","last_unstale":"2023-10-06T04:36:21.303903+0000","last_undegraded":"2023-10-06T04:36:21.303903+0000","last_fullsized":"2023-10-06T04:36:21.303903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:39.050172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.282090+0000","last_change":"2023-10-06T04:36:16.232507+0000","last_active":"2023-10-06T04:36:21.282090+0000","last_peered":"2023-10-06T04:36:21.282090+0000","last_clean":"2023-10-06T04:36:21.282090+0000","last_became_active":"2023-10-06T04:36:16.232152+0000","last_became_peered":"2023-10-06T04:36:16.232152+0000","last_unstale":"2023-10-06T04:36:21.282090+0000","last_undegraded":"2023-10-06T04:36:21.282090+0000","last_fullsized":"2023-10-06T04:36:21.282090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:12.145940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.278617+0000","last_change":"2023-10-06T04:36:17.254040+0000","last_active":"2023-10-06T04:36:21.278617+0000","last_peered":"2023-10-06T04:36:21.278617+0000","last_clean":"2023-10-06T04:36:21.278617+0000","last_became_active":"2023-10-06T04:36:17.252810+0000","last_became_peered":"2023-10-06T04:36:17.252810+0000","last_unstale":"2023-10-06T04:36:21.278617+0000","last_undegraded":"2023-10-06T04:36:21.278617+0000","last_fullsized":"2023-10-06T04:36:21.278617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:15:51.848244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.295280+0000","last_change":"2023-10-06T04:36:21.290604+0000","last_active":"2023-10-06T04:36:21.295280+0000","last_peered":"2023-10-06T04:36:21.295280+0000","last_clean":"2023-10-06T04:36:21.295280+0000","last_became_active":"2023-10-06T04:36:21.290250+0000","last_became_peered":"2023-10-06T04:36:21.290250+0000","last_unstale":"2023-10-06T04:36:21.295280+0000","last_undegraded":"2023-10-06T04:36:21.295280+0000","last_fullsized":"2023-10-06T04:36:21.295280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:06:31.394534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.277373+0000","last_change":"2023-10-06T04:36:16.226122+0000","last_active":"2023-10-06T04:36:21.277373+0000","last_peered":"2023-10-06T04:36:21.277373+0000","last_clean":"2023-10-06T04:36:21.277373+0000","last_became_active":"2023-10-06T04:36:16.225815+0000","last_became_peered":"2023-10-06T04:36:16.225815+0000","last_unstale":"2023-10-06T04:36:21.277373+0000","last_undegraded":"2023-10-06T04:36:21.277373+0000","last_fullsized":"2023-10-06T04:36:21.277373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:58:31.078830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.286372+0000","last_change":"2023-10-06T04:36:17.250474+0000","last_active":"2023-10-06T04:36:21.286372+0000","last_peered":"2023-10-06T04:36:21.286372+0000","last_clean":"2023-10-06T04:36:21.286372+0000","last_became_active":"2023-10-06T04:36:17.250205+0000","last_became_peered":"2023-10-06T04:36:17.250205+0000","last_unstale":"2023-10-06T04:36:21.286372+0000","last_undegraded":"2023-10-06T04:36:21.286372+0000","last_fullsized":"2023-10-06T04:36:21.286372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:46.694413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.306587+0000","last_change":"2023-10-06T04:36:21.301478+0000","last_active":"2023-10-06T04:36:21.306587+0000","last_peered":"2023-10-06T04:36:21.306587+0000","last_clean":"2023-10-06T04:36:21.306587+0000","last_became_active":"2023-10-06T04:36:21.300836+0000","last_became_peered":"2023-10-06T04:36:21.300836+0000","last_unstale":"2023-10-06T04:36:21.306587+0000","last_undegraded":"2023-10-06T04:36:21.306587+0000","last_fullsized":"2023-10-06T04:36:21.306587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:00.055287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276255+0000","last_change":"2023-10-06T04:36:16.231833+0000","last_active":"2023-10-06T04:36:21.276255+0000","last_peered":"2023-10-06T04:36:21.276255+0000","last_clean":"2023-10-06T04:36:21.276255+0000","last_became_active":"2023-10-06T04:36:16.231263+0000","last_became_peered":"2023-10-06T04:36:16.231263+0000","last_unstale":"2023-10-06T04:36:21.276255+0000","last_undegraded":"2023-10-06T04:36:21.276255+0000","last_fullsized":"2023-10-06T04:36:21.276255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:45:33.128307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.277178+0000","last_change":"2023-10-06T04:36:17.250303+0000","last_active":"2023-10-06T04:36:21.277178+0000","last_peered":"2023-10-06T04:36:21.277178+0000","last_clean":"2023-10-06T04:36:21.277178+0000","last_became_active":"2023-10-06T04:36:17.250033+0000","last_became_peered":"2023-10-06T04:36:17.250033+0000","last_unstale":"2023-10-06T04:36:21.277178+0000","last_undegraded":"2023-10-06T04:36:21.277178+0000","last_fullsized":"2023-10-06T04:36:21.277178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:35.000504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.309264+0000","last_change":"2023-10-06T04:36:21.302970+0000","last_active":"2023-10-06T04:36:21.309264+0000","last_peered":"2023-10-06T04:36:21.309264+0000","last_clean":"2023-10-06T04:36:21.309264+0000","last_became_active":"2023-10-06T04:36:21.302562+0000","last_became_peered":"2023-10-06T04:36:21.302562+0000","last_unstale":"2023-10-06T04:36:21.309264+0000","last_undegraded":"2023-10-06T04:36:21.309264+0000","last_fullsized":"2023-10-06T04:36:21.309264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:53.314660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291194+0000","last_change":"2023-10-06T04:36:16.230552+0000","last_active":"2023-10-06T04:36:21.291194+0000","last_peered":"2023-10-06T04:36:21.291194+0000","last_clean":"2023-10-06T04:36:21.291194+0000","last_became_active":"2023-10-06T04:36:16.230077+0000","last_became_peered":"2023-10-06T04:36:16.230077+0000","last_unstale":"2023-10-06T04:36:21.291194+0000","last_undegraded":"2023-10-06T04:36:21.291194+0000","last_fullsized":"2023-10-06T04:36:21.291194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:51:43.351582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.275705+0000","last_change":"2023-10-06T04:36:17.253484+0000","last_active":"2023-10-06T04:36:21.275705+0000","last_peered":"2023-10-06T04:36:21.275705+0000","last_clean":"2023-10-06T04:36:21.275705+0000","last_became_active":"2023-10-06T04:36:17.253217+0000","last_became_peered":"2023-10-06T04:36:17.253217+0000","last_unstale":"2023-10-06T04:36:21.275705+0000","last_undegraded":"2023-10-06T04:36:21.275705+0000","last_fullsized":"2023-10-06T04:36:21.275705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:23:08.806295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.301600+0000","last_change":"2023-10-06T04:36:21.296152+0000","last_active":"2023-10-06T04:36:21.301600+0000","last_peered":"2023-10-06T04:36:21.301600+0000","last_clean":"2023-10-06T04:36:21.301600+0000","last_became_active":"2023-10-06T04:36:21.295728+0000","last_became_peered":"2023-10-06T04:36:21.295728+0000","last_unstale":"2023-10-06T04:36:21.301600+0000","last_undegraded":"2023-10-06T04:36:21.301600+0000","last_fullsized":"2023-10-06T04:36:21.301600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:44.809580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.292523+0000","last_change":"2023-10-06T04:36:16.237564+0000","last_active":"2023-10-06T04:36:21.292523+0000","last_peered":"2023-10-06T04:36:21.292523+0000","last_clean":"2023-10-06T04:36:21.292523+0000","last_became_active":"2023-10-06T04:36:16.237309+0000","last_became_peered":"2023-10-06T04:36:16.237309+0000","last_unstale":"2023-10-06T04:36:21.292523+0000","last_undegraded":"2023-10-06T04:36:21.292523+0000","last_fullsized":"2023-10-06T04:36:21.292523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:47.521994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.281533+0000","last_change":"2023-10-06T04:36:17.256321+0000","last_active":"2023-10-06T04:36:21.281533+0000","last_peered":"2023-10-06T04:36:21.281533+0000","last_clean":"2023-10-06T04:36:21.281533+0000","last_became_active":"2023-10-06T04:36:17.256041+0000","last_became_peered":"2023-10-06T04:36:17.256041+0000","last_unstale":"2023-10-06T04:36:21.281533+0000","last_undegraded":"2023-10-06T04:36:21.281533+0000","last_fullsized":"2023-10-06T04:36:21.281533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:22.912226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.303744+0000","last_change":"2023-10-06T04:36:21.300383+0000","last_active":"2023-10-06T04:36:21.303744+0000","last_peered":"2023-10-06T04:36:21.303744+0000","last_clean":"2023-10-06T04:36:21.303744+0000","last_became_active":"2023-10-06T04:36:21.299968+0000","last_became_peered":"2023-10-06T04:36:21.299968+0000","last_unstale":"2023-10-06T04:36:21.303744+0000","last_undegraded":"2023-10-06T04:36:21.303744+0000","last_fullsized":"2023-10-06T04:36:21.303744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:22:34.846112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T04:36:27.099477+0000","last_change":"2023-10-06T04:36:16.229754+0000","last_active":"2023-10-06T04:36:27.099477+0000","last_peered":"2023-10-06T04:36:27.099477+0000","last_clean":"2023-10-06T04:36:27.099477+0000","last_became_active":"2023-10-06T04:36:16.229482+0000","last_became_peered":"2023-10-06T04:36:16.229482+0000","last_unstale":"2023-10-06T04:36:27.099477+0000","last_undegraded":"2023-10-06T04:36:27.099477+0000","last_fullsized":"2023-10-06T04:36:27.099477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:12.145940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280792+0000","last_change":"2023-10-06T04:36:17.254403+0000","last_active":"2023-10-06T04:36:21.280792+0000","last_peered":"2023-10-06T04:36:21.280792+0000","last_clean":"2023-10-06T04:36:21.280792+0000","last_became_active":"2023-10-06T04:36:17.254147+0000","last_became_peered":"2023-10-06T04:36:17.254147+0000","last_unstale":"2023-10-06T04:36:21.280792+0000","last_undegraded":"2023-10-06T04:36:21.280792+0000","last_fullsized":"2023-10-06T04:36:21.280792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:03.209071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.303821+0000","last_change":"2023-10-06T04:36:21.298829+0000","last_active":"2023-10-06T04:36:21.303821+0000","last_peered":"2023-10-06T04:36:21.303821+0000","last_clean":"2023-10-06T04:36:21.303821+0000","last_became_active":"2023-10-06T04:36:21.298456+0000","last_became_peered":"2023-10-06T04:36:21.298456+0000","last_unstale":"2023-10-06T04:36:21.303821+0000","last_undegraded":"2023-10-06T04:36:21.303821+0000","last_fullsized":"2023-10-06T04:36:21.303821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:52.989017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.292810+0000","last_change":"2023-10-06T04:36:16.235605+0000","last_active":"2023-10-06T04:36:21.292810+0000","last_peered":"2023-10-06T04:36:21.292810+0000","last_clean":"2023-10-06T04:36:21.292810+0000","last_became_active":"2023-10-06T04:36:16.235280+0000","last_became_peered":"2023-10-06T04:36:16.235280+0000","last_unstale":"2023-10-06T04:36:21.292810+0000","last_undegraded":"2023-10-06T04:36:21.292810+0000","last_fullsized":"2023-10-06T04:36:21.292810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:37.729642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.281044+0000","last_change":"2023-10-06T04:36:17.255715+0000","last_active":"2023-10-06T04:36:21.281044+0000","last_peered":"2023-10-06T04:36:21.281044+0000","last_clean":"2023-10-06T04:36:21.281044+0000","last_became_active":"2023-10-06T04:36:17.255461+0000","last_became_peered":"2023-10-06T04:36:17.255461+0000","last_unstale":"2023-10-06T04:36:21.281044+0000","last_undegraded":"2023-10-06T04:36:21.281044+0000","last_fullsized":"2023-10-06T04:36:21.281044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:28:24.765888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.301636+0000","last_change":"2023-10-06T04:36:21.294549+0000","last_active":"2023-10-06T04:36:21.301636+0000","last_peered":"2023-10-06T04:36:21.301636+0000","last_clean":"2023-10-06T04:36:21.301636+0000","last_became_active":"2023-10-06T04:36:21.293440+0000","last_became_peered":"2023-10-06T04:36:21.293440+0000","last_unstale":"2023-10-06T04:36:21.301636+0000","last_undegraded":"2023-10-06T04:36:21.301636+0000","last_fullsized":"2023-10-06T04:36:21.301636+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:42.828588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.278781+0000","last_change":"2023-10-06T04:36:16.226258+0000","last_active":"2023-10-06T04:36:21.278781+0000","last_peered":"2023-10-06T04:36:21.278781+0000","last_clean":"2023-10-06T04:36:21.278781+0000","last_became_active":"2023-10-06T04:36:16.225988+0000","last_became_peered":"2023-10-06T04:36:16.225988+0000","last_unstale":"2023-10-06T04:36:21.278781+0000","last_undegraded":"2023-10-06T04:36:21.278781+0000","last_fullsized":"2023-10-06T04:36:21.278781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:54.757446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291513+0000","last_change":"2023-10-06T04:36:17.257055+0000","last_active":"2023-10-06T04:36:21.291513+0000","last_peered":"2023-10-06T04:36:21.291513+0000","last_clean":"2023-10-06T04:36:21.291513+0000","last_became_active":"2023-10-06T04:36:17.256355+0000","last_became_peered":"2023-10-06T04:36:17.256355+0000","last_unstale":"2023-10-06T04:36:21.291513+0000","last_undegraded":"2023-10-06T04:36:21.291513+0000","last_fullsized":"2023-10-06T04:36:21.291513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:11.333475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.297023+0000","last_change":"2023-10-06T04:36:21.293305+0000","last_active":"2023-10-06T04:36:21.297023+0000","last_peered":"2023-10-06T04:36:21.297023+0000","last_clean":"2023-10-06T04:36:21.297023+0000","last_became_active":"2023-10-06T04:36:21.291331+0000","last_became_peered":"2023-10-06T04:36:21.291331+0000","last_unstale":"2023-10-06T04:36:21.297023+0000","last_undegraded":"2023-10-06T04:36:21.297023+0000","last_fullsized":"2023-10-06T04:36:21.297023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:14:57.032741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291211+0000","last_change":"2023-10-06T04:36:16.235344+0000","last_active":"2023-10-06T04:36:21.291211+0000","last_peered":"2023-10-06T04:36:21.291211+0000","last_clean":"2023-10-06T04:36:21.291211+0000","last_became_active":"2023-10-06T04:36:16.235092+0000","last_became_peered":"2023-10-06T04:36:16.235092+0000","last_unstale":"2023-10-06T04:36:21.291211+0000","last_undegraded":"2023-10-06T04:36:21.291211+0000","last_fullsized":"2023-10-06T04:36:21.291211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:40.040325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.278875+0000","last_change":"2023-10-06T04:36:17.252187+0000","last_active":"2023-10-06T04:36:21.278875+0000","last_peered":"2023-10-06T04:36:21.278875+0000","last_clean":"2023-10-06T04:36:21.278875+0000","last_became_active":"2023-10-06T04:36:17.251853+0000","last_became_peered":"2023-10-06T04:36:17.251853+0000","last_unstale":"2023-10-06T04:36:21.278875+0000","last_undegraded":"2023-10-06T04:36:21.278875+0000","last_fullsized":"2023-10-06T04:36:21.278875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:01:35.146203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.307146+0000","last_change":"2023-10-06T04:36:21.302469+0000","last_active":"2023-10-06T04:36:21.307146+0000","last_peered":"2023-10-06T04:36:21.307146+0000","last_clean":"2023-10-06T04:36:21.307146+0000","last_became_active":"2023-10-06T04:36:21.302085+0000","last_became_peered":"2023-10-06T04:36:21.302085+0000","last_unstale":"2023-10-06T04:36:21.307146+0000","last_undegraded":"2023-10-06T04:36:21.307146+0000","last_fullsized":"2023-10-06T04:36:21.307146+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:06:31.394534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.288489+0000","last_change":"2023-10-06T04:36:16.236074+0000","last_active":"2023-10-06T04:36:21.288489+0000","last_peered":"2023-10-06T04:36:21.288489+0000","last_clean":"2023-10-06T04:36:21.288489+0000","last_became_active":"2023-10-06T04:36:16.235777+0000","last_became_peered":"2023-10-06T04:36:16.235777+0000","last_unstale":"2023-10-06T04:36:21.288489+0000","last_undegraded":"2023-10-06T04:36:21.288489+0000","last_fullsized":"2023-10-06T04:36:21.288489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:42:27.974066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.279446+0000","last_change":"2023-10-06T04:36:17.259778+0000","last_active":"2023-10-06T04:36:21.279446+0000","last_peered":"2023-10-06T04:36:21.279446+0000","last_clean":"2023-10-06T04:36:21.279446+0000","last_became_active":"2023-10-06T04:36:17.259529+0000","last_became_peered":"2023-10-06T04:36:17.259529+0000","last_unstale":"2023-10-06T04:36:21.279446+0000","last_undegraded":"2023-10-06T04:36:21.279446+0000","last_fullsized":"2023-10-06T04:36:21.279446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:02.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.309340+0000","last_change":"2023-10-06T04:36:21.305292+0000","last_active":"2023-10-06T04:36:21.309340+0000","last_peered":"2023-10-06T04:36:21.309340+0000","last_clean":"2023-10-06T04:36:21.309340+0000","last_became_active":"2023-10-06T04:36:21.304899+0000","last_became_peered":"2023-10-06T04:36:21.304899+0000","last_unstale":"2023-10-06T04:36:21.309340+0000","last_undegraded":"2023-10-06T04:36:21.309340+0000","last_fullsized":"2023-10-06T04:36:21.309340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:30.790855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.296904+0000","last_change":"2023-10-06T04:36:16.235873+0000","last_active":"2023-10-06T04:36:21.296904+0000","last_peered":"2023-10-06T04:36:21.296904+0000","last_clean":"2023-10-06T04:36:21.296904+0000","last_became_active":"2023-10-06T04:36:16.235577+0000","last_became_peered":"2023-10-06T04:36:16.235577+0000","last_unstale":"2023-10-06T04:36:21.296904+0000","last_undegraded":"2023-10-06T04:36:21.296904+0000","last_fullsized":"2023-10-06T04:36:21.296904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:39.497925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.290348+0000","last_change":"2023-10-06T04:36:17.256627+0000","last_active":"2023-10-06T04:36:21.290348+0000","last_peered":"2023-10-06T04:36:21.290348+0000","last_clean":"2023-10-06T04:36:21.290348+0000","last_became_active":"2023-10-06T04:36:17.256351+0000","last_became_peered":"2023-10-06T04:36:17.256351+0000","last_unstale":"2023-10-06T04:36:21.290348+0000","last_undegraded":"2023-10-06T04:36:21.290348+0000","last_fullsized":"2023-10-06T04:36:21.290348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:18.298620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.299923+0000","last_change":"2023-10-06T04:36:21.292866+0000","last_active":"2023-10-06T04:36:21.299923+0000","last_peered":"2023-10-06T04:36:21.299923+0000","last_clean":"2023-10-06T04:36:21.299923+0000","last_became_active":"2023-10-06T04:36:21.292441+0000","last_became_peered":"2023-10-06T04:36:21.292441+0000","last_unstale":"2023-10-06T04:36:21.299923+0000","last_undegraded":"2023-10-06T04:36:21.299923+0000","last_fullsized":"2023-10-06T04:36:21.299923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:29.699781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.293323+0000","last_change":"2023-10-06T04:36:16.235438+0000","last_active":"2023-10-06T04:36:21.293323+0000","last_peered":"2023-10-06T04:36:21.293323+0000","last_clean":"2023-10-06T04:36:21.293323+0000","last_became_active":"2023-10-06T04:36:16.235142+0000","last_became_peered":"2023-10-06T04:36:16.235142+0000","last_unstale":"2023-10-06T04:36:21.293323+0000","last_undegraded":"2023-10-06T04:36:21.293323+0000","last_fullsized":"2023-10-06T04:36:21.293323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:45.690139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280210+0000","last_change":"2023-10-06T04:36:17.262198+0000","last_active":"2023-10-06T04:36:21.280210+0000","last_peered":"2023-10-06T04:36:21.280210+0000","last_clean":"2023-10-06T04:36:21.280210+0000","last_became_active":"2023-10-06T04:36:17.261922+0000","last_became_peered":"2023-10-06T04:36:17.261922+0000","last_unstale":"2023-10-06T04:36:21.280210+0000","last_undegraded":"2023-10-06T04:36:21.280210+0000","last_fullsized":"2023-10-06T04:36:21.280210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:52.911614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.302413+0000","last_change":"2023-10-06T04:36:21.301322+0000","last_active":"2023-10-06T04:36:21.302413+0000","last_peered":"2023-10-06T04:36:21.302413+0000","last_clean":"2023-10-06T04:36:21.302413+0000","last_became_active":"2023-10-06T04:36:21.300972+0000","last_became_peered":"2023-10-06T04:36:21.300972+0000","last_unstale":"2023-10-06T04:36:21.302413+0000","last_undegraded":"2023-10-06T04:36:21.302413+0000","last_fullsized":"2023-10-06T04:36:21.302413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:16.931552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.292453+0000","last_change":"2023-10-06T04:36:16.231930+0000","last_active":"2023-10-06T04:36:21.292453+0000","last_peered":"2023-10-06T04:36:21.292453+0000","last_clean":"2023-10-06T04:36:21.292453+0000","last_became_active":"2023-10-06T04:36:16.231670+0000","last_became_peered":"2023-10-06T04:36:16.231670+0000","last_unstale":"2023-10-06T04:36:21.292453+0000","last_undegraded":"2023-10-06T04:36:21.292453+0000","last_fullsized":"2023-10-06T04:36:21.292453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:14.880214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.283773+0000","last_change":"2023-10-06T04:36:17.257608+0000","last_active":"2023-10-06T04:36:21.283773+0000","last_peered":"2023-10-06T04:36:21.283773+0000","last_clean":"2023-10-06T04:36:21.283773+0000","last_became_active":"2023-10-06T04:36:17.257367+0000","last_became_peered":"2023-10-06T04:36:17.257367+0000","last_unstale":"2023-10-06T04:36:21.283773+0000","last_undegraded":"2023-10-06T04:36:21.283773+0000","last_fullsized":"2023-10-06T04:36:21.283773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:48.526269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.290478+0000","last_change":"2023-10-06T04:36:21.289073+0000","last_active":"2023-10-06T04:36:21.290478+0000","last_peered":"2023-10-06T04:36:21.290478+0000","last_clean":"2023-10-06T04:36:21.290478+0000","last_became_active":"2023-10-06T04:36:21.288651+0000","last_became_peered":"2023-10-06T04:36:21.288651+0000","last_unstale":"2023-10-06T04:36:21.290478+0000","last_undegraded":"2023-10-06T04:36:21.290478+0000","last_fullsized":"2023-10-06T04:36:21.290478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:23:12.855962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291282+0000","last_change":"2023-10-06T04:36:16.238006+0000","last_active":"2023-10-06T04:36:21.291282+0000","last_peered":"2023-10-06T04:36:21.291282+0000","last_clean":"2023-10-06T04:36:21.291282+0000","last_became_active":"2023-10-06T04:36:16.237733+0000","last_became_peered":"2023-10-06T04:36:16.237733+0000","last_unstale":"2023-10-06T04:36:21.291282+0000","last_undegraded":"2023-10-06T04:36:21.291282+0000","last_fullsized":"2023-10-06T04:36:21.291282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:45:33.128307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.284558+0000","last_change":"2023-10-06T04:36:17.248071+0000","last_active":"2023-10-06T04:36:21.284558+0000","last_peered":"2023-10-06T04:36:21.284558+0000","last_clean":"2023-10-06T04:36:21.284558+0000","last_became_active":"2023-10-06T04:36:17.247774+0000","last_became_peered":"2023-10-06T04:36:17.247774+0000","last_unstale":"2023-10-06T04:36:21.284558+0000","last_undegraded":"2023-10-06T04:36:21.284558+0000","last_fullsized":"2023-10-06T04:36:21.284558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:06.137894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.303676+0000","last_change":"2023-10-06T04:36:21.302376+0000","last_active":"2023-10-06T04:36:21.303676+0000","last_peered":"2023-10-06T04:36:21.303676+0000","last_clean":"2023-10-06T04:36:21.303676+0000","last_became_active":"2023-10-06T04:36:21.301996+0000","last_became_peered":"2023-10-06T04:36:21.301996+0000","last_unstale":"2023-10-06T04:36:21.303676+0000","last_undegraded":"2023-10-06T04:36:21.303676+0000","last_fullsized":"2023-10-06T04:36:21.303676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:35:31.655298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.275570+0000","last_change":"2023-10-06T04:36:16.226105+0000","last_active":"2023-10-06T04:36:21.275570+0000","last_peered":"2023-10-06T04:36:21.275570+0000","last_clean":"2023-10-06T04:36:21.275570+0000","last_became_active":"2023-10-06T04:36:16.225746+0000","last_became_peered":"2023-10-06T04:36:16.225746+0000","last_unstale":"2023-10-06T04:36:21.275570+0000","last_undegraded":"2023-10-06T04:36:21.275570+0000","last_fullsized":"2023-10-06T04:36:21.275570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:10.606701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280903+0000","last_change":"2023-10-06T04:36:17.248063+0000","last_active":"2023-10-06T04:36:21.280903+0000","last_peered":"2023-10-06T04:36:21.280903+0000","last_clean":"2023-10-06T04:36:21.280903+0000","last_became_active":"2023-10-06T04:36:17.247756+0000","last_became_peered":"2023-10-06T04:36:17.247756+0000","last_unstale":"2023-10-06T04:36:21.280903+0000","last_undegraded":"2023-10-06T04:36:21.280903+0000","last_fullsized":"2023-10-06T04:36:21.280903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:15:51.848244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.300498+0000","last_change":"2023-10-06T04:36:21.295888+0000","last_active":"2023-10-06T04:36:21.300498+0000","last_peered":"2023-10-06T04:36:21.300498+0000","last_clean":"2023-10-06T04:36:21.300498+0000","last_became_active":"2023-10-06T04:36:21.295493+0000","last_became_peered":"2023-10-06T04:36:21.295493+0000","last_unstale":"2023-10-06T04:36:21.300498+0000","last_undegraded":"2023-10-06T04:36:21.300498+0000","last_fullsized":"2023-10-06T04:36:21.300498+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:36.618164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.283866+0000","last_change":"2023-10-06T04:36:16.235993+0000","last_active":"2023-10-06T04:36:21.283866+0000","last_peered":"2023-10-06T04:36:21.283866+0000","last_clean":"2023-10-06T04:36:21.283866+0000","last_became_active":"2023-10-06T04:36:16.235737+0000","last_became_peered":"2023-10-06T04:36:16.235737+0000","last_unstale":"2023-10-06T04:36:21.283866+0000","last_undegraded":"2023-10-06T04:36:21.283866+0000","last_fullsized":"2023-10-06T04:36:21.283866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:51:43.351582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.281338+0000","last_change":"2023-10-06T04:36:17.251705+0000","last_active":"2023-10-06T04:36:21.281338+0000","last_peered":"2023-10-06T04:36:21.281338+0000","last_clean":"2023-10-06T04:36:21.281338+0000","last_became_active":"2023-10-06T04:36:17.251306+0000","last_became_peered":"2023-10-06T04:36:17.251306+0000","last_unstale":"2023-10-06T04:36:21.281338+0000","last_undegraded":"2023-10-06T04:36:21.281338+0000","last_fullsized":"2023-10-06T04:36:21.281338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:53.016887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.303623+0000","last_change":"2023-10-06T04:36:21.296312+0000","last_active":"2023-10-06T04:36:21.303623+0000","last_peered":"2023-10-06T04:36:21.303623+0000","last_clean":"2023-10-06T04:36:21.303623+0000","last_became_active":"2023-10-06T04:36:21.294384+0000","last_became_peered":"2023-10-06T04:36:21.294384+0000","last_unstale":"2023-10-06T04:36:21.303623+0000","last_undegraded":"2023-10-06T04:36:21.303623+0000","last_fullsized":"2023-10-06T04:36:21.303623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:22:34.846112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280043+0000","last_change":"2023-10-06T04:36:16.234482+0000","last_active":"2023-10-06T04:36:21.280043+0000","last_peered":"2023-10-06T04:36:21.280043+0000","last_clean":"2023-10-06T04:36:21.280043+0000","last_became_active":"2023-10-06T04:36:16.234239+0000","last_became_peered":"2023-10-06T04:36:16.234239+0000","last_unstale":"2023-10-06T04:36:21.280043+0000","last_undegraded":"2023-10-06T04:36:21.280043+0000","last_fullsized":"2023-10-06T04:36:21.280043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:51:43.351582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.281261+0000","last_change":"2023-10-06T04:36:17.254931+0000","last_active":"2023-10-06T04:36:21.281261+0000","last_peered":"2023-10-06T04:36:21.281261+0000","last_clean":"2023-10-06T04:36:21.281261+0000","last_became_active":"2023-10-06T04:36:17.254674+0000","last_became_peered":"2023-10-06T04:36:17.254674+0000","last_unstale":"2023-10-06T04:36:21.281261+0000","last_undegraded":"2023-10-06T04:36:21.281261+0000","last_fullsized":"2023-10-06T04:36:21.281261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:06.137894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.296227+0000","last_change":"2023-10-06T04:36:21.294775+0000","last_active":"2023-10-06T04:36:21.296227+0000","last_peered":"2023-10-06T04:36:21.296227+0000","last_clean":"2023-10-06T04:36:21.296227+0000","last_became_active":"2023-10-06T04:36:21.294362+0000","last_became_peered":"2023-10-06T04:36:21.294362+0000","last_unstale":"2023-10-06T04:36:21.296227+0000","last_undegraded":"2023-10-06T04:36:21.296227+0000","last_fullsized":"2023-10-06T04:36:21.296227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:37.257094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.277076+0000","last_change":"2023-10-06T04:36:16.234752+0000","last_active":"2023-10-06T04:36:21.277076+0000","last_peered":"2023-10-06T04:36:21.277076+0000","last_clean":"2023-10-06T04:36:21.277076+0000","last_became_active":"2023-10-06T04:36:16.230744+0000","last_became_peered":"2023-10-06T04:36:16.230744+0000","last_unstale":"2023-10-06T04:36:21.277076+0000","last_undegraded":"2023-10-06T04:36:21.277076+0000","last_fullsized":"2023-10-06T04:36:21.277076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:32.855334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276381+0000","last_change":"2023-10-06T04:36:17.255101+0000","last_active":"2023-10-06T04:36:21.276381+0000","last_peered":"2023-10-06T04:36:21.276381+0000","last_clean":"2023-10-06T04:36:21.276381+0000","last_became_active":"2023-10-06T04:36:17.254846+0000","last_became_peered":"2023-10-06T04:36:17.254846+0000","last_unstale":"2023-10-06T04:36:21.276381+0000","last_undegraded":"2023-10-06T04:36:21.276381+0000","last_fullsized":"2023-10-06T04:36:21.276381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:01:35.146203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.303559+0000","last_change":"2023-10-06T04:36:21.295704+0000","last_active":"2023-10-06T04:36:21.303559+0000","last_peered":"2023-10-06T04:36:21.303559+0000","last_clean":"2023-10-06T04:36:21.303559+0000","last_became_active":"2023-10-06T04:36:21.295333+0000","last_became_peered":"2023-10-06T04:36:21.295333+0000","last_unstale":"2023-10-06T04:36:21.303559+0000","last_undegraded":"2023-10-06T04:36:21.303559+0000","last_fullsized":"2023-10-06T04:36:21.303559+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:21:19.303096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.277832+0000","last_change":"2023-10-06T04:36:16.227900+0000","last_active":"2023-10-06T04:36:21.277832+0000","last_peered":"2023-10-06T04:36:21.277832+0000","last_clean":"2023-10-06T04:36:21.277832+0000","last_became_active":"2023-10-06T04:36:16.227587+0000","last_became_peered":"2023-10-06T04:36:16.227587+0000","last_unstale":"2023-10-06T04:36:21.277832+0000","last_undegraded":"2023-10-06T04:36:21.277832+0000","last_fullsized":"2023-10-06T04:36:21.277832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:54.757446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.281521+0000","last_change":"2023-10-06T04:36:11.192215+0000","last_active":"2023-10-06T04:36:21.281521+0000","last_peered":"2023-10-06T04:36:21.281521+0000","last_clean":"2023-10-06T04:36:21.281521+0000","last_became_active":"2023-10-06T04:36:11.191953+0000","last_became_peered":"2023-10-06T04:36:11.191953+0000","last_unstale":"2023-10-06T04:36:21.281521+0000","last_undegraded":"2023-10-06T04:36:21.281521+0000","last_fullsized":"2023-10-06T04:36:21.281521+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:37.026121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.277485+0000","last_change":"2023-10-06T04:36:17.254170+0000","last_active":"2023-10-06T04:36:21.277485+0000","last_peered":"2023-10-06T04:36:21.277485+0000","last_clean":"2023-10-06T04:36:21.277485+0000","last_became_active":"2023-10-06T04:36:17.253910+0000","last_became_peered":"2023-10-06T04:36:17.253910+0000","last_unstale":"2023-10-06T04:36:21.277485+0000","last_undegraded":"2023-10-06T04:36:21.277485+0000","last_fullsized":"2023-10-06T04:36:21.277485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:18.298620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.296974+0000","last_change":"2023-10-06T04:36:21.291691+0000","last_active":"2023-10-06T04:36:21.296974+0000","last_peered":"2023-10-06T04:36:21.296974+0000","last_clean":"2023-10-06T04:36:21.296974+0000","last_became_active":"2023-10-06T04:36:21.291287+0000","last_became_peered":"2023-10-06T04:36:21.291287+0000","last_unstale":"2023-10-06T04:36:21.296974+0000","last_undegraded":"2023-10-06T04:36:21.296974+0000","last_fullsized":"2023-10-06T04:36:21.296974+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:59:55.077526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280946+0000","last_change":"2023-10-06T04:36:11.184555+0000","last_active":"2023-10-06T04:36:21.280946+0000","last_peered":"2023-10-06T04:36:21.280946+0000","last_clean":"2023-10-06T04:36:21.280946+0000","last_became_active":"2023-10-06T04:36:11.184229+0000","last_became_peered":"2023-10-06T04:36:11.184229+0000","last_unstale":"2023-10-06T04:36:21.280946+0000","last_undegraded":"2023-10-06T04:36:21.280946+0000","last_fullsized":"2023-10-06T04:36:21.280946+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:19.938716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.295381+0000","last_change":"2023-10-06T04:36:16.227655+0000","last_active":"2023-10-06T04:36:21.295381+0000","last_peered":"2023-10-06T04:36:21.295381+0000","last_clean":"2023-10-06T04:36:21.295381+0000","last_became_active":"2023-10-06T04:36:16.227033+0000","last_became_peered":"2023-10-06T04:36:16.227033+0000","last_unstale":"2023-10-06T04:36:21.295381+0000","last_undegraded":"2023-10-06T04:36:21.295381+0000","last_fullsized":"2023-10-06T04:36:21.295381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:10.606701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280143+0000","last_change":"2023-10-06T04:36:17.250515+0000","last_active":"2023-10-06T04:36:21.280143+0000","last_peered":"2023-10-06T04:36:21.280143+0000","last_clean":"2023-10-06T04:36:21.280143+0000","last_became_active":"2023-10-06T04:36:17.250192+0000","last_became_peered":"2023-10-06T04:36:17.250192+0000","last_unstale":"2023-10-06T04:36:21.280143+0000","last_undegraded":"2023-10-06T04:36:21.280143+0000","last_fullsized":"2023-10-06T04:36:21.280143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:25.650113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.304036+0000","last_change":"2023-10-06T04:36:21.298658+0000","last_active":"2023-10-06T04:36:21.304036+0000","last_peered":"2023-10-06T04:36:21.304036+0000","last_clean":"2023-10-06T04:36:21.304036+0000","last_became_active":"2023-10-06T04:36:21.298118+0000","last_became_peered":"2023-10-06T04:36:21.298118+0000","last_unstale":"2023-10-06T04:36:21.304036+0000","last_undegraded":"2023-10-06T04:36:21.304036+0000","last_fullsized":"2023-10-06T04:36:21.304036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:38.096649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276479+0000","last_change":"2023-10-06T04:36:11.184460+0000","last_active":"2023-10-06T04:36:21.276479+0000","last_peered":"2023-10-06T04:36:21.276479+0000","last_clean":"2023-10-06T04:36:21.276479+0000","last_became_active":"2023-10-06T04:36:11.184119+0000","last_became_peered":"2023-10-06T04:36:11.184119+0000","last_unstale":"2023-10-06T04:36:21.276479+0000","last_undegraded":"2023-10-06T04:36:21.276479+0000","last_fullsized":"2023-10-06T04:36:21.276479+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:37.026121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":166,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.290702+0000","last_change":"2023-10-06T04:36:12.183155+0000","last_active":"2023-10-06T04:36:21.290702+0000","last_peered":"2023-10-06T04:36:21.290702+0000","last_clean":"2023-10-06T04:36:21.290702+0000","last_became_active":"2023-10-06T04:36:12.182903+0000","last_became_peered":"2023-10-06T04:36:12.182903+0000","last_unstale":"2023-10-06T04:36:21.290702+0000","last_undegraded":"2023-10-06T04:36:21.290702+0000","last_fullsized":"2023-10-06T04:36:21.290702+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:11.171104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:11.171104+0000","last_clean_scrub_stamp":"2023-10-06T04:36:11.171104+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:38:54.323364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.275958+0000","last_change":"2023-10-06T04:36:16.228034+0000","last_active":"2023-10-06T04:36:21.275958+0000","last_peered":"2023-10-06T04:36:21.275958+0000","last_clean":"2023-10-06T04:36:21.275958+0000","last_became_active":"2023-10-06T04:36:16.227743+0000","last_became_peered":"2023-10-06T04:36:16.227743+0000","last_unstale":"2023-10-06T04:36:21.275958+0000","last_undegraded":"2023-10-06T04:36:21.275958+0000","last_fullsized":"2023-10-06T04:36:21.275958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:12.145940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.278791+0000","last_change":"2023-10-06T04:36:17.257761+0000","last_active":"2023-10-06T04:36:21.278791+0000","last_peered":"2023-10-06T04:36:21.278791+0000","last_clean":"2023-10-06T04:36:21.278791+0000","last_became_active":"2023-10-06T04:36:17.257238+0000","last_became_peered":"2023-10-06T04:36:17.257238+0000","last_unstale":"2023-10-06T04:36:21.278791+0000","last_undegraded":"2023-10-06T04:36:21.278791+0000","last_fullsized":"2023-10-06T04:36:21.278791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:03.209071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.300390+0000","last_change":"2023-10-06T04:36:21.296982+0000","last_active":"2023-10-06T04:36:21.300390+0000","last_peered":"2023-10-06T04:36:21.300390+0000","last_clean":"2023-10-06T04:36:21.300390+0000","last_became_active":"2023-10-06T04:36:21.296294+0000","last_became_peered":"2023-10-06T04:36:21.296294+0000","last_unstale":"2023-10-06T04:36:21.300390+0000","last_undegraded":"2023-10-06T04:36:21.300390+0000","last_fullsized":"2023-10-06T04:36:21.300390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:39.050172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.292995+0000","last_change":"2023-10-06T04:36:11.193056+0000","last_active":"2023-10-06T04:36:21.292995+0000","last_peered":"2023-10-06T04:36:21.292995+0000","last_clean":"2023-10-06T04:36:21.292995+0000","last_became_active":"2023-10-06T04:36:11.192712+0000","last_became_peered":"2023-10-06T04:36:11.192712+0000","last_unstale":"2023-10-06T04:36:21.292995+0000","last_undegraded":"2023-10-06T04:36:21.292995+0000","last_fullsized":"2023-10-06T04:36:21.292995+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:00.008654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.278242+0000","last_change":"2023-10-06T04:36:16.234660+0000","last_active":"2023-10-06T04:36:21.278242+0000","last_peered":"2023-10-06T04:36:21.278242+0000","last_clean":"2023-10-06T04:36:21.278242+0000","last_became_active":"2023-10-06T04:36:16.234357+0000","last_became_peered":"2023-10-06T04:36:16.234357+0000","last_unstale":"2023-10-06T04:36:21.278242+0000","last_undegraded":"2023-10-06T04:36:21.278242+0000","last_fullsized":"2023-10-06T04:36:21.278242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:42:27.974066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276281+0000","last_change":"2023-10-06T04:36:17.251700+0000","last_active":"2023-10-06T04:36:21.276281+0000","last_peered":"2023-10-06T04:36:21.276281+0000","last_clean":"2023-10-06T04:36:21.276281+0000","last_became_active":"2023-10-06T04:36:17.251034+0000","last_became_peered":"2023-10-06T04:36:17.251034+0000","last_unstale":"2023-10-06T04:36:21.276281+0000","last_undegraded":"2023-10-06T04:36:21.276281+0000","last_fullsized":"2023-10-06T04:36:21.276281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:11.333475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.309325+0000","last_change":"2023-10-06T04:36:21.305039+0000","last_active":"2023-10-06T04:36:21.309325+0000","last_peered":"2023-10-06T04:36:21.309325+0000","last_clean":"2023-10-06T04:36:21.309325+0000","last_became_active":"2023-10-06T04:36:21.304584+0000","last_became_peered":"2023-10-06T04:36:21.304584+0000","last_unstale":"2023-10-06T04:36:21.309325+0000","last_undegraded":"2023-10-06T04:36:21.309325+0000","last_fullsized":"2023-10-06T04:36:21.309325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:07.162250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.290530+0000","last_change":"2023-10-06T04:36:11.192701+0000","last_active":"2023-10-06T04:36:21.290530+0000","last_peered":"2023-10-06T04:36:21.290530+0000","last_clean":"2023-10-06T04:36:21.290530+0000","last_became_active":"2023-10-06T04:36:11.192335+0000","last_became_peered":"2023-10-06T04:36:11.192335+0000","last_unstale":"2023-10-06T04:36:21.290530+0000","last_undegraded":"2023-10-06T04:36:21.290530+0000","last_fullsized":"2023-10-06T04:36:21.290530+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:18.643570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276668+0000","last_change":"2023-10-06T04:36:16.234341+0000","last_active":"2023-10-06T04:36:21.276668+0000","last_peered":"2023-10-06T04:36:21.276668+0000","last_clean":"2023-10-06T04:36:21.276668+0000","last_became_active":"2023-10-06T04:36:16.230428+0000","last_became_peered":"2023-10-06T04:36:16.230428+0000","last_unstale":"2023-10-06T04:36:21.276668+0000","last_undegraded":"2023-10-06T04:36:21.276668+0000","last_fullsized":"2023-10-06T04:36:21.276668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:39.497925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291935+0000","last_change":"2023-10-06T04:36:17.263627+0000","last_active":"2023-10-06T04:36:21.291935+0000","last_peered":"2023-10-06T04:36:21.291935+0000","last_clean":"2023-10-06T04:36:21.291935+0000","last_became_active":"2023-10-06T04:36:17.263090+0000","last_became_peered":"2023-10-06T04:36:17.263090+0000","last_unstale":"2023-10-06T04:36:21.291935+0000","last_undegraded":"2023-10-06T04:36:21.291935+0000","last_fullsized":"2023-10-06T04:36:21.291935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:38.733916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.305005+0000","last_change":"2023-10-06T04:36:21.302935+0000","last_active":"2023-10-06T04:36:21.305005+0000","last_peered":"2023-10-06T04:36:21.305005+0000","last_clean":"2023-10-06T04:36:21.305005+0000","last_became_active":"2023-10-06T04:36:21.302531+0000","last_became_peered":"2023-10-06T04:36:21.302531+0000","last_unstale":"2023-10-06T04:36:21.305005+0000","last_undegraded":"2023-10-06T04:36:21.305005+0000","last_fullsized":"2023-10-06T04:36:21.305005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:53.314660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.290636+0000","last_change":"2023-10-06T04:36:11.193497+0000","last_active":"2023-10-06T04:36:21.290636+0000","last_peered":"2023-10-06T04:36:21.290636+0000","last_clean":"2023-10-06T04:36:21.290636+0000","last_became_active":"2023-10-06T04:36:11.193215+0000","last_became_peered":"2023-10-06T04:36:11.193215+0000","last_unstale":"2023-10-06T04:36:21.290636+0000","last_undegraded":"2023-10-06T04:36:21.290636+0000","last_fullsized":"2023-10-06T04:36:21.290636+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:07.497987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280777+0000","last_change":"2023-10-06T04:36:16.228895+0000","last_active":"2023-10-06T04:36:21.280777+0000","last_peered":"2023-10-06T04:36:21.280777+0000","last_clean":"2023-10-06T04:36:21.280777+0000","last_became_active":"2023-10-06T04:36:16.228165+0000","last_became_peered":"2023-10-06T04:36:16.228165+0000","last_unstale":"2023-10-06T04:36:21.280777+0000","last_undegraded":"2023-10-06T04:36:21.280777+0000","last_fullsized":"2023-10-06T04:36:21.280777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:10.606701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.282559+0000","last_change":"2023-10-06T04:36:17.245277+0000","last_active":"2023-10-06T04:36:21.282559+0000","last_peered":"2023-10-06T04:36:21.282559+0000","last_clean":"2023-10-06T04:36:21.282559+0000","last_became_active":"2023-10-06T04:36:17.245034+0000","last_became_peered":"2023-10-06T04:36:17.245034+0000","last_unstale":"2023-10-06T04:36:21.282559+0000","last_undegraded":"2023-10-06T04:36:21.282559+0000","last_fullsized":"2023-10-06T04:36:21.282559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:48.526269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.305149+0000","last_change":"2023-10-06T04:36:21.299758+0000","last_active":"2023-10-06T04:36:21.305149+0000","last_peered":"2023-10-06T04:36:21.305149+0000","last_clean":"2023-10-06T04:36:21.305149+0000","last_became_active":"2023-10-06T04:36:21.299383+0000","last_became_peered":"2023-10-06T04:36:21.299383+0000","last_unstale":"2023-10-06T04:36:21.305149+0000","last_undegraded":"2023-10-06T04:36:21.305149+0000","last_fullsized":"2023-10-06T04:36:21.305149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:29.699781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.283643+0000","last_change":"2023-10-06T04:36:11.193111+0000","last_active":"2023-10-06T04:36:21.283643+0000","last_peered":"2023-10-06T04:36:21.283643+0000","last_clean":"2023-10-06T04:36:21.283643+0000","last_became_active":"2023-10-06T04:36:11.192836+0000","last_became_peered":"2023-10-06T04:36:11.192836+0000","last_unstale":"2023-10-06T04:36:21.283643+0000","last_undegraded":"2023-10-06T04:36:21.283643+0000","last_fullsized":"2023-10-06T04:36:21.283643+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:19.938716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276725+0000","last_change":"2023-10-06T04:36:16.233274+0000","last_active":"2023-10-06T04:36:21.276725+0000","last_peered":"2023-10-06T04:36:21.276725+0000","last_clean":"2023-10-06T04:36:21.276725+0000","last_became_active":"2023-10-06T04:36:16.232385+0000","last_became_peered":"2023-10-06T04:36:16.232385+0000","last_unstale":"2023-10-06T04:36:21.276725+0000","last_undegraded":"2023-10-06T04:36:21.276725+0000","last_fullsized":"2023-10-06T04:36:21.276725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:51:43.351582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.284374+0000","last_change":"2023-10-06T04:36:17.251317+0000","last_active":"2023-10-06T04:36:21.284374+0000","last_peered":"2023-10-06T04:36:21.284374+0000","last_clean":"2023-10-06T04:36:21.284374+0000","last_became_active":"2023-10-06T04:36:17.251156+0000","last_became_peered":"2023-10-06T04:36:17.251156+0000","last_unstale":"2023-10-06T04:36:21.284374+0000","last_undegraded":"2023-10-06T04:36:21.284374+0000","last_fullsized":"2023-10-06T04:36:21.284374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:14.615096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.305152+0000","last_change":"2023-10-06T04:36:21.303952+0000","last_active":"2023-10-06T04:36:21.305152+0000","last_peered":"2023-10-06T04:36:21.305152+0000","last_clean":"2023-10-06T04:36:21.305152+0000","last_became_active":"2023-10-06T04:36:21.303042+0000","last_became_peered":"2023-10-06T04:36:21.303042+0000","last_unstale":"2023-10-06T04:36:21.305152+0000","last_undegraded":"2023-10-06T04:36:21.305152+0000","last_fullsized":"2023-10-06T04:36:21.305152+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:00.910253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.286309+0000","last_change":"2023-10-06T04:36:11.182804+0000","last_active":"2023-10-06T04:36:21.286309+0000","last_peered":"2023-10-06T04:36:21.286309+0000","last_clean":"2023-10-06T04:36:21.286309+0000","last_became_active":"2023-10-06T04:36:11.182575+0000","last_became_peered":"2023-10-06T04:36:11.182575+0000","last_unstale":"2023-10-06T04:36:21.286309+0000","last_undegraded":"2023-10-06T04:36:21.286309+0000","last_fullsized":"2023-10-06T04:36:21.286309+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:07.497987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291508+0000","last_change":"2023-10-06T04:36:16.237994+0000","last_active":"2023-10-06T04:36:21.291508+0000","last_peered":"2023-10-06T04:36:21.291508+0000","last_clean":"2023-10-06T04:36:21.291508+0000","last_became_active":"2023-10-06T04:36:16.237722+0000","last_became_peered":"2023-10-06T04:36:16.237722+0000","last_unstale":"2023-10-06T04:36:21.291508+0000","last_undegraded":"2023-10-06T04:36:21.291508+0000","last_fullsized":"2023-10-06T04:36:21.291508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:54.757446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.281269+0000","last_change":"2023-10-06T04:36:17.251489+0000","last_active":"2023-10-06T04:36:21.281269+0000","last_peered":"2023-10-06T04:36:21.281269+0000","last_clean":"2023-10-06T04:36:21.281269+0000","last_became_active":"2023-10-06T04:36:17.251233+0000","last_became_peered":"2023-10-06T04:36:17.251233+0000","last_unstale":"2023-10-06T04:36:21.281269+0000","last_undegraded":"2023-10-06T04:36:21.281269+0000","last_fullsized":"2023-10-06T04:36:21.281269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:18.298620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.298102+0000","last_change":"2023-10-06T04:36:21.293975+0000","last_active":"2023-10-06T04:36:21.298102+0000","last_peered":"2023-10-06T04:36:21.298102+0000","last_clean":"2023-10-06T04:36:21.298102+0000","last_became_active":"2023-10-06T04:36:21.293578+0000","last_became_peered":"2023-10-06T04:36:21.293578+0000","last_unstale":"2023-10-06T04:36:21.298102+0000","last_undegraded":"2023-10-06T04:36:21.298102+0000","last_fullsized":"2023-10-06T04:36:21.298102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:14.917841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.284317+0000","last_change":"2023-10-06T04:36:16.229589+0000","last_active":"2023-10-06T04:36:21.284317+0000","last_peered":"2023-10-06T04:36:21.284317+0000","last_clean":"2023-10-06T04:36:21.284317+0000","last_became_active":"2023-10-06T04:36:16.229178+0000","last_became_peered":"2023-10-06T04:36:16.229178+0000","last_unstale":"2023-10-06T04:36:21.284317+0000","last_undegraded":"2023-10-06T04:36:21.284317+0000","last_fullsized":"2023-10-06T04:36:21.284317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:51:43.351582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.272441+0000","last_change":"2023-10-06T04:36:17.250854+0000","last_active":"2023-10-06T04:36:21.272441+0000","last_peered":"2023-10-06T04:36:21.272441+0000","last_clean":"2023-10-06T04:36:21.272441+0000","last_became_active":"2023-10-06T04:36:17.250610+0000","last_became_peered":"2023-10-06T04:36:17.250610+0000","last_unstale":"2023-10-06T04:36:21.272441+0000","last_undegraded":"2023-10-06T04:36:21.272441+0000","last_fullsized":"2023-10-06T04:36:21.272441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:55.761720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.309362+0000","last_change":"2023-10-06T04:36:21.306750+0000","last_active":"2023-10-06T04:36:21.309362+0000","last_peered":"2023-10-06T04:36:21.309362+0000","last_clean":"2023-10-06T04:36:21.309362+0000","last_became_active":"2023-10-06T04:36:21.306419+0000","last_became_peered":"2023-10-06T04:36:21.306419+0000","last_unstale":"2023-10-06T04:36:21.309362+0000","last_undegraded":"2023-10-06T04:36:21.309362+0000","last_fullsized":"2023-10-06T04:36:21.309362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:52.989017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291179+0000","last_change":"2023-10-06T04:36:16.233250+0000","last_active":"2023-10-06T04:36:21.291179+0000","last_peered":"2023-10-06T04:36:21.291179+0000","last_clean":"2023-10-06T04:36:21.291179+0000","last_became_active":"2023-10-06T04:36:16.232939+0000","last_became_peered":"2023-10-06T04:36:16.232939+0000","last_unstale":"2023-10-06T04:36:21.291179+0000","last_undegraded":"2023-10-06T04:36:21.291179+0000","last_fullsized":"2023-10-06T04:36:21.291179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:42.572631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280600+0000","last_change":"2023-10-06T04:36:17.261079+0000","last_active":"2023-10-06T04:36:21.280600+0000","last_peered":"2023-10-06T04:36:21.280600+0000","last_clean":"2023-10-06T04:36:21.280600+0000","last_became_active":"2023-10-06T04:36:17.260815+0000","last_became_peered":"2023-10-06T04:36:17.260815+0000","last_unstale":"2023-10-06T04:36:21.280600+0000","last_undegraded":"2023-10-06T04:36:21.280600+0000","last_fullsized":"2023-10-06T04:36:21.280600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:14.615096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.303853+0000","last_change":"2023-10-06T04:36:21.297230+0000","last_active":"2023-10-06T04:36:21.303853+0000","last_peered":"2023-10-06T04:36:21.303853+0000","last_clean":"2023-10-06T04:36:21.303853+0000","last_became_active":"2023-10-06T04:36:21.296880+0000","last_became_peered":"2023-10-06T04:36:21.296880+0000","last_unstale":"2023-10-06T04:36:21.303853+0000","last_undegraded":"2023-10-06T04:36:21.303853+0000","last_fullsized":"2023-10-06T04:36:21.303853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:02.285634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291398+0000","last_change":"2023-10-06T04:36:16.232832+0000","last_active":"2023-10-06T04:36:21.291398+0000","last_peered":"2023-10-06T04:36:21.291398+0000","last_clean":"2023-10-06T04:36:21.291398+0000","last_became_active":"2023-10-06T04:36:16.232556+0000","last_became_peered":"2023-10-06T04:36:16.232556+0000","last_unstale":"2023-10-06T04:36:21.291398+0000","last_undegraded":"2023-10-06T04:36:21.291398+0000","last_fullsized":"2023-10-06T04:36:21.291398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:10.606701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280531+0000","last_change":"2023-10-06T04:36:17.247689+0000","last_active":"2023-10-06T04:36:21.280531+0000","last_peered":"2023-10-06T04:36:21.280531+0000","last_clean":"2023-10-06T04:36:21.280531+0000","last_became_active":"2023-10-06T04:36:17.247409+0000","last_became_peered":"2023-10-06T04:36:17.247409+0000","last_unstale":"2023-10-06T04:36:21.280531+0000","last_undegraded":"2023-10-06T04:36:21.280531+0000","last_fullsized":"2023-10-06T04:36:21.280531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:35:27.605631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.304354+0000","last_change":"2023-10-06T04:36:21.302319+0000","last_active":"2023-10-06T04:36:21.304354+0000","last_peered":"2023-10-06T04:36:21.304354+0000","last_clean":"2023-10-06T04:36:21.304354+0000","last_became_active":"2023-10-06T04:36:21.301959+0000","last_became_peered":"2023-10-06T04:36:21.301959+0000","last_unstale":"2023-10-06T04:36:21.304354+0000","last_undegraded":"2023-10-06T04:36:21.304354+0000","last_fullsized":"2023-10-06T04:36:21.304354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:18.466700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.277468+0000","last_change":"2023-10-06T04:36:16.228609+0000","last_active":"2023-10-06T04:36:21.277468+0000","last_peered":"2023-10-06T04:36:21.277468+0000","last_clean":"2023-10-06T04:36:21.277468+0000","last_became_active":"2023-10-06T04:36:16.228294+0000","last_became_peered":"2023-10-06T04:36:16.228294+0000","last_unstale":"2023-10-06T04:36:21.277468+0000","last_undegraded":"2023-10-06T04:36:21.277468+0000","last_fullsized":"2023-10-06T04:36:21.277468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:40.040325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.275892+0000","last_change":"2023-10-06T04:36:17.246675+0000","last_active":"2023-10-06T04:36:21.275892+0000","last_peered":"2023-10-06T04:36:21.275892+0000","last_clean":"2023-10-06T04:36:21.275892+0000","last_became_active":"2023-10-06T04:36:17.246403+0000","last_became_peered":"2023-10-06T04:36:17.246403+0000","last_unstale":"2023-10-06T04:36:21.275892+0000","last_undegraded":"2023-10-06T04:36:21.275892+0000","last_fullsized":"2023-10-06T04:36:21.275892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:35:27.605631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.298091+0000","last_change":"2023-10-06T04:36:21.293736+0000","last_active":"2023-10-06T04:36:21.298091+0000","last_peered":"2023-10-06T04:36:21.298091+0000","last_clean":"2023-10-06T04:36:21.298091+0000","last_became_active":"2023-10-06T04:36:21.293317+0000","last_became_peered":"2023-10-06T04:36:21.293317+0000","last_unstale":"2023-10-06T04:36:21.298091+0000","last_undegraded":"2023-10-06T04:36:21.298091+0000","last_fullsized":"2023-10-06T04:36:21.298091+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:00.910253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276350+0000","last_change":"2023-10-06T04:36:16.232060+0000","last_active":"2023-10-06T04:36:21.276350+0000","last_peered":"2023-10-06T04:36:21.276350+0000","last_clean":"2023-10-06T04:36:21.276350+0000","last_became_active":"2023-10-06T04:36:16.231602+0000","last_became_peered":"2023-10-06T04:36:16.231602+0000","last_unstale":"2023-10-06T04:36:21.276350+0000","last_undegraded":"2023-10-06T04:36:21.276350+0000","last_fullsized":"2023-10-06T04:36:21.276350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:32.855334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.279896+0000","last_change":"2023-10-06T04:36:17.252345+0000","last_active":"2023-10-06T04:36:21.279896+0000","last_peered":"2023-10-06T04:36:21.279896+0000","last_clean":"2023-10-06T04:36:21.279896+0000","last_became_active":"2023-10-06T04:36:17.250338+0000","last_became_peered":"2023-10-06T04:36:17.250338+0000","last_unstale":"2023-10-06T04:36:21.279896+0000","last_undegraded":"2023-10-06T04:36:21.279896+0000","last_fullsized":"2023-10-06T04:36:21.279896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:28:24.765888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.290285+0000","last_change":"2023-10-06T04:36:17.261636+0000","last_active":"2023-10-06T04:36:21.290285+0000","last_peered":"2023-10-06T04:36:21.290285+0000","last_clean":"2023-10-06T04:36:21.290285+0000","last_became_active":"2023-10-06T04:36:17.261392+0000","last_became_peered":"2023-10-06T04:36:17.261392+0000","last_unstale":"2023-10-06T04:36:21.290285+0000","last_undegraded":"2023-10-06T04:36:21.290285+0000","last_fullsized":"2023-10-06T04:36:21.290285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:41.044599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.275984+0000","last_change":"2023-10-06T04:36:17.255595+0000","last_active":"2023-10-06T04:36:21.275984+0000","last_peered":"2023-10-06T04:36:21.275984+0000","last_clean":"2023-10-06T04:36:21.275984+0000","last_became_active":"2023-10-06T04:36:17.255326+0000","last_became_peered":"2023-10-06T04:36:17.255326+0000","last_unstale":"2023-10-06T04:36:21.275984+0000","last_undegraded":"2023-10-06T04:36:21.275984+0000","last_fullsized":"2023-10-06T04:36:21.275984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:56.005620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280802+0000","last_change":"2023-10-06T04:36:17.266065+0000","last_active":"2023-10-06T04:36:21.280802+0000","last_peered":"2023-10-06T04:36:21.280802+0000","last_clean":"2023-10-06T04:36:21.280802+0000","last_became_active":"2023-10-06T04:36:17.264225+0000","last_became_peered":"2023-10-06T04:36:17.264225+0000","last_unstale":"2023-10-06T04:36:21.280802+0000","last_undegraded":"2023-10-06T04:36:21.280802+0000","last_fullsized":"2023-10-06T04:36:21.280802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:12.881884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.277129+0000","last_change":"2023-10-06T04:36:17.253460+0000","last_active":"2023-10-06T04:36:21.277129+0000","last_peered":"2023-10-06T04:36:21.277129+0000","last_clean":"2023-10-06T04:36:21.277129+0000","last_became_active":"2023-10-06T04:36:17.253170+0000","last_became_peered":"2023-10-06T04:36:17.253170+0000","last_unstale":"2023-10-06T04:36:21.277129+0000","last_undegraded":"2023-10-06T04:36:21.277129+0000","last_fullsized":"2023-10-06T04:36:21.277129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:25.650113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276624+0000","last_change":"2023-10-06T04:36:17.257970+0000","last_active":"2023-10-06T04:36:21.276624+0000","last_peered":"2023-10-06T04:36:21.276624+0000","last_clean":"2023-10-06T04:36:21.276624+0000","last_became_active":"2023-10-06T04:36:17.257685+0000","last_became_peered":"2023-10-06T04:36:17.257685+0000","last_unstale":"2023-10-06T04:36:21.276624+0000","last_undegraded":"2023-10-06T04:36:21.276624+0000","last_fullsized":"2023-10-06T04:36:21.276624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:15.884489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298156,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073684,"statfs":{"total":96636764160,"available":96331452416,"internally_reserved":0,"allocated":888832,"data_stored":703756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":266240,"data_stored":109458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298128,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073712,"statfs":{"total":96636764160,"available":96331481088,"internally_reserved":0,"allocated":860160,"data_stored":699826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":266240,"data_stored":109034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":108480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":266240,"data_stored":108570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":286720,"data_stored":113228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":274432,"data_stored":110082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:36:30.861 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:36:31.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.008+0000 7f7d7379e700 1 Processor -- start 2023-10-06T04:36:31.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.008+0000 7f7d7379e700 1 -- start start 2023-10-06T04:36:31.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.008+0000 7f7d7379e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d6c0af680 0x7f7d6c15e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:31.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.008+0000 7f7d7379e700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7d6c0cb360 0x7f7d6c0d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:31.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.009+0000 7f7d7379e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d6c0cc4c0 con 0x7f7d6c0d08d0 2023-10-06T04:36:31.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.009+0000 7f7d7379e700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d6c15d460 con 0x7f7d6c0cb360 2023-10-06T04:36:31.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.009+0000 7f7d7379e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6c0d0d50 con 0x7f7d6c0af680 2023-10-06T04:36:31.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.009+0000 7f7d70d39700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7d6c0cb360 0x7f7d6c0d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:31.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.009+0000 7f7d70d39700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7d6c0cb360 0x7f7d6c0d0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38400/0 (socket says 172.21.15.8:38400) 2023-10-06T04:36:31.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.009+0000 7f7d70d39700 1 -- 172.21.15.8:0/2746084770 learned_addr learned my addr 172.21.15.8:0/2746084770 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:31.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.009+0000 7f7d7153a700 1 --2- 172.21.15.8:0/2746084770 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d6c0af680 0x7f7d6c15e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:31.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.009+0000 7f7d70d39700 1 -- 172.21.15.8:0/2746084770 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d6c0af680 msgr2=0x7f7d6c15e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:31.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.009+0000 7f7d70d39700 1 --2- 172.21.15.8:0/2746084770 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d6c0af680 0x7f7d6c15e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:31.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.009+0000 7f7d70d39700 1 -- 172.21.15.8:0/2746084770 >> v1:172.21.15.184:6789/0 conn(0x7f7d6c0d08d0 legacy=0x7f7d6c0b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:31.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.009+0000 7f7d70d39700 1 -- 172.21.15.8:0/2746084770 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d6c15e580 con 0x7f7d6c0cb360 2023-10-06T04:36:31.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.009+0000 7f7d7153a700 1 --2- 172.21.15.8:0/2746084770 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d6c0af680 0x7f7d6c15e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:31.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.009+0000 7f7d70d39700 1 --2- 172.21.15.8:0/2746084770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d6c0cb360 0x7f7d6c0d0390 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7d600099e0 tx=0x7f7d60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=158061fee942286b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:31.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.009+0000 7f7d6bfff700 1 -- 172.21.15.8:0/2746084770 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6000b820 con 0x7f7d6c0cb360 2023-10-06T04:36:31.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.009+0000 7f7d6bfff700 1 -- 172.21.15.8:0/2746084770 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6000b980 con 0x7f7d6c0cb360 2023-10-06T04:36:31.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.009+0000 7f7d6bfff700 1 -- 172.21.15.8:0/2746084770 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6000bd20 con 0x7f7d6c0cb360 2023-10-06T04:36:31.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.010+0000 7f7d7379e700 1 -- 172.21.15.8:0/2746084770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d6c0cb360 msgr2=0x7f7d6c0d0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:31.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.010+0000 7f7d7379e700 1 --2- 172.21.15.8:0/2746084770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d6c0cb360 0x7f7d6c0d0390 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7d600099e0 tx=0x7f7d60009250 comp rx=0 tx=0).stop 2023-10-06T04:36:31.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.010+0000 7f7d7379e700 1 -- 172.21.15.8:0/2746084770 shutdown_connections 2023-10-06T04:36:31.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.010+0000 7f7d7379e700 1 --2- 172.21.15.8:0/2746084770 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d6c0af680 0x7f7d6c15e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:31.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.010+0000 7f7d7379e700 1 --2- 172.21.15.8:0/2746084770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d6c0cb360 0x7f7d6c0d0390 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:31.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.010+0000 7f7d7379e700 1 -- 172.21.15.8:0/2746084770 >> 172.21.15.8:0/2746084770 conn(0x7f7d6c0633d0 msgr2=0x7f7d6c0637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:31.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.010+0000 7f7d7379e700 1 -- 172.21.15.8:0/2746084770 shutdown_connections 2023-10-06T04:36:31.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.010+0000 7f7d7379e700 1 -- 172.21.15.8:0/2746084770 wait complete. 2023-10-06T04:36:31.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.011+0000 7f7d7379e700 1 Processor -- start 2023-10-06T04:36:31.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.011+0000 7f7d7379e700 1 -- start start 2023-10-06T04:36:31.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.012+0000 7f7d7379e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d6c0af680 0x7f7d6c1509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:31.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.012+0000 7f7d7379e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d6c0cb360 0x7f7d6c169e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:31.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.012+0000 7f7d7379e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d6c0d08d0 0x7f7d6c0a78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:31.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.012+0000 7f7d7379e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6c0c6080 con 0x7f7d6c0af680 2023-10-06T04:36:31.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.012+0000 7f7d7379e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6c0c5470 con 0x7f7d6c0d08d0 2023-10-06T04:36:31.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.012+0000 7f7d7379e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6c0c5750 con 0x7f7d6c0cb360 2023-10-06T04:36:31.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.012+0000 7f7d7153a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d6c0af680 0x7f7d6c1509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:31.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.012+0000 7f7d7153a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d6c0af680 0x7f7d6c1509b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38402/0 (socket says 172.21.15.8:38402) 2023-10-06T04:36:31.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.012+0000 7f7d7153a700 1 -- 172.21.15.8:0/1883540267 learned_addr learned my addr 172.21.15.8:0/1883540267 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:31.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.012+0000 7f7d71d3b700 1 --2- 172.21.15.8:0/1883540267 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d6c0d08d0 0x7f7d6c0a78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:31.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.012+0000 7f7d70d39700 1 --2- 172.21.15.8:0/1883540267 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d6c0cb360 0x7f7d6c169e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:31.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.012+0000 7f7d7153a700 1 -- 172.21.15.8:0/1883540267 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d6c0cb360 msgr2=0x7f7d6c169e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:31.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.012+0000 7f7d7153a700 1 --2- 172.21.15.8:0/1883540267 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d6c0cb360 0x7f7d6c169e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:31.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.012+0000 7f7d7153a700 1 -- 172.21.15.8:0/1883540267 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d6c0d08d0 msgr2=0x7f7d6c0a78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:31.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.012+0000 7f7d7153a700 1 --2- 172.21.15.8:0/1883540267 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d6c0d08d0 0x7f7d6c0a78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:31.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.012+0000 7f7d7153a700 1 -- 172.21.15.8:0/1883540267 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d600094f0 con 0x7f7d6c0af680 2023-10-06T04:36:31.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.013+0000 7f7d7153a700 1 --2- 172.21.15.8:0/1883540267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d6c0af680 0x7f7d6c1509b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7d6400d1d0 tx=0x7f7d64009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:31.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.013+0000 7f7d697fa700 1 -- 172.21.15.8:0/1883540267 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6400dd10 con 0x7f7d6c0af680 2023-10-06T04:36:31.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.013+0000 7f7d697fa700 1 -- 172.21.15.8:0/1883540267 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6400f040 con 0x7f7d6c0af680 2023-10-06T04:36:31.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.013+0000 7f7d7379e700 1 -- 172.21.15.8:0/1883540267 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d6c0c5a30 con 0x7f7d6c0af680 2023-10-06T04:36:31.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.013+0000 7f7d697fa700 1 -- 172.21.15.8:0/1883540267 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d64015670 con 0x7f7d6c0af680 2023-10-06T04:36:31.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.013+0000 7f7d7379e700 1 -- 172.21.15.8:0/1883540267 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d6c150ef0 con 0x7f7d6c0af680 2023-10-06T04:36:31.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.014+0000 7f7d7379e700 1 -- 172.21.15.8:0/1883540267 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d6c0c6360 con 0x7f7d6c0af680 2023-10-06T04:36:31.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.014+0000 7f7d697fa700 1 -- 172.21.15.8:0/1883540267 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d64015a60 con 0x7f7d6c0af680 2023-10-06T04:36:31.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.014+0000 7f7d697fa700 1 --2- 172.21.15.8:0/1883540267 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7d58066f30 0x7f7d580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:31.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.015+0000 7f7d697fa700 1 -- 172.21.15.8:0/1883540267 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7d64084d70 con 0x7f7d6c0af680 2023-10-06T04:36:31.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.015+0000 7f7d70d39700 1 --2- 172.21.15.8:0/1883540267 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7d58066f30 0x7f7d580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:31.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.015+0000 7f7d70d39700 1 --2- 172.21.15.8:0/1883540267 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7d58066f30 0x7f7d580693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7d600099e0 tx=0x7f7d60017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:31.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.019+0000 7f7d697fa700 1 -- 172.21.15.8:0/1883540267 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d6404e5a0 con 0x7f7d6c0af680 2023-10-06T04:36:31.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.207+0000 7f7d7379e700 1 -- 172.21.15.8:0/1883540267 --> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7d6c0c61c0 con 0x7f7d58066f30 2023-10-06T04:36:31.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.217+0000 7f7d697fa700 1 -- 172.21.15.8:0/1883540267 <== mgr.4105 v2:172.21.15.184:6832/90283 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367523 (secure 0 0 0) 0x7f7d6000baf0 con 0x7f7d58066f30 2023-10-06T04:36:31.225 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:36:31.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.220+0000 7f7d7379e700 1 -- 172.21.15.8:0/1883540267 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7d58066f30 msgr2=0x7f7d580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:31.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.220+0000 7f7d7379e700 1 --2- 172.21.15.8:0/1883540267 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7d58066f30 0x7f7d580693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7d600099e0 tx=0x7f7d60017000 comp rx=0 tx=0).stop 2023-10-06T04:36:31.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.221+0000 7f7d7379e700 1 -- 172.21.15.8:0/1883540267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d6c0af680 msgr2=0x7f7d6c1509b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:31.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.221+0000 7f7d7379e700 1 --2- 172.21.15.8:0/1883540267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d6c0af680 0x7f7d6c1509b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7d6400d1d0 tx=0x7f7d64009a90 comp rx=0 tx=0).stop 2023-10-06T04:36:31.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.221+0000 7f7d7379e700 1 -- 172.21.15.8:0/1883540267 shutdown_connections 2023-10-06T04:36:31.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.221+0000 7f7d7379e700 1 --2- 172.21.15.8:0/1883540267 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7d58066f30 0x7f7d580693e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:31.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.221+0000 7f7d7379e700 1 --2- 172.21.15.8:0/1883540267 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d6c0d08d0 0x7f7d6c0a78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:31.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.221+0000 7f7d7379e700 1 --2- 172.21.15.8:0/1883540267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d6c0af680 0x7f7d6c1509b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:31.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.221+0000 7f7d7379e700 1 --2- 172.21.15.8:0/1883540267 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d6c0cb360 0x7f7d6c169e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:31.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.221+0000 7f7d7379e700 1 -- 172.21.15.8:0/1883540267 >> 172.21.15.8:0/1883540267 conn(0x7f7d6c0633d0 msgr2=0x7f7d6c15c950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:31.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.221+0000 7f7d7379e700 1 -- 172.21.15.8:0/1883540267 shutdown_connections 2023-10-06T04:36:31.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.221+0000 7f7d7379e700 1 -- 172.21.15.8:0/1883540267 wait complete. 2023-10-06T04:36:31.229 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-06T04:36:31.235 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-10-06T04:36:30.633294+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594852,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381596,"kb_used_data":3292,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593124,"statfs":{"total":773094113280,"available":770655358976,"internally_reserved":0,"allocated":3371008,"data_stored":2062434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2178,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.356605"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.272647+0000","last_change":"2023-10-06T04:36:17.255009+0000","last_active":"2023-10-06T04:36:21.272647+0000","last_peered":"2023-10-06T04:36:21.272647+0000","last_clean":"2023-10-06T04:36:21.272647+0000","last_became_active":"2023-10-06T04:36:17.254704+0000","last_became_peered":"2023-10-06T04:36:17.254704+0000","last_unstale":"2023-10-06T04:36:21.272647+0000","last_undegraded":"2023-10-06T04:36:21.272647+0000","last_fullsized":"2023-10-06T04:36:21.272647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:45:34.132581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291077+0000","last_change":"2023-10-06T04:36:17.256537+0000","last_active":"2023-10-06T04:36:21.291077+0000","last_peered":"2023-10-06T04:36:21.291077+0000","last_clean":"2023-10-06T04:36:21.291077+0000","last_became_active":"2023-10-06T04:36:17.256004+0000","last_became_peered":"2023-10-06T04:36:17.256004+0000","last_unstale":"2023-10-06T04:36:21.291077+0000","last_undegraded":"2023-10-06T04:36:21.291077+0000","last_fullsized":"2023-10-06T04:36:21.291077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:02.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.281626+0000","last_change":"2023-10-06T04:36:17.251532+0000","last_active":"2023-10-06T04:36:21.281626+0000","last_peered":"2023-10-06T04:36:21.281626+0000","last_clean":"2023-10-06T04:36:21.281626+0000","last_became_active":"2023-10-06T04:36:17.250378+0000","last_became_peered":"2023-10-06T04:36:17.250378+0000","last_unstale":"2023-10-06T04:36:21.281626+0000","last_undegraded":"2023-10-06T04:36:21.281626+0000","last_fullsized":"2023-10-06T04:36:21.281626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:10.868173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.283431+0000","last_change":"2023-10-06T04:36:17.256131+0000","last_active":"2023-10-06T04:36:21.283431+0000","last_peered":"2023-10-06T04:36:21.283431+0000","last_clean":"2023-10-06T04:36:21.283431+0000","last_became_active":"2023-10-06T04:36:17.255865+0000","last_became_peered":"2023-10-06T04:36:17.255865+0000","last_unstale":"2023-10-06T04:36:21.283431+0000","last_undegraded":"2023-10-06T04:36:21.283431+0000","last_fullsized":"2023-10-06T04:36:21.283431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:40.502199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.284418+0000","last_change":"2023-10-06T04:36:17.247145+0000","last_active":"2023-10-06T04:36:21.284418+0000","last_peered":"2023-10-06T04:36:21.284418+0000","last_clean":"2023-10-06T04:36:21.284418+0000","last_became_active":"2023-10-06T04:36:17.246879+0000","last_became_peered":"2023-10-06T04:36:17.246879+0000","last_unstale":"2023-10-06T04:36:21.284418+0000","last_undegraded":"2023-10-06T04:36:21.284418+0000","last_fullsized":"2023-10-06T04:36:21.284418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:23:08.806295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280687+0000","last_change":"2023-10-06T04:36:17.252945+0000","last_active":"2023-10-06T04:36:21.280687+0000","last_peered":"2023-10-06T04:36:21.280687+0000","last_clean":"2023-10-06T04:36:21.280687+0000","last_became_active":"2023-10-06T04:36:17.252697+0000","last_became_peered":"2023-10-06T04:36:17.252697+0000","last_unstale":"2023-10-06T04:36:21.280687+0000","last_undegraded":"2023-10-06T04:36:21.280687+0000","last_fullsized":"2023-10-06T04:36:21.280687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:56.005620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291321+0000","last_change":"2023-10-06T04:36:17.259179+0000","last_active":"2023-10-06T04:36:21.291321+0000","last_peered":"2023-10-06T04:36:21.291321+0000","last_clean":"2023-10-06T04:36:21.291321+0000","last_became_active":"2023-10-06T04:36:17.258896+0000","last_became_peered":"2023-10-06T04:36:17.258896+0000","last_unstale":"2023-10-06T04:36:21.291321+0000","last_undegraded":"2023-10-06T04:36:21.291321+0000","last_fullsized":"2023-10-06T04:36:21.291321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:06.137894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.290396+0000","last_change":"2023-10-06T04:36:17.251370+0000","last_active":"2023-10-06T04:36:21.290396+0000","last_peered":"2023-10-06T04:36:21.290396+0000","last_clean":"2023-10-06T04:36:21.290396+0000","last_became_active":"2023-10-06T04:36:17.251111+0000","last_became_peered":"2023-10-06T04:36:17.251111+0000","last_unstale":"2023-10-06T04:36:21.290396+0000","last_undegraded":"2023-10-06T04:36:21.290396+0000","last_fullsized":"2023-10-06T04:36:21.290396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:01:35.146203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276077+0000","last_change":"2023-10-06T04:36:17.247564+0000","last_active":"2023-10-06T04:36:21.276077+0000","last_peered":"2023-10-06T04:36:21.276077+0000","last_clean":"2023-10-06T04:36:21.276077+0000","last_became_active":"2023-10-06T04:36:17.247306+0000","last_became_peered":"2023-10-06T04:36:17.247306+0000","last_unstale":"2023-10-06T04:36:21.276077+0000","last_undegraded":"2023-10-06T04:36:21.276077+0000","last_fullsized":"2023-10-06T04:36:21.276077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:02.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291293+0000","last_change":"2023-10-06T04:36:17.256706+0000","last_active":"2023-10-06T04:36:21.291293+0000","last_peered":"2023-10-06T04:36:21.291293+0000","last_clean":"2023-10-06T04:36:21.291293+0000","last_became_active":"2023-10-06T04:36:17.256322+0000","last_became_peered":"2023-10-06T04:36:17.256322+0000","last_unstale":"2023-10-06T04:36:21.291293+0000","last_undegraded":"2023-10-06T04:36:21.291293+0000","last_fullsized":"2023-10-06T04:36:21.291293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:23:08.806295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.281544+0000","last_change":"2023-10-06T04:36:17.266725+0000","last_active":"2023-10-06T04:36:21.281544+0000","last_peered":"2023-10-06T04:36:21.281544+0000","last_clean":"2023-10-06T04:36:21.281544+0000","last_became_active":"2023-10-06T04:36:17.266037+0000","last_became_peered":"2023-10-06T04:36:17.266037+0000","last_unstale":"2023-10-06T04:36:21.281544+0000","last_undegraded":"2023-10-06T04:36:21.281544+0000","last_fullsized":"2023-10-06T04:36:21.281544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:35.000504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.272228+0000","last_change":"2023-10-06T04:36:17.244295+0000","last_active":"2023-10-06T04:36:21.272228+0000","last_peered":"2023-10-06T04:36:21.272228+0000","last_clean":"2023-10-06T04:36:21.272228+0000","last_became_active":"2023-10-06T04:36:17.244029+0000","last_became_peered":"2023-10-06T04:36:17.244029+0000","last_unstale":"2023-10-06T04:36:21.272228+0000","last_undegraded":"2023-10-06T04:36:21.272228+0000","last_fullsized":"2023-10-06T04:36:21.272228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:11.610976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.272361+0000","last_change":"2023-10-06T04:36:17.247080+0000","last_active":"2023-10-06T04:36:21.272361+0000","last_peered":"2023-10-06T04:36:21.272361+0000","last_clean":"2023-10-06T04:36:21.272361+0000","last_became_active":"2023-10-06T04:36:17.246794+0000","last_became_peered":"2023-10-06T04:36:17.246794+0000","last_unstale":"2023-10-06T04:36:21.272361+0000","last_undegraded":"2023-10-06T04:36:21.272361+0000","last_fullsized":"2023-10-06T04:36:21.272361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:13.150215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291383+0000","last_change":"2023-10-06T04:36:17.258372+0000","last_active":"2023-10-06T04:36:21.291383+0000","last_peered":"2023-10-06T04:36:21.291383+0000","last_clean":"2023-10-06T04:36:21.291383+0000","last_became_active":"2023-10-06T04:36:17.258116+0000","last_became_peered":"2023-10-06T04:36:17.258116+0000","last_unstale":"2023-10-06T04:36:21.291383+0000","last_undegraded":"2023-10-06T04:36:21.291383+0000","last_fullsized":"2023-10-06T04:36:21.291383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:15.884489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291099+0000","last_change":"2023-10-06T04:36:17.259309+0000","last_active":"2023-10-06T04:36:21.291099+0000","last_peered":"2023-10-06T04:36:21.291099+0000","last_clean":"2023-10-06T04:36:21.291099+0000","last_became_active":"2023-10-06T04:36:17.259048+0000","last_became_peered":"2023-10-06T04:36:17.259048+0000","last_unstale":"2023-10-06T04:36:21.291099+0000","last_undegraded":"2023-10-06T04:36:21.291099+0000","last_fullsized":"2023-10-06T04:36:21.291099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:03.209071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280262+0000","last_change":"2023-10-06T04:36:17.248671+0000","last_active":"2023-10-06T04:36:21.280262+0000","last_peered":"2023-10-06T04:36:21.280262+0000","last_clean":"2023-10-06T04:36:21.280262+0000","last_became_active":"2023-10-06T04:36:17.248389+0000","last_became_peered":"2023-10-06T04:36:17.248389+0000","last_unstale":"2023-10-06T04:36:21.280262+0000","last_undegraded":"2023-10-06T04:36:21.280262+0000","last_fullsized":"2023-10-06T04:36:21.280262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:32.568497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276165+0000","last_change":"2023-10-06T04:36:17.253794+0000","last_active":"2023-10-06T04:36:21.276165+0000","last_peered":"2023-10-06T04:36:21.276165+0000","last_clean":"2023-10-06T04:36:21.276165+0000","last_became_active":"2023-10-06T04:36:17.253556+0000","last_became_peered":"2023-10-06T04:36:17.253556+0000","last_unstale":"2023-10-06T04:36:21.276165+0000","last_undegraded":"2023-10-06T04:36:21.276165+0000","last_fullsized":"2023-10-06T04:36:21.276165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:53.436742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.281355+0000","last_change":"2023-10-06T04:36:17.248844+0000","last_active":"2023-10-06T04:36:21.281355+0000","last_peered":"2023-10-06T04:36:21.281355+0000","last_clean":"2023-10-06T04:36:21.281355+0000","last_became_active":"2023-10-06T04:36:17.248564+0000","last_became_peered":"2023-10-06T04:36:17.248564+0000","last_unstale":"2023-10-06T04:36:21.281355+0000","last_undegraded":"2023-10-06T04:36:21.281355+0000","last_fullsized":"2023-10-06T04:36:21.281355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:09:48.312479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.272565+0000","last_change":"2023-10-06T04:36:17.250339+0000","last_active":"2023-10-06T04:36:21.272565+0000","last_peered":"2023-10-06T04:36:21.272565+0000","last_clean":"2023-10-06T04:36:21.272565+0000","last_became_active":"2023-10-06T04:36:17.250051+0000","last_became_peered":"2023-10-06T04:36:17.250051+0000","last_unstale":"2023-10-06T04:36:21.272565+0000","last_undegraded":"2023-10-06T04:36:21.272565+0000","last_fullsized":"2023-10-06T04:36:21.272565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:43.576906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280996+0000","last_change":"2023-10-06T04:36:17.250606+0000","last_active":"2023-10-06T04:36:21.280996+0000","last_peered":"2023-10-06T04:36:21.280996+0000","last_clean":"2023-10-06T04:36:21.280996+0000","last_became_active":"2023-10-06T04:36:17.250295+0000","last_became_peered":"2023-10-06T04:36:17.250295+0000","last_unstale":"2023-10-06T04:36:21.280996+0000","last_undegraded":"2023-10-06T04:36:21.280996+0000","last_fullsized":"2023-10-06T04:36:21.280996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:52.945703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.292940+0000","last_change":"2023-10-06T04:36:17.260489+0000","last_active":"2023-10-06T04:36:21.292940+0000","last_peered":"2023-10-06T04:36:21.292940+0000","last_clean":"2023-10-06T04:36:21.292940+0000","last_became_active":"2023-10-06T04:36:17.259923+0000","last_became_peered":"2023-10-06T04:36:17.259923+0000","last_unstale":"2023-10-06T04:36:21.292940+0000","last_undegraded":"2023-10-06T04:36:21.292940+0000","last_fullsized":"2023-10-06T04:36:21.292940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:53.436742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.278618+0000","last_change":"2023-10-06T04:36:17.248545+0000","last_active":"2023-10-06T04:36:21.278618+0000","last_peered":"2023-10-06T04:36:21.278618+0000","last_clean":"2023-10-06T04:36:21.278618+0000","last_became_active":"2023-10-06T04:36:17.248276+0000","last_became_peered":"2023-10-06T04:36:17.248276+0000","last_unstale":"2023-10-06T04:36:21.278618+0000","last_undegraded":"2023-10-06T04:36:21.278618+0000","last_fullsized":"2023-10-06T04:36:21.278618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:35:27.605631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276071+0000","last_change":"2023-10-06T04:36:17.252822+0000","last_active":"2023-10-06T04:36:21.276071+0000","last_peered":"2023-10-06T04:36:21.276071+0000","last_clean":"2023-10-06T04:36:21.276071+0000","last_became_active":"2023-10-06T04:36:17.252543+0000","last_became_peered":"2023-10-06T04:36:17.252543+0000","last_unstale":"2023-10-06T04:36:21.276071+0000","last_undegraded":"2023-10-06T04:36:21.276071+0000","last_fullsized":"2023-10-06T04:36:21.276071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:12.881884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.290615+0000","last_change":"2023-10-06T04:36:17.260460+0000","last_active":"2023-10-06T04:36:21.290615+0000","last_peered":"2023-10-06T04:36:21.290615+0000","last_clean":"2023-10-06T04:36:21.290615+0000","last_became_active":"2023-10-06T04:36:17.260121+0000","last_became_peered":"2023-10-06T04:36:17.260121+0000","last_unstale":"2023-10-06T04:36:21.290615+0000","last_undegraded":"2023-10-06T04:36:21.290615+0000","last_fullsized":"2023-10-06T04:36:21.290615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:02.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276878+0000","last_change":"2023-10-06T04:36:17.252219+0000","last_active":"2023-10-06T04:36:21.276878+0000","last_peered":"2023-10-06T04:36:21.276878+0000","last_clean":"2023-10-06T04:36:21.276878+0000","last_became_active":"2023-10-06T04:36:17.251409+0000","last_became_peered":"2023-10-06T04:36:17.251409+0000","last_unstale":"2023-10-06T04:36:21.276878+0000","last_undegraded":"2023-10-06T04:36:21.276878+0000","last_fullsized":"2023-10-06T04:36:21.276878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:23:08.806295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.279778+0000","last_change":"2023-10-06T04:36:17.246611+0000","last_active":"2023-10-06T04:36:21.279778+0000","last_peered":"2023-10-06T04:36:21.279778+0000","last_clean":"2023-10-06T04:36:21.279778+0000","last_became_active":"2023-10-06T04:36:17.246330+0000","last_became_peered":"2023-10-06T04:36:17.246330+0000","last_unstale":"2023-10-06T04:36:21.279778+0000","last_undegraded":"2023-10-06T04:36:21.279778+0000","last_fullsized":"2023-10-06T04:36:21.279778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:33.859609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291627+0000","last_change":"2023-10-06T04:36:17.257554+0000","last_active":"2023-10-06T04:36:21.291627+0000","last_peered":"2023-10-06T04:36:21.291627+0000","last_clean":"2023-10-06T04:36:21.291627+0000","last_became_active":"2023-10-06T04:36:17.256991+0000","last_became_peered":"2023-10-06T04:36:17.256991+0000","last_unstale":"2023-10-06T04:36:21.291627+0000","last_undegraded":"2023-10-06T04:36:21.291627+0000","last_fullsized":"2023-10-06T04:36:21.291627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:53.436742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.299304+0000","last_change":"2023-10-06T04:36:21.295618+0000","last_active":"2023-10-06T04:36:21.299304+0000","last_peered":"2023-10-06T04:36:21.299304+0000","last_clean":"2023-10-06T04:36:21.299304+0000","last_became_active":"2023-10-06T04:36:21.295184+0000","last_became_peered":"2023-10-06T04:36:21.295184+0000","last_unstale":"2023-10-06T04:36:21.299304+0000","last_undegraded":"2023-10-06T04:36:21.299304+0000","last_fullsized":"2023-10-06T04:36:21.299304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:20:30.698636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280678+0000","last_change":"2023-10-06T04:36:16.230697+0000","last_active":"2023-10-06T04:36:21.280678+0000","last_peered":"2023-10-06T04:36:21.280678+0000","last_clean":"2023-10-06T04:36:21.280678+0000","last_became_active":"2023-10-06T04:36:16.230463+0000","last_became_peered":"2023-10-06T04:36:16.230463+0000","last_unstale":"2023-10-06T04:36:21.280678+0000","last_undegraded":"2023-10-06T04:36:21.280678+0000","last_fullsized":"2023-10-06T04:36:21.280678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:42.572631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.279718+0000","last_change":"2023-10-06T04:36:17.250531+0000","last_active":"2023-10-06T04:36:21.279718+0000","last_peered":"2023-10-06T04:36:21.279718+0000","last_clean":"2023-10-06T04:36:21.279718+0000","last_became_active":"2023-10-06T04:36:17.250025+0000","last_became_peered":"2023-10-06T04:36:17.250025+0000","last_unstale":"2023-10-06T04:36:21.279718+0000","last_undegraded":"2023-10-06T04:36:21.279718+0000","last_fullsized":"2023-10-06T04:36:21.279718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:14.615096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.303903+0000","last_change":"2023-10-06T04:36:21.293815+0000","last_active":"2023-10-06T04:36:21.303903+0000","last_peered":"2023-10-06T04:36:21.303903+0000","last_clean":"2023-10-06T04:36:21.303903+0000","last_became_active":"2023-10-06T04:36:21.292202+0000","last_became_peered":"2023-10-06T04:36:21.292202+0000","last_unstale":"2023-10-06T04:36:21.303903+0000","last_undegraded":"2023-10-06T04:36:21.303903+0000","last_fullsized":"2023-10-06T04:36:21.303903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:39.050172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.282090+0000","last_change":"2023-10-06T04:36:16.232507+0000","last_active":"2023-10-06T04:36:21.282090+0000","last_peered":"2023-10-06T04:36:21.282090+0000","last_clean":"2023-10-06T04:36:21.282090+0000","last_became_active":"2023-10-06T04:36:16.232152+0000","last_became_peered":"2023-10-06T04:36:16.232152+0000","last_unstale":"2023-10-06T04:36:21.282090+0000","last_undegraded":"2023-10-06T04:36:21.282090+0000","last_fullsized":"2023-10-06T04:36:21.282090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:12.145940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.278617+0000","last_change":"2023-10-06T04:36:17.254040+0000","last_active":"2023-10-06T04:36:21.278617+0000","last_peered":"2023-10-06T04:36:21.278617+0000","last_clean":"2023-10-06T04:36:21.278617+0000","last_became_active":"2023-10-06T04:36:17.252810+0000","last_became_peered":"2023-10-06T04:36:17.252810+0000","last_unstale":"2023-10-06T04:36:21.278617+0000","last_undegraded":"2023-10-06T04:36:21.278617+0000","last_fullsized":"2023-10-06T04:36:21.278617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:15:51.848244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.295280+0000","last_change":"2023-10-06T04:36:21.290604+0000","last_active":"2023-10-06T04:36:21.295280+0000","last_peered":"2023-10-06T04:36:21.295280+0000","last_clean":"2023-10-06T04:36:21.295280+0000","last_became_active":"2023-10-06T04:36:21.290250+0000","last_became_peered":"2023-10-06T04:36:21.290250+0000","last_unstale":"2023-10-06T04:36:21.295280+0000","last_undegraded":"2023-10-06T04:36:21.295280+0000","last_fullsized":"2023-10-06T04:36:21.295280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:06:31.394534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.277373+0000","last_change":"2023-10-06T04:36:16.226122+0000","last_active":"2023-10-06T04:36:21.277373+0000","last_peered":"2023-10-06T04:36:21.277373+0000","last_clean":"2023-10-06T04:36:21.277373+0000","last_became_active":"2023-10-06T04:36:16.225815+0000","last_became_peered":"2023-10-06T04:36:16.225815+0000","last_unstale":"2023-10-06T04:36:21.277373+0000","last_undegraded":"2023-10-06T04:36:21.277373+0000","last_fullsized":"2023-10-06T04:36:21.277373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:58:31.078830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.286372+0000","last_change":"2023-10-06T04:36:17.250474+0000","last_active":"2023-10-06T04:36:21.286372+0000","last_peered":"2023-10-06T04:36:21.286372+0000","last_clean":"2023-10-06T04:36:21.286372+0000","last_became_active":"2023-10-06T04:36:17.250205+0000","last_became_peered":"2023-10-06T04:36:17.250205+0000","last_unstale":"2023-10-06T04:36:21.286372+0000","last_undegraded":"2023-10-06T04:36:21.286372+0000","last_fullsized":"2023-10-06T04:36:21.286372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:46.694413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.306587+0000","last_change":"2023-10-06T04:36:21.301478+0000","last_active":"2023-10-06T04:36:21.306587+0000","last_peered":"2023-10-06T04:36:21.306587+0000","last_clean":"2023-10-06T04:36:21.306587+0000","last_became_active":"2023-10-06T04:36:21.300836+0000","last_became_peered":"2023-10-06T04:36:21.300836+0000","last_unstale":"2023-10-06T04:36:21.306587+0000","last_undegraded":"2023-10-06T04:36:21.306587+0000","last_fullsized":"2023-10-06T04:36:21.306587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:00.055287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276255+0000","last_change":"2023-10-06T04:36:16.231833+0000","last_active":"2023-10-06T04:36:21.276255+0000","last_peered":"2023-10-06T04:36:21.276255+0000","last_clean":"2023-10-06T04:36:21.276255+0000","last_became_active":"2023-10-06T04:36:16.231263+0000","last_became_peered":"2023-10-06T04:36:16.231263+0000","last_unstale":"2023-10-06T04:36:21.276255+0000","last_undegraded":"2023-10-06T04:36:21.276255+0000","last_fullsized":"2023-10-06T04:36:21.276255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:45:33.128307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.277178+0000","last_change":"2023-10-06T04:36:17.250303+0000","last_active":"2023-10-06T04:36:21.277178+0000","last_peered":"2023-10-06T04:36:21.277178+0000","last_clean":"2023-10-06T04:36:21.277178+0000","last_became_active":"2023-10-06T04:36:17.250033+0000","last_became_peered":"2023-10-06T04:36:17.250033+0000","last_unstale":"2023-10-06T04:36:21.277178+0000","last_undegraded":"2023-10-06T04:36:21.277178+0000","last_fullsized":"2023-10-06T04:36:21.277178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:35.000504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.309264+0000","last_change":"2023-10-06T04:36:21.302970+0000","last_active":"2023-10-06T04:36:21.309264+0000","last_peered":"2023-10-06T04:36:21.309264+0000","last_clean":"2023-10-06T04:36:21.309264+0000","last_became_active":"2023-10-06T04:36:21.302562+0000","last_became_peered":"2023-10-06T04:36:21.302562+0000","last_unstale":"2023-10-06T04:36:21.309264+0000","last_undegraded":"2023-10-06T04:36:21.309264+0000","last_fullsized":"2023-10-06T04:36:21.309264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:53.314660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291194+0000","last_change":"2023-10-06T04:36:16.230552+0000","last_active":"2023-10-06T04:36:21.291194+0000","last_peered":"2023-10-06T04:36:21.291194+0000","last_clean":"2023-10-06T04:36:21.291194+0000","last_became_active":"2023-10-06T04:36:16.230077+0000","last_became_peered":"2023-10-06T04:36:16.230077+0000","last_unstale":"2023-10-06T04:36:21.291194+0000","last_undegraded":"2023-10-06T04:36:21.291194+0000","last_fullsized":"2023-10-06T04:36:21.291194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:51:43.351582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.275705+0000","last_change":"2023-10-06T04:36:17.253484+0000","last_active":"2023-10-06T04:36:21.275705+0000","last_peered":"2023-10-06T04:36:21.275705+0000","last_clean":"2023-10-06T04:36:21.275705+0000","last_became_active":"2023-10-06T04:36:17.253217+0000","last_became_peered":"2023-10-06T04:36:17.253217+0000","last_unstale":"2023-10-06T04:36:21.275705+0000","last_undegraded":"2023-10-06T04:36:21.275705+0000","last_fullsized":"2023-10-06T04:36:21.275705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:23:08.806295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.301600+0000","last_change":"2023-10-06T04:36:21.296152+0000","last_active":"2023-10-06T04:36:21.301600+0000","last_peered":"2023-10-06T04:36:21.301600+0000","last_clean":"2023-10-06T04:36:21.301600+0000","last_became_active":"2023-10-06T04:36:21.295728+0000","last_became_peered":"2023-10-06T04:36:21.295728+0000","last_unstale":"2023-10-06T04:36:21.301600+0000","last_undegraded":"2023-10-06T04:36:21.301600+0000","last_fullsized":"2023-10-06T04:36:21.301600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:44.809580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.292523+0000","last_change":"2023-10-06T04:36:16.237564+0000","last_active":"2023-10-06T04:36:21.292523+0000","last_peered":"2023-10-06T04:36:21.292523+0000","last_clean":"2023-10-06T04:36:21.292523+0000","last_became_active":"2023-10-06T04:36:16.237309+0000","last_became_peered":"2023-10-06T04:36:16.237309+0000","last_unstale":"2023-10-06T04:36:21.292523+0000","last_undegraded":"2023-10-06T04:36:21.292523+0000","last_fullsized":"2023-10-06T04:36:21.292523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:47.521994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.281533+0000","last_change":"2023-10-06T04:36:17.256321+0000","last_active":"2023-10-06T04:36:21.281533+0000","last_peered":"2023-10-06T04:36:21.281533+0000","last_clean":"2023-10-06T04:36:21.281533+0000","last_became_active":"2023-10-06T04:36:17.256041+0000","last_became_peered":"2023-10-06T04:36:17.256041+0000","last_unstale":"2023-10-06T04:36:21.281533+0000","last_undegraded":"2023-10-06T04:36:21.281533+0000","last_fullsized":"2023-10-06T04:36:21.281533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:22.912226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.303744+0000","last_change":"2023-10-06T04:36:21.300383+0000","last_active":"2023-10-06T04:36:21.303744+0000","last_peered":"2023-10-06T04:36:21.303744+0000","last_clean":"2023-10-06T04:36:21.303744+0000","last_became_active":"2023-10-06T04:36:21.299968+0000","last_became_peered":"2023-10-06T04:36:21.299968+0000","last_unstale":"2023-10-06T04:36:21.303744+0000","last_undegraded":"2023-10-06T04:36:21.303744+0000","last_fullsized":"2023-10-06T04:36:21.303744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:22:34.846112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T04:36:27.099477+0000","last_change":"2023-10-06T04:36:16.229754+0000","last_active":"2023-10-06T04:36:27.099477+0000","last_peered":"2023-10-06T04:36:27.099477+0000","last_clean":"2023-10-06T04:36:27.099477+0000","last_became_active":"2023-10-06T04:36:16.229482+0000","last_became_peered":"2023-10-06T04:36:16.229482+0000","last_unstale":"2023-10-06T04:36:27.099477+0000","last_undegraded":"2023-10-06T04:36:27.099477+0000","last_fullsized":"2023-10-06T04:36:27.099477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:12.145940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280792+0000","last_change":"2023-10-06T04:36:17.254403+0000","last_active":"2023-10-06T04:36:21.280792+0000","last_peered":"2023-10-06T04:36:21.280792+0000","last_clean":"2023-10-06T04:36:21.280792+0000","last_became_active":"2023-10-06T04:36:17.254147+0000","last_became_peered":"2023-10-06T04:36:17.254147+0000","last_unstale":"2023-10-06T04:36:21.280792+0000","last_undegraded":"2023-10-06T04:36:21.280792+0000","last_fullsized":"2023-10-06T04:36:21.280792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:03.209071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.303821+0000","last_change":"2023-10-06T04:36:21.298829+0000","last_active":"2023-10-06T04:36:21.303821+0000","last_peered":"2023-10-06T04:36:21.303821+0000","last_clean":"2023-10-06T04:36:21.303821+0000","last_became_active":"2023-10-06T04:36:21.298456+0000","last_became_peered":"2023-10-06T04:36:21.298456+0000","last_unstale":"2023-10-06T04:36:21.303821+0000","last_undegraded":"2023-10-06T04:36:21.303821+0000","last_fullsized":"2023-10-06T04:36:21.303821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:52.989017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.292810+0000","last_change":"2023-10-06T04:36:16.235605+0000","last_active":"2023-10-06T04:36:21.292810+0000","last_peered":"2023-10-06T04:36:21.292810+0000","last_clean":"2023-10-06T04:36:21.292810+0000","last_became_active":"2023-10-06T04:36:16.235280+0000","last_became_peered":"2023-10-06T04:36:16.235280+0000","last_unstale":"2023-10-06T04:36:21.292810+0000","last_undegraded":"2023-10-06T04:36:21.292810+0000","last_fullsized":"2023-10-06T04:36:21.292810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:37.729642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.281044+0000","last_change":"2023-10-06T04:36:17.255715+0000","last_active":"2023-10-06T04:36:21.281044+0000","last_peered":"2023-10-06T04:36:21.281044+0000","last_clean":"2023-10-06T04:36:21.281044+0000","last_became_active":"2023-10-06T04:36:17.255461+0000","last_became_peered":"2023-10-06T04:36:17.255461+0000","last_unstale":"2023-10-06T04:36:21.281044+0000","last_undegraded":"2023-10-06T04:36:21.281044+0000","last_fullsized":"2023-10-06T04:36:21.281044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:28:24.765888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.301636+0000","last_change":"2023-10-06T04:36:21.294549+0000","last_active":"2023-10-06T04:36:21.301636+0000","last_peered":"2023-10-06T04:36:21.301636+0000","last_clean":"2023-10-06T04:36:21.301636+0000","last_became_active":"2023-10-06T04:36:21.293440+0000","last_became_peered":"2023-10-06T04:36:21.293440+0000","last_unstale":"2023-10-06T04:36:21.301636+0000","last_undegraded":"2023-10-06T04:36:21.301636+0000","last_fullsized":"2023-10-06T04:36:21.301636+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:42.828588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.278781+0000","last_change":"2023-10-06T04:36:16.226258+0000","last_active":"2023-10-06T04:36:21.278781+0000","last_peered":"2023-10-06T04:36:21.278781+0000","last_clean":"2023-10-06T04:36:21.278781+0000","last_became_active":"2023-10-06T04:36:16.225988+0000","last_became_peered":"2023-10-06T04:36:16.225988+0000","last_unstale":"2023-10-06T04:36:21.278781+0000","last_undegraded":"2023-10-06T04:36:21.278781+0000","last_fullsized":"2023-10-06T04:36:21.278781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:54.757446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291513+0000","last_change":"2023-10-06T04:36:17.257055+0000","last_active":"2023-10-06T04:36:21.291513+0000","last_peered":"2023-10-06T04:36:21.291513+0000","last_clean":"2023-10-06T04:36:21.291513+0000","last_became_active":"2023-10-06T04:36:17.256355+0000","last_became_peered":"2023-10-06T04:36:17.256355+0000","last_unstale":"2023-10-06T04:36:21.291513+0000","last_undegraded":"2023-10-06T04:36:21.291513+0000","last_fullsized":"2023-10-06T04:36:21.291513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:11.333475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.297023+0000","last_change":"2023-10-06T04:36:21.293305+0000","last_active":"2023-10-06T04:36:21.297023+0000","last_peered":"2023-10-06T04:36:21.297023+0000","last_clean":"2023-10-06T04:36:21.297023+0000","last_became_active":"2023-10-06T04:36:21.291331+0000","last_became_peered":"2023-10-06T04:36:21.291331+0000","last_unstale":"2023-10-06T04:36:21.297023+0000","last_undegraded":"2023-10-06T04:36:21.297023+0000","last_fullsized":"2023-10-06T04:36:21.297023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:14:57.032741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291211+0000","last_change":"2023-10-06T04:36:16.235344+0000","last_active":"2023-10-06T04:36:21.291211+0000","last_peered":"2023-10-06T04:36:21.291211+0000","last_clean":"2023-10-06T04:36:21.291211+0000","last_became_active":"2023-10-06T04:36:16.235092+0000","last_became_peered":"2023-10-06T04:36:16.235092+0000","last_unstale":"2023-10-06T04:36:21.291211+0000","last_undegraded":"2023-10-06T04:36:21.291211+0000","last_fullsized":"2023-10-06T04:36:21.291211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:40.040325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.278875+0000","last_change":"2023-10-06T04:36:17.252187+0000","last_active":"2023-10-06T04:36:21.278875+0000","last_peered":"2023-10-06T04:36:21.278875+0000","last_clean":"2023-10-06T04:36:21.278875+0000","last_became_active":"2023-10-06T04:36:17.251853+0000","last_became_peered":"2023-10-06T04:36:17.251853+0000","last_unstale":"2023-10-06T04:36:21.278875+0000","last_undegraded":"2023-10-06T04:36:21.278875+0000","last_fullsized":"2023-10-06T04:36:21.278875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:01:35.146203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.307146+0000","last_change":"2023-10-06T04:36:21.302469+0000","last_active":"2023-10-06T04:36:21.307146+0000","last_peered":"2023-10-06T04:36:21.307146+0000","last_clean":"2023-10-06T04:36:21.307146+0000","last_became_active":"2023-10-06T04:36:21.302085+0000","last_became_peered":"2023-10-06T04:36:21.302085+0000","last_unstale":"2023-10-06T04:36:21.307146+0000","last_undegraded":"2023-10-06T04:36:21.307146+0000","last_fullsized":"2023-10-06T04:36:21.307146+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:06:31.394534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.288489+0000","last_change":"2023-10-06T04:36:16.236074+0000","last_active":"2023-10-06T04:36:21.288489+0000","last_peered":"2023-10-06T04:36:21.288489+0000","last_clean":"2023-10-06T04:36:21.288489+0000","last_became_active":"2023-10-06T04:36:16.235777+0000","last_became_peered":"2023-10-06T04:36:16.235777+0000","last_unstale":"2023-10-06T04:36:21.288489+0000","last_undegraded":"2023-10-06T04:36:21.288489+0000","last_fullsized":"2023-10-06T04:36:21.288489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:42:27.974066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.279446+0000","last_change":"2023-10-06T04:36:17.259778+0000","last_active":"2023-10-06T04:36:21.279446+0000","last_peered":"2023-10-06T04:36:21.279446+0000","last_clean":"2023-10-06T04:36:21.279446+0000","last_became_active":"2023-10-06T04:36:17.259529+0000","last_became_peered":"2023-10-06T04:36:17.259529+0000","last_unstale":"2023-10-06T04:36:21.279446+0000","last_undegraded":"2023-10-06T04:36:21.279446+0000","last_fullsized":"2023-10-06T04:36:21.279446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:02.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.309340+0000","last_change":"2023-10-06T04:36:21.305292+0000","last_active":"2023-10-06T04:36:21.309340+0000","last_peered":"2023-10-06T04:36:21.309340+0000","last_clean":"2023-10-06T04:36:21.309340+0000","last_became_active":"2023-10-06T04:36:21.304899+0000","last_became_peered":"2023-10-06T04:36:21.304899+0000","last_unstale":"2023-10-06T04:36:21.309340+0000","last_undegraded":"2023-10-06T04:36:21.309340+0000","last_fullsized":"2023-10-06T04:36:21.309340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:30.790855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.296904+0000","last_change":"2023-10-06T04:36:16.235873+0000","last_active":"2023-10-06T04:36:21.296904+0000","last_peered":"2023-10-06T04:36:21.296904+0000","last_clean":"2023-10-06T04:36:21.296904+0000","last_became_active":"2023-10-06T04:36:16.235577+0000","last_became_peered":"2023-10-06T04:36:16.235577+0000","last_unstale":"2023-10-06T04:36:21.296904+0000","last_undegraded":"2023-10-06T04:36:21.296904+0000","last_fullsized":"2023-10-06T04:36:21.296904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:39.497925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.290348+0000","last_change":"2023-10-06T04:36:17.256627+0000","last_active":"2023-10-06T04:36:21.290348+0000","last_peered":"2023-10-06T04:36:21.290348+0000","last_clean":"2023-10-06T04:36:21.290348+0000","last_became_active":"2023-10-06T04:36:17.256351+0000","last_became_peered":"2023-10-06T04:36:17.256351+0000","last_unstale":"2023-10-06T04:36:21.290348+0000","last_undegraded":"2023-10-06T04:36:21.290348+0000","last_fullsized":"2023-10-06T04:36:21.290348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:18.298620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.299923+0000","last_change":"2023-10-06T04:36:21.292866+0000","last_active":"2023-10-06T04:36:21.299923+0000","last_peered":"2023-10-06T04:36:21.299923+0000","last_clean":"2023-10-06T04:36:21.299923+0000","last_became_active":"2023-10-06T04:36:21.292441+0000","last_became_peered":"2023-10-06T04:36:21.292441+0000","last_unstale":"2023-10-06T04:36:21.299923+0000","last_undegraded":"2023-10-06T04:36:21.299923+0000","last_fullsized":"2023-10-06T04:36:21.299923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:29.699781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.293323+0000","last_change":"2023-10-06T04:36:16.235438+0000","last_active":"2023-10-06T04:36:21.293323+0000","last_peered":"2023-10-06T04:36:21.293323+0000","last_clean":"2023-10-06T04:36:21.293323+0000","last_became_active":"2023-10-06T04:36:16.235142+0000","last_became_peered":"2023-10-06T04:36:16.235142+0000","last_unstale":"2023-10-06T04:36:21.293323+0000","last_undegraded":"2023-10-06T04:36:21.293323+0000","last_fullsized":"2023-10-06T04:36:21.293323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:45.690139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280210+0000","last_change":"2023-10-06T04:36:17.262198+0000","last_active":"2023-10-06T04:36:21.280210+0000","last_peered":"2023-10-06T04:36:21.280210+0000","last_clean":"2023-10-06T04:36:21.280210+0000","last_became_active":"2023-10-06T04:36:17.261922+0000","last_became_peered":"2023-10-06T04:36:17.261922+0000","last_unstale":"2023-10-06T04:36:21.280210+0000","last_undegraded":"2023-10-06T04:36:21.280210+0000","last_fullsized":"2023-10-06T04:36:21.280210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:52.911614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.302413+0000","last_change":"2023-10-06T04:36:21.301322+0000","last_active":"2023-10-06T04:36:21.302413+0000","last_peered":"2023-10-06T04:36:21.302413+0000","last_clean":"2023-10-06T04:36:21.302413+0000","last_became_active":"2023-10-06T04:36:21.300972+0000","last_became_peered":"2023-10-06T04:36:21.300972+0000","last_unstale":"2023-10-06T04:36:21.302413+0000","last_undegraded":"2023-10-06T04:36:21.302413+0000","last_fullsized":"2023-10-06T04:36:21.302413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:16.931552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.292453+0000","last_change":"2023-10-06T04:36:16.231930+0000","last_active":"2023-10-06T04:36:21.292453+0000","last_peered":"2023-10-06T04:36:21.292453+0000","last_clean":"2023-10-06T04:36:21.292453+0000","last_became_active":"2023-10-06T04:36:16.231670+0000","last_became_peered":"2023-10-06T04:36:16.231670+0000","last_unstale":"2023-10-06T04:36:21.292453+0000","last_undegraded":"2023-10-06T04:36:21.292453+0000","last_fullsized":"2023-10-06T04:36:21.292453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:14.880214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.283773+0000","last_change":"2023-10-06T04:36:17.257608+0000","last_active":"2023-10-06T04:36:21.283773+0000","last_peered":"2023-10-06T04:36:21.283773+0000","last_clean":"2023-10-06T04:36:21.283773+0000","last_became_active":"2023-10-06T04:36:17.257367+0000","last_became_peered":"2023-10-06T04:36:17.257367+0000","last_unstale":"2023-10-06T04:36:21.283773+0000","last_undegraded":"2023-10-06T04:36:21.283773+0000","last_fullsized":"2023-10-06T04:36:21.283773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:48.526269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.290478+0000","last_change":"2023-10-06T04:36:21.289073+0000","last_active":"2023-10-06T04:36:21.290478+0000","last_peered":"2023-10-06T04:36:21.290478+0000","last_clean":"2023-10-06T04:36:21.290478+0000","last_became_active":"2023-10-06T04:36:21.288651+0000","last_became_peered":"2023-10-06T04:36:21.288651+0000","last_unstale":"2023-10-06T04:36:21.290478+0000","last_undegraded":"2023-10-06T04:36:21.290478+0000","last_fullsized":"2023-10-06T04:36:21.290478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:23:12.855962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291282+0000","last_change":"2023-10-06T04:36:16.238006+0000","last_active":"2023-10-06T04:36:21.291282+0000","last_peered":"2023-10-06T04:36:21.291282+0000","last_clean":"2023-10-06T04:36:21.291282+0000","last_became_active":"2023-10-06T04:36:16.237733+0000","last_became_peered":"2023-10-06T04:36:16.237733+0000","last_unstale":"2023-10-06T04:36:21.291282+0000","last_undegraded":"2023-10-06T04:36:21.291282+0000","last_fullsized":"2023-10-06T04:36:21.291282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:45:33.128307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.284558+0000","last_change":"2023-10-06T04:36:17.248071+0000","last_active":"2023-10-06T04:36:21.284558+0000","last_peered":"2023-10-06T04:36:21.284558+0000","last_clean":"2023-10-06T04:36:21.284558+0000","last_became_active":"2023-10-06T04:36:17.247774+0000","last_became_peered":"2023-10-06T04:36:17.247774+0000","last_unstale":"2023-10-06T04:36:21.284558+0000","last_undegraded":"2023-10-06T04:36:21.284558+0000","last_fullsized":"2023-10-06T04:36:21.284558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:06.137894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.303676+0000","last_change":"2023-10-06T04:36:21.302376+0000","last_active":"2023-10-06T04:36:21.303676+0000","last_peered":"2023-10-06T04:36:21.303676+0000","last_clean":"2023-10-06T04:36:21.303676+0000","last_became_active":"2023-10-06T04:36:21.301996+0000","last_became_peered":"2023-10-06T04:36:21.301996+0000","last_unstale":"2023-10-06T04:36:21.303676+0000","last_undegraded":"2023-10-06T04:36:21.303676+0000","last_fullsized":"2023-10-06T04:36:21.303676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:35:31.655298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.275570+0000","last_change":"2023-10-06T04:36:16.226105+0000","last_active":"2023-10-06T04:36:21.275570+0000","last_peered":"2023-10-06T04:36:21.275570+0000","last_clean":"2023-10-06T04:36:21.275570+0000","last_became_active":"2023-10-06T04:36:16.225746+0000","last_became_peered":"2023-10-06T04:36:16.225746+0000","last_unstale":"2023-10-06T04:36:21.275570+0000","last_undegraded":"2023-10-06T04:36:21.275570+0000","last_fullsized":"2023-10-06T04:36:21.275570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:10.606701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280903+0000","last_change":"2023-10-06T04:36:17.248063+0000","last_active":"2023-10-06T04:36:21.280903+0000","last_peered":"2023-10-06T04:36:21.280903+0000","last_clean":"2023-10-06T04:36:21.280903+0000","last_became_active":"2023-10-06T04:36:17.247756+0000","last_became_peered":"2023-10-06T04:36:17.247756+0000","last_unstale":"2023-10-06T04:36:21.280903+0000","last_undegraded":"2023-10-06T04:36:21.280903+0000","last_fullsized":"2023-10-06T04:36:21.280903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:15:51.848244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.300498+0000","last_change":"2023-10-06T04:36:21.295888+0000","last_active":"2023-10-06T04:36:21.300498+0000","last_peered":"2023-10-06T04:36:21.300498+0000","last_clean":"2023-10-06T04:36:21.300498+0000","last_became_active":"2023-10-06T04:36:21.295493+0000","last_became_peered":"2023-10-06T04:36:21.295493+0000","last_unstale":"2023-10-06T04:36:21.300498+0000","last_undegraded":"2023-10-06T04:36:21.300498+0000","last_fullsized":"2023-10-06T04:36:21.300498+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:36.618164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.283866+0000","last_change":"2023-10-06T04:36:16.235993+0000","last_active":"2023-10-06T04:36:21.283866+0000","last_peered":"2023-10-06T04:36:21.283866+0000","last_clean":"2023-10-06T04:36:21.283866+0000","last_became_active":"2023-10-06T04:36:16.235737+0000","last_became_peered":"2023-10-06T04:36:16.235737+0000","last_unstale":"2023-10-06T04:36:21.283866+0000","last_undegraded":"2023-10-06T04:36:21.283866+0000","last_fullsized":"2023-10-06T04:36:21.283866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:51:43.351582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.281338+0000","last_change":"2023-10-06T04:36:17.251705+0000","last_active":"2023-10-06T04:36:21.281338+0000","last_peered":"2023-10-06T04:36:21.281338+0000","last_clean":"2023-10-06T04:36:21.281338+0000","last_became_active":"2023-10-06T04:36:17.251306+0000","last_became_peered":"2023-10-06T04:36:17.251306+0000","last_unstale":"2023-10-06T04:36:21.281338+0000","last_undegraded":"2023-10-06T04:36:21.281338+0000","last_fullsized":"2023-10-06T04:36:21.281338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:53.016887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.303623+0000","last_change":"2023-10-06T04:36:21.296312+0000","last_active":"2023-10-06T04:36:21.303623+0000","last_peered":"2023-10-06T04:36:21.303623+0000","last_clean":"2023-10-06T04:36:21.303623+0000","last_became_active":"2023-10-06T04:36:21.294384+0000","last_became_peered":"2023-10-06T04:36:21.294384+0000","last_unstale":"2023-10-06T04:36:21.303623+0000","last_undegraded":"2023-10-06T04:36:21.303623+0000","last_fullsized":"2023-10-06T04:36:21.303623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:22:34.846112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280043+0000","last_change":"2023-10-06T04:36:16.234482+0000","last_active":"2023-10-06T04:36:21.280043+0000","last_peered":"2023-10-06T04:36:21.280043+0000","last_clean":"2023-10-06T04:36:21.280043+0000","last_became_active":"2023-10-06T04:36:16.234239+0000","last_became_peered":"2023-10-06T04:36:16.234239+0000","last_unstale":"2023-10-06T04:36:21.280043+0000","last_undegraded":"2023-10-06T04:36:21.280043+0000","last_fullsized":"2023-10-06T04:36:21.280043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:51:43.351582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.281261+0000","last_change":"2023-10-06T04:36:17.254931+0000","last_active":"2023-10-06T04:36:21.281261+0000","last_peered":"2023-10-06T04:36:21.281261+0000","last_clean":"2023-10-06T04:36:21.281261+0000","last_became_active":"2023-10-06T04:36:17.254674+0000","last_became_peered":"2023-10-06T04:36:17.254674+0000","last_unstale":"2023-10-06T04:36:21.281261+0000","last_undegraded":"2023-10-06T04:36:21.281261+0000","last_fullsized":"2023-10-06T04:36:21.281261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:06.137894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.296227+0000","last_change":"2023-10-06T04:36:21.294775+0000","last_active":"2023-10-06T04:36:21.296227+0000","last_peered":"2023-10-06T04:36:21.296227+0000","last_clean":"2023-10-06T04:36:21.296227+0000","last_became_active":"2023-10-06T04:36:21.294362+0000","last_became_peered":"2023-10-06T04:36:21.294362+0000","last_unstale":"2023-10-06T04:36:21.296227+0000","last_undegraded":"2023-10-06T04:36:21.296227+0000","last_fullsized":"2023-10-06T04:36:21.296227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:37.257094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.277076+0000","last_change":"2023-10-06T04:36:16.234752+0000","last_active":"2023-10-06T04:36:21.277076+0000","last_peered":"2023-10-06T04:36:21.277076+0000","last_clean":"2023-10-06T04:36:21.277076+0000","last_became_active":"2023-10-06T04:36:16.230744+0000","last_became_peered":"2023-10-06T04:36:16.230744+0000","last_unstale":"2023-10-06T04:36:21.277076+0000","last_undegraded":"2023-10-06T04:36:21.277076+0000","last_fullsized":"2023-10-06T04:36:21.277076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:32.855334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276381+0000","last_change":"2023-10-06T04:36:17.255101+0000","last_active":"2023-10-06T04:36:21.276381+0000","last_peered":"2023-10-06T04:36:21.276381+0000","last_clean":"2023-10-06T04:36:21.276381+0000","last_became_active":"2023-10-06T04:36:17.254846+0000","last_became_peered":"2023-10-06T04:36:17.254846+0000","last_unstale":"2023-10-06T04:36:21.276381+0000","last_undegraded":"2023-10-06T04:36:21.276381+0000","last_fullsized":"2023-10-06T04:36:21.276381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:01:35.146203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.303559+0000","last_change":"2023-10-06T04:36:21.295704+0000","last_active":"2023-10-06T04:36:21.303559+0000","last_peered":"2023-10-06T04:36:21.303559+0000","last_clean":"2023-10-06T04:36:21.303559+0000","last_became_active":"2023-10-06T04:36:21.295333+0000","last_became_peered":"2023-10-06T04:36:21.295333+0000","last_unstale":"2023-10-06T04:36:21.303559+0000","last_undegraded":"2023-10-06T04:36:21.303559+0000","last_fullsized":"2023-10-06T04:36:21.303559+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:21:19.303096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.277832+0000","last_change":"2023-10-06T04:36:16.227900+0000","last_active":"2023-10-06T04:36:21.277832+0000","last_peered":"2023-10-06T04:36:21.277832+0000","last_clean":"2023-10-06T04:36:21.277832+0000","last_became_active":"2023-10-06T04:36:16.227587+0000","last_became_peered":"2023-10-06T04:36:16.227587+0000","last_unstale":"2023-10-06T04:36:21.277832+0000","last_undegraded":"2023-10-06T04:36:21.277832+0000","last_fullsized":"2023-10-06T04:36:21.277832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:54.757446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.281521+0000","last_change":"2023-10-06T04:36:11.192215+0000","last_active":"2023-10-06T04:36:21.281521+0000","last_peered":"2023-10-06T04:36:21.281521+0000","last_clean":"2023-10-06T04:36:21.281521+0000","last_became_active":"2023-10-06T04:36:11.191953+0000","last_became_peered":"2023-10-06T04:36:11.191953+0000","last_unstale":"2023-10-06T04:36:21.281521+0000","last_undegraded":"2023-10-06T04:36:21.281521+0000","last_fullsized":"2023-10-06T04:36:21.281521+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:37.026121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.277485+0000","last_change":"2023-10-06T04:36:17.254170+0000","last_active":"2023-10-06T04:36:21.277485+0000","last_peered":"2023-10-06T04:36:21.277485+0000","last_clean":"2023-10-06T04:36:21.277485+0000","last_became_active":"2023-10-06T04:36:17.253910+0000","last_became_peered":"2023-10-06T04:36:17.253910+0000","last_unstale":"2023-10-06T04:36:21.277485+0000","last_undegraded":"2023-10-06T04:36:21.277485+0000","last_fullsized":"2023-10-06T04:36:21.277485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:18.298620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.296974+0000","last_change":"2023-10-06T04:36:21.291691+0000","last_active":"2023-10-06T04:36:21.296974+0000","last_peered":"2023-10-06T04:36:21.296974+0000","last_clean":"2023-10-06T04:36:21.296974+0000","last_became_active":"2023-10-06T04:36:21.291287+0000","last_became_peered":"2023-10-06T04:36:21.291287+0000","last_unstale":"2023-10-06T04:36:21.296974+0000","last_undegraded":"2023-10-06T04:36:21.296974+0000","last_fullsized":"2023-10-06T04:36:21.296974+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:59:55.077526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280946+0000","last_change":"2023-10-06T04:36:11.184555+0000","last_active":"2023-10-06T04:36:21.280946+0000","last_peered":"2023-10-06T04:36:21.280946+0000","last_clean":"2023-10-06T04:36:21.280946+0000","last_became_active":"2023-10-06T04:36:11.184229+0000","last_became_peered":"2023-10-06T04:36:11.184229+0000","last_unstale":"2023-10-06T04:36:21.280946+0000","last_undegraded":"2023-10-06T04:36:21.280946+0000","last_fullsized":"2023-10-06T04:36:21.280946+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:19.938716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.295381+0000","last_change":"2023-10-06T04:36:16.227655+0000","last_active":"2023-10-06T04:36:21.295381+0000","last_peered":"2023-10-06T04:36:21.295381+0000","last_clean":"2023-10-06T04:36:21.295381+0000","last_became_active":"2023-10-06T04:36:16.227033+0000","last_became_peered":"2023-10-06T04:36:16.227033+0000","last_unstale":"2023-10-06T04:36:21.295381+0000","last_undegraded":"2023-10-06T04:36:21.295381+0000","last_fullsized":"2023-10-06T04:36:21.295381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:10.606701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280143+0000","last_change":"2023-10-06T04:36:17.250515+0000","last_active":"2023-10-06T04:36:21.280143+0000","last_peered":"2023-10-06T04:36:21.280143+0000","last_clean":"2023-10-06T04:36:21.280143+0000","last_became_active":"2023-10-06T04:36:17.250192+0000","last_became_peered":"2023-10-06T04:36:17.250192+0000","last_unstale":"2023-10-06T04:36:21.280143+0000","last_undegraded":"2023-10-06T04:36:21.280143+0000","last_fullsized":"2023-10-06T04:36:21.280143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:25.650113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.304036+0000","last_change":"2023-10-06T04:36:21.298658+0000","last_active":"2023-10-06T04:36:21.304036+0000","last_peered":"2023-10-06T04:36:21.304036+0000","last_clean":"2023-10-06T04:36:21.304036+0000","last_became_active":"2023-10-06T04:36:21.298118+0000","last_became_peered":"2023-10-06T04:36:21.298118+0000","last_unstale":"2023-10-06T04:36:21.304036+0000","last_undegraded":"2023-10-06T04:36:21.304036+0000","last_fullsized":"2023-10-06T04:36:21.304036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:38.096649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276479+0000","last_change":"2023-10-06T04:36:11.184460+0000","last_active":"2023-10-06T04:36:21.276479+0000","last_peered":"2023-10-06T04:36:21.276479+0000","last_clean":"2023-10-06T04:36:21.276479+0000","last_became_active":"2023-10-06T04:36:11.184119+0000","last_became_peered":"2023-10-06T04:36:11.184119+0000","last_unstale":"2023-10-06T04:36:21.276479+0000","last_undegraded":"2023-10-06T04:36:21.276479+0000","last_fullsized":"2023-10-06T04:36:21.276479+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:37.026121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":166,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.290702+0000","last_change":"2023-10-06T04:36:12.183155+0000","last_active":"2023-10-06T04:36:21.290702+0000","last_peered":"2023-10-06T04:36:21.290702+0000","last_clean":"2023-10-06T04:36:21.290702+0000","last_became_active":"2023-10-06T04:36:12.182903+0000","last_became_peered":"2023-10-06T04:36:12.182903+0000","last_unstale":"2023-10-06T04:36:21.290702+0000","last_undegraded":"2023-10-06T04:36:21.290702+0000","last_fullsized":"2023-10-06T04:36:21.290702+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:11.171104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:11.171104+0000","last_clean_scrub_stamp":"2023-10-06T04:36:11.171104+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:38:54.323364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.275958+0000","last_change":"2023-10-06T04:36:16.228034+0000","last_active":"2023-10-06T04:36:21.275958+0000","last_peered":"2023-10-06T04:36:21.275958+0000","last_clean":"2023-10-06T04:36:21.275958+0000","last_became_active":"2023-10-06T04:36:16.227743+0000","last_became_peered":"2023-10-06T04:36:16.227743+0000","last_unstale":"2023-10-06T04:36:21.275958+0000","last_undegraded":"2023-10-06T04:36:21.275958+0000","last_fullsized":"2023-10-06T04:36:21.275958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:12.145940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.278791+0000","last_change":"2023-10-06T04:36:17.257761+0000","last_active":"2023-10-06T04:36:21.278791+0000","last_peered":"2023-10-06T04:36:21.278791+0000","last_clean":"2023-10-06T04:36:21.278791+0000","last_became_active":"2023-10-06T04:36:17.257238+0000","last_became_peered":"2023-10-06T04:36:17.257238+0000","last_unstale":"2023-10-06T04:36:21.278791+0000","last_undegraded":"2023-10-06T04:36:21.278791+0000","last_fullsized":"2023-10-06T04:36:21.278791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:03.209071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.300390+0000","last_change":"2023-10-06T04:36:21.296982+0000","last_active":"2023-10-06T04:36:21.300390+0000","last_peered":"2023-10-06T04:36:21.300390+0000","last_clean":"2023-10-06T04:36:21.300390+0000","last_became_active":"2023-10-06T04:36:21.296294+0000","last_became_peered":"2023-10-06T04:36:21.296294+0000","last_unstale":"2023-10-06T04:36:21.300390+0000","last_undegraded":"2023-10-06T04:36:21.300390+0000","last_fullsized":"2023-10-06T04:36:21.300390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:39.050172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.292995+0000","last_change":"2023-10-06T04:36:11.193056+0000","last_active":"2023-10-06T04:36:21.292995+0000","last_peered":"2023-10-06T04:36:21.292995+0000","last_clean":"2023-10-06T04:36:21.292995+0000","last_became_active":"2023-10-06T04:36:11.192712+0000","last_became_peered":"2023-10-06T04:36:11.192712+0000","last_unstale":"2023-10-06T04:36:21.292995+0000","last_undegraded":"2023-10-06T04:36:21.292995+0000","last_fullsized":"2023-10-06T04:36:21.292995+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:00.008654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.278242+0000","last_change":"2023-10-06T04:36:16.234660+0000","last_active":"2023-10-06T04:36:21.278242+0000","last_peered":"2023-10-06T04:36:21.278242+0000","last_clean":"2023-10-06T04:36:21.278242+0000","last_became_active":"2023-10-06T04:36:16.234357+0000","last_became_peered":"2023-10-06T04:36:16.234357+0000","last_unstale":"2023-10-06T04:36:21.278242+0000","last_undegraded":"2023-10-06T04:36:21.278242+0000","last_fullsized":"2023-10-06T04:36:21.278242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:42:27.974066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276281+0000","last_change":"2023-10-06T04:36:17.251700+0000","last_active":"2023-10-06T04:36:21.276281+0000","last_peered":"2023-10-06T04:36:21.276281+0000","last_clean":"2023-10-06T04:36:21.276281+0000","last_became_active":"2023-10-06T04:36:17.251034+0000","last_became_peered":"2023-10-06T04:36:17.251034+0000","last_unstale":"2023-10-06T04:36:21.276281+0000","last_undegraded":"2023-10-06T04:36:21.276281+0000","last_fullsized":"2023-10-06T04:36:21.276281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:11.333475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.309325+0000","last_change":"2023-10-06T04:36:21.305039+0000","last_active":"2023-10-06T04:36:21.309325+0000","last_peered":"2023-10-06T04:36:21.309325+0000","last_clean":"2023-10-06T04:36:21.309325+0000","last_became_active":"2023-10-06T04:36:21.304584+0000","last_became_peered":"2023-10-06T04:36:21.304584+0000","last_unstale":"2023-10-06T04:36:21.309325+0000","last_undegraded":"2023-10-06T04:36:21.309325+0000","last_fullsized":"2023-10-06T04:36:21.309325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:07.162250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.290530+0000","last_change":"2023-10-06T04:36:11.192701+0000","last_active":"2023-10-06T04:36:21.290530+0000","last_peered":"2023-10-06T04:36:21.290530+0000","last_clean":"2023-10-06T04:36:21.290530+0000","last_became_active":"2023-10-06T04:36:11.192335+0000","last_became_peered":"2023-10-06T04:36:11.192335+0000","last_unstale":"2023-10-06T04:36:21.290530+0000","last_undegraded":"2023-10-06T04:36:21.290530+0000","last_fullsized":"2023-10-06T04:36:21.290530+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:18.643570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276668+0000","last_change":"2023-10-06T04:36:16.234341+0000","last_active":"2023-10-06T04:36:21.276668+0000","last_peered":"2023-10-06T04:36:21.276668+0000","last_clean":"2023-10-06T04:36:21.276668+0000","last_became_active":"2023-10-06T04:36:16.230428+0000","last_became_peered":"2023-10-06T04:36:16.230428+0000","last_unstale":"2023-10-06T04:36:21.276668+0000","last_undegraded":"2023-10-06T04:36:21.276668+0000","last_fullsized":"2023-10-06T04:36:21.276668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:39.497925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291935+0000","last_change":"2023-10-06T04:36:17.263627+0000","last_active":"2023-10-06T04:36:21.291935+0000","last_peered":"2023-10-06T04:36:21.291935+0000","last_clean":"2023-10-06T04:36:21.291935+0000","last_became_active":"2023-10-06T04:36:17.263090+0000","last_became_peered":"2023-10-06T04:36:17.263090+0000","last_unstale":"2023-10-06T04:36:21.291935+0000","last_undegraded":"2023-10-06T04:36:21.291935+0000","last_fullsized":"2023-10-06T04:36:21.291935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:38.733916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.305005+0000","last_change":"2023-10-06T04:36:21.302935+0000","last_active":"2023-10-06T04:36:21.305005+0000","last_peered":"2023-10-06T04:36:21.305005+0000","last_clean":"2023-10-06T04:36:21.305005+0000","last_became_active":"2023-10-06T04:36:21.302531+0000","last_became_peered":"2023-10-06T04:36:21.302531+0000","last_unstale":"2023-10-06T04:36:21.305005+0000","last_undegraded":"2023-10-06T04:36:21.305005+0000","last_fullsized":"2023-10-06T04:36:21.305005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:53.314660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.290636+0000","last_change":"2023-10-06T04:36:11.193497+0000","last_active":"2023-10-06T04:36:21.290636+0000","last_peered":"2023-10-06T04:36:21.290636+0000","last_clean":"2023-10-06T04:36:21.290636+0000","last_became_active":"2023-10-06T04:36:11.193215+0000","last_became_peered":"2023-10-06T04:36:11.193215+0000","last_unstale":"2023-10-06T04:36:21.290636+0000","last_undegraded":"2023-10-06T04:36:21.290636+0000","last_fullsized":"2023-10-06T04:36:21.290636+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:07.497987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280777+0000","last_change":"2023-10-06T04:36:16.228895+0000","last_active":"2023-10-06T04:36:21.280777+0000","last_peered":"2023-10-06T04:36:21.280777+0000","last_clean":"2023-10-06T04:36:21.280777+0000","last_became_active":"2023-10-06T04:36:16.228165+0000","last_became_peered":"2023-10-06T04:36:16.228165+0000","last_unstale":"2023-10-06T04:36:21.280777+0000","last_undegraded":"2023-10-06T04:36:21.280777+0000","last_fullsized":"2023-10-06T04:36:21.280777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:10.606701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.282559+0000","last_change":"2023-10-06T04:36:17.245277+0000","last_active":"2023-10-06T04:36:21.282559+0000","last_peered":"2023-10-06T04:36:21.282559+0000","last_clean":"2023-10-06T04:36:21.282559+0000","last_became_active":"2023-10-06T04:36:17.245034+0000","last_became_peered":"2023-10-06T04:36:17.245034+0000","last_unstale":"2023-10-06T04:36:21.282559+0000","last_undegraded":"2023-10-06T04:36:21.282559+0000","last_fullsized":"2023-10-06T04:36:21.282559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:48.526269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.305149+0000","last_change":"2023-10-06T04:36:21.299758+0000","last_active":"2023-10-06T04:36:21.305149+0000","last_peered":"2023-10-06T04:36:21.305149+0000","last_clean":"2023-10-06T04:36:21.305149+0000","last_became_active":"2023-10-06T04:36:21.299383+0000","last_became_peered":"2023-10-06T04:36:21.299383+0000","last_unstale":"2023-10-06T04:36:21.305149+0000","last_undegraded":"2023-10-06T04:36:21.305149+0000","last_fullsized":"2023-10-06T04:36:21.305149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:29.699781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.283643+0000","last_change":"2023-10-06T04:36:11.193111+0000","last_active":"2023-10-06T04:36:21.283643+0000","last_peered":"2023-10-06T04:36:21.283643+0000","last_clean":"2023-10-06T04:36:21.283643+0000","last_became_active":"2023-10-06T04:36:11.192836+0000","last_became_peered":"2023-10-06T04:36:11.192836+0000","last_unstale":"2023-10-06T04:36:21.283643+0000","last_undegraded":"2023-10-06T04:36:21.283643+0000","last_fullsized":"2023-10-06T04:36:21.283643+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:19.938716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276725+0000","last_change":"2023-10-06T04:36:16.233274+0000","last_active":"2023-10-06T04:36:21.276725+0000","last_peered":"2023-10-06T04:36:21.276725+0000","last_clean":"2023-10-06T04:36:21.276725+0000","last_became_active":"2023-10-06T04:36:16.232385+0000","last_became_peered":"2023-10-06T04:36:16.232385+0000","last_unstale":"2023-10-06T04:36:21.276725+0000","last_undegraded":"2023-10-06T04:36:21.276725+0000","last_fullsized":"2023-10-06T04:36:21.276725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:51:43.351582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.284374+0000","last_change":"2023-10-06T04:36:17.251317+0000","last_active":"2023-10-06T04:36:21.284374+0000","last_peered":"2023-10-06T04:36:21.284374+0000","last_clean":"2023-10-06T04:36:21.284374+0000","last_became_active":"2023-10-06T04:36:17.251156+0000","last_became_peered":"2023-10-06T04:36:17.251156+0000","last_unstale":"2023-10-06T04:36:21.284374+0000","last_undegraded":"2023-10-06T04:36:21.284374+0000","last_fullsized":"2023-10-06T04:36:21.284374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:14.615096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.305152+0000","last_change":"2023-10-06T04:36:21.303952+0000","last_active":"2023-10-06T04:36:21.305152+0000","last_peered":"2023-10-06T04:36:21.305152+0000","last_clean":"2023-10-06T04:36:21.305152+0000","last_became_active":"2023-10-06T04:36:21.303042+0000","last_became_peered":"2023-10-06T04:36:21.303042+0000","last_unstale":"2023-10-06T04:36:21.305152+0000","last_undegraded":"2023-10-06T04:36:21.305152+0000","last_fullsized":"2023-10-06T04:36:21.305152+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:00.910253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.286309+0000","last_change":"2023-10-06T04:36:11.182804+0000","last_active":"2023-10-06T04:36:21.286309+0000","last_peered":"2023-10-06T04:36:21.286309+0000","last_clean":"2023-10-06T04:36:21.286309+0000","last_became_active":"2023-10-06T04:36:11.182575+0000","last_became_peered":"2023-10-06T04:36:11.182575+0000","last_unstale":"2023-10-06T04:36:21.286309+0000","last_undegraded":"2023-10-06T04:36:21.286309+0000","last_fullsized":"2023-10-06T04:36:21.286309+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:07.497987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291508+0000","last_change":"2023-10-06T04:36:16.237994+0000","last_active":"2023-10-06T04:36:21.291508+0000","last_peered":"2023-10-06T04:36:21.291508+0000","last_clean":"2023-10-06T04:36:21.291508+0000","last_became_active":"2023-10-06T04:36:16.237722+0000","last_became_peered":"2023-10-06T04:36:16.237722+0000","last_unstale":"2023-10-06T04:36:21.291508+0000","last_undegraded":"2023-10-06T04:36:21.291508+0000","last_fullsized":"2023-10-06T04:36:21.291508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:54.757446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.281269+0000","last_change":"2023-10-06T04:36:17.251489+0000","last_active":"2023-10-06T04:36:21.281269+0000","last_peered":"2023-10-06T04:36:21.281269+0000","last_clean":"2023-10-06T04:36:21.281269+0000","last_became_active":"2023-10-06T04:36:17.251233+0000","last_became_peered":"2023-10-06T04:36:17.251233+0000","last_unstale":"2023-10-06T04:36:21.281269+0000","last_undegraded":"2023-10-06T04:36:21.281269+0000","last_fullsized":"2023-10-06T04:36:21.281269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:18.298620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.298102+0000","last_change":"2023-10-06T04:36:21.293975+0000","last_active":"2023-10-06T04:36:21.298102+0000","last_peered":"2023-10-06T04:36:21.298102+0000","last_clean":"2023-10-06T04:36:21.298102+0000","last_became_active":"2023-10-06T04:36:21.293578+0000","last_became_peered":"2023-10-06T04:36:21.293578+0000","last_unstale":"2023-10-06T04:36:21.298102+0000","last_undegraded":"2023-10-06T04:36:21.298102+0000","last_fullsized":"2023-10-06T04:36:21.298102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:14.917841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.284317+0000","last_change":"2023-10-06T04:36:16.229589+0000","last_active":"2023-10-06T04:36:21.284317+0000","last_peered":"2023-10-06T04:36:21.284317+0000","last_clean":"2023-10-06T04:36:21.284317+0000","last_became_active":"2023-10-06T04:36:16.229178+0000","last_became_peered":"2023-10-06T04:36:16.229178+0000","last_unstale":"2023-10-06T04:36:21.284317+0000","last_undegraded":"2023-10-06T04:36:21.284317+0000","last_fullsized":"2023-10-06T04:36:21.284317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:51:43.351582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.272441+0000","last_change":"2023-10-06T04:36:17.250854+0000","last_active":"2023-10-06T04:36:21.272441+0000","last_peered":"2023-10-06T04:36:21.272441+0000","last_clean":"2023-10-06T04:36:21.272441+0000","last_became_active":"2023-10-06T04:36:17.250610+0000","last_became_peered":"2023-10-06T04:36:17.250610+0000","last_unstale":"2023-10-06T04:36:21.272441+0000","last_undegraded":"2023-10-06T04:36:21.272441+0000","last_fullsized":"2023-10-06T04:36:21.272441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:55.761720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.309362+0000","last_change":"2023-10-06T04:36:21.306750+0000","last_active":"2023-10-06T04:36:21.309362+0000","last_peered":"2023-10-06T04:36:21.309362+0000","last_clean":"2023-10-06T04:36:21.309362+0000","last_became_active":"2023-10-06T04:36:21.306419+0000","last_became_peered":"2023-10-06T04:36:21.306419+0000","last_unstale":"2023-10-06T04:36:21.309362+0000","last_undegraded":"2023-10-06T04:36:21.309362+0000","last_fullsized":"2023-10-06T04:36:21.309362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:52.989017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291179+0000","last_change":"2023-10-06T04:36:16.233250+0000","last_active":"2023-10-06T04:36:21.291179+0000","last_peered":"2023-10-06T04:36:21.291179+0000","last_clean":"2023-10-06T04:36:21.291179+0000","last_became_active":"2023-10-06T04:36:16.232939+0000","last_became_peered":"2023-10-06T04:36:16.232939+0000","last_unstale":"2023-10-06T04:36:21.291179+0000","last_undegraded":"2023-10-06T04:36:21.291179+0000","last_fullsized":"2023-10-06T04:36:21.291179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:42.572631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280600+0000","last_change":"2023-10-06T04:36:17.261079+0000","last_active":"2023-10-06T04:36:21.280600+0000","last_peered":"2023-10-06T04:36:21.280600+0000","last_clean":"2023-10-06T04:36:21.280600+0000","last_became_active":"2023-10-06T04:36:17.260815+0000","last_became_peered":"2023-10-06T04:36:17.260815+0000","last_unstale":"2023-10-06T04:36:21.280600+0000","last_undegraded":"2023-10-06T04:36:21.280600+0000","last_fullsized":"2023-10-06T04:36:21.280600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:14.615096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.303853+0000","last_change":"2023-10-06T04:36:21.297230+0000","last_active":"2023-10-06T04:36:21.303853+0000","last_peered":"2023-10-06T04:36:21.303853+0000","last_clean":"2023-10-06T04:36:21.303853+0000","last_became_active":"2023-10-06T04:36:21.296880+0000","last_became_peered":"2023-10-06T04:36:21.296880+0000","last_unstale":"2023-10-06T04:36:21.303853+0000","last_undegraded":"2023-10-06T04:36:21.303853+0000","last_fullsized":"2023-10-06T04:36:21.303853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:02.285634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291398+0000","last_change":"2023-10-06T04:36:16.232832+0000","last_active":"2023-10-06T04:36:21.291398+0000","last_peered":"2023-10-06T04:36:21.291398+0000","last_clean":"2023-10-06T04:36:21.291398+0000","last_became_active":"2023-10-06T04:36:16.232556+0000","last_became_peered":"2023-10-06T04:36:16.232556+0000","last_unstale":"2023-10-06T04:36:21.291398+0000","last_undegraded":"2023-10-06T04:36:21.291398+0000","last_fullsized":"2023-10-06T04:36:21.291398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:10.606701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280531+0000","last_change":"2023-10-06T04:36:17.247689+0000","last_active":"2023-10-06T04:36:21.280531+0000","last_peered":"2023-10-06T04:36:21.280531+0000","last_clean":"2023-10-06T04:36:21.280531+0000","last_became_active":"2023-10-06T04:36:17.247409+0000","last_became_peered":"2023-10-06T04:36:17.247409+0000","last_unstale":"2023-10-06T04:36:21.280531+0000","last_undegraded":"2023-10-06T04:36:21.280531+0000","last_fullsized":"2023-10-06T04:36:21.280531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:35:27.605631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.304354+0000","last_change":"2023-10-06T04:36:21.302319+0000","last_active":"2023-10-06T04:36:21.304354+0000","last_peered":"2023-10-06T04:36:21.304354+0000","last_clean":"2023-10-06T04:36:21.304354+0000","last_became_active":"2023-10-06T04:36:21.301959+0000","last_became_peered":"2023-10-06T04:36:21.301959+0000","last_unstale":"2023-10-06T04:36:21.304354+0000","last_undegraded":"2023-10-06T04:36:21.304354+0000","last_fullsized":"2023-10-06T04:36:21.304354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:18.466700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.277468+0000","last_change":"2023-10-06T04:36:16.228609+0000","last_active":"2023-10-06T04:36:21.277468+0000","last_peered":"2023-10-06T04:36:21.277468+0000","last_clean":"2023-10-06T04:36:21.277468+0000","last_became_active":"2023-10-06T04:36:16.228294+0000","last_became_peered":"2023-10-06T04:36:16.228294+0000","last_unstale":"2023-10-06T04:36:21.277468+0000","last_undegraded":"2023-10-06T04:36:21.277468+0000","last_fullsized":"2023-10-06T04:36:21.277468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:40.040325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.275892+0000","last_change":"2023-10-06T04:36:17.246675+0000","last_active":"2023-10-06T04:36:21.275892+0000","last_peered":"2023-10-06T04:36:21.275892+0000","last_clean":"2023-10-06T04:36:21.275892+0000","last_became_active":"2023-10-06T04:36:17.246403+0000","last_became_peered":"2023-10-06T04:36:17.246403+0000","last_unstale":"2023-10-06T04:36:21.275892+0000","last_undegraded":"2023-10-06T04:36:21.275892+0000","last_fullsized":"2023-10-06T04:36:21.275892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:35:27.605631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.298091+0000","last_change":"2023-10-06T04:36:21.293736+0000","last_active":"2023-10-06T04:36:21.298091+0000","last_peered":"2023-10-06T04:36:21.298091+0000","last_clean":"2023-10-06T04:36:21.298091+0000","last_became_active":"2023-10-06T04:36:21.293317+0000","last_became_peered":"2023-10-06T04:36:21.293317+0000","last_unstale":"2023-10-06T04:36:21.298091+0000","last_undegraded":"2023-10-06T04:36:21.298091+0000","last_fullsized":"2023-10-06T04:36:21.298091+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:00.910253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276350+0000","last_change":"2023-10-06T04:36:16.232060+0000","last_active":"2023-10-06T04:36:21.276350+0000","last_peered":"2023-10-06T04:36:21.276350+0000","last_clean":"2023-10-06T04:36:21.276350+0000","last_became_active":"2023-10-06T04:36:16.231602+0000","last_became_peered":"2023-10-06T04:36:16.231602+0000","last_unstale":"2023-10-06T04:36:21.276350+0000","last_undegraded":"2023-10-06T04:36:21.276350+0000","last_fullsized":"2023-10-06T04:36:21.276350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:32.855334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.279896+0000","last_change":"2023-10-06T04:36:17.252345+0000","last_active":"2023-10-06T04:36:21.279896+0000","last_peered":"2023-10-06T04:36:21.279896+0000","last_clean":"2023-10-06T04:36:21.279896+0000","last_became_active":"2023-10-06T04:36:17.250338+0000","last_became_peered":"2023-10-06T04:36:17.250338+0000","last_unstale":"2023-10-06T04:36:21.279896+0000","last_undegraded":"2023-10-06T04:36:21.279896+0000","last_fullsized":"2023-10-06T04:36:21.279896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:28:24.765888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.290285+0000","last_change":"2023-10-06T04:36:17.261636+0000","last_active":"2023-10-06T04:36:21.290285+0000","last_peered":"2023-10-06T04:36:21.290285+0000","last_clean":"2023-10-06T04:36:21.290285+0000","last_became_active":"2023-10-06T04:36:17.261392+0000","last_became_peered":"2023-10-06T04:36:17.261392+0000","last_unstale":"2023-10-06T04:36:21.290285+0000","last_undegraded":"2023-10-06T04:36:21.290285+0000","last_fullsized":"2023-10-06T04:36:21.290285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:41.044599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.275984+0000","last_change":"2023-10-06T04:36:17.255595+0000","last_active":"2023-10-06T04:36:21.275984+0000","last_peered":"2023-10-06T04:36:21.275984+0000","last_clean":"2023-10-06T04:36:21.275984+0000","last_became_active":"2023-10-06T04:36:17.255326+0000","last_became_peered":"2023-10-06T04:36:17.255326+0000","last_unstale":"2023-10-06T04:36:21.275984+0000","last_undegraded":"2023-10-06T04:36:21.275984+0000","last_fullsized":"2023-10-06T04:36:21.275984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:56.005620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280802+0000","last_change":"2023-10-06T04:36:17.266065+0000","last_active":"2023-10-06T04:36:21.280802+0000","last_peered":"2023-10-06T04:36:21.280802+0000","last_clean":"2023-10-06T04:36:21.280802+0000","last_became_active":"2023-10-06T04:36:17.264225+0000","last_became_peered":"2023-10-06T04:36:17.264225+0000","last_unstale":"2023-10-06T04:36:21.280802+0000","last_undegraded":"2023-10-06T04:36:21.280802+0000","last_fullsized":"2023-10-06T04:36:21.280802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:12.881884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.277129+0000","last_change":"2023-10-06T04:36:17.253460+0000","last_active":"2023-10-06T04:36:21.277129+0000","last_peered":"2023-10-06T04:36:21.277129+0000","last_clean":"2023-10-06T04:36:21.277129+0000","last_became_active":"2023-10-06T04:36:17.253170+0000","last_became_peered":"2023-10-06T04:36:17.253170+0000","last_unstale":"2023-10-06T04:36:21.277129+0000","last_undegraded":"2023-10-06T04:36:21.277129+0000","last_fullsized":"2023-10-06T04:36:21.277129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:25.650113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276624+0000","last_change":"2023-10-06T04:36:17.257970+0000","last_active":"2023-10-06T04:36:21.276624+0000","last_peered":"2023-10-06T04:36:21.276624+0000","last_clean":"2023-10-06T04:36:21.276624+0000","last_became_active":"2023-10-06T04:36:17.257685+0000","last_became_peered":"2023-10-06T04:36:17.257685+0000","last_unstale":"2023-10-06T04:36:21.276624+0000","last_undegraded":"2023-10-06T04:36:21.276624+0000","last_fullsized":"2023-10-06T04:36:21.276624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:15.884489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298156,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073684,"statfs":{"total":96636764160,"available":96331452416,"internally_reserved":0,"allocated":888832,"data_stored":703756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":266240,"data_stored":109458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298128,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073712,"statfs":{"total":96636764160,"available":96331481088,"internally_reserved":0,"allocated":860160,"data_stored":699826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":266240,"data_stored":109034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":108480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":266240,"data_stored":108570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":286720,"data_stored":113228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":274432,"data_stored":110082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:36:31.244 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T04:36:31.244 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-06T04:36:31.244 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-06T04:36:31.244 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-06T04:36:31.245 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-06T04:36:31.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.393+0000 7ff427330700 1 Processor -- start 2023-10-06T04:36:31.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.393+0000 7ff427330700 1 -- start start 2023-10-06T04:36:31.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.394+0000 7ff427330700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff420156160 0x7ff4200c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:31.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.394+0000 7ff427330700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4200b0c70 con 0x7ff4200ca1a0 2023-10-06T04:36:31.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.394+0000 7ff427330700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4200c8720 con 0x7ff420156530 2023-10-06T04:36:31.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.394+0000 7ff427330700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4200c8520 con 0x7ff420156160 2023-10-06T04:36:31.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.394+0000 7ff4250cc700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff420156160 0x7ff4200c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:31.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.394+0000 7ff4258cd700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ff4200ca1a0 0x7ff4200b1100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34572/0 (socket says 172.21.15.8:34572) 2023-10-06T04:36:31.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.394+0000 7ff4258cd700 1 -- 172.21.15.8:0/2100576544 learned_addr learned my addr 172.21.15.8:0/2100576544 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:31.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.394+0000 7ff4250cc700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff420156160 0x7ff4200c7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38404/0 (socket says 172.21.15.8:38404) 2023-10-06T04:36:31.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.395+0000 7ff4250cc700 1 -- 172.21.15.8:0/2100576544 >> v1:172.21.15.184:6789/0 conn(0x7ff420156530 legacy=0x7ff4200c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:31.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.395+0000 7ff4250cc700 1 -- 172.21.15.8:0/2100576544 >> v1:172.21.15.8:6789/0 conn(0x7ff4200ca1a0 legacy=0x7ff4200b1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:31.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.395+0000 7ff41ffff700 1 -- 172.21.15.8:0/2100576544 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4202064288 0 0) 0x7ff4200b0c70 con 0x7ff4200ca1a0 2023-10-06T04:36:31.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.395+0000 7ff4250cc700 1 -- 172.21.15.8:0/2100576544 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4200c8a00 con 0x7ff420156160 2023-10-06T04:36:31.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.395+0000 7ff4250cc700 1 --2- 172.21.15.8:0/2100576544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff420156160 0x7ff4200c7fe0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff4180098e0 tx=0x7ff4180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=517bde3270836c47 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:31.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.395+0000 7ff41ffff700 1 -- 172.21.15.8:0/2100576544 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff418009e80 con 0x7ff420156160 2023-10-06T04:36:31.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.395+0000 7ff41ffff700 1 -- 172.21.15.8:0/2100576544 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41800b860 con 0x7ff420156160 2023-10-06T04:36:31.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.395+0000 7ff41ffff700 1 -- 172.21.15.8:0/2100576544 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41800bbe0 con 0x7ff420156160 2023-10-06T04:36:31.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.396+0000 7ff427330700 1 -- 172.21.15.8:0/2100576544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff420156160 msgr2=0x7ff4200c7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:31.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.396+0000 7ff427330700 1 --2- 172.21.15.8:0/2100576544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff420156160 0x7ff4200c7fe0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff4180098e0 tx=0x7ff4180091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:31.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.396+0000 7ff427330700 1 -- 172.21.15.8:0/2100576544 shutdown_connections 2023-10-06T04:36:31.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.396+0000 7ff427330700 1 --2- 172.21.15.8:0/2100576544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff420156160 0x7ff4200c7fe0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:31.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.396+0000 7ff427330700 1 -- 172.21.15.8:0/2100576544 >> 172.21.15.8:0/2100576544 conn(0x7ff4200686e0 msgr2=0x7ff420068ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:31.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.396+0000 7ff427330700 1 -- 172.21.15.8:0/2100576544 shutdown_connections 2023-10-06T04:36:31.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.396+0000 7ff427330700 1 -- 172.21.15.8:0/2100576544 wait complete. 2023-10-06T04:36:31.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.397+0000 7ff427330700 1 Processor -- start 2023-10-06T04:36:31.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.397+0000 7ff427330700 1 -- start start 2023-10-06T04:36:31.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.398+0000 7ff427330700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4200ca1a0 0x7ff4200c2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:31.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.398+0000 7ff427330700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff420156160 0x7ff420165020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:31.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.398+0000 7ff427330700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff420156530 0x7ff4200c3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:31.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.398+0000 7ff427330700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4201660c0 con 0x7ff4200ca1a0 2023-10-06T04:36:31.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.398+0000 7ff427330700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4200c52a0 con 0x7ff420156160 2023-10-06T04:36:31.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.398+0000 7ff427330700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff420165560 con 0x7ff420156530 2023-10-06T04:36:31.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.398+0000 7ff4250cc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4200ca1a0 0x7ff4200c2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:31.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.398+0000 7ff4250cc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4200ca1a0 0x7ff4200c2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38406/0 (socket says 172.21.15.8:38406) 2023-10-06T04:36:31.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.398+0000 7ff4250cc700 1 -- 172.21.15.8:0/3133699017 learned_addr learned my addr 172.21.15.8:0/3133699017 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:31.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.398+0000 7ff4258cd700 1 --2- 172.21.15.8:0/3133699017 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff420156530 0x7ff4200c3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:31.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.398+0000 7ff4248cb700 1 --2- 172.21.15.8:0/3133699017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff420156160 0x7ff420165020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:31.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.398+0000 7ff4250cc700 1 -- 172.21.15.8:0/3133699017 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff420156530 msgr2=0x7ff4200c3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:31.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.398+0000 7ff4250cc700 1 --2- 172.21.15.8:0/3133699017 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff420156530 0x7ff4200c3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:31.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.398+0000 7ff4250cc700 1 -- 172.21.15.8:0/3133699017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff420156160 msgr2=0x7ff420165020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:31.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.398+0000 7ff4250cc700 1 --2- 172.21.15.8:0/3133699017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff420156160 0x7ff420165020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:31.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.398+0000 7ff4250cc700 1 -- 172.21.15.8:0/3133699017 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff418009420 con 0x7ff4200ca1a0 2023-10-06T04:36:31.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.398+0000 7ff4250cc700 1 --2- 172.21.15.8:0/3133699017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4200ca1a0 0x7ff4200c2810 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff420065600 tx=0x7ff418017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:31.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.398+0000 7ff41d7fa700 1 -- 172.21.15.8:0/3133699017 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41801f070 con 0x7ff4200ca1a0 2023-10-06T04:36:31.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.399+0000 7ff41d7fa700 1 -- 172.21.15.8:0/3133699017 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff418000c90 con 0x7ff4200ca1a0 2023-10-06T04:36:31.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.399+0000 7ff427330700 1 -- 172.21.15.8:0/3133699017 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff420165820 con 0x7ff4200ca1a0 2023-10-06T04:36:31.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.399+0000 7ff41d7fa700 1 -- 172.21.15.8:0/3133699017 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff418025420 con 0x7ff4200ca1a0 2023-10-06T04:36:31.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.399+0000 7ff427330700 1 -- 172.21.15.8:0/3133699017 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff420165de0 con 0x7ff4200ca1a0 2023-10-06T04:36:31.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.399+0000 7ff427330700 1 -- 172.21.15.8:0/3133699017 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4200c5070 con 0x7ff4200ca1a0 2023-10-06T04:36:31.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.400+0000 7ff41d7fa700 1 -- 172.21.15.8:0/3133699017 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff418023070 con 0x7ff4200ca1a0 2023-10-06T04:36:31.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.400+0000 7ff41d7fa700 1 --2- 172.21.15.8:0/3133699017 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff40c066f30 0x7ff40c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:31.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.401+0000 7ff41d7fa700 1 -- 172.21.15.8:0/3133699017 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff418085e40 con 0x7ff4200ca1a0 2023-10-06T04:36:31.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.401+0000 7ff4248cb700 1 --2- 172.21.15.8:0/3133699017 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff40c066f30 0x7ff40c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:31.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.401+0000 7ff4248cb700 1 --2- 172.21.15.8:0/3133699017 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff40c066f30 0x7ff40c0693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff4140039e0 tx=0x7ff414007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:31.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.405+0000 7ff41d7fa700 1 -- 172.21.15.8:0/3133699017 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4200c5070 con 0x7ff4200ca1a0 2023-10-06T04:36:31.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.655+0000 7ff427330700 1 -- 172.21.15.8:0/3133699017 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff4200c5070 con 0x7ff4200ca1a0 2023-10-06T04:36:31.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.658+0000 7ff41d7fa700 1 -- 172.21.15.8:0/3133699017 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163704 (secure 0 0 0) 0x7ff4200c5070 con 0x7ff4200ca1a0 2023-10-06T04:36:31.662 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:36:31.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.660+0000 7ff427330700 1 -- 172.21.15.8:0/3133699017 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff40c066f30 msgr2=0x7ff40c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:31.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.660+0000 7ff427330700 1 --2- 172.21.15.8:0/3133699017 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff40c066f30 0x7ff40c0693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff4140039e0 tx=0x7ff414007ec0 comp rx=0 tx=0).stop 2023-10-06T04:36:31.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.660+0000 7ff427330700 1 -- 172.21.15.8:0/3133699017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4200ca1a0 msgr2=0x7ff4200c2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:31.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.660+0000 7ff427330700 1 --2- 172.21.15.8:0/3133699017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4200ca1a0 0x7ff4200c2810 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff420065600 tx=0x7ff418017000 comp rx=0 tx=0).stop 2023-10-06T04:36:31.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.661+0000 7ff427330700 1 -- 172.21.15.8:0/3133699017 shutdown_connections 2023-10-06T04:36:31.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.661+0000 7ff427330700 1 --2- 172.21.15.8:0/3133699017 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff40c066f30 0x7ff40c0693e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:31.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.661+0000 7ff427330700 1 --2- 172.21.15.8:0/3133699017 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff420156530 0x7ff4200c3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:31.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.661+0000 7ff427330700 1 --2- 172.21.15.8:0/3133699017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4200ca1a0 0x7ff4200c2810 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:31.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.661+0000 7ff427330700 1 --2- 172.21.15.8:0/3133699017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff420156160 0x7ff420165020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:31.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.661+0000 7ff427330700 1 -- 172.21.15.8:0/3133699017 >> 172.21.15.8:0/3133699017 conn(0x7ff4200686e0 msgr2=0x7ff4200c75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:31.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.661+0000 7ff427330700 1 -- 172.21.15.8:0/3133699017 shutdown_connections 2023-10-06T04:36:31.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.661+0000 7ff427330700 1 -- 172.21.15.8:0/3133699017 wait complete. 2023-10-06T04:36:31.675 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":5,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":90283},{"type":"v1","addr":"172.21.15.184:6833","nonce":90283}]},"active_addr":"172.21.15.184:6833/90283","active_change":"2023-10-06T04:36:04.622549+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":896355351}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":2824863202}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":3510045128}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":699910006}]}]} 2023-10-06T04:36:31.680 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-06T04:36:31.680 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-06T04:36:31.680 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:36:31.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.796+0000 7fcf9be40700 1 Processor -- start 2023-10-06T04:36:31.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.796+0000 7fcf9be40700 1 -- start start 2023-10-06T04:36:31.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.797+0000 7fcf9be40700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fcf9406c060 0x7fcf940ac000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:31.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.797+0000 7fcf9be40700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fcf940ad640 0x7fcf9415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:31.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.797+0000 7fcf9be40700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf940af1c0 con 0x7fcf940ac540 2023-10-06T04:36:31.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.797+0000 7fcf9be40700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf94159da0 con 0x7fcf940ad640 2023-10-06T04:36:31.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.797+0000 7fcf9be40700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf94159fb0 con 0x7fcf9406c060 2023-10-06T04:36:31.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.797+0000 7fcf9a3dd700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fcf940ad640 0x7fcf9415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:31.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.797+0000 7fcf9a3dd700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fcf940ad640 0x7fcf9415b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38412/0 (socket says 172.21.15.8:38412) 2023-10-06T04:36:31.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.797+0000 7fcf9a3dd700 1 -- 172.21.15.8:0/1732861685 learned_addr learned my addr 172.21.15.8:0/1732861685 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:31.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.797+0000 7fcf99bdc700 1 --2- 172.21.15.8:0/1732861685 >> v2:172.21.15.184:3300/0 conn(0x7fcf9406c060 0x7fcf940ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:31.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.798+0000 7fcf9a3dd700 1 -- 172.21.15.8:0/1732861685 >> v2:172.21.15.184:3300/0 conn(0x7fcf9406c060 msgr2=0x7fcf940ac000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:31.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.798+0000 7fcf9a3dd700 1 --2- 172.21.15.8:0/1732861685 >> v2:172.21.15.184:3300/0 conn(0x7fcf9406c060 0x7fcf940ac000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:31.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.798+0000 7fcf9a3dd700 1 -- 172.21.15.8:0/1732861685 >> v1:172.21.15.184:6789/0 conn(0x7fcf940ac540 legacy=0x7fcf940acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:31.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.798+0000 7fcf9a3dd700 1 -- 172.21.15.8:0/1732861685 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9415a290 con 0x7fcf940ad640 2023-10-06T04:36:31.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.798+0000 7fcf9a3dd700 1 --2- 172.21.15.8:0/1732861685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf940ad640 0x7fcf9415b0a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcf84009f20 tx=0x7fcf84009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=735b6b68a0654447 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:31.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.798+0000 7fcf98bda700 1 -- 172.21.15.8:0/1732861685 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8400e070 con 0x7fcf940ad640 2023-10-06T04:36:31.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.798+0000 7fcf98bda700 1 -- 172.21.15.8:0/1732861685 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8400ba40 con 0x7fcf940ad640 2023-10-06T04:36:31.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.798+0000 7fcf98bda700 1 -- 172.21.15.8:0/1732861685 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf840092e0 con 0x7fcf940ad640 2023-10-06T04:36:31.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.798+0000 7fcf9be40700 1 -- 172.21.15.8:0/1732861685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf940ad640 msgr2=0x7fcf9415b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:31.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.798+0000 7fcf9be40700 1 --2- 172.21.15.8:0/1732861685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf940ad640 0x7fcf9415b0a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcf84009f20 tx=0x7fcf84009840 comp rx=0 tx=0).stop 2023-10-06T04:36:31.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.799+0000 7fcf9be40700 1 -- 172.21.15.8:0/1732861685 shutdown_connections 2023-10-06T04:36:31.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.799+0000 7fcf9be40700 1 --2- 172.21.15.8:0/1732861685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf940ad640 0x7fcf9415b0a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:31.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.799+0000 7fcf9be40700 1 --2- 172.21.15.8:0/1732861685 >> v2:172.21.15.184:3300/0 conn(0x7fcf9406c060 0x7fcf940ac000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:31.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.799+0000 7fcf9be40700 1 -- 172.21.15.8:0/1732861685 >> 172.21.15.8:0/1732861685 conn(0x7fcf9406e900 msgr2=0x7fcf9406ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:31.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.799+0000 7fcf9be40700 1 -- 172.21.15.8:0/1732861685 shutdown_connections 2023-10-06T04:36:31.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.799+0000 7fcf9be40700 1 -- 172.21.15.8:0/1732861685 wait complete. 2023-10-06T04:36:31.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.800+0000 7fcf9be40700 1 Processor -- start 2023-10-06T04:36:31.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.800+0000 7fcf9be40700 1 -- start start 2023-10-06T04:36:31.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.800+0000 7fcf9be40700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf9406c060 0x7fcf94150800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:31.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.800+0000 7fcf9be40700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf940ac540 0x7fcf9416cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:31.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.800+0000 7fcf9be40700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf940ad640 0x7fcf941699f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:31.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.800+0000 7fcf9be40700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf940b0a70 con 0x7fcf940ac540 2023-10-06T04:36:31.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.800+0000 7fcf9be40700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9416d890 con 0x7fcf940ad640 2023-10-06T04:36:31.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.800+0000 7fcf9be40700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9416db70 con 0x7fcf9406c060 2023-10-06T04:36:31.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.801+0000 7fcf993db700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf940ac540 0x7fcf9416cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:31.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.801+0000 7fcf993db700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf940ac540 0x7fcf9416cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38418/0 (socket says 172.21.15.8:38418) 2023-10-06T04:36:31.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.801+0000 7fcf993db700 1 -- 172.21.15.8:0/3177789073 learned_addr learned my addr 172.21.15.8:0/3177789073 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:31.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.801+0000 7fcf99bdc700 1 --2- 172.21.15.8:0/3177789073 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf9406c060 0x7fcf94150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:31.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.801+0000 7fcf9a3dd700 1 --2- 172.21.15.8:0/3177789073 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf940ad640 0x7fcf941699f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:31.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.801+0000 7fcf993db700 1 -- 172.21.15.8:0/3177789073 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf9406c060 msgr2=0x7fcf94150800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:31.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.801+0000 7fcf993db700 1 --2- 172.21.15.8:0/3177789073 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf9406c060 0x7fcf94150800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:31.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.801+0000 7fcf993db700 1 -- 172.21.15.8:0/3177789073 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf940ad640 msgr2=0x7fcf941699f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:31.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.801+0000 7fcf993db700 1 --2- 172.21.15.8:0/3177789073 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf940ad640 0x7fcf941699f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:31.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.801+0000 7fcf993db700 1 -- 172.21.15.8:0/3177789073 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf84009ae0 con 0x7fcf940ac540 2023-10-06T04:36:31.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.801+0000 7fcf9a3dd700 1 --2- 172.21.15.8:0/3177789073 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf940ad640 0x7fcf941699f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:31.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.801+0000 7fcf993db700 1 --2- 172.21.15.8:0/3177789073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf940ac540 0x7fcf9416cfb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcf8800c790 tx=0x7fcf88007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:31.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.801+0000 7fcf91ffb700 1 -- 172.21.15.8:0/3177789073 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf88011590 con 0x7fcf940ac540 2023-10-06T04:36:31.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.801+0000 7fcf91ffb700 1 -- 172.21.15.8:0/3177789073 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf880116f0 con 0x7fcf940ac540 2023-10-06T04:36:31.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.801+0000 7fcf9be40700 1 -- 172.21.15.8:0/3177789073 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf940b0700 con 0x7fcf940ac540 2023-10-06T04:36:31.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.801+0000 7fcf91ffb700 1 -- 172.21.15.8:0/3177789073 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf88011ab0 con 0x7fcf940ac540 2023-10-06T04:36:31.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.802+0000 7fcf9be40700 1 -- 172.21.15.8:0/3177789073 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf94169f30 con 0x7fcf940ac540 2023-10-06T04:36:31.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.802+0000 7fcf9be40700 1 -- 172.21.15.8:0/3177789073 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf9416a150 con 0x7fcf940ac540 2023-10-06T04:36:31.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.803+0000 7fcf91ffb700 1 -- 172.21.15.8:0/3177789073 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcf8801b3b0 con 0x7fcf940ac540 2023-10-06T04:36:31.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.803+0000 7fcf91ffb700 1 --2- 172.21.15.8:0/3177789073 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fcf80066f30 0x7fcf800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:31.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.803+0000 7fcf91ffb700 1 -- 172.21.15.8:0/3177789073 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fcf88083e60 con 0x7fcf940ac540 2023-10-06T04:36:31.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.804+0000 7fcf99bdc700 1 --2- 172.21.15.8:0/3177789073 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fcf80066f30 0x7fcf800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:31.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.804+0000 7fcf99bdc700 1 --2- 172.21.15.8:0/3177789073 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fcf80066f30 0x7fcf800693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c006fd0 tx=0x7fcf8c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:31.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:31.808+0000 7fcf91ffb700 1 -- 172.21.15.8:0/3177789073 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcf9416a150 con 0x7fcf940ac540 2023-10-06T04:36:32.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.002+0000 7fcf9be40700 1 -- 172.21.15.8:0/3177789073 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf9416a150 con 0x7fcf940ac540 2023-10-06T04:36:32.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.003+0000 7fcf91ffb700 1 -- 172.21.15.8:0/3177789073 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18659 (secure 0 0 0) 0x7fcf9416a150 con 0x7fcf940ac540 2023-10-06T04:36:32.005 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:36:32.005 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":25,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:36:21.690266+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:36:10.148177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:36:10.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:36:14.390671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:36:15.601089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:36:19.291300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.555871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.490505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.504578+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.517217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:05.991135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.537329+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.543232+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.443715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:36:32.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.004+0000 7fcf9be40700 1 -- 172.21.15.8:0/3177789073 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fcf80066f30 msgr2=0x7fcf800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.004+0000 7fcf9be40700 1 --2- 172.21.15.8:0/3177789073 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fcf80066f30 0x7fcf800693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c006fd0 tx=0x7fcf8c008040 comp rx=0 tx=0).stop 2023-10-06T04:36:32.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.004+0000 7fcf9be40700 1 -- 172.21.15.8:0/3177789073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf940ac540 msgr2=0x7fcf9416cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.004+0000 7fcf9be40700 1 --2- 172.21.15.8:0/3177789073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf940ac540 0x7fcf9416cfb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcf8800c790 tx=0x7fcf88007f20 comp rx=0 tx=0).stop 2023-10-06T04:36:32.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.005+0000 7fcf9be40700 1 -- 172.21.15.8:0/3177789073 shutdown_connections 2023-10-06T04:36:32.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.005+0000 7fcf9be40700 1 --2- 172.21.15.8:0/3177789073 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fcf80066f30 0x7fcf800693e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.005+0000 7fcf9be40700 1 --2- 172.21.15.8:0/3177789073 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf940ad640 0x7fcf941699f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.005+0000 7fcf9be40700 1 --2- 172.21.15.8:0/3177789073 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf9406c060 0x7fcf94150800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.005+0000 7fcf9be40700 1 --2- 172.21.15.8:0/3177789073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf940ac540 0x7fcf9416cfb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.005+0000 7fcf9be40700 1 -- 172.21.15.8:0/3177789073 >> 172.21.15.8:0/3177789073 conn(0x7fcf9406e900 msgr2=0x7fcf9415c000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:32.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.005+0000 7fcf9be40700 1 -- 172.21.15.8:0/3177789073 shutdown_connections 2023-10-06T04:36:32.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.005+0000 7fcf9be40700 1 -- 172.21.15.8:0/3177789073 wait complete. 2023-10-06T04:36:32.019 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-06T04:36:32.019 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:36:32.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.136+0000 7f2279991700 1 Processor -- start 2023-10-06T04:36:32.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.136+0000 7f2279991700 1 -- start start 2023-10-06T04:36:32.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.137+0000 7f2279991700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2274157170 0x7f22740c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.137+0000 7f2279991700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f227415da90 0x7f227415a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.137+0000 7f2279991700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22740c7630 0x7f22740c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.137+0000 7f2279991700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22740c7fb0 con 0x7f2274157170 2023-10-06T04:36:32.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.137+0000 7f2279991700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2274157540 con 0x7f227415da90 2023-10-06T04:36:32.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.137+0000 7f2279991700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22740ca030 con 0x7f22740c7630 2023-10-06T04:36:32.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.137+0000 7f2272ffd700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2274157170 0x7f22740c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.137+0000 7f2272ffd700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2274157170 0x7f22740c99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38434/0 (socket says 172.21.15.8:38434) 2023-10-06T04:36:32.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.137+0000 7f2272ffd700 1 -- 172.21.15.8:0/3003539195 learned_addr learned my addr 172.21.15.8:0/3003539195 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:32.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.137+0000 7f22737fe700 1 --2- 172.21.15.8:0/3003539195 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22740c7630 0x7f22740c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.137+0000 7f22727fc700 1 --2- 172.21.15.8:0/3003539195 >> v2:172.21.15.184:3300/0 conn(0x7f227415da90 0x7f227415a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.137+0000 7f2272ffd700 1 -- 172.21.15.8:0/3003539195 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22740c7630 msgr2=0x7f22740c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:32.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.137+0000 7f2272ffd700 1 --2- 172.21.15.8:0/3003539195 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22740c7630 0x7f22740c7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.137+0000 7f2272ffd700 1 -- 172.21.15.8:0/3003539195 >> v2:172.21.15.184:3300/0 conn(0x7f227415da90 msgr2=0x7f227415a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:32.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.137+0000 7f2272ffd700 1 --2- 172.21.15.8:0/3003539195 >> v2:172.21.15.184:3300/0 conn(0x7f227415da90 0x7f227415a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.137+0000 7f2272ffd700 1 -- 172.21.15.8:0/3003539195 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22740ca310 con 0x7f2274157170 2023-10-06T04:36:32.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.137+0000 7f2272ffd700 1 --2- 172.21.15.8:0/3003539195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2274157170 0x7f22740c99a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2274068610 tx=0x7f2264009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88deb366062f656c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.137+0000 7f2271ffb700 1 -- 172.21.15.8:0/3003539195 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226400b860 con 0x7f2274157170 2023-10-06T04:36:32.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.137+0000 7f2271ffb700 1 -- 172.21.15.8:0/3003539195 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226400b9c0 con 0x7f2274157170 2023-10-06T04:36:32.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.137+0000 7f2271ffb700 1 -- 172.21.15.8:0/3003539195 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226400bd60 con 0x7f2274157170 2023-10-06T04:36:32.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.138+0000 7f2279991700 1 -- 172.21.15.8:0/3003539195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2274157170 msgr2=0x7f22740c99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.138+0000 7f2279991700 1 --2- 172.21.15.8:0/3003539195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2274157170 0x7f22740c99a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2274068610 tx=0x7f2264009250 comp rx=0 tx=0).stop 2023-10-06T04:36:32.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.138+0000 7f2279991700 1 -- 172.21.15.8:0/3003539195 shutdown_connections 2023-10-06T04:36:32.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.138+0000 7f2279991700 1 --2- 172.21.15.8:0/3003539195 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22740c7630 0x7f22740c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.138+0000 7f2279991700 1 --2- 172.21.15.8:0/3003539195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2274157170 0x7f22740c99a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.138+0000 7f2279991700 1 --2- 172.21.15.8:0/3003539195 >> v2:172.21.15.184:3300/0 conn(0x7f227415da90 0x7f227415a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.138+0000 7f2279991700 1 -- 172.21.15.8:0/3003539195 >> 172.21.15.8:0/3003539195 conn(0x7f22740686e0 msgr2=0x7f2274068ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:32.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.138+0000 7f2279991700 1 -- 172.21.15.8:0/3003539195 shutdown_connections 2023-10-06T04:36:32.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.138+0000 7f2279991700 1 -- 172.21.15.8:0/3003539195 wait complete. 2023-10-06T04:36:32.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.139+0000 7f2279991700 1 Processor -- start 2023-10-06T04:36:32.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.139+0000 7f2279991700 1 -- start start 2023-10-06T04:36:32.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.140+0000 7f2279991700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22740c7630 0x7f2274153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.140+0000 7f2279991700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2274157170 0x7f2274152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.140+0000 7f2279991700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f227415da90 0x7f22740c6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.140+0000 7f2279991700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22740c71b0 con 0x7f227415da90 2023-10-06T04:36:32.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.140+0000 7f2279991700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227416cdc0 con 0x7f22740c7630 2023-10-06T04:36:32.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.140+0000 7f2279991700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2274153d60 con 0x7f2274157170 2023-10-06T04:36:32.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.140+0000 7f22737fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f227415da90 0x7f22740c6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.140+0000 7f22737fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f227415da90 0x7f22740c6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38450/0 (socket says 172.21.15.8:38450) 2023-10-06T04:36:32.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.140+0000 7f22737fe700 1 -- 172.21.15.8:0/3499869646 learned_addr learned my addr 172.21.15.8:0/3499869646 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:32.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.140+0000 7f22727fc700 1 --2- 172.21.15.8:0/3499869646 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2274157170 0x7f2274152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.140+0000 7f2272ffd700 1 --2- 172.21.15.8:0/3499869646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22740c7630 0x7f2274153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.140+0000 7f22737fe700 1 -- 172.21.15.8:0/3499869646 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2274157170 msgr2=0x7f2274152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.140+0000 7f22737fe700 1 --2- 172.21.15.8:0/3499869646 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2274157170 0x7f2274152f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.140+0000 7f22737fe700 1 -- 172.21.15.8:0/3499869646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22740c7630 msgr2=0x7f2274153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.140+0000 7f22737fe700 1 --2- 172.21.15.8:0/3499869646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22740c7630 0x7f2274153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.140+0000 7f22737fe700 1 -- 172.21.15.8:0/3499869646 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22640094f0 con 0x7f227415da90 2023-10-06T04:36:32.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.141+0000 7f22737fe700 1 --2- 172.21.15.8:0/3499869646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f227415da90 0x7f22740c6410 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f226c007f80 tx=0x7f226c009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.141+0000 7f225affd700 1 -- 172.21.15.8:0/3499869646 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c00ebf0 con 0x7f227415da90 2023-10-06T04:36:32.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.141+0000 7f225affd700 1 -- 172.21.15.8:0/3499869646 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226c00ed70 con 0x7f227415da90 2023-10-06T04:36:32.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.141+0000 7f225affd700 1 -- 172.21.15.8:0/3499869646 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c00eee0 con 0x7f227415da90 2023-10-06T04:36:32.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.141+0000 7f2279991700 1 -- 172.21.15.8:0/3499869646 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22740c6950 con 0x7f227415da90 2023-10-06T04:36:32.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.141+0000 7f2279991700 1 -- 172.21.15.8:0/3499869646 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22740c6ed0 con 0x7f227415da90 2023-10-06T04:36:32.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.142+0000 7f2279991700 1 -- 172.21.15.8:0/3499869646 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f227416cf50 con 0x7f227415da90 2023-10-06T04:36:32.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.142+0000 7f225affd700 1 -- 172.21.15.8:0/3499869646 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f226c014880 con 0x7f227415da90 2023-10-06T04:36:32.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.143+0000 7f225affd700 1 --2- 172.21.15.8:0/3499869646 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2260066f30 0x7f22600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.143+0000 7f225affd700 1 -- 172.21.15.8:0/3499869646 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f226c084ed0 con 0x7f227415da90 2023-10-06T04:36:32.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.143+0000 7f2272ffd700 1 --2- 172.21.15.8:0/3499869646 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2260066f30 0x7f22600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.143+0000 7f2272ffd700 1 --2- 172.21.15.8:0/3499869646 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2260066f30 0x7f22600693e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2274068610 tx=0x7f2264017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.147+0000 7f225affd700 1 -- 172.21.15.8:0/3499869646 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f226c051cf0 con 0x7f227415da90 2023-10-06T04:36:32.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.340+0000 7f2279991700 1 -- 172.21.15.8:0/3499869646 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2274071550 con 0x7f227415da90 2023-10-06T04:36:32.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.341+0000 7f225affd700 1 -- 172.21.15.8:0/3499869646 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f226c055310 con 0x7f227415da90 2023-10-06T04:36:32.344 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:36:32.344 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":25,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:36:21.690266+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:36:10.148177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:36:10.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:36:14.390671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:36:15.601089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:36:19.291300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.555871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.490505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.504578+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.517217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:05.991135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.537329+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.543232+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.443715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:36:32.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.343+0000 7f2279991700 1 -- 172.21.15.8:0/3499869646 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2260066f30 msgr2=0x7f22600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.343+0000 7f2279991700 1 --2- 172.21.15.8:0/3499869646 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2260066f30 0x7f22600693e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2274068610 tx=0x7f2264017000 comp rx=0 tx=0).stop 2023-10-06T04:36:32.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.343+0000 7f2279991700 1 -- 172.21.15.8:0/3499869646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f227415da90 msgr2=0x7f22740c6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.343+0000 7f2279991700 1 --2- 172.21.15.8:0/3499869646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f227415da90 0x7f22740c6410 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f226c007f80 tx=0x7f226c009860 comp rx=0 tx=0).stop 2023-10-06T04:36:32.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.343+0000 7f2279991700 1 -- 172.21.15.8:0/3499869646 shutdown_connections 2023-10-06T04:36:32.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.343+0000 7f2279991700 1 --2- 172.21.15.8:0/3499869646 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2260066f30 0x7f22600693e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.343+0000 7f2279991700 1 --2- 172.21.15.8:0/3499869646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f227415da90 0x7f22740c6410 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.343+0000 7f2279991700 1 --2- 172.21.15.8:0/3499869646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22740c7630 0x7f2274153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.343+0000 7f2279991700 1 --2- 172.21.15.8:0/3499869646 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2274157170 0x7f2274152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.343+0000 7f2279991700 1 -- 172.21.15.8:0/3499869646 >> 172.21.15.8:0/3499869646 conn(0x7f22740686e0 msgr2=0x7f22741545f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:32.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.343+0000 7f2279991700 1 -- 172.21.15.8:0/3499869646 shutdown_connections 2023-10-06T04:36:32.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.343+0000 7f2279991700 1 -- 172.21.15.8:0/3499869646 wait complete. 2023-10-06T04:36:32.358 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-06T04:36:32.359 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-06T04:36:32.359 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-06T04:36:32.360 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-06T04:36:32.360 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-06T04:36:32.360 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-06T04:36:32.361 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-06T04:36:32.361 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-06T04:36:32.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.561+0000 7fc31817c700 1 Processor -- start 2023-10-06T04:36:32.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.562+0000 7fc31817c700 1 -- start start 2023-10-06T04:36:32.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.563+0000 7fc31817c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3101561c0 0x7fc310159e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.563+0000 7fc31817c700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc3100687c0 0x7fc31015a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.563+0000 7fc31817c700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc31006af80 con 0x7fc3100ca490 2023-10-06T04:36:32.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.563+0000 7fc31817c700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc31006b410 con 0x7fc3100687c0 2023-10-06T04:36:32.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.563+0000 7fc31817c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31006a370 con 0x7fc3101561c0 2023-10-06T04:36:32.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.563+0000 7fc316719700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fc3100ca490 0x7fc3100ca910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34578/0 (socket says 172.21.15.8:34578) 2023-10-06T04:36:32.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.563+0000 7fc316719700 1 -- 172.21.15.8:0/3974047457 learned_addr learned my addr 172.21.15.8:0/3974047457 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:32.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.563+0000 7fc315717700 1 --2- 172.21.15.8:0/3974047457 >> v2:172.21.15.8:3300/0 conn(0x7fc3100687c0 0x7fc31015a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.564+0000 7fc315f18700 1 --2- 172.21.15.8:0/3974047457 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3101561c0 0x7fc310159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.564+0000 7fc315717700 1 -- 172.21.15.8:0/3974047457 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3101561c0 msgr2=0x7fc310159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:32.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.564+0000 7fc315717700 1 --2- 172.21.15.8:0/3974047457 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3101561c0 0x7fc310159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.564+0000 7fc314f16700 1 -- 172.21.15.8:0/3974047457 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1206971010 0 0) 0x7fc31006af80 con 0x7fc3100ca490 2023-10-06T04:36:32.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.564+0000 7fc315717700 1 -- 172.21.15.8:0/3974047457 >> v1:172.21.15.8:6789/0 conn(0x7fc3100ca490 legacy=0x7fc3100ca910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.564+0000 7fc315717700 1 -- 172.21.15.8:0/3974047457 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31006a650 con 0x7fc3100687c0 2023-10-06T04:36:32.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.564+0000 7fc315f18700 1 --2- 172.21.15.8:0/3974047457 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3101561c0 0x7fc310159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:36:32.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.564+0000 7fc315717700 1 --2- 172.21.15.8:0/3974047457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3100687c0 0x7fc31015a3a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc30c00bb90 tx=0x7fc30c00b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df1d0cecdc0678db server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.564+0000 7fc314f16700 1 -- 172.21.15.8:0/3974047457 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c00db40 con 0x7fc3100687c0 2023-10-06T04:36:32.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.565+0000 7fc314f16700 1 -- 172.21.15.8:0/3974047457 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30c00dca0 con 0x7fc3100687c0 2023-10-06T04:36:32.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.565+0000 7fc314f16700 1 -- 172.21.15.8:0/3974047457 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c0196b0 con 0x7fc3100687c0 2023-10-06T04:36:32.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.565+0000 7fc31817c700 1 -- 172.21.15.8:0/3974047457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3100687c0 msgr2=0x7fc31015a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.565+0000 7fc31817c700 1 --2- 172.21.15.8:0/3974047457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3100687c0 0x7fc31015a3a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc30c00bb90 tx=0x7fc30c00b430 comp rx=0 tx=0).stop 2023-10-06T04:36:32.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.566+0000 7f9e5c4bd700 1 Processor -- start 2023-10-06T04:36:32.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.566+0000 7f9e5c4bd700 1 -- start start 2023-10-06T04:36:32.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.566+0000 7f3956d70700 1 Processor -- start 2023-10-06T04:36:32.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.567+0000 7f9e5c4bd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e540c8eb0 0x7f9e54159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.567+0000 7f9e5c4bd700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9e54159fc0 0x7f9e540692f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.567+0000 7f9e5c4bd700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e54068e60 con 0x7f9e54153aa0 2023-10-06T04:36:32.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.567+0000 7f9e5c4bd700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e5415aad0 con 0x7f9e54159fc0 2023-10-06T04:36:32.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.567+0000 7f9e5c4bd700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5415a7f0 con 0x7f9e540c8eb0 2023-10-06T04:36:32.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.567+0000 7f9e5a259700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f9e54153aa0 0x7f9e540c87a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.8:48986/0 (socket says 172.21.15.8:48986) 2023-10-06T04:36:32.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.567+0000 7f9e5a259700 1 -- 172.21.15.8:0/3542502919 learned_addr learned my addr 172.21.15.8:0/3542502919 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:32.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.566+0000 7f3956d70700 1 -- start start 2023-10-06T04:36:32.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.567+0000 7f3956d70700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39500af290 0x7f395006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.567+0000 7f3956d70700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39500b0ce0 con 0x7f395006f3c0 2023-10-06T04:36:32.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.567+0000 7f3956d70700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39500b00d0 con 0x7f3950156160 2023-10-06T04:36:32.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.567+0000 7f3956d70700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39500b03b0 con 0x7f39500af290 2023-10-06T04:36:32.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.568+0000 7f9e59a58700 1 --2- 172.21.15.8:0/3542502919 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e540c8eb0 0x7f9e54159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.568+0000 7f3954b0c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f3950156160 0x7f39500aeb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.8:48994/0 (socket says 172.21.15.8:48994) 2023-10-06T04:36:32.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.568+0000 7f3954b0c700 1 -- 172.21.15.8:0/3750957424 learned_addr learned my addr 172.21.15.8:0/3750957424 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:32.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.568+0000 7f9e59257700 1 -- 172.21.15.8:0/3542502919 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 793307537 0 0) 0x7f9e54068e60 con 0x7f9e54153aa0 2023-10-06T04:36:32.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.568+0000 7f9e59257700 1 -- 172.21.15.8:0/3542502919 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e40003570 con 0x7f9e54153aa0 2023-10-06T04:36:32.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.568+0000 7f4853c56700 1 Processor -- start 2023-10-06T04:36:32.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.568+0000 7f9e59a58700 1 -- 172.21.15.8:0/3542502919 >> v2:172.21.15.8:3300/0 conn(0x7f9e54159fc0 msgr2=0x7f9e540692f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:32.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.568+0000 7f394f7fe700 1 -- 172.21.15.8:0/3750957424 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2250314439 0 0) 0x7f39500b0ce0 con 0x7f395006f3c0 2023-10-06T04:36:32.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.568+0000 7f394f7fe700 1 -- 172.21.15.8:0/3750957424 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3940003570 con 0x7f395006f3c0 2023-10-06T04:36:32.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.568+0000 7f9e59a58700 1 --2- 172.21.15.8:0/3542502919 >> v2:172.21.15.8:3300/0 conn(0x7f9e54159fc0 0x7f9e540692f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.568+0000 7f9e59a58700 1 -- 172.21.15.8:0/3542502919 >> v1:172.21.15.184:6789/0 conn(0x7f9e54153aa0 legacy=0x7f9e540c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.568+0000 7f9e59a58700 1 -- 172.21.15.8:0/3542502919 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e54068810 con 0x7f9e540c8eb0 2023-10-06T04:36:32.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.568+0000 7f394f7fe700 1 -- 172.21.15.8:0/3750957424 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2335970355 0 0) 0x7f39500b00d0 con 0x7f3950156160 2023-10-06T04:36:32.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.568+0000 7f394f7fe700 1 -- 172.21.15.8:0/3750957424 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39500b0ce0 con 0x7f3950156160 2023-10-06T04:36:32.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.568+0000 7f9e59a58700 1 --2- 172.21.15.8:0/3542502919 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e540c8eb0 0x7f9e54159a80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9e500098e0 tx=0x7f9e500091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a42323e2ed87fc86 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.569+0000 7fc31817c700 1 -- 172.21.15.8:0/3974047457 shutdown_connections 2023-10-06T04:36:32.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.569+0000 7fc31817c700 1 --2- 172.21.15.8:0/3974047457 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3101561c0 0x7fc310159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.569+0000 7fc31817c700 1 --2- 172.21.15.8:0/3974047457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3100687c0 0x7fc31015a3a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.569+0000 7fc31817c700 1 -- 172.21.15.8:0/3974047457 >> 172.21.15.8:0/3974047457 conn(0x7fc3100c9330 msgr2=0x7fc3100c9730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:32.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.569+0000 7fc31817c700 1 -- 172.21.15.8:0/3974047457 shutdown_connections 2023-10-06T04:36:32.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.569+0000 7f394f7fe700 1 -- 172.21.15.8:0/3750957424 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2172152028 0 0) 0x7f39500b0ce0 con 0x7f3950156160 2023-10-06T04:36:32.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.569+0000 7f394f7fe700 1 -- 172.21.15.8:0/3750957424 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39500af290 msgr2=0x7f395006ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:32.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.569+0000 7f394ffff700 1 --2- 172.21.15.8:0/3750957424 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39500af290 0x7f395006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.569+0000 7fc31817c700 1 -- 172.21.15.8:0/3974047457 wait complete. 2023-10-06T04:36:32.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.569+0000 7f394f7fe700 1 --2- 172.21.15.8:0/3750957424 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39500af290 0x7f395006ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.569+0000 7f394f7fe700 1 -- 172.21.15.8:0/3750957424 >> v1:172.21.15.8:6789/0 conn(0x7f395006f3c0 legacy=0x7f3950156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.569+0000 7f394f7fe700 1 -- 172.21.15.8:0/3750957424 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39500b0690 con 0x7f3950156160 2023-10-06T04:36:32.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.569+0000 7ff0efc66700 1 Processor -- start 2023-10-06T04:36:32.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.570+0000 7ff0efc66700 1 -- start start 2023-10-06T04:36:32.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.569+0000 7f394f7fe700 1 -- 172.21.15.8:0/3750957424 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7f39440014b0 con 0x7f3950156160 2023-10-06T04:36:32.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.569+0000 7f394f7fe700 1 -- 172.21.15.8:0/3750957424 >> v1:172.21.15.184:6789/0 conn(0x7f3950156160 legacy=0x7f39500aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.569+0000 7f394f7fe700 1 --2- 172.21.15.8:0/3750957424 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3940003c20 0x7f3940003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.569+0000 7f394f7fe700 1 --2- 172.21.15.8:0/3750957424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3940004810 0x7f3940004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.569+0000 7f394f7fe700 1 --2- 172.21.15.8:0/3750957424 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3940005230 0x7f394000dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.569+0000 7f394f7fe700 1 -- 172.21.15.8:0/3750957424 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39480015b0 con 0x7f3940004810 2023-10-06T04:36:32.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.569+0000 7f394f7fe700 1 -- 172.21.15.8:0/3750957424 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39500b03b0 con 0x7f3940005230 2023-10-06T04:36:32.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.569+0000 7f394f7fe700 1 -- 172.21.15.8:0/3750957424 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394000e3c0 con 0x7f3940003c20 2023-10-06T04:36:32.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.569+0000 7f394ffff700 1 --2- 172.21.15.8:0/3750957424 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39500af290 0x7f395006ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:36:32.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.569+0000 7f394ffff700 1 --2- 172.21.15.8:0/3750957424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3940004810 0x7f3940004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.569+0000 7f3954b0c700 1 --2- 172.21.15.8:0/3750957424 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3940003c20 0x7f3940003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.569+0000 7f395530d700 1 --2- 172.21.15.8:0/3750957424 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3940005230 0x7f394000dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.568+0000 7f4853c56700 1 -- start start 2023-10-06T04:36:32.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.570+0000 7f4853c56700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f484c0cd060 0x7f484c15e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.570+0000 7f4853c56700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f484c0b23f0 0x7f484c0afff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.570+0000 7f4853c56700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f484c0b2850 con 0x7f484c0cd430 2023-10-06T04:36:32.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.570+0000 7f4853c56700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f484c0af6c0 con 0x7f484c0cd060 2023-10-06T04:36:32.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.570+0000 7f4853c56700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f484c0b2d70 con 0x7f484c0b23f0 2023-10-06T04:36:32.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.570+0000 7f394ffff700 1 -- 172.21.15.8:0/3750957424 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3940003c20 msgr2=0x7f3940003ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:32.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.570+0000 7f394ffff700 1 --2- 172.21.15.8:0/3750957424 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3940003c20 0x7f3940003ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.570+0000 7f394ffff700 1 -- 172.21.15.8:0/3750957424 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3940005230 msgr2=0x7f394000dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:32.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.570+0000 7f394ffff700 1 --2- 172.21.15.8:0/3750957424 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3940005230 0x7f394000dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.570+0000 7f394ffff700 1 -- 172.21.15.8:0/3750957424 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39500b0690 con 0x7f3940004810 2023-10-06T04:36:32.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.570+0000 7f48521f3700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f484c0b23f0 0x7f484c0afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.570+0000 7f48521f3700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f484c0b23f0 0x7f484c0afff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.8:53124/0 (socket says 172.21.15.8:53124) 2023-10-06T04:36:32.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.570+0000 7f48521f3700 1 -- 172.21.15.8:0/4068710495 learned_addr learned my addr 172.21.15.8:0/4068710495 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:32.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.570+0000 7f394ffff700 1 --2- 172.21.15.8:0/3750957424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3940004810 0x7f3940004c80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f39500acb40 tx=0x7f393c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5128926138d8208 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.571+0000 7f394f7fe700 1 -- 172.21.15.8:0/3750957424 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c0113f0 con 0x7f3940004810 2023-10-06T04:36:32.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.571+0000 7f394f7fe700 1 -- 172.21.15.8:0/3750957424 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393c011570 con 0x7f3940004810 2023-10-06T04:36:32.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.571+0000 7f394f7fe700 1 -- 172.21.15.8:0/3750957424 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c011930 con 0x7f3940004810 2023-10-06T04:36:32.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.570+0000 7f9e59257700 1 -- 172.21.15.8:0/3542502919 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c0017f0 con 0x7f9e540c8eb0 2023-10-06T04:36:32.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.570+0000 7f9e59257700 1 -- 172.21.15.8:0/3542502919 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e50011420 con 0x7f9e540c8eb0 2023-10-06T04:36:32.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.570+0000 7f9e59257700 1 -- 172.21.15.8:0/3542502919 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e500117e0 con 0x7f9e540c8eb0 2023-10-06T04:36:32.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.571+0000 7fc31817c700 1 Processor -- start 2023-10-06T04:36:32.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.571+0000 7f48521f3700 1 -- 172.21.15.8:0/4068710495 >> v2:172.21.15.184:3300/0 conn(0x7f484c0cd060 msgr2=0x7f484c15e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:32.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.571+0000 7f48521f3700 1 --2- 172.21.15.8:0/4068710495 >> v2:172.21.15.184:3300/0 conn(0x7f484c0cd060 0x7f484c15e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.571+0000 7f48521f3700 1 -- 172.21.15.8:0/4068710495 >> v1:172.21.15.8:6789/0 conn(0x7f484c0cd430 legacy=0x7f484c159060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.571+0000 7f48509f0700 1 -- 172.21.15.8:0/4068710495 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 956373070 0 0) 0x7f48440014e0 con 0x7f484c0cd430 2023-10-06T04:36:32.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.571+0000 7f48521f3700 1 -- 172.21.15.8:0/4068710495 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f484c0b2a90 con 0x7f484c0b23f0 2023-10-06T04:36:32.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.571+0000 7ff0efc66700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff0e8156160 0x7ff0e80aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.571+0000 7f48521f3700 1 --2- 172.21.15.8:0/4068710495 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f484c0b23f0 0x7f484c0afff0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f48480099b0 tx=0x7f4848009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78fcd8be5c01e6ea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.571+0000 7f7536a3b700 1 Processor -- start 2023-10-06T04:36:32.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.571+0000 7ff0efc66700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e80b0ce0 con 0x7ff0e80af0c0 2023-10-06T04:36:32.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.571+0000 7ff0efc66700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e80b00d0 con 0x7ff0e806f590 2023-10-06T04:36:32.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.571+0000 7ff0efc66700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e80af560 con 0x7ff0e8156160 2023-10-06T04:36:32.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.571+0000 7f9e5c4bd700 1 -- 172.21.15.8:0/3542502919 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e540c8eb0 msgr2=0x7f9e54159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.571+0000 7f9e5c4bd700 1 --2- 172.21.15.8:0/3542502919 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e540c8eb0 0x7f9e54159a80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9e500098e0 tx=0x7f9e500091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.571+0000 7f7536a3b700 1 -- start start 2023-10-06T04:36:32.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.572+0000 7ff0ed201700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ff0e80af0c0 0x7ff0e806ee80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34618/0 (socket says 172.21.15.8:34618) 2023-10-06T04:36:32.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.572+0000 7ff0ed201700 1 -- 172.21.15.8:0/3825034087 learned_addr learned my addr 172.21.15.8:0/3825034087 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:32.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.572+0000 7f9e5c4bd700 1 -- 172.21.15.8:0/3542502919 shutdown_connections 2023-10-06T04:36:32.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.572+0000 7f9e5c4bd700 1 --2- 172.21.15.8:0/3542502919 >> v2:172.21.15.8:3300/0 conn(0x7f9e54159fc0 0x7f9e540692f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.572+0000 7f9e5c4bd700 1 --2- 172.21.15.8:0/3542502919 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e540c8eb0 0x7f9e54159a80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.572+0000 7f9e5c4bd700 1 -- 172.21.15.8:0/3542502919 >> 172.21.15.8:0/3542502919 conn(0x7f9e540ce200 msgr2=0x7f9e540ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:32.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.571+0000 7f48509f0700 1 -- 172.21.15.8:0/4068710495 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484800b860 con 0x7f484c0b23f0 2023-10-06T04:36:32.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.571+0000 7f48509f0700 1 -- 172.21.15.8:0/4068710495 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484800b9c0 con 0x7f484c0b23f0 2023-10-06T04:36:32.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.571+0000 7f48509f0700 1 -- 172.21.15.8:0/4068710495 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484800bd40 con 0x7f484c0b23f0 2023-10-06T04:36:32.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.572+0000 7ff0eda02700 1 --2- 172.21.15.8:0/3825034087 >> v2:172.21.15.184:3300/0 conn(0x7ff0e8156160 0x7ff0e80aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.572+0000 7ff0eca00700 1 -- 172.21.15.8:0/3825034087 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2178309545 0 0) 0x7ff0e80b0ce0 con 0x7ff0e80af0c0 2023-10-06T04:36:32.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.572+0000 7ff0eca00700 1 -- 172.21.15.8:0/3825034087 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0d4003570 con 0x7ff0e80af0c0 2023-10-06T04:36:32.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.571+0000 7fc31817c700 1 -- start start 2023-10-06T04:36:32.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.572+0000 7fc31817c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3100687c0 0x7fc310154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.572+0000 7fc31817c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3100ca490 0x7fc3101577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.572+0000 7fc31817c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3101561c0 0x7fc3100b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.572+0000 7fc31817c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc310155130 con 0x7fc3101561c0 2023-10-06T04:36:32.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.572+0000 7fc31817c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3100b06b0 con 0x7fc3100687c0 2023-10-06T04:36:32.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.572+0000 7fc31817c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3100b1230 con 0x7fc3100ca490 2023-10-06T04:36:32.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.572+0000 7fc316719700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3101561c0 0x7fc3100b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.572+0000 7fc315717700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3100ca490 0x7fc3101577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.572+0000 7f4853c56700 1 -- 172.21.15.8:0/4068710495 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f484c0b23f0 msgr2=0x7f484c0afff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.572+0000 7f4853c56700 1 --2- 172.21.15.8:0/4068710495 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f484c0b23f0 0x7f484c0afff0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f48480099b0 tx=0x7f4848009250 comp rx=0 tx=0).stop 2023-10-06T04:36:32.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.572+0000 7fc316719700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3101561c0 0x7fc3100b16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38496/0 (socket says 172.21.15.8:38496) 2023-10-06T04:36:32.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.572+0000 7fc316719700 1 -- 172.21.15.8:0/4036576494 learned_addr learned my addr 172.21.15.8:0/4036576494 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:32.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.572+0000 7fc315f18700 1 --2- 172.21.15.8:0/4036576494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3100687c0 0x7fc310154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.572+0000 7f9e5c4bd700 1 -- 172.21.15.8:0/3542502919 shutdown_connections 2023-10-06T04:36:32.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.572+0000 7f9e5c4bd700 1 -- 172.21.15.8:0/3542502919 wait complete. 2023-10-06T04:36:32.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.572+0000 7ff0eda02700 1 -- 172.21.15.8:0/3825034087 >> v1:172.21.15.184:6789/0 conn(0x7ff0e806f590 legacy=0x7ff0e8156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.572+0000 7ff0eda02700 1 -- 172.21.15.8:0/3825034087 >> v1:172.21.15.8:6789/0 conn(0x7ff0e80af0c0 legacy=0x7ff0e806ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.572+0000 7ff0eda02700 1 -- 172.21.15.8:0/3825034087 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e80b03b0 con 0x7ff0e8156160 2023-10-06T04:36:32.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.573+0000 7f7536a3b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75300ccb00 0x7f75301552a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.573+0000 7f7536a3b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f753006bbf0 0x7f75300c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.573+0000 7f7536a3b700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7530069b40 con 0x7f7530159120 2023-10-06T04:36:32.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.573+0000 7f7536a3b700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f753015a0a0 con 0x7f753006bbf0 2023-10-06T04:36:32.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.573+0000 7f7536a3b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7530159ae0 con 0x7f75300ccb00 2023-10-06T04:36:32.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.573+0000 7f4853c56700 1 -- 172.21.15.8:0/4068710495 shutdown_connections 2023-10-06T04:36:32.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.573+0000 7f4853c56700 1 --2- 172.21.15.8:0/4068710495 >> v2:172.21.15.184:3300/0 conn(0x7f484c0cd060 0x7f484c15e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.573+0000 7f4853c56700 1 --2- 172.21.15.8:0/4068710495 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f484c0b23f0 0x7f484c0afff0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.573+0000 7f4853c56700 1 -- 172.21.15.8:0/4068710495 >> 172.21.15.8:0/4068710495 conn(0x7f484c06ed00 msgr2=0x7f484c06f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:32.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.573+0000 7fc315717700 1 -- 172.21.15.8:0/4036576494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3100687c0 msgr2=0x7fc310154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.573+0000 7fc315717700 1 --2- 172.21.15.8:0/4036576494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3100687c0 0x7fc310154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.573+0000 7fc315717700 1 -- 172.21.15.8:0/4036576494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3101561c0 msgr2=0x7fc3100b16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.573+0000 7fc315717700 1 --2- 172.21.15.8:0/4036576494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3101561c0 0x7fc3100b16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.573+0000 7fc315717700 1 -- 172.21.15.8:0/4036576494 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc300009420 con 0x7fc3100ca490 2023-10-06T04:36:32.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.573+0000 7fc316719700 1 --2- 172.21.15.8:0/4036576494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3101561c0 0x7fc3100b16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:36:32.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.573+0000 7ff0eda02700 1 --2- 172.21.15.8:0/3825034087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0e8156160 0x7ff0e80aeb80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff0d80098e0 tx=0x7ff0d80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=549bd867b4cb2373 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.573+0000 7f7534fd8700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f753006bbf0 0x7f75300c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.573+0000 7f7534fd8700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f753006bbf0 0x7f75300c9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38506/0 (socket says 172.21.15.8:38506) 2023-10-06T04:36:32.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.573+0000 7f7534fd8700 1 -- 172.21.15.8:0/1920610535 learned_addr learned my addr 172.21.15.8:0/1920610535 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:32.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.573+0000 7ff0eca00700 1 -- 172.21.15.8:0/3825034087 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d800f6b0 con 0x7ff0e8156160 2023-10-06T04:36:32.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.573+0000 7fc315717700 1 --2- 172.21.15.8:0/4036576494 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3100ca490 0x7fc3101577a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc30c018000 tx=0x7fc30c01b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.573+0000 7f3956d70700 1 -- 172.21.15.8:0/3750957424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3940004810 msgr2=0x7f3940004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.573+0000 7f3956d70700 1 --2- 172.21.15.8:0/3750957424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3940004810 0x7f3940004c80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f39500acb40 tx=0x7f393c008040 comp rx=0 tx=0).stop 2023-10-06T04:36:32.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.573+0000 7ff0eca00700 1 -- 172.21.15.8:0/3825034087 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d800f810 con 0x7ff0e8156160 2023-10-06T04:36:32.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.573+0000 7ff0eca00700 1 -- 172.21.15.8:0/3825034087 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d800fb90 con 0x7ff0e8156160 2023-10-06T04:36:32.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.574+0000 7f395530d700 1 -- 172.21.15.8:0/3750957424 reap_dead start 2023-10-06T04:36:32.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.574+0000 7fc305ffb700 1 -- 172.21.15.8:0/4036576494 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c010470 con 0x7fc3100ca490 2023-10-06T04:36:32.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.574+0000 7fc305ffb700 1 -- 172.21.15.8:0/4036576494 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30c0105d0 con 0x7fc3100ca490 2023-10-06T04:36:32.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.574+0000 7fc305ffb700 1 -- 172.21.15.8:0/4036576494 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c010990 con 0x7fc3100ca490 2023-10-06T04:36:32.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.574+0000 7fc31817c700 1 -- 172.21.15.8:0/4036576494 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc30c00b6d0 con 0x7fc3100ca490 2023-10-06T04:36:32.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.574+0000 7f7534fd8700 1 -- 172.21.15.8:0/1920610535 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75300ccb00 msgr2=0x7f75301552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:32.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.574+0000 7f752ffff700 1 --2- 172.21.15.8:0/1920610535 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75300ccb00 0x7f75301552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.574+0000 7f7534fd8700 1 --2- 172.21.15.8:0/1920610535 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75300ccb00 0x7f75301552a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.574+0000 7f7534fd8700 1 -- 172.21.15.8:0/1920610535 >> v1:172.21.15.8:6789/0 conn(0x7f7530159120 legacy=0x7f753006b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:32.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.574+0000 7f3956d70700 1 -- 172.21.15.8:0/3750957424 shutdown_connections 2023-10-06T04:36:32.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.574+0000 7f3956d70700 1 -- 172.21.15.8:0/3750957424 >> 172.21.15.8:0/3750957424 conn(0x7f395006a770 msgr2=0x7f395006ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:32.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.574+0000 7fc31817c700 1 -- 172.21.15.8:0/4036576494 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3100b0be0 con 0x7fc3100ca490 2023-10-06T04:36:32.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.574+0000 7f7534fd8700 1 -- 172.21.15.8:0/1920610535 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7530159dc0 con 0x7f753006bbf0 2023-10-06T04:36:32.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.574+0000 7f3956d70700 1 -- 172.21.15.8:0/3750957424 shutdown_connections 2023-10-06T04:36:32.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.574+0000 7f4853c56700 1 -- 172.21.15.8:0/4068710495 shutdown_connections 2023-10-06T04:36:32.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.574+0000 7f4853c56700 1 -- 172.21.15.8:0/4068710495 wait complete. 2023-10-06T04:36:32.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.574+0000 7f752ffff700 1 --2- 172.21.15.8:0/1920610535 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75300ccb00 0x7f75301552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:36:32.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.574+0000 7f3956d70700 1 -- 172.21.15.8:0/3750957424 wait complete. 2023-10-06T04:36:32.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.574+0000 7f9e5c4bd700 1 Processor -- start 2023-10-06T04:36:32.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.575+0000 7ff0efc66700 1 -- 172.21.15.8:0/3825034087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0e8156160 msgr2=0x7ff0e80aeb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.575+0000 7ff0efc66700 1 --2- 172.21.15.8:0/3825034087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0e8156160 0x7ff0e80aeb80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff0d80098e0 tx=0x7ff0d80091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.575+0000 7ff0efc66700 1 -- 172.21.15.8:0/3825034087 shutdown_connections 2023-10-06T04:36:32.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.575+0000 7ff0efc66700 1 --2- 172.21.15.8:0/3825034087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0e8156160 0x7ff0e80aeb80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.575+0000 7ff0efc66700 1 -- 172.21.15.8:0/3825034087 >> 172.21.15.8:0/3825034087 conn(0x7ff0e806a770 msgr2=0x7ff0e806ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:32.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.575+0000 7ff0efc66700 1 -- 172.21.15.8:0/3825034087 shutdown_connections 2023-10-06T04:36:32.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.575+0000 7f9e5c4bd700 1 -- start start 2023-10-06T04:36:32.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.575+0000 7f3956d70700 1 Processor -- start 2023-10-06T04:36:32.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.576+0000 7f4853c56700 1 Processor -- start 2023-10-06T04:36:32.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.576+0000 7f4853c56700 1 -- start start 2023-10-06T04:36:32.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.576+0000 7f3956d70700 1 -- start start 2023-10-06T04:36:32.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.576+0000 7fc305ffb700 1 -- 172.21.15.8:0/4036576494 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc30c02d440 con 0x7fc3100ca490 2023-10-06T04:36:32.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.576+0000 7f9e5c4bd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e540c8eb0 0x7f9e54142ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.576+0000 7f9e5c4bd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e54153aa0 0x7f9e5415adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.576+0000 7f9e5c4bd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e54159fc0 0x7f9e540c0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.576+0000 7f9e5c4bd700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e54143010 con 0x7f9e54153aa0 2023-10-06T04:36:32.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.576+0000 7f9e5c4bd700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5415d8b0 con 0x7f9e54159fc0 2023-10-06T04:36:32.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.576+0000 7f9e5c4bd700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5415ca00 con 0x7f9e540c8eb0 2023-10-06T04:36:32.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.575+0000 7ff0efc66700 1 -- 172.21.15.8:0/3825034087 wait complete. 2023-10-06T04:36:32.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7ff0efc66700 1 Processor -- start 2023-10-06T04:36:32.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7fc305ffb700 1 --2- 172.21.15.8:0/4036576494 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc2f4066f30 0x7fc2f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7fc305ffb700 1 -- 172.21.15.8:0/4036576494 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fc30c020070 con 0x7fc3100ca490 2023-10-06T04:36:32.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7f4853c56700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f484c0b23f0 0x7f484c15a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7f4853c56700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f484c0cd060 0x7f484c0c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7f4853c56700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f484c0cd430 0x7f484c169ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7f4853c56700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484c0c7490 con 0x7f484c0cd060 2023-10-06T04:36:32.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7f4853c56700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484c0c76e0 con 0x7f484c0cd430 2023-10-06T04:36:32.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7f4853c56700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f484c0c79c0 con 0x7f484c0b23f0 2023-10-06T04:36:32.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7f48511f1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f484c0cd060 0x7f484c0c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7f48511f1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f484c0cd060 0x7f484c0c57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38530/0 (socket says 172.21.15.8:38530) 2023-10-06T04:36:32.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7f48511f1700 1 -- 172.21.15.8:0/388972830 learned_addr learned my addr 172.21.15.8:0/388972830 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:32.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7f2cd1c94700 1 Processor -- start 2023-10-06T04:36:32.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7f2cd1c94700 1 -- start start 2023-10-06T04:36:32.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.576+0000 7f3956d70700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3940004810 0x7f39501591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.576+0000 7f3956d70700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3950158530 0x7f3950143880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7f3956d70700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3950143dc0 0x7f3950156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7f3956d70700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3950144220 con 0x7f3950143dc0 2023-10-06T04:36:32.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7f3956d70700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3950157490 con 0x7f3940004810 2023-10-06T04:36:32.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7f3956d70700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3950157770 con 0x7f3950158530 2023-10-06T04:36:32.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7f3954b0c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3940004810 0x7f39501591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7f3954b0c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3940004810 0x7f39501591f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.8:35358/0 (socket says 172.21.15.8:35358) 2023-10-06T04:36:32.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7f3954b0c700 1 -- 172.21.15.8:0/952705623 learned_addr learned my addr 172.21.15.8:0/952705623 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:32.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7f395530d700 1 --2- 172.21.15.8:0/952705623 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3950143dc0 0x7f3950156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7f394ffff700 1 --2- 172.21.15.8:0/952705623 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3950158530 0x7f3950143880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7f48521f3700 1 --2- 172.21.15.8:0/388972830 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f484c0cd430 0x7f484c169ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7f7534fd8700 1 --2- 172.21.15.8:0/1920610535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f753006bbf0 0x7f75300c9bc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7528009f20 tx=0x7f7528009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c054ffc29775cb7f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7fc315f18700 1 --2- 172.21.15.8:0/4036576494 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc2f4066f30 0x7fc2f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7f48519f2700 1 --2- 172.21.15.8:0/388972830 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f484c0b23f0 0x7f484c15a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7f3954b0c700 1 -- 172.21.15.8:0/952705623 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3950158530 msgr2=0x7f3950143880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7f3954b0c700 1 --2- 172.21.15.8:0/952705623 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3950158530 0x7f3950143880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7f3954b0c700 1 -- 172.21.15.8:0/952705623 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3950143dc0 msgr2=0x7f3950156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7f3954b0c700 1 --2- 172.21.15.8:0/952705623 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3950143dc0 0x7f3950156760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7f3954b0c700 1 -- 172.21.15.8:0/952705623 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3950157a50 con 0x7f3940004810 2023-10-06T04:36:32.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7f48521f3700 1 -- 172.21.15.8:0/388972830 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f484c0b23f0 msgr2=0x7f484c15a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7f48521f3700 1 --2- 172.21.15.8:0/388972830 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f484c0b23f0 0x7f484c15a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7f48521f3700 1 -- 172.21.15.8:0/388972830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f484c0cd060 msgr2=0x7f484c0c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7f48521f3700 1 --2- 172.21.15.8:0/388972830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f484c0cd060 0x7f484c0c57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7f48521f3700 1 -- 172.21.15.8:0/388972830 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48480094f0 con 0x7f484c0cd430 2023-10-06T04:36:32.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7f752effd700 1 -- 172.21.15.8:0/1920610535 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752800e070 con 0x7f753006bbf0 2023-10-06T04:36:32.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7f48519f2700 1 --2- 172.21.15.8:0/388972830 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f484c0b23f0 0x7f484c15a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:32.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7ff0efc66700 1 -- start start 2023-10-06T04:36:32.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7ff0efc66700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0e806f590 0x7ff0e80cd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7ff0efc66700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0e80af0c0 0x7ff0e8171740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7ff0efc66700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff0e8156160 0x7ff0e81499a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7ff0efc66700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e80cc3b0 con 0x7ff0e80af0c0 2023-10-06T04:36:32.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7ff0efc66700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e80cc690 con 0x7ff0e806f590 2023-10-06T04:36:32.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7ff0efc66700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e80cc970 con 0x7ff0e8156160 2023-10-06T04:36:32.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7fc31817c700 1 --2- 172.21.15.8:0/4036576494 >> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] conn(0x7fc2f00015f0 0x7fc2f0003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7fc31817c700 1 -- 172.21.15.8:0/4036576494 --> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc2f0006b90 con 0x7fc2f00015f0 2023-10-06T04:36:32.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7f48521f3700 1 --2- 172.21.15.8:0/388972830 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f484c0cd430 0x7f484c169ae0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f484c089530 tx=0x7f4848017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7fc316719700 1 --2- 172.21.15.8:0/4036576494 >> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] conn(0x7fc2f00015f0 0x7fc2f0003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7ff0eda02700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0e806f590 0x7ff0e80cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7ff0eda02700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0e806f590 0x7ff0e80cd450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.8:35374/0 (socket says 172.21.15.8:35374) 2023-10-06T04:36:32.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7ff0eda02700 1 -- 172.21.15.8:0/961651316 learned_addr learned my addr 172.21.15.8:0/961651316 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:32.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7ff0ee203700 1 --2- 172.21.15.8:0/961651316 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff0e8156160 0x7ff0e81499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7f2cd1c94700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ccc1470b0 0x7f2ccc15df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7f2cd1c94700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2ccc0c6d40 0x7f2ccc0c0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7f2cd1c94700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ccc0cb160 con 0x7f2ccc0ca050 2023-10-06T04:36:32.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7f2cd1c94700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ccc0ca550 con 0x7f2ccc0c6d40 2023-10-06T04:36:32.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7f2cd1c94700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ccc0ca830 con 0x7f2ccc1470b0 2023-10-06T04:36:32.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.579+0000 7f3954b0c700 1 --2- 172.21.15.8:0/952705623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3940004810 0x7f39501591f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3944001240 tx=0x7f3944001e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.579+0000 7f4841ffb700 1 -- 172.21.15.8:0/388972830 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484801a640 con 0x7f484c0cd430 2023-10-06T04:36:32.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.579+0000 7f4841ffb700 1 -- 172.21.15.8:0/388972830 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484801f070 con 0x7f484c0cd430 2023-10-06T04:36:32.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.579+0000 7f4841ffb700 1 -- 172.21.15.8:0/388972830 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484801a9f0 con 0x7f484c0cd430 2023-10-06T04:36:32.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.579+0000 7ff0eda02700 1 -- 172.21.15.8:0/961651316 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff0e8156160 msgr2=0x7ff0e81499a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.579+0000 7fc315f18700 1 --2- 172.21.15.8:0/4036576494 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc2f4066f30 0x7fc2f40693e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc300009ea0 tx=0x7fc3000091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.579+0000 7ff0eda02700 1 --2- 172.21.15.8:0/961651316 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff0e8156160 0x7ff0e81499a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.579+0000 7ff0eda02700 1 -- 172.21.15.8:0/961651316 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0e80af0c0 msgr2=0x7ff0e8171740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.579+0000 7ff0eda02700 1 --2- 172.21.15.8:0/961651316 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0e80af0c0 0x7ff0e8171740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.579+0000 7ff0eda02700 1 -- 172.21.15.8:0/961651316 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d8009420 con 0x7ff0e806f590 2023-10-06T04:36:32.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7f752effd700 1 -- 172.21.15.8:0/1920610535 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752800ba40 con 0x7f753006bbf0 2023-10-06T04:36:32.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7f752effd700 1 -- 172.21.15.8:0/1920610535 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75280092e0 con 0x7f753006bbf0 2023-10-06T04:36:32.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.579+0000 7f7536a3b700 1 -- 172.21.15.8:0/1920610535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f753006bbf0 msgr2=0x7f75300c9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.579+0000 7f7536a3b700 1 --2- 172.21.15.8:0/1920610535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f753006bbf0 0x7f75300c9bc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7528009f20 tx=0x7f7528009840 comp rx=0 tx=0).stop 2023-10-06T04:36:32.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.579+0000 7f2ccb7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ccc1470b0 0x7f2ccc15df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.579+0000 7f394cff9700 1 -- 172.21.15.8:0/952705623 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3944018030 con 0x7f3940004810 2023-10-06T04:36:32.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.579+0000 7f394cff9700 1 -- 172.21.15.8:0/952705623 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f394400fa50 con 0x7f3940004810 2023-10-06T04:36:32.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.579+0000 7f3956d70700 1 -- 172.21.15.8:0/952705623 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3950157d30 con 0x7f3940004810 2023-10-06T04:36:32.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.579+0000 7f3956d70700 1 -- 172.21.15.8:0/952705623 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3950159730 con 0x7f3940004810 2023-10-06T04:36:32.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.579+0000 7ff0ee203700 1 --2- 172.21.15.8:0/961651316 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff0e8156160 0x7ff0e81499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:36:32.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.579+0000 7ff0eda02700 1 --2- 172.21.15.8:0/961651316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0e806f590 0x7ff0e80cd450 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff0e806c080 tx=0x7ff0d8019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.579+0000 7ff0ddffb700 1 -- 172.21.15.8:0/961651316 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d801d040 con 0x7ff0e806f590 2023-10-06T04:36:32.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.579+0000 7f2ccaffd700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f2ccc0ca050 0x7f2ccc0c6630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34630/0 (socket says 172.21.15.8:34630) 2023-10-06T04:36:32.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.579+0000 7f2ccaffd700 1 -- 172.21.15.8:0/2202477472 learned_addr learned my addr 172.21.15.8:0/2202477472 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:32.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.579+0000 7ff0efc66700 1 -- 172.21.15.8:0/961651316 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e80ccc50 con 0x7ff0e806f590 2023-10-06T04:36:32.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.579+0000 7f7536a3b700 1 -- 172.21.15.8:0/1920610535 shutdown_connections 2023-10-06T04:36:32.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.579+0000 7f7536a3b700 1 --2- 172.21.15.8:0/1920610535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f753006bbf0 0x7f75300c9bc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.579+0000 7f7536a3b700 1 --2- 172.21.15.8:0/1920610535 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75300ccb00 0x7f75301552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.579+0000 7f7536a3b700 1 -- 172.21.15.8:0/1920610535 >> 172.21.15.8:0/1920610535 conn(0x7f75300cbff0 msgr2=0x7f75300cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:32.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.580+0000 7ff0efc66700 1 -- 172.21.15.8:0/961651316 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e8171c80 con 0x7ff0e806f590 2023-10-06T04:36:32.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.580+0000 7f7536a3b700 1 -- 172.21.15.8:0/1920610535 shutdown_connections 2023-10-06T04:36:32.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.580+0000 7fc316719700 1 --2- 172.21.15.8:0/4036576494 >> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] conn(0x7fc2f00015f0 0x7fc2f0003aa0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.580+0000 7f2ccb7fe700 1 -- 172.21.15.8:0/2202477472 >> v2:172.21.15.184:3300/0 conn(0x7f2ccc0c6d40 msgr2=0x7f2ccc0c0d90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T04:36:32.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.580+0000 7f2ccb7fe700 1 --2- 172.21.15.8:0/2202477472 >> v2:172.21.15.184:3300/0 conn(0x7f2ccc0c6d40 0x7f2ccc0c0d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.580+0000 7f2ccb7fe700 1 -- 172.21.15.8:0/2202477472 >> v1:172.21.15.8:6789/0 conn(0x7f2ccc0ca050 legacy=0x7f2ccc0c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:32.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.580+0000 7f2ccb7fe700 1 -- 172.21.15.8:0/2202477472 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ccc0cab10 con 0x7f2ccc1470b0 2023-10-06T04:36:32.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.579+0000 7f394cff9700 1 -- 172.21.15.8:0/952705623 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394400fe10 con 0x7f3940004810 2023-10-06T04:36:32.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.580+0000 7f3956d70700 1 -- 172.21.15.8:0/952705623 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3930000fd0 con 0x7f3940004810 2023-10-06T04:36:32.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.580+0000 7f2ccb7fe700 1 --2- 172.21.15.8:0/2202477472 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ccc1470b0 0x7f2ccc15df20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc0098e0 tx=0x7f2cbc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0e4dc299ed49951 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.580+0000 7ff0ddffb700 1 -- 172.21.15.8:0/961651316 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d8000c90 con 0x7ff0e806f590 2023-10-06T04:36:32.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.580+0000 7ff0ddffb700 1 -- 172.21.15.8:0/961651316 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d800fb90 con 0x7ff0e806f590 2023-10-06T04:36:32.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.580+0000 7ff0efc66700 1 -- 172.21.15.8:0/961651316 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff0e80cc800 con 0x7ff0e806f590 2023-10-06T04:36:32.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7f9e5aa5a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e54159fc0 0x7f9e540c0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7f9e5aa5a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e54159fc0 0x7f9e540c0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.8:35356/0 (socket says 172.21.15.8:35356) 2023-10-06T04:36:32.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7f9e5aa5a700 1 -- 172.21.15.8:0/2622130648 learned_addr learned my addr 172.21.15.8:0/2622130648 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:32.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7f9e5a259700 1 --2- 172.21.15.8:0/2622130648 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e540c8eb0 0x7f9e54142ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7f9e59a58700 1 --2- 172.21.15.8:0/2622130648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e54153aa0 0x7f9e5415adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7f9e5a259700 1 -- 172.21.15.8:0/2622130648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e54159fc0 msgr2=0x7f9e540c0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7f9e5a259700 1 --2- 172.21.15.8:0/2622130648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e54159fc0 0x7f9e540c0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7f9e5a259700 1 -- 172.21.15.8:0/2622130648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e54153aa0 msgr2=0x7f9e5415adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7f9e5a259700 1 --2- 172.21.15.8:0/2622130648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e54153aa0 0x7f9e5415adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7f9e5a259700 1 -- 172.21.15.8:0/2622130648 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e50009420 con 0x7f9e540c8eb0 2023-10-06T04:36:32.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.577+0000 7f9e5aa5a700 1 --2- 172.21.15.8:0/2622130648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e54159fc0 0x7f9e540c0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:36:32.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7f9e5a259700 1 --2- 172.21.15.8:0/2622130648 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e540c8eb0 0x7f9e54142ad0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c001920 tx=0x7f9e4c007da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7f9e4a7fc700 1 -- 172.21.15.8:0/2622130648 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c004bb0 con 0x7f9e540c8eb0 2023-10-06T04:36:32.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7f9e4a7fc700 1 -- 172.21.15.8:0/2622130648 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4c029070 con 0x7f9e540c8eb0 2023-10-06T04:36:32.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.578+0000 7f9e4a7fc700 1 -- 172.21.15.8:0/2622130648 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c014080 con 0x7f9e540c8eb0 2023-10-06T04:36:32.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.581+0000 7f9e5c4bd700 1 -- 172.21.15.8:0/2622130648 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e5415cca0 con 0x7f9e540c8eb0 2023-10-06T04:36:32.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.581+0000 7f9e5c4bd700 1 -- 172.21.15.8:0/2622130648 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e5415d260 con 0x7f9e540c8eb0 2023-10-06T04:36:32.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.581+0000 7f394cff9700 1 -- 172.21.15.8:0/952705623 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f394401b070 con 0x7f3940004810 2023-10-06T04:36:32.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.581+0000 7f2cca7fc700 1 -- 172.21.15.8:0/2202477472 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc009e80 con 0x7f2ccc1470b0 2023-10-06T04:36:32.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.581+0000 7f2cca7fc700 1 -- 172.21.15.8:0/2202477472 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cbc00b820 con 0x7f2ccc1470b0 2023-10-06T04:36:32.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.581+0000 7f2cca7fc700 1 -- 172.21.15.8:0/2202477472 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc00bbe0 con 0x7f2ccc1470b0 2023-10-06T04:36:32.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.580+0000 7f7536a3b700 1 -- 172.21.15.8:0/1920610535 wait complete. 2023-10-06T04:36:32.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.581+0000 7f7536a3b700 1 Processor -- start 2023-10-06T04:36:32.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.581+0000 7f4853c56700 1 -- 172.21.15.8:0/388972830 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f484c0c7ca0 con 0x7f484c0cd430 2023-10-06T04:36:32.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.581+0000 7f4853c56700 1 -- 172.21.15.8:0/388972830 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f484c15a800 con 0x7f484c0cd430 2023-10-06T04:36:32.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.582+0000 7f4853c56700 1 -- 172.21.15.8:0/388972830 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f484c0646e0 con 0x7f484c0cd430 2023-10-06T04:36:32.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.582+0000 7f2cd1c94700 1 -- 172.21.15.8:0/2202477472 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ccc1470b0 msgr2=0x7f2ccc15df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.582+0000 7f2cd1c94700 1 --2- 172.21.15.8:0/2202477472 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ccc1470b0 0x7f2ccc15df20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc0098e0 tx=0x7f2cbc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.582+0000 7fc305ffb700 1 -- 172.21.15.8:0/4036576494 <== osd.2 v2:172.21.15.8:6800/90670 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fc2f0006b90 con 0x7fc2f00015f0 2023-10-06T04:36:32.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.582+0000 7f2cd1c94700 1 -- 172.21.15.8:0/2202477472 shutdown_connections 2023-10-06T04:36:32.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.582+0000 7f2cd1c94700 1 --2- 172.21.15.8:0/2202477472 >> v2:172.21.15.184:3300/0 conn(0x7f2ccc0c6d40 0x7f2ccc0c0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.582+0000 7f2cd1c94700 1 --2- 172.21.15.8:0/2202477472 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ccc1470b0 0x7f2ccc15df20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.582+0000 7f2cd1c94700 1 -- 172.21.15.8:0/2202477472 >> 172.21.15.8:0/2202477472 conn(0x7f2ccc0680a0 msgr2=0x7f2ccc0cbff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:32.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.582+0000 7f394cff9700 1 --2- 172.21.15.8:0/952705623 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3934067000 0x7f39340694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.582+0000 7f394cff9700 1 -- 172.21.15.8:0/952705623 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f3944019070 con 0x7f3940004810 2023-10-06T04:36:32.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.582+0000 7f394cff9700 1 --2- 172.21.15.8:0/952705623 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x7f3934070cd0 0x7f3934073100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.582+0000 7f394cff9700 1 -- 172.21.15.8:0/952705623 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f39340737d0 con 0x7f3934070cd0 2023-10-06T04:36:32.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.582+0000 7f394cff9700 1 -- 172.21.15.8:0/952705623 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3944085670 con 0x7f3940004810 2023-10-06T04:36:32.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.582+0000 7f395530d700 1 --2- 172.21.15.8:0/952705623 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x7f3934070cd0 0x7f3934073100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.582+0000 7f7536a3b700 1 -- start start 2023-10-06T04:36:32.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.583+0000 7f9e5c4bd700 1 -- 172.21.15.8:0/2622130648 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9e54071550 con 0x7f9e540c8eb0 2023-10-06T04:36:32.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.583+0000 7f7536a3b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f753006bbf0 0x7f75301758c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.583+0000 7f7536a3b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75300ccb00 0x7f75300b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.583+0000 7f7536a3b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7530159120 0x7f7530150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.583+0000 7f7536a3b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75301500d0 con 0x7f75300ccb00 2023-10-06T04:36:32.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.583+0000 7f7536a3b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75300b15c0 con 0x7f7530159120 2023-10-06T04:36:32.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.583+0000 7f7536a3b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f753014f310 con 0x7f753006bbf0 2023-10-06T04:36:32.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.583+0000 7f7534fd8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7530159120 0x7f7530150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.583+0000 7f752f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75300ccb00 0x7f75300b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.583+0000 7f394ffff700 1 --2- 172.21.15.8:0/952705623 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3934067000 0x7f39340694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.583+0000 7f7534fd8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7530159120 0x7f7530150b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.8:35402/0 (socket says 172.21.15.8:35402) 2023-10-06T04:36:32.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.583+0000 7f7534fd8700 1 -- 172.21.15.8:0/34829461 learned_addr learned my addr 172.21.15.8:0/34829461 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:32.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.583+0000 7f4841ffb700 1 -- 172.21.15.8:0/388972830 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4848026480 con 0x7f484c0cd430 2023-10-06T04:36:32.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.582+0000 7ff0ddffb700 1 -- 172.21.15.8:0/961651316 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff0d802c430 con 0x7ff0e806f590 2023-10-06T04:36:32.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.583+0000 7ff0ddffb700 1 --2- 172.21.15.8:0/961651316 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff0cc066f30 0x7ff0cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.583+0000 7ff0ddffb700 1 -- 172.21.15.8:0/961651316 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff0d8014070 con 0x7ff0e806f590 2023-10-06T04:36:32.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.583+0000 7ff0ddffb700 1 --2- 172.21.15.8:0/961651316 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x7ff0cc070b80 0x7ff0cc072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.583+0000 7ff0ddffb700 1 -- 172.21.15.8:0/961651316 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff0cc073680 con 0x7ff0cc070b80 2023-10-06T04:36:32.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.583+0000 7ff0ddffb700 1 -- 172.21.15.8:0/961651316 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff0d80864f0 con 0x7ff0e806f590 2023-10-06T04:36:32.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.584+0000 7f4841ffb700 1 --2- 172.21.15.8:0/388972830 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4830067000 0x7f48300694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.584+0000 7f752f7fe700 1 -- 172.21.15.8:0/34829461 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f753006bbf0 msgr2=0x7f75301758c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.584+0000 7f752f7fe700 1 --2- 172.21.15.8:0/34829461 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f753006bbf0 0x7f75301758c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.584+0000 7f752f7fe700 1 -- 172.21.15.8:0/34829461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7530159120 msgr2=0x7f7530150b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.584+0000 7f752f7fe700 1 --2- 172.21.15.8:0/34829461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7530159120 0x7f7530150b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.584+0000 7f752f7fe700 1 -- 172.21.15.8:0/34829461 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7528009ae0 con 0x7f75300ccb00 2023-10-06T04:36:32.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.584+0000 7f394ffff700 1 --2- 172.21.15.8:0/952705623 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3934067000 0x7f39340694b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f39500acb40 tx=0x7f393c019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.584+0000 7f752f7fe700 1 --2- 172.21.15.8:0/34829461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75300ccb00 0x7f75300b0be0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f752000b4c0 tx=0x7f7520009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.584+0000 7f4841ffb700 1 -- 172.21.15.8:0/388972830 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4848021070 con 0x7f484c0cd430 2023-10-06T04:36:32.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.584+0000 7f48519f2700 1 --2- 172.21.15.8:0/388972830 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4830067000 0x7f48300694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.584+0000 7f4841ffb700 1 --2- 172.21.15.8:0/388972830 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x7f4830070c50 0x7f4830073080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.584+0000 7f4841ffb700 1 -- 172.21.15.8:0/388972830 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4830073750 con 0x7f4830070c50 2023-10-06T04:36:32.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.584+0000 7f4841ffb700 1 -- 172.21.15.8:0/388972830 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4848053730 con 0x7f484c0cd430 2023-10-06T04:36:32.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.584+0000 7f395530d700 1 --2- 172.21.15.8:0/952705623 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x7f3934070cd0 0x7f3934073100 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.584+0000 7f48511f1700 1 --2- 172.21.15.8:0/388972830 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x7f4830070c50 0x7f4830073080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.584+0000 7f7517fff700 1 -- 172.21.15.8:0/34829461 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752000f510 con 0x7f75300ccb00 2023-10-06T04:36:32.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.584+0000 7f9e4a7fc700 1 -- 172.21.15.8:0/2622130648 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e4c00f070 con 0x7f9e540c8eb0 2023-10-06T04:36:32.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.584+0000 7f9e4a7fc700 1 --2- 172.21.15.8:0/2622130648 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9e38067080 0x7f9e38069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.584+0000 7f9e4a7fc700 1 -- 172.21.15.8:0/2622130648 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9e4c094c70 con 0x7f9e540c8eb0 2023-10-06T04:36:32.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.584+0000 7f9e59a58700 1 --2- 172.21.15.8:0/2622130648 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9e38067080 0x7f9e38069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.584+0000 7f9e4a7fc700 1 --2- 172.21.15.8:0/2622130648 >> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] conn(0x7f9e38070d50 0x7f9e38073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.584+0000 7f9e4a7fc700 1 -- 172.21.15.8:0/2622130648 --> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9e38073850 con 0x7f9e38070d50 2023-10-06T04:36:32.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.584+0000 7f9e4a7fc700 1 -- 172.21.15.8:0/2622130648 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e4c097210 con 0x7f9e540c8eb0 2023-10-06T04:36:32.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.585+0000 7f2cd1c94700 1 -- 172.21.15.8:0/2202477472 shutdown_connections 2023-10-06T04:36:32.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.584+0000 7f7536a3b700 1 -- 172.21.15.8:0/34829461 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f753014f5f0 con 0x7f75300ccb00 2023-10-06T04:36:32.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.585+0000 7f7536a3b700 1 -- 172.21.15.8:0/34829461 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f753014fbb0 con 0x7f75300ccb00 2023-10-06T04:36:32.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.585+0000 7f2cd1c94700 1 -- 172.21.15.8:0/2202477472 wait complete. 2023-10-06T04:36:32.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.585+0000 7ff0ed201700 1 --2- 172.21.15.8:0/961651316 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff0cc066f30 0x7ff0cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.585+0000 7f9e5aa5a700 1 --2- 172.21.15.8:0/2622130648 >> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] conn(0x7f9e38070d50 0x7f9e38073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.585+0000 7f48519f2700 1 --2- 172.21.15.8:0/388972830 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4830067000 0x7f48300694b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f483c009b10 tx=0x7f483c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.585+0000 7ff0ed201700 1 --2- 172.21.15.8:0/961651316 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff0cc066f30 0x7ff0cc0693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff0e40058d0 tx=0x7ff0e40079d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.586+0000 7f9e59a58700 1 --2- 172.21.15.8:0/2622130648 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9e38067080 0x7f9e38069530 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9e500098e0 tx=0x7f9e50017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.586+0000 7f9e5aa5a700 1 --2- 172.21.15.8:0/2622130648 >> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] conn(0x7f9e38070d50 0x7f9e38073180 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.586+0000 7f394cff9700 1 -- 172.21.15.8:0/952705623 <== osd.3 v2:172.21.15.8:6823/90671 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f39340737d0 con 0x7f3934070cd0 2023-10-06T04:36:32.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.585+0000 7f7517fff700 1 -- 172.21.15.8:0/34829461 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752000f670 con 0x7f75300ccb00 2023-10-06T04:36:32.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.585+0000 7f7517fff700 1 -- 172.21.15.8:0/34829461 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752000fa30 con 0x7f75300ccb00 2023-10-06T04:36:32.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.586+0000 7f48511f1700 1 --2- 172.21.15.8:0/388972830 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x7f4830070c50 0x7f4830073080 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.586+0000 7f7517fff700 1 -- 172.21.15.8:0/34829461 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f752001a400 con 0x7f75300ccb00 2023-10-06T04:36:32.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.586+0000 7fb33c195700 1 Processor -- start 2023-10-06T04:36:32.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.587+0000 7f9e4a7fc700 1 -- 172.21.15.8:0/2622130648 <== osd.1 v2:172.21.15.8:6816/90669 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f9e38073850 con 0x7f9e38070d50 2023-10-06T04:36:32.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.587+0000 7fb33c195700 1 -- start start 2023-10-06T04:36:32.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.587+0000 7f2cd1c94700 1 Processor -- start 2023-10-06T04:36:32.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.587+0000 7f7517fff700 1 --2- 172.21.15.8:0/34829461 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f751c066f30 0x7f751c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.587+0000 7f7517fff700 1 -- 172.21.15.8:0/34829461 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f75200843b0 con 0x7f75300ccb00 2023-10-06T04:36:32.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.587+0000 7f752ffff700 1 --2- 172.21.15.8:0/34829461 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f751c066f30 0x7f751c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.587+0000 7f2cd1c94700 1 -- start start 2023-10-06T04:36:32.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.587+0000 7f4841ffb700 1 -- 172.21.15.8:0/388972830 <== osd.4 v2:172.21.15.184:6800/90868 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f4830073750 con 0x7f4830070c50 2023-10-06T04:36:32.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.588+0000 7f2cd1c94700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ccc0c6d40 0x7f2ccc06d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.588+0000 7f2cd1c94700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ccc0ca050 0x7f2ccc142610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.588+0000 7f2cd1c94700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ccc1470b0 0x7f2ccc142b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.588+0000 7f2cd1c94700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ccc0c5780 con 0x7f2ccc0c6d40 2023-10-06T04:36:32.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.588+0000 7f2cd1c94700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ccc0c4b70 con 0x7f2ccc1470b0 2023-10-06T04:36:32.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.588+0000 7f2cd1c94700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ccc0c4e50 con 0x7f2ccc0ca050 2023-10-06T04:36:32.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.588+0000 7f2ccb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ccc0c6d40 0x7f2ccc06d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.588+0000 7f2ccb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ccc0c6d40 0x7f2ccc06d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38556/0 (socket says 172.21.15.8:38556) 2023-10-06T04:36:32.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.588+0000 7f2ccb7fe700 1 -- 172.21.15.8:0/3782227591 learned_addr learned my addr 172.21.15.8:0/3782227591 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:32.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.588+0000 7f752ffff700 1 --2- 172.21.15.8:0/34829461 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f751c066f30 0x7f751c0693e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7524007aa0 tx=0x7f7524008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.588+0000 7fb33c195700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb3340ae080 0x7fb334069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.588+0000 7fb33c195700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb33415b5d0 0x7fb33406d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.588+0000 7fb33c195700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3340cb310 con 0x7fb33415bbc0 2023-10-06T04:36:32.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.588+0000 7fb33c195700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3340ca700 con 0x7fb3340ae080 2023-10-06T04:36:32.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.588+0000 7fb33c195700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3340ca9e0 con 0x7fb33415b5d0 2023-10-06T04:36:32.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.588+0000 7f2ccb7fe700 1 -- 172.21.15.8:0/3782227591 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ccc0ca050 msgr2=0x7f2ccc142610 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:36:32.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.588+0000 7f2ccb7fe700 1 --2- 172.21.15.8:0/3782227591 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ccc0ca050 0x7f2ccc142610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.588+0000 7f2ccb7fe700 1 -- 172.21.15.8:0/3782227591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ccc1470b0 msgr2=0x7f2ccc142b50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:36:32.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.588+0000 7f2ccb7fe700 1 --2- 172.21.15.8:0/3782227591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ccc1470b0 0x7f2ccc142b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.588+0000 7f2ccb7fe700 1 -- 172.21.15.8:0/3782227591 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cbc009420 con 0x7f2ccc0c6d40 2023-10-06T04:36:32.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.588+0000 7fb339730700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fb33415bbc0 0x7fb33415aec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.8:49002/0 (socket says 172.21.15.8:49002) 2023-10-06T04:36:32.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.588+0000 7fb339730700 1 -- 172.21.15.8:0/4148545722 learned_addr learned my addr 172.21.15.8:0/4148545722 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:32.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.588+0000 7fb339f31700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb3340ae080 0x7fb334069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.588+0000 7fb33a732700 1 --2- 172.21.15.8:0/4148545722 >> v2:172.21.15.184:3300/0 conn(0x7fb33415b5d0 0x7fb33406d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.589+0000 7f2ccb7fe700 1 --2- 172.21.15.8:0/3782227591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ccc0c6d40 0x7f2ccc06d550 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc002000 tx=0x7f2cbc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.589+0000 7fb339f31700 1 -- 172.21.15.8:0/4148545722 >> v2:172.21.15.184:3300/0 conn(0x7fb33415b5d0 msgr2=0x7fb33406d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:32.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.589+0000 7fb339f31700 1 --2- 172.21.15.8:0/4148545722 >> v2:172.21.15.184:3300/0 conn(0x7fb33415b5d0 0x7fb33406d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.589+0000 7fb339f31700 1 -- 172.21.15.8:0/4148545722 >> v1:172.21.15.184:6789/0 conn(0x7fb33415bbc0 legacy=0x7fb33415aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.589+0000 7fb338f2f700 1 -- 172.21.15.8:0/4148545722 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 596438081 0 0) 0x7fb3340cb310 con 0x7fb33415bbc0 2023-10-06T04:36:32.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.589+0000 7fb339f31700 1 -- 172.21.15.8:0/4148545722 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3340cacc0 con 0x7fb3340ae080 2023-10-06T04:36:32.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.589+0000 7fb339f31700 1 --2- 172.21.15.8:0/4148545722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3340ae080 0x7fb334069dd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb3340cb280 tx=0x7fb3240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f93671b6e98e50 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.589+0000 7fb338f2f700 1 -- 172.21.15.8:0/4148545722 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb324011630 con 0x7fb3340ae080 2023-10-06T04:36:32.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.589+0000 7fb338f2f700 1 -- 172.21.15.8:0/4148545722 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb324011790 con 0x7fb3340ae080 2023-10-06T04:36:32.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.589+0000 7fb338f2f700 1 -- 172.21.15.8:0/4148545722 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb324011b30 con 0x7fb3340ae080 2023-10-06T04:36:32.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.590+0000 7fb33c195700 1 -- 172.21.15.8:0/4148545722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3340ae080 msgr2=0x7fb334069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.590+0000 7fb33c195700 1 --2- 172.21.15.8:0/4148545722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3340ae080 0x7fb334069dd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb3340cb280 tx=0x7fb3240091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.590+0000 7fb33c195700 1 -- 172.21.15.8:0/4148545722 shutdown_connections 2023-10-06T04:36:32.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.590+0000 7fb33c195700 1 --2- 172.21.15.8:0/4148545722 >> v2:172.21.15.184:3300/0 conn(0x7fb33415b5d0 0x7fb33406d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.590+0000 7fb33c195700 1 --2- 172.21.15.8:0/4148545722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3340ae080 0x7fb334069dd0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.590+0000 7fb33c195700 1 -- 172.21.15.8:0/4148545722 >> 172.21.15.8:0/4148545722 conn(0x7fb3340cbff0 msgr2=0x7fb3340cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:32.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.591+0000 7fb33c195700 1 -- 172.21.15.8:0/4148545722 shutdown_connections 2023-10-06T04:36:32.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.591+0000 7fb33c195700 1 -- 172.21.15.8:0/4148545722 wait complete. 2023-10-06T04:36:32.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.591+0000 7f2cb37fe700 1 -- 172.21.15.8:0/3782227591 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc01c460 con 0x7f2ccc0c6d40 2023-10-06T04:36:32.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.591+0000 7f2cb37fe700 1 -- 172.21.15.8:0/3782227591 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cbc01c600 con 0x7f2ccc0c6d40 2023-10-06T04:36:32.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.591+0000 7f2cb37fe700 1 -- 172.21.15.8:0/3782227591 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc01c9c0 con 0x7f2ccc0c6d40 2023-10-06T04:36:32.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.591+0000 7f2cd1c94700 1 -- 172.21.15.8:0/3782227591 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ccc0c5130 con 0x7f2ccc0c6d40 2023-10-06T04:36:32.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.591+0000 7f2cd1c94700 1 -- 172.21.15.8:0/3782227591 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ccc06da90 con 0x7f2ccc0c6d40 2023-10-06T04:36:32.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.592+0000 7f2cd1c94700 1 -- 172.21.15.8:0/3782227591 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2ccc06dce0 con 0x7f2ccc0c6d40 2023-10-06T04:36:32.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.592+0000 7fb33c195700 1 Processor -- start 2023-10-06T04:36:32.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.592+0000 7f2cb37fe700 1 -- 172.21.15.8:0/3782227591 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2cbc01a450 con 0x7f2ccc0c6d40 2023-10-06T04:36:32.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.592+0000 7fb33c195700 1 -- start start 2023-10-06T04:36:32.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.593+0000 7ff0ee203700 1 --2- 172.21.15.8:0/961651316 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x7ff0cc070b80 0x7ff0cc072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.593+0000 7f2cb37fe700 1 --2- 172.21.15.8:0/3782227591 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2cb8067000 0x7f2cb80694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.593+0000 7f2cb37fe700 1 -- 172.21.15.8:0/3782227591 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f2cbc086ed0 con 0x7f2ccc0c6d40 2023-10-06T04:36:32.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.593+0000 7f2cb37fe700 1 --2- 172.21.15.8:0/3782227591 >> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] conn(0x7f2cb8070cd0 0x7f2cb8073100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.593+0000 7f2cb37fe700 1 -- 172.21.15.8:0/3782227591 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2cb80737d0 con 0x7f2cb8070cd0 2023-10-06T04:36:32.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.593+0000 7f2cb37fe700 1 -- 172.21.15.8:0/3782227591 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2cbc0894b0 con 0x7f2ccc0c6d40 2023-10-06T04:36:32.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.593+0000 7f7536a3b700 1 --2- 172.21.15.8:0/34829461 >> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] conn(0x7f75100015f0 0x7f7510003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.593+0000 7f7536a3b700 1 -- 172.21.15.8:0/34829461 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7510006b90 con 0x7f75100015f0 2023-10-06T04:36:32.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.594+0000 7fb33c195700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3340ae080 0x7fb33414c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.594+0000 7fb33c195700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb33415b5d0 0x7fb3341463b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.594+0000 7fb33c195700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb33415bbc0 0x7fb3341468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.594+0000 7fb33c195700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb334144fd0 con 0x7fb3340ae080 2023-10-06T04:36:32.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.594+0000 7fb33c195700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3341452b0 con 0x7fb33415b5d0 2023-10-06T04:36:32.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.594+0000 7fb33c195700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb334145590 con 0x7fb33415bbc0 2023-10-06T04:36:32.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.594+0000 7fb339f31700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3340ae080 0x7fb33414c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.594+0000 7fb339f31700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3340ae080 0x7fb33414c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38578/0 (socket says 172.21.15.8:38578) 2023-10-06T04:36:32.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.594+0000 7fb339f31700 1 -- 172.21.15.8:0/3389925156 learned_addr learned my addr 172.21.15.8:0/3389925156 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:32.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.594+0000 7ff0ee203700 1 --2- 172.21.15.8:0/961651316 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x7ff0cc070b80 0x7ff0cc072fb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.594+0000 7fb339730700 1 --2- 172.21.15.8:0/3389925156 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb33415b5d0 0x7fb3341463b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.594+0000 7fb339f31700 1 -- 172.21.15.8:0/3389925156 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb33415bbc0 msgr2=0x7fb3341468f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T04:36:32.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.594+0000 7fb339f31700 1 --2- 172.21.15.8:0/3389925156 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb33415bbc0 0x7fb3341468f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.594+0000 7fb339f31700 1 -- 172.21.15.8:0/3389925156 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb33415b5d0 msgr2=0x7fb3341463b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.594+0000 7fb339f31700 1 --2- 172.21.15.8:0/3389925156 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb33415b5d0 0x7fb3341463b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.594+0000 7fb339f31700 1 -- 172.21.15.8:0/3389925156 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb324009420 con 0x7fb3340ae080 2023-10-06T04:36:32.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.594+0000 7fb339730700 1 --2- 172.21.15.8:0/3389925156 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb33415b5d0 0x7fb3341463b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:32.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.594+0000 7fb339f31700 1 --2- 172.21.15.8:0/3389925156 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3340ae080 0x7fb33414c520 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb3340c2e90 tx=0x7fb324017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.595+0000 7fb329ffb700 1 -- 172.21.15.8:0/3389925156 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb324011900 con 0x7fb3340ae080 2023-10-06T04:36:32.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.595+0000 7fb329ffb700 1 -- 172.21.15.8:0/3389925156 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb324011aa0 con 0x7fb3340ae080 2023-10-06T04:36:32.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.595+0000 7fb33c195700 1 -- 172.21.15.8:0/3389925156 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb334145870 con 0x7fb3340ae080 2023-10-06T04:36:32.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.595+0000 7fb329ffb700 1 -- 172.21.15.8:0/3389925156 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb324025670 con 0x7fb3340ae080 2023-10-06T04:36:32.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.598+0000 7f7534fd8700 1 --2- 172.21.15.8:0/34829461 >> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] conn(0x7f75100015f0 0x7f7510003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.598+0000 7f7534fd8700 1 --2- 172.21.15.8:0/34829461 >> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] conn(0x7f75100015f0 0x7f7510003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.595+0000 7fb33c195700 1 -- 172.21.15.8:0/3389925156 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb334140290 con 0x7fb3340ae080 2023-10-06T04:36:32.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.596+0000 7fb33c195700 1 -- 172.21.15.8:0/3389925156 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb334071550 con 0x7fb3340ae080 2023-10-06T04:36:32.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.596+0000 7fb329ffb700 1 -- 172.21.15.8:0/3389925156 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb324023070 con 0x7fb3340ae080 2023-10-06T04:36:32.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.597+0000 7fb329ffb700 1 --2- 172.21.15.8:0/3389925156 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb318066f30 0x7fb3180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.597+0000 7fb329ffb700 1 -- 172.21.15.8:0/3389925156 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb324086860 con 0x7fb3340ae080 2023-10-06T04:36:32.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.597+0000 7fb339730700 1 --2- 172.21.15.8:0/3389925156 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb318066f30 0x7fb3180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.597+0000 7fb329ffb700 1 --2- 172.21.15.8:0/3389925156 >> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] conn(0x7fb318070c00 0x7fb318073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.597+0000 7fb329ffb700 1 -- 172.21.15.8:0/3389925156 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb318073700 con 0x7fb318070c00 2023-10-06T04:36:32.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.597+0000 7fb329ffb700 1 -- 172.21.15.8:0/3389925156 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb324086c30 con 0x7fb3340ae080 2023-10-06T04:36:32.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.598+0000 7fb339730700 1 --2- 172.21.15.8:0/3389925156 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb318066f30 0x7fb3180693e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb33413fe30 tx=0x7fb330009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.599+0000 7f7517fff700 1 -- 172.21.15.8:0/34829461 <== osd.6 v2:172.21.15.184:6816/90899 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f7510006b90 con 0x7f75100015f0 2023-10-06T04:36:32.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.594+0000 7f2ccbfff700 1 --2- 172.21.15.8:0/3782227591 >> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] conn(0x7f2cb8070cd0 0x7f2cb8073100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.594+0000 7f2ccbfff700 1 --2- 172.21.15.8:0/3782227591 >> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] conn(0x7f2cb8070cd0 0x7f2cb8073100 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.595+0000 7f2cb37fe700 1 -- 172.21.15.8:0/3782227591 <== osd.5 v2:172.21.15.184:6824/90894 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f2cb80737d0 con 0x7f2cb8070cd0 2023-10-06T04:36:32.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.598+0000 7f2ccaffd700 1 --2- 172.21.15.8:0/3782227591 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2cb8067000 0x7f2cb80694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.598+0000 7f2ccaffd700 1 --2- 172.21.15.8:0/3782227591 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2cb8067000 0x7f2cb80694b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc179c50 tx=0x7f2cc0007bf0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.608+0000 7ff0ddffb700 1 -- 172.21.15.8:0/961651316 <== osd.0 v2:172.21.15.8:6808/90668 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7ff0cc073680 con 0x7ff0cc070b80 2023-10-06T04:36:32.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.613+0000 7fc31817c700 1 -- 172.21.15.8:0/4036576494 --> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc2f0005c80 con 0x7fc2f00015f0 2023-10-06T04:36:32.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.613+0000 7fb33a732700 1 --2- 172.21.15.8:0/3389925156 >> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] conn(0x7fb318070c00 0x7fb318073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.613+0000 7fc305ffb700 1 -- 172.21.15.8:0/4036576494 <== osd.2 v2:172.21.15.8:6800/90670 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc2f0005c80 con 0x7fc2f00015f0 2023-10-06T04:36:32.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.613+0000 7fc31817c700 1 -- 172.21.15.8:0/4036576494 >> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] conn(0x7fc2f00015f0 msgr2=0x7fc2f0003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.613+0000 7fc31817c700 1 --2- 172.21.15.8:0/4036576494 >> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] conn(0x7fc2f00015f0 0x7fc2f0003aa0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.614+0000 7fc31817c700 1 -- 172.21.15.8:0/4036576494 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc2f4066f30 msgr2=0x7fc2f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.614+0000 7fc31817c700 1 --2- 172.21.15.8:0/4036576494 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc2f4066f30 0x7fc2f40693e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc300009ea0 tx=0x7fc3000091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.614+0000 7fc31817c700 1 -- 172.21.15.8:0/4036576494 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3100ca490 msgr2=0x7fc3101577a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.614+0000 7fc31817c700 1 --2- 172.21.15.8:0/4036576494 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3100ca490 0x7fc3101577a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc30c018000 tx=0x7fc30c01b000 comp rx=0 tx=0).stop 2023-10-06T04:36:32.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.614+0000 7fc316719700 1 -- 172.21.15.8:0/4036576494 reap_dead start 2023-10-06T04:36:32.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.615+0000 7f9e5c4bd700 1 -- 172.21.15.8:0/2622130648 --> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9e5406ba90 con 0x7f9e38070d50 2023-10-06T04:36:32.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.615+0000 7fc31817c700 1 -- 172.21.15.8:0/4036576494 shutdown_connections 2023-10-06T04:36:32.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.615+0000 7fc31817c700 1 -- 172.21.15.8:0/4036576494 >> 172.21.15.8:0/4036576494 conn(0x7fc3100c9330 msgr2=0x7fc3100c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:32.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.615+0000 7f9e4a7fc700 1 -- 172.21.15.8:0/2622130648 <== osd.1 v2:172.21.15.8:6816/90669 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9e5406ba90 con 0x7f9e38070d50 2023-10-06T04:36:32.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.615+0000 7f4853c56700 1 -- 172.21.15.8:0/388972830 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f484c0c7820 con 0x7f4830070c50 2023-10-06T04:36:32.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.616+0000 7f9e5c4bd700 1 -- 172.21.15.8:0/2622130648 >> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] conn(0x7f9e38070d50 msgr2=0x7f9e38073180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.616+0000 7f9e5c4bd700 1 --2- 172.21.15.8:0/2622130648 >> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] conn(0x7f9e38070d50 0x7f9e38073180 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.616+0000 7fc31817c700 1 -- 172.21.15.8:0/4036576494 shutdown_connections 2023-10-06T04:36:32.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.616+0000 7fc31817c700 1 -- 172.21.15.8:0/4036576494 wait complete. 2023-10-06T04:36:32.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.616+0000 7f9e5c4bd700 1 -- 172.21.15.8:0/2622130648 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9e38067080 msgr2=0x7f9e38069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.616+0000 7f9e5c4bd700 1 --2- 172.21.15.8:0/2622130648 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9e38067080 0x7f9e38069530 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9e500098e0 tx=0x7f9e50017000 comp rx=0 tx=0).stop 2023-10-06T04:36:32.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.616+0000 7f9e5c4bd700 1 -- 172.21.15.8:0/2622130648 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e540c8eb0 msgr2=0x7f9e54142ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.616+0000 7f9e5c4bd700 1 --2- 172.21.15.8:0/2622130648 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e540c8eb0 0x7f9e54142ad0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c001920 tx=0x7f9e4c007da0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.616+0000 7f9e5aa5a700 1 -- 172.21.15.8:0/2622130648 reap_dead start 2023-10-06T04:36:32.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.616+0000 7f4841ffb700 1 -- 172.21.15.8:0/388972830 <== osd.4 v2:172.21.15.184:6800/90868 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f484c0c7820 con 0x7f4830070c50 2023-10-06T04:36:32.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.616+0000 7f9e5c4bd700 1 -- 172.21.15.8:0/2622130648 shutdown_connections 2023-10-06T04:36:32.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.616+0000 7f9e5c4bd700 1 -- 172.21.15.8:0/2622130648 >> 172.21.15.8:0/2622130648 conn(0x7f9e540ce200 msgr2=0x7f9e54152b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:32.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.616+0000 7f9e5c4bd700 1 -- 172.21.15.8:0/2622130648 shutdown_connections 2023-10-06T04:36:32.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.616+0000 7f9e5c4bd700 1 -- 172.21.15.8:0/2622130648 wait complete. 2023-10-06T04:36:32.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.616+0000 7f4853c56700 1 -- 172.21.15.8:0/388972830 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x7f4830070c50 msgr2=0x7f4830073080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.616+0000 7f4853c56700 1 --2- 172.21.15.8:0/388972830 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x7f4830070c50 0x7f4830073080 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.617+0000 7f4853c56700 1 -- 172.21.15.8:0/388972830 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4830067000 msgr2=0x7f48300694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.617+0000 7f4853c56700 1 --2- 172.21.15.8:0/388972830 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4830067000 0x7f48300694b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f483c009b10 tx=0x7f483c008040 comp rx=0 tx=0).stop 2023-10-06T04:36:32.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.617+0000 7f4853c56700 1 -- 172.21.15.8:0/388972830 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f484c0cd430 msgr2=0x7f484c169ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.617+0000 7f4853c56700 1 --2- 172.21.15.8:0/388972830 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f484c0cd430 0x7f484c169ae0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f484c089530 tx=0x7f4848017000 comp rx=0 tx=0).stop 2023-10-06T04:36:32.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.617+0000 7f48521f3700 1 -- 172.21.15.8:0/388972830 reap_dead start 2023-10-06T04:36:32.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.617+0000 7f4853c56700 1 -- 172.21.15.8:0/388972830 shutdown_connections 2023-10-06T04:36:32.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.617+0000 7f4853c56700 1 -- 172.21.15.8:0/388972830 >> 172.21.15.8:0/388972830 conn(0x7f484c06ed00 msgr2=0x7f484c15b550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:32.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.617+0000 7f4853c56700 1 -- 172.21.15.8:0/388972830 shutdown_connections 2023-10-06T04:36:32.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.617+0000 7f4853c56700 1 -- 172.21.15.8:0/388972830 wait complete. 2023-10-06T04:36:32.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.622+0000 7f2cd1c94700 1 -- 172.21.15.8:0/3782227591 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2ccc071550 con 0x7f2cb8070cd0 2023-10-06T04:36:32.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.622+0000 7f2cb37fe700 1 -- 172.21.15.8:0/3782227591 <== osd.5 v2:172.21.15.184:6824/90894 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2ccc071550 con 0x7f2cb8070cd0 2023-10-06T04:36:32.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.623+0000 7f2cd1c94700 1 -- 172.21.15.8:0/3782227591 >> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] conn(0x7f2cb8070cd0 msgr2=0x7f2cb8073100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.623+0000 7f2cd1c94700 1 --2- 172.21.15.8:0/3782227591 >> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] conn(0x7f2cb8070cd0 0x7f2cb8073100 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.623+0000 7f2cd1c94700 1 -- 172.21.15.8:0/3782227591 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2cb8067000 msgr2=0x7f2cb80694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.623+0000 7f2cd1c94700 1 --2- 172.21.15.8:0/3782227591 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2cb8067000 0x7f2cb80694b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc179c50 tx=0x7f2cc0007bf0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.623+0000 7f2cd1c94700 1 -- 172.21.15.8:0/3782227591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ccc0c6d40 msgr2=0x7f2ccc06d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.623+0000 7f2cd1c94700 1 --2- 172.21.15.8:0/3782227591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ccc0c6d40 0x7f2ccc06d550 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc002000 tx=0x7f2cbc016000 comp rx=0 tx=0).stop 2023-10-06T04:36:32.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.623+0000 7f2ccbfff700 1 -- 172.21.15.8:0/3782227591 reap_dead start 2023-10-06T04:36:32.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.623+0000 7f2cd1c94700 1 -- 172.21.15.8:0/3782227591 shutdown_connections 2023-10-06T04:36:32.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.623+0000 7f2cd1c94700 1 -- 172.21.15.8:0/3782227591 >> 172.21.15.8:0/3782227591 conn(0x7f2ccc0680a0 msgr2=0x7f2ccc0c0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:32.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.623+0000 7f2cd1c94700 1 -- 172.21.15.8:0/3782227591 shutdown_connections 2023-10-06T04:36:32.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.625+0000 7f2cd1c94700 1 -- 172.21.15.8:0/3782227591 wait complete. 2023-10-06T04:36:32.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.623+0000 7fb33a732700 1 --2- 172.21.15.8:0/3389925156 >> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] conn(0x7fb318070c00 0x7fb318073030 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.624+0000 7fb329ffb700 1 -- 172.21.15.8:0/3389925156 <== osd.7 v2:172.21.15.184:6808/90869 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fb318073700 con 0x7fb318070c00 2023-10-06T04:36:32.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.625+0000 7f3956d70700 1 -- 172.21.15.8:0/952705623 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3930002d30 con 0x7f3934070cd0 2023-10-06T04:36:32.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.630+0000 7f7536a3b700 1 -- 172.21.15.8:0/34829461 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7510005c20 con 0x7f75100015f0 2023-10-06T04:36:32.670 INFO:teuthology.orchestra.run.smithi008.stdout:55834574854 2023-10-06T04:36:32.670 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T04:36:32.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.630+0000 7f7517fff700 1 -- 172.21.15.8:0/34829461 <== osd.6 v2:172.21.15.184:6816/90899 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7510005c20 con 0x7f75100015f0 2023-10-06T04:36:32.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.634+0000 7f394cff9700 1 -- 172.21.15.8:0/952705623 <== osd.3 v2:172.21.15.8:6823/90671 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3930002d30 con 0x7f3934070cd0 2023-10-06T04:36:32.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.634+0000 7f3956d70700 1 -- 172.21.15.8:0/952705623 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x7f3934070cd0 msgr2=0x7f3934073100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.634+0000 7f3956d70700 1 --2- 172.21.15.8:0/952705623 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x7f3934070cd0 0x7f3934073100 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.634+0000 7f3956d70700 1 -- 172.21.15.8:0/952705623 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3934067000 msgr2=0x7f39340694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.634+0000 7f3956d70700 1 --2- 172.21.15.8:0/952705623 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3934067000 0x7f39340694b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f39500acb40 tx=0x7f393c019000 comp rx=0 tx=0).stop 2023-10-06T04:36:32.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.634+0000 7f3956d70700 1 -- 172.21.15.8:0/952705623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3940004810 msgr2=0x7f39501591f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.634+0000 7f3956d70700 1 --2- 172.21.15.8:0/952705623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3940004810 0x7f39501591f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3944001240 tx=0x7f3944001e60 comp rx=0 tx=0).stop 2023-10-06T04:36:32.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.634+0000 7f395530d700 1 -- 172.21.15.8:0/952705623 reap_dead start 2023-10-06T04:36:32.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.635+0000 7f3956d70700 1 -- 172.21.15.8:0/952705623 shutdown_connections 2023-10-06T04:36:32.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.635+0000 7f3956d70700 1 -- 172.21.15.8:0/952705623 >> 172.21.15.8:0/952705623 conn(0x7f395006a770 msgr2=0x7f3950151c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:32.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.635+0000 7f7536a3b700 1 -- 172.21.15.8:0/34829461 >> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] conn(0x7f75100015f0 msgr2=0x7f7510003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.635+0000 7f7536a3b700 1 --2- 172.21.15.8:0/34829461 >> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] conn(0x7f75100015f0 0x7f7510003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.635+0000 7f7536a3b700 1 -- 172.21.15.8:0/34829461 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f751c066f30 msgr2=0x7f751c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.635+0000 7f7536a3b700 1 --2- 172.21.15.8:0/34829461 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f751c066f30 0x7f751c0693e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7524007aa0 tx=0x7f7524008040 comp rx=0 tx=0).stop 2023-10-06T04:36:32.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.635+0000 7f7536a3b700 1 -- 172.21.15.8:0/34829461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75300ccb00 msgr2=0x7f75300b0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.635+0000 7f7536a3b700 1 --2- 172.21.15.8:0/34829461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75300ccb00 0x7f75300b0be0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f752000b4c0 tx=0x7f7520009060 comp rx=0 tx=0).stop 2023-10-06T04:36:32.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.635+0000 7f7534fd8700 1 -- 172.21.15.8:0/34829461 reap_dead start 2023-10-06T04:36:32.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.635+0000 7f7536a3b700 1 -- 172.21.15.8:0/34829461 shutdown_connections 2023-10-06T04:36:32.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.635+0000 7f7536a3b700 1 -- 172.21.15.8:0/34829461 >> 172.21.15.8:0/34829461 conn(0x7f75300cbff0 msgr2=0x7f75300c9160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:32.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.636+0000 7f7536a3b700 1 -- 172.21.15.8:0/34829461 shutdown_connections 2023-10-06T04:36:32.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.636+0000 7f7536a3b700 1 -- 172.21.15.8:0/34829461 wait complete. 2023-10-06T04:36:32.675 INFO:teuthology.orchestra.run.smithi008.stdout:55834574855 2023-10-06T04:36:32.675 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T04:36:32.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.637+0000 7ff0efc66700 1 -- 172.21.15.8:0/961651316 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff0e8171f30 con 0x7ff0cc070b80 2023-10-06T04:36:32.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.637+0000 7ff0ddffb700 1 -- 172.21.15.8:0/961651316 <== osd.0 v2:172.21.15.8:6808/90668 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff0e8171f30 con 0x7ff0cc070b80 2023-10-06T04:36:32.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.637+0000 7ff0efc66700 1 -- 172.21.15.8:0/961651316 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x7ff0cc070b80 msgr2=0x7ff0cc072fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.637+0000 7ff0efc66700 1 --2- 172.21.15.8:0/961651316 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x7ff0cc070b80 0x7ff0cc072fb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.638+0000 7ff0efc66700 1 -- 172.21.15.8:0/961651316 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff0cc066f30 msgr2=0x7ff0cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.638+0000 7ff0efc66700 1 --2- 172.21.15.8:0/961651316 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff0cc066f30 0x7ff0cc0693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff0e40058d0 tx=0x7ff0e40079d0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.638+0000 7ff0efc66700 1 -- 172.21.15.8:0/961651316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0e806f590 msgr2=0x7ff0e80cd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.638+0000 7ff0efc66700 1 --2- 172.21.15.8:0/961651316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0e806f590 0x7ff0e80cd450 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff0e806c080 tx=0x7ff0d8019000 comp rx=0 tx=0).stop 2023-10-06T04:36:32.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.638+0000 7ff0ee203700 1 -- 172.21.15.8:0/961651316 reap_dead start 2023-10-06T04:36:32.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.638+0000 7ff0efc66700 1 -- 172.21.15.8:0/961651316 shutdown_connections 2023-10-06T04:36:32.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.638+0000 7ff0efc66700 1 -- 172.21.15.8:0/961651316 >> 172.21.15.8:0/961651316 conn(0x7ff0e806a770 msgr2=0x7ff0e8155410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:32.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.638+0000 7ff0efc66700 1 -- 172.21.15.8:0/961651316 shutdown_connections 2023-10-06T04:36:32.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.638+0000 7ff0efc66700 1 -- 172.21.15.8:0/961651316 wait complete. 2023-10-06T04:36:32.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.639+0000 7f3956d70700 1 -- 172.21.15.8:0/952705623 shutdown_connections 2023-10-06T04:36:32.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.639+0000 7f3956d70700 1 -- 172.21.15.8:0/952705623 wait complete. 2023-10-06T04:36:32.679 INFO:teuthology.orchestra.run.smithi008.stdout:55834574855 2023-10-06T04:36:32.679 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T04:36:32.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.649+0000 7fb33c195700 1 -- 172.21.15.8:0/3389925156 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb3340cafa0 con 0x7fb318070c00 2023-10-06T04:36:32.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.649+0000 7fb329ffb700 1 -- 172.21.15.8:0/3389925156 <== osd.7 v2:172.21.15.184:6808/90869 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb3340cafa0 con 0x7fb318070c00 2023-10-06T04:36:32.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.650+0000 7fb33c195700 1 -- 172.21.15.8:0/3389925156 >> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] conn(0x7fb318070c00 msgr2=0x7fb318073030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.650+0000 7fb33c195700 1 --2- 172.21.15.8:0/3389925156 >> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] conn(0x7fb318070c00 0x7fb318073030 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.650+0000 7fb33c195700 1 -- 172.21.15.8:0/3389925156 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb318066f30 msgr2=0x7fb3180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.650+0000 7fb33c195700 1 --2- 172.21.15.8:0/3389925156 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb318066f30 0x7fb3180693e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb33413fe30 tx=0x7fb330009040 comp rx=0 tx=0).stop 2023-10-06T04:36:32.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.650+0000 7fb33c195700 1 -- 172.21.15.8:0/3389925156 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3340ae080 msgr2=0x7fb33414c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.650+0000 7fb33c195700 1 --2- 172.21.15.8:0/3389925156 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3340ae080 0x7fb33414c520 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb3340c2e90 tx=0x7fb324017000 comp rx=0 tx=0).stop 2023-10-06T04:36:32.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.650+0000 7fb33a732700 1 -- 172.21.15.8:0/3389925156 reap_dead start 2023-10-06T04:36:32.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.650+0000 7fb33c195700 1 -- 172.21.15.8:0/3389925156 shutdown_connections 2023-10-06T04:36:32.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.650+0000 7fb33c195700 1 -- 172.21.15.8:0/3389925156 >> 172.21.15.8:0/3389925156 conn(0x7fb3340cbff0 msgr2=0x7fb334150de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:32.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.650+0000 7fb33c195700 1 -- 172.21.15.8:0/3389925156 shutdown_connections 2023-10-06T04:36:32.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.650+0000 7fb33c195700 1 -- 172.21.15.8:0/3389925156 wait complete. 2023-10-06T04:36:32.682 INFO:teuthology.orchestra.run.smithi008.stdout:55834574856 2023-10-06T04:36:32.683 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T04:36:32.683 INFO:teuthology.orchestra.run.smithi008.stdout:55834574855 2023-10-06T04:36:32.684 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T04:36:32.684 INFO:teuthology.orchestra.run.smithi008.stdout:55834574855 2023-10-06T04:36:32.685 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T04:36:32.685 INFO:teuthology.orchestra.run.smithi008.stdout:55834574856 2023-10-06T04:36:32.686 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T04:36:32.686 INFO:teuthology.orchestra.run.smithi008.stdout:55834574855 2023-10-06T04:36:32.687 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T04:36:32.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.918+0000 7fb19cf3d700 1 Processor -- start 2023-10-06T04:36:32.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.918+0000 7fb19cf3d700 1 -- start start 2023-10-06T04:36:32.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.919+0000 7fc6ebc24700 1 Processor -- start 2023-10-06T04:36:32.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.919+0000 7fb19cf3d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1980699d0 0x7fb198069e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.919+0000 7fb19cf3d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1980ca000 0x7fb1980ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.919+0000 7fb19cf3d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb198161f90 con 0x7fb19815d910 2023-10-06T04:36:32.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.919+0000 7fb19cf3d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb19806a360 con 0x7fb1980ca000 2023-10-06T04:36:32.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.919+0000 7fb19cf3d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb198161660 con 0x7fb1980699d0 2023-10-06T04:36:32.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.920+0000 7fb19659c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fb19815d910 0x7fb1980c6a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.8:49010/0 (socket says 172.21.15.8:49010) 2023-10-06T04:36:32.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.920+0000 7fb19659c700 1 -- 172.21.15.8:0/1066935716 learned_addr learned my addr 172.21.15.8:0/1066935716 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:32.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.920+0000 7fb195d9b700 1 --2- 172.21.15.8:0/1066935716 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1980699d0 0x7fb198069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.921+0000 7fb196d9d700 1 --2- 172.21.15.8:0/1066935716 >> v2:172.21.15.184:3300/0 conn(0x7fb1980ca000 0x7fb1980ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.919+0000 7fc6ebc24700 1 -- start start 2023-10-06T04:36:32.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.921+0000 7fc6ebc24700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc6e41552a0 0x7fc6e40c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.921+0000 7fc6ebc24700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc6e4155670 0x7fc6e4159120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.921+0000 7fc6ebc24700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e4069b40 con 0x7fc6e4159660 2023-10-06T04:36:32.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.921+0000 7fc6ebc24700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6e415a0a0 con 0x7fc6e4155670 2023-10-06T04:36:32.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.921+0000 7fc6ebc24700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6e4159ae0 con 0x7fc6e41552a0 2023-10-06T04:36:32.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.921+0000 7fc6e99c0700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc6e41552a0 0x7fc6e40c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.921+0000 7fc6e99c0700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc6e41552a0 0x7fc6e40c9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.8:35436/0 (socket says 172.21.15.8:35436) 2023-10-06T04:36:32.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.921+0000 7fc6e99c0700 1 -- 172.21.15.8:0/250198827 learned_addr learned my addr 172.21.15.8:0/250198827 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:32.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.921+0000 7fb195d9b700 1 -- 172.21.15.8:0/1066935716 >> v2:172.21.15.184:3300/0 conn(0x7fb1980ca000 msgr2=0x7fb1980ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:32.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.921+0000 7fb195d9b700 1 --2- 172.21.15.8:0/1066935716 >> v2:172.21.15.184:3300/0 conn(0x7fb1980ca000 0x7fb1980ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.921+0000 7fb195d9b700 1 -- 172.21.15.8:0/1066935716 >> v1:172.21.15.184:6789/0 conn(0x7fb19815d910 legacy=0x7fb1980c6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.921+0000 7fb195d9b700 1 -- 172.21.15.8:0/1066935716 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb198161940 con 0x7fb1980699d0 2023-10-06T04:36:32.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.921+0000 7fb195d9b700 1 --2- 172.21.15.8:0/1066935716 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1980699d0 0x7fb198069e20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb1880098e0 tx=0x7fb1880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2b7f4cf4b75b6fe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.921+0000 7fc6e99c0700 1 -- 172.21.15.8:0/250198827 >> v2:172.21.15.8:3300/0 conn(0x7fc6e4155670 msgr2=0x7fc6e4159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:32.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.921+0000 7fc6e99c0700 1 --2- 172.21.15.8:0/250198827 >> v2:172.21.15.8:3300/0 conn(0x7fc6e4155670 0x7fc6e4159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.921+0000 7fc6e99c0700 1 -- 172.21.15.8:0/250198827 >> v1:172.21.15.184:6789/0 conn(0x7fc6e4159660 legacy=0x7fc6e406b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.921+0000 7fc6e99c0700 1 -- 172.21.15.8:0/250198827 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e4159dc0 con 0x7fc6e41552a0 2023-10-06T04:36:32.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.921+0000 7fb19559a700 1 -- 172.21.15.8:0/1066935716 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb188011630 con 0x7fb1980699d0 2023-10-06T04:36:32.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.922+0000 7fb19559a700 1 -- 172.21.15.8:0/1066935716 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb188011790 con 0x7fb1980699d0 2023-10-06T04:36:32.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.922+0000 7fb19559a700 1 -- 172.21.15.8:0/1066935716 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb188011b50 con 0x7fb1980699d0 2023-10-06T04:36:32.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.922+0000 7fc6e99c0700 1 --2- 172.21.15.8:0/250198827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6e41552a0 0x7fc6e40c9bc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc6e40c2eb0 tx=0x7fc6dc0076e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33a163838293c6c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.922+0000 7fc6e89be700 1 -- 172.21.15.8:0/250198827 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc010070 con 0x7fc6e41552a0 2023-10-06T04:36:32.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.922+0000 7fc6e89be700 1 -- 172.21.15.8:0/250198827 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6dc00dd80 con 0x7fc6e41552a0 2023-10-06T04:36:32.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.922+0000 7fc6e89be700 1 -- 172.21.15.8:0/250198827 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc007da0 con 0x7fc6e41552a0 2023-10-06T04:36:32.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.922+0000 7f60787d5700 1 Processor -- start 2023-10-06T04:36:32.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.922+0000 7f60787d5700 1 -- start start 2023-10-06T04:36:32.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.922+0000 7fb19cf3d700 1 -- 172.21.15.8:0/1066935716 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1980699d0 msgr2=0x7fb198069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.922+0000 7fb19cf3d700 1 --2- 172.21.15.8:0/1066935716 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1980699d0 0x7fb198069e20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb1880098e0 tx=0x7fb1880091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.923+0000 7fc6ebc24700 1 -- 172.21.15.8:0/250198827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6e41552a0 msgr2=0x7fc6e40c9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.923+0000 7fc6ebc24700 1 --2- 172.21.15.8:0/250198827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6e41552a0 0x7fc6e40c9bc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc6e40c2eb0 tx=0x7fc6dc0076e0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.923+0000 7fc6ebc24700 1 -- 172.21.15.8:0/250198827 shutdown_connections 2023-10-06T04:36:32.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.923+0000 7fc6ebc24700 1 --2- 172.21.15.8:0/250198827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6e41552a0 0x7fc6e40c9bc0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.923+0000 7fc6ebc24700 1 --2- 172.21.15.8:0/250198827 >> v2:172.21.15.8:3300/0 conn(0x7fc6e4155670 0x7fc6e4159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.923+0000 7fc6ebc24700 1 -- 172.21.15.8:0/250198827 >> 172.21.15.8:0/250198827 conn(0x7fc6e40cbff0 msgr2=0x7fc6e40cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:32.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.923+0000 7fb19cf3d700 1 -- 172.21.15.8:0/1066935716 shutdown_connections 2023-10-06T04:36:32.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.923+0000 7fb19cf3d700 1 --2- 172.21.15.8:0/1066935716 >> v2:172.21.15.184:3300/0 conn(0x7fb1980ca000 0x7fb1980ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.923+0000 7fb19cf3d700 1 --2- 172.21.15.8:0/1066935716 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1980699d0 0x7fb198069e20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.923+0000 7fb19cf3d700 1 -- 172.21.15.8:0/1066935716 >> 172.21.15.8:0/1066935716 conn(0x7fb1980cc430 msgr2=0x7fb1980cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:32.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.923+0000 7fc6ebc24700 1 -- 172.21.15.8:0/250198827 shutdown_connections 2023-10-06T04:36:32.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.923+0000 7fc6ebc24700 1 -- 172.21.15.8:0/250198827 wait complete. 2023-10-06T04:36:32.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.923+0000 7f2653994700 1 Processor -- start 2023-10-06T04:36:32.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.924+0000 7fb19cf3d700 1 -- 172.21.15.8:0/1066935716 shutdown_connections 2023-10-06T04:36:32.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.924+0000 7fb19cf3d700 1 -- 172.21.15.8:0/1066935716 wait complete. 2023-10-06T04:36:32.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.924+0000 7f2653994700 1 -- start start 2023-10-06T04:36:32.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.924+0000 7fc6ebc24700 1 Processor -- start 2023-10-06T04:36:32.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.924+0000 7fc6ebc24700 1 -- start start 2023-10-06T04:36:32.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.924+0000 7f60787d5700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6070155670 0x7f6070159120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.924+0000 7f60787d5700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6070069b40 con 0x7f60701552a0 2023-10-06T04:36:32.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.924+0000 7f60787d5700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f607015a0a0 con 0x7f6070159660 2023-10-06T04:36:32.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.924+0000 7f60787d5700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60700ca2d0 con 0x7f6070155670 2023-10-06T04:36:32.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.924+0000 7f6076571700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f60701552a0 0x7f60700c9bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34634/0 (socket says 172.21.15.8:34634) 2023-10-06T04:36:32.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.924+0000 7f6076571700 1 -- 172.21.15.8:0/2232770221 learned_addr learned my addr 172.21.15.8:0/2232770221 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:32.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.924+0000 7f6075d70700 1 --2- 172.21.15.8:0/2232770221 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6070155670 0x7f6070159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.924+0000 7f607556f700 1 -- 172.21.15.8:0/2232770221 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 785121982 0 0) 0x7f607015a0a0 con 0x7f6070159660 2023-10-06T04:36:32.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.924+0000 7f6075d70700 1 -- 172.21.15.8:0/2232770221 >> v1:172.21.15.184:6789/0 conn(0x7f6070159660 legacy=0x7f607006b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.924+0000 7f6075d70700 1 -- 172.21.15.8:0/2232770221 >> v1:172.21.15.8:6789/0 conn(0x7f60701552a0 legacy=0x7f60700c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.924+0000 7f6075d70700 1 -- 172.21.15.8:0/2232770221 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6070159ae0 con 0x7f6070155670 2023-10-06T04:36:32.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.925+0000 7f6075d70700 1 --2- 172.21.15.8:0/2232770221 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6070155670 0x7f6070159120 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f606c009910 tx=0x7f606c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d5e61746928c35 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.925+0000 7f607556f700 1 -- 172.21.15.8:0/2232770221 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c00b860 con 0x7f6070155670 2023-10-06T04:36:32.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.925+0000 7f607556f700 1 -- 172.21.15.8:0/2232770221 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606c00b9c0 con 0x7f6070155670 2023-10-06T04:36:32.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.925+0000 7f607556f700 1 -- 172.21.15.8:0/2232770221 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c00bd60 con 0x7f6070155670 2023-10-06T04:36:32.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.925+0000 7f2653994700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f264c1561c0 0x7f264c159e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.925+0000 7f2653994700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f264c0687c0 0x7f264c15a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.925+0000 7f2653994700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f264c0ca490 0x7f264c0ca910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.925+0000 7f2653994700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f264c06b410 con 0x7f264c0ca490 2023-10-06T04:36:32.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.925+0000 7f2653994700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f264c06af80 con 0x7f264c0687c0 2023-10-06T04:36:32.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.925+0000 7f2653994700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f264c06a370 con 0x7f264c1561c0 2023-10-06T04:36:32.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.925+0000 7f2651730700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f264c1561c0 0x7f264c159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.925+0000 7fb19cf3d700 1 Processor -- start 2023-10-06T04:36:32.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.925+0000 7f2651730700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f264c1561c0 0x7f264c159e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.8:53246/0 (socket says 172.21.15.8:53246) 2023-10-06T04:36:32.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.925+0000 7f2651730700 1 -- 172.21.15.8:0/3027847283 learned_addr learned my addr 172.21.15.8:0/3027847283 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:32.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.925+0000 7f2651f31700 1 --2- 172.21.15.8:0/3027847283 >> v2:172.21.15.8:3300/0 conn(0x7f264c0ca490 0x7f264c0ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.925+0000 7f2650f2f700 1 --2- 172.21.15.8:0/3027847283 >> v2:172.21.15.184:3300/0 conn(0x7f264c0687c0 0x7f264c15a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.925+0000 7fb19cf3d700 1 -- start start 2023-10-06T04:36:32.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.926+0000 7f2651730700 1 -- 172.21.15.8:0/3027847283 >> v2:172.21.15.184:3300/0 conn(0x7f264c0687c0 msgr2=0x7f264c15a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:32.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.926+0000 7f2651730700 1 --2- 172.21.15.8:0/3027847283 >> v2:172.21.15.184:3300/0 conn(0x7f264c0687c0 0x7f264c15a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.926+0000 7f2651730700 1 -- 172.21.15.8:0/3027847283 >> v2:172.21.15.8:3300/0 conn(0x7f264c0ca490 msgr2=0x7f264c0ca910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:32.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.926+0000 7f2651730700 1 --2- 172.21.15.8:0/3027847283 >> v2:172.21.15.8:3300/0 conn(0x7f264c0ca490 0x7f264c0ca910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.926+0000 7f2651730700 1 -- 172.21.15.8:0/3027847283 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f264c06a650 con 0x7f264c1561c0 2023-10-06T04:36:32.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.926+0000 7fcfa11dd700 1 Processor -- start 2023-10-06T04:36:32.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.926+0000 7f60787d5700 1 -- 172.21.15.8:0/2232770221 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6070155670 msgr2=0x7f6070159120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.926+0000 7f60787d5700 1 --2- 172.21.15.8:0/2232770221 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6070155670 0x7f6070159120 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f606c009910 tx=0x7f606c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.926+0000 7fc6ebc24700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6e41552a0 0x7fc6e4148200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.926+0000 7fc6ebc24700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6e4155670 0x7fc6e40ad690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.926+0000 7fc6ebc24700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6e4148a70 0x7fc6e40aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.926+0000 7fc6ebc24700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e40c41d0 con 0x7fc6e4155670 2023-10-06T04:36:32.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.926+0000 7fc6ebc24700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e40c4d40 con 0x7fc6e41552a0 2023-10-06T04:36:32.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.926+0000 7fc6ebc24700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e4148740 con 0x7fc6e4148a70 2023-10-06T04:36:32.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.926+0000 7f2651730700 1 --2- 172.21.15.8:0/3027847283 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f264c1561c0 0x7f264c159e60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f264c06d9d0 tx=0x7f264400ba50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61e960beb9f91f3e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.926+0000 7f9e81223700 1 Processor -- start 2023-10-06T04:36:32.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.926+0000 7fc6e99c0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6e41552a0 0x7fc6e4148200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.926+0000 7f2643fff700 1 -- 172.21.15.8:0/3027847283 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2644010070 con 0x7f264c1561c0 2023-10-06T04:36:32.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.926+0000 7fc6e99c0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6e41552a0 0x7fc6e4148200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.8:35448/0 (socket says 172.21.15.8:35448) 2023-10-06T04:36:32.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.926+0000 7fc6e99c0700 1 -- 172.21.15.8:0/1152947211 learned_addr learned my addr 172.21.15.8:0/1152947211 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:32.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.926+0000 7f2643fff700 1 -- 172.21.15.8:0/3027847283 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264400dd30 con 0x7f264c1561c0 2023-10-06T04:36:32.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.926+0000 7f2643fff700 1 -- 172.21.15.8:0/3027847283 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264400dea0 con 0x7f264c1561c0 2023-10-06T04:36:32.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.926+0000 7fc6e99c0700 1 -- 172.21.15.8:0/1152947211 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6e4148a70 msgr2=0x7fc6e40aed90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:36:32.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.926+0000 7fc6e99c0700 1 --2- 172.21.15.8:0/1152947211 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6e4148a70 0x7fc6e40aed90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.926+0000 7fc6e99c0700 1 -- 172.21.15.8:0/1152947211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6e4155670 msgr2=0x7fc6e40ad690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.926+0000 7fc6e99c0700 1 --2- 172.21.15.8:0/1152947211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6e4155670 0x7fc6e40ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.926+0000 7fc6e99c0700 1 -- 172.21.15.8:0/1152947211 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6dc007980 con 0x7fc6e41552a0 2023-10-06T04:36:32.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.926+0000 7fb19cf3d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1980699d0 0x7fb19816f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.926+0000 7fb19cf3d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1980ca000 0x7fb198171000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.927+0000 7fb19cf3d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb19815d910 0x7fb198171840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.927+0000 7fb19cf3d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1980ad440 con 0x7fb1980ca000 2023-10-06T04:36:32.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.927+0000 7fb19cf3d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1980c4c10 con 0x7fb19815d910 2023-10-06T04:36:32.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.927+0000 7fb19cf3d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1980c4ef0 con 0x7fb1980699d0 2023-10-06T04:36:32.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.927+0000 7fc6e99c0700 1 --2- 172.21.15.8:0/1152947211 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6e41552a0 0x7fc6e4148200 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4159c20 tx=0x7fc6dc01b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.927+0000 7fb19659c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1980699d0 0x7fb19816f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.927+0000 7fb195d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1980ca000 0x7fb198171000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.927+0000 7fb19659c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1980699d0 0x7fb19816f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.8:53270/0 (socket says 172.21.15.8:53270) 2023-10-06T04:36:32.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.927+0000 7fb19659c700 1 -- 172.21.15.8:0/344308666 learned_addr learned my addr 172.21.15.8:0/344308666 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:32.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.927+0000 7fb196d9d700 1 --2- 172.21.15.8:0/344308666 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb19815d910 0x7fb198171840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.927+0000 7fc6d9ffb700 1 -- 172.21.15.8:0/1152947211 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc016440 con 0x7fc6e41552a0 2023-10-06T04:36:32.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.927+0000 7fc6d9ffb700 1 -- 172.21.15.8:0/1152947211 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6dc0165c0 con 0x7fc6e41552a0 2023-10-06T04:36:32.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.927+0000 7fc6d9ffb700 1 -- 172.21.15.8:0/1152947211 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc016980 con 0x7fc6e41552a0 2023-10-06T04:36:32.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.926+0000 7fcfa11dd700 1 -- start start 2023-10-06T04:36:32.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.927+0000 7fcfa11dd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fcf9c155680 0x7fcf9c0c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.927+0000 7fcfa11dd700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fcf9c06bc50 0x7fcf9c06adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.927+0000 7fcfa11dd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf9c06b300 0x7fcf9c159320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.927+0000 7fcfa11dd700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf9c0caa00 con 0x7fcf9c06bc50 2023-10-06T04:36:32.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.927+0000 7fcfa11dd700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf9c06b780 con 0x7fcf9c155680 2023-10-06T04:36:32.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.927+0000 7fcfa11dd700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c0cb4e0 con 0x7fcf9c06b300 2023-10-06T04:36:32.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.927+0000 7fcf9a59c700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fcf9c06bc50 0x7fcf9c06adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.927+0000 7fcf9a59c700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fcf9c06bc50 0x7fcf9c06adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38614/0 (socket says 172.21.15.8:38614) 2023-10-06T04:36:32.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.927+0000 7fcf9a59c700 1 -- 172.21.15.8:0/1485875471 learned_addr learned my addr 172.21.15.8:0/1485875471 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:32.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.928+0000 7fcf9ad9d700 1 --2- 172.21.15.8:0/1485875471 >> v2:172.21.15.184:3300/0 conn(0x7fcf9c155680 0x7fcf9c0c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.926+0000 7f9e81223700 1 -- start start 2023-10-06T04:36:32.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.928+0000 7f9e81223700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e7c0ca050 0x7f9e7c15df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.928+0000 7f9e81223700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e7c0cb160 con 0x7f9e7c1470b0 2023-10-06T04:36:32.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.928+0000 7f9e81223700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e7c0ca550 con 0x7f9e7c0c6d40 2023-10-06T04:36:32.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.928+0000 7f9e81223700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c0ca830 con 0x7f9e7c0ca050 2023-10-06T04:36:32.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.928+0000 7fcf9a59c700 1 -- 172.21.15.8:0/1485875471 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf9c06b300 msgr2=0x7fcf9c159320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:32.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.928+0000 7fcf9a59c700 1 --2- 172.21.15.8:0/1485875471 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf9c06b300 0x7fcf9c159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.928+0000 7fcf9a59c700 1 -- 172.21.15.8:0/1485875471 >> v2:172.21.15.184:3300/0 conn(0x7fcf9c155680 msgr2=0x7fcf9c0c72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:32.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.928+0000 7fcf9a59c700 1 --2- 172.21.15.8:0/1485875471 >> v2:172.21.15.184:3300/0 conn(0x7fcf9c155680 0x7fcf9c0c72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.928+0000 7fcf9a59c700 1 -- 172.21.15.8:0/1485875471 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9c0cabf0 con 0x7fcf9c06bc50 2023-10-06T04:36:32.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.928+0000 7fcf9a59c700 1 --2- 172.21.15.8:0/1485875471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf9c06bc50 0x7fcf9c06adc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c06d2c0 tx=0x7fcf900082d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef2d3b8d489066e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.927+0000 7fb196d9d700 1 -- 172.21.15.8:0/344308666 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1980699d0 msgr2=0x7fb19816f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.927+0000 7fb196d9d700 1 --2- 172.21.15.8:0/344308666 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1980699d0 0x7fb19816f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.927+0000 7fb196d9d700 1 -- 172.21.15.8:0/344308666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1980ca000 msgr2=0x7fb198171000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.927+0000 7fb196d9d700 1 --2- 172.21.15.8:0/344308666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1980ca000 0x7fb198171000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.927+0000 7fb196d9d700 1 -- 172.21.15.8:0/344308666 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb188009420 con 0x7fb19815d910 2023-10-06T04:36:32.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.927+0000 7fb195d9b700 1 --2- 172.21.15.8:0/344308666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1980ca000 0x7fb198171000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:36:32.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.928+0000 7fb196d9d700 1 --2- 172.21.15.8:0/344308666 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb19815d910 0x7fb198171840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb18c00e950 tx=0x7fb18c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.928+0000 7fb1867fc700 1 -- 172.21.15.8:0/344308666 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c013680 con 0x7fb19815d910 2023-10-06T04:36:32.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.928+0000 7fb1867fc700 1 -- 172.21.15.8:0/344308666 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18c013800 con 0x7fb19815d910 2023-10-06T04:36:32.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.928+0000 7fb19cf3d700 1 -- 172.21.15.8:0/344308666 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1980c51d0 con 0x7fb19815d910 2023-10-06T04:36:32.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.928+0000 7fb19cf3d700 1 -- 172.21.15.8:0/344308666 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb198171540 con 0x7fb19815d910 2023-10-06T04:36:32.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7fcf99d9b700 1 -- 172.21.15.8:0/1485875471 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf90010070 con 0x7fcf9c06bc50 2023-10-06T04:36:32.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7fcf99d9b700 1 -- 172.21.15.8:0/1485875471 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9000da50 con 0x7fcf9c06bc50 2023-10-06T04:36:32.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7fcf99d9b700 1 -- 172.21.15.8:0/1485875471 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9000de10 con 0x7fcf9c06bc50 2023-10-06T04:36:32.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7f2653994700 1 -- 172.21.15.8:0/3027847283 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f264c1561c0 msgr2=0x7f264c159e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7f2653994700 1 --2- 172.21.15.8:0/3027847283 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f264c1561c0 0x7f264c159e60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f264c06d9d0 tx=0x7f264400ba50 comp rx=0 tx=0).stop 2023-10-06T04:36:32.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7f2653994700 1 -- 172.21.15.8:0/3027847283 shutdown_connections 2023-10-06T04:36:32.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7f2653994700 1 --2- 172.21.15.8:0/3027847283 >> v2:172.21.15.8:3300/0 conn(0x7f264c0ca490 0x7f264c0ca910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7f2653994700 1 --2- 172.21.15.8:0/3027847283 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f264c1561c0 0x7f264c159e60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7f2653994700 1 --2- 172.21.15.8:0/3027847283 >> v2:172.21.15.184:3300/0 conn(0x7f264c0687c0 0x7f264c15a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7f2653994700 1 -- 172.21.15.8:0/3027847283 >> 172.21.15.8:0/3027847283 conn(0x7f264c0c9330 msgr2=0x7f264c0c9730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:32.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7fb1867fc700 1 -- 172.21.15.8:0/344308666 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c013ba0 con 0x7fb19815d910 2023-10-06T04:36:32.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7fc6ebc24700 1 -- 172.21.15.8:0/1152947211 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e40c4410 con 0x7fc6e41552a0 2023-10-06T04:36:32.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7fb19cf3d700 1 -- 172.21.15.8:0/344308666 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb198071550 con 0x7fb19815d910 2023-10-06T04:36:32.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.928+0000 7f9e7ad9d700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f9e7c1470b0 0x7f9e7c0c6630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34650/0 (socket says 172.21.15.8:34650) 2023-10-06T04:36:32.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.928+0000 7f9e7ad9d700 1 -- 172.21.15.8:0/53875083 learned_addr learned my addr 172.21.15.8:0/53875083 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:32.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7f9e79d9b700 1 -- 172.21.15.8:0/53875083 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3470418511 0 0) 0x7f9e7c0cb160 con 0x7f9e7c1470b0 2023-10-06T04:36:32.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7f9e79d9b700 1 -- 172.21.15.8:0/53875083 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e64003570 con 0x7f9e7c1470b0 2023-10-06T04:36:32.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7f9e7b59e700 1 --2- 172.21.15.8:0/53875083 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e7c0ca050 0x7f9e7c15df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7f9e79d9b700 1 -- 172.21.15.8:0/53875083 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3991842130 0 0) 0x7f9e7c0ca550 con 0x7f9e7c0c6d40 2023-10-06T04:36:32.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7f9e79d9b700 1 -- 172.21.15.8:0/53875083 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e7c0cb160 con 0x7f9e7c0c6d40 2023-10-06T04:36:32.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7f9e79d9b700 1 -- 172.21.15.8:0/53875083 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1340161415 0 0) 0x7f9e64003570 con 0x7f9e7c1470b0 2023-10-06T04:36:32.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7f9e79d9b700 1 -- 172.21.15.8:0/53875083 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e7c0ca050 msgr2=0x7f9e7c15df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:32.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7f9e79d9b700 1 --2- 172.21.15.8:0/53875083 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e7c0ca050 0x7f9e7c15df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7f9e79d9b700 1 -- 172.21.15.8:0/53875083 >> v1:172.21.15.184:6789/0 conn(0x7f9e7c0c6d40 legacy=0x7f9e7c0c0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7f9e79d9b700 1 -- 172.21.15.8:0/53875083 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e7c0cab10 con 0x7f9e7c1470b0 2023-10-06T04:36:32.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7f9e79d9b700 1 -- 172.21.15.8:0/53875083 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7f9e6c001470 con 0x7f9e7c1470b0 2023-10-06T04:36:32.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7f9e79d9b700 1 -- 172.21.15.8:0/53875083 >> v1:172.21.15.8:6789/0 conn(0x7f9e7c1470b0 legacy=0x7f9e7c0c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7f9e79d9b700 1 --2- 172.21.15.8:0/53875083 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e64003c20 0x7f9e64004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7f9e79d9b700 1 --2- 172.21.15.8:0/53875083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e64004810 0x7f9e64004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7f9e79d9b700 1 --2- 172.21.15.8:0/53875083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e640051c0 0x7f9e6400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7f9e79d9b700 1 -- 172.21.15.8:0/53875083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c0ca830 con 0x7f9e640051c0 2023-10-06T04:36:32.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7f9e79d9b700 1 -- 172.21.15.8:0/53875083 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6400c080 con 0x7f9e64004810 2023-10-06T04:36:32.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7f9e79d9b700 1 -- 172.21.15.8:0/53875083 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6400c240 con 0x7f9e64003c20 2023-10-06T04:36:32.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7f9e7b59e700 1 --2- 172.21.15.8:0/53875083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e640051c0 0x7f9e6400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7f9e7ad9d700 1 --2- 172.21.15.8:0/53875083 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e64003c20 0x7f9e64004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7f9e7a59c700 1 --2- 172.21.15.8:0/53875083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e64004810 0x7f9e64004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7f9e7b59e700 1 -- 172.21.15.8:0/53875083 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e64003c20 msgr2=0x7f9e64004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:32.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7f9e7b59e700 1 --2- 172.21.15.8:0/53875083 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e64003c20 0x7f9e64004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7f9e7b59e700 1 -- 172.21.15.8:0/53875083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e64004810 msgr2=0x7f9e64004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:32.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7f9e7b59e700 1 --2- 172.21.15.8:0/53875083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e64004810 0x7f9e64004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.929+0000 7f9e7b59e700 1 -- 172.21.15.8:0/53875083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e7c0cab10 con 0x7f9e640051c0 2023-10-06T04:36:32.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.930+0000 7f9e7b59e700 1 --2- 172.21.15.8:0/53875083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e640051c0 0x7f9e6400ba60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c06d290 tx=0x7f9e700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f218d4e4b240f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.930+0000 7fc6ebc24700 1 -- 172.21.15.8:0/1152947211 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e40c49d0 con 0x7fc6e41552a0 2023-10-06T04:36:32.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.930+0000 7f9e79d9b700 1 -- 172.21.15.8:0/53875083 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7000e610 con 0x7f9e640051c0 2023-10-06T04:36:32.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.930+0000 7fcfa11dd700 1 -- 172.21.15.8:0/1485875471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf9c06bc50 msgr2=0x7fcf9c06adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.930+0000 7fcfa11dd700 1 --2- 172.21.15.8:0/1485875471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf9c06bc50 0x7fcf9c06adc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c06d2c0 tx=0x7fcf900082d0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.930+0000 7f9e79d9b700 1 -- 172.21.15.8:0/53875083 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7000e770 con 0x7f9e640051c0 2023-10-06T04:36:32.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.930+0000 7f9e79d9b700 1 -- 172.21.15.8:0/53875083 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7000eb10 con 0x7f9e640051c0 2023-10-06T04:36:32.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.930+0000 7f2653994700 1 -- 172.21.15.8:0/3027847283 shutdown_connections 2023-10-06T04:36:32.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.930+0000 7fcfa11dd700 1 -- 172.21.15.8:0/1485875471 shutdown_connections 2023-10-06T04:36:32.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.930+0000 7fcfa11dd700 1 --2- 172.21.15.8:0/1485875471 >> v2:172.21.15.184:3300/0 conn(0x7fcf9c155680 0x7fcf9c0c72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.930+0000 7fcfa11dd700 1 --2- 172.21.15.8:0/1485875471 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf9c06b300 0x7fcf9c159320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.930+0000 7fcfa11dd700 1 --2- 172.21.15.8:0/1485875471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf9c06bc50 0x7fcf9c06adc0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.930+0000 7fcfa11dd700 1 -- 172.21.15.8:0/1485875471 >> 172.21.15.8:0/1485875471 conn(0x7fcf9c0ccf40 msgr2=0x7fcf9c0c8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:32.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.930+0000 7f60787d5700 1 -- 172.21.15.8:0/2232770221 shutdown_connections 2023-10-06T04:36:32.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.930+0000 7f60787d5700 1 --2- 172.21.15.8:0/2232770221 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6070155670 0x7f6070159120 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.930+0000 7f60787d5700 1 -- 172.21.15.8:0/2232770221 >> 172.21.15.8:0/2232770221 conn(0x7f60700cbff0 msgr2=0x7f60700cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:32.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.930+0000 7f60787d5700 1 -- 172.21.15.8:0/2232770221 shutdown_connections 2023-10-06T04:36:32.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.930+0000 7f60787d5700 1 -- 172.21.15.8:0/2232770221 wait complete. 2023-10-06T04:36:32.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.931+0000 7fb1867fc700 1 -- 172.21.15.8:0/344308666 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb18c00c3e0 con 0x7fb19815d910 2023-10-06T04:36:32.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.931+0000 7fcfa11dd700 1 -- 172.21.15.8:0/1485875471 shutdown_connections 2023-10-06T04:36:32.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.931+0000 7f9e81223700 1 -- 172.21.15.8:0/53875083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e640051c0 msgr2=0x7f9e6400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.931+0000 7f9e81223700 1 --2- 172.21.15.8:0/53875083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e640051c0 0x7f9e6400ba60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c06d290 tx=0x7f9e700091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.931+0000 7f9e7b59e700 1 -- 172.21.15.8:0/53875083 reap_dead start 2023-10-06T04:36:32.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.931+0000 7f9e81223700 1 -- 172.21.15.8:0/53875083 shutdown_connections 2023-10-06T04:36:32.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.931+0000 7f9e81223700 1 -- 172.21.15.8:0/53875083 >> 172.21.15.8:0/53875083 conn(0x7f9e7c0680a0 msgr2=0x7f9e7c0cbff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:32.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.931+0000 7fc6ebc24700 1 -- 172.21.15.8:0/1152947211 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e4071550 con 0x7fc6e41552a0 2023-10-06T04:36:32.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.931+0000 7f9e81223700 1 -- 172.21.15.8:0/53875083 shutdown_connections 2023-10-06T04:36:32.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.931+0000 7fb1867fc700 1 --2- 172.21.15.8:0/344308666 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb178066f80 0x7fb178069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.931+0000 7f9e81223700 1 -- 172.21.15.8:0/53875083 wait complete. 2023-10-06T04:36:32.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.931+0000 7fb1867fc700 1 -- 172.21.15.8:0/344308666 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb18c084f80 con 0x7fb19815d910 2023-10-06T04:36:32.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.932+0000 7f60787d5700 1 Processor -- start 2023-10-06T04:36:32.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.930+0000 7f2653994700 1 -- 172.21.15.8:0/3027847283 wait complete. 2023-10-06T04:36:32.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.932+0000 7f2653994700 1 Processor -- start 2023-10-06T04:36:32.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.932+0000 7f60787d5700 1 -- start start 2023-10-06T04:36:32.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.932+0000 7f2653994700 1 -- start start 2023-10-06T04:36:32.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.933+0000 7fa3fb1d7700 1 Processor -- start 2023-10-06T04:36:32.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.933+0000 7fa3fb1d7700 1 -- start start 2023-10-06T04:36:32.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.933+0000 7f60787d5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60701552a0 0x7f60700c4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.933+0000 7f60787d5700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6070155670 0x7f60700b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.933+0000 7f60787d5700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f607016da30 0x7f60700c7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.933+0000 7f60787d5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60700b0af0 con 0x7f60701552a0 2023-10-06T04:36:32.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.933+0000 7f60787d5700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60700ac5f0 con 0x7f607016da30 2023-10-06T04:36:32.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.933+0000 7f60787d5700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60700b0ce0 con 0x7f6070155670 2023-10-06T04:36:32.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.933+0000 7f2653994700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f264c0687c0 0x7f264c0ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.933+0000 7f2653994700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f264c0ca490 0x7f264c168aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.933+0000 7f6075d70700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6070155670 0x7f60700b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.933+0000 7f6075d70700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6070155670 0x7f60700b05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.8:53312/0 (socket says 172.21.15.8:53312) 2023-10-06T04:36:32.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.933+0000 7f6075d70700 1 -- 172.21.15.8:0/3634720474 learned_addr learned my addr 172.21.15.8:0/3634720474 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:32.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.933+0000 7f2653994700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f264c1561c0 0x7f264c0c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.933+0000 7f2653994700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264c0b2710 con 0x7f264c0ca490 2023-10-06T04:36:32.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.933+0000 7f2653994700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264c1654a0 con 0x7f264c0687c0 2023-10-06T04:36:32.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.933+0000 7f2653994700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f264c0c4420 con 0x7f264c1561c0 2023-10-06T04:36:32.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.933+0000 7f2650f2f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f264c0ca490 0x7f264c168aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.933+0000 7f2650f2f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f264c0ca490 0x7f264c168aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38638/0 (socket says 172.21.15.8:38638) 2023-10-06T04:36:32.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.933+0000 7f2650f2f700 1 -- 172.21.15.8:0/633376724 learned_addr learned my addr 172.21.15.8:0/633376724 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:32.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.933+0000 7f2651f31700 1 --2- 172.21.15.8:0/633376724 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f264c1561c0 0x7f264c0c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.931+0000 7fcfa11dd700 1 -- 172.21.15.8:0/1485875471 wait complete. 2023-10-06T04:36:32.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.933+0000 7fcfa11dd700 1 Processor -- start 2023-10-06T04:36:32.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.933+0000 7f9e81223700 1 Processor -- start 2023-10-06T04:36:32.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.933+0000 7f2651730700 1 --2- 172.21.15.8:0/633376724 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f264c0687c0 0x7f264c0ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.933+0000 7fcfa11dd700 1 -- start start 2023-10-06T04:36:32.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.933+0000 7f6075d70700 1 -- 172.21.15.8:0/3634720474 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f607016da30 msgr2=0x7f60700c7590 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:36:32.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.933+0000 7f6075d70700 1 --2- 172.21.15.8:0/3634720474 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f607016da30 0x7f60700c7590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.933+0000 7f6075d70700 1 -- 172.21.15.8:0/3634720474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60701552a0 msgr2=0x7f60700c4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.933+0000 7f6075d70700 1 --2- 172.21.15.8:0/3634720474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60701552a0 0x7f60700c4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.934+0000 7f6075d70700 1 -- 172.21.15.8:0/3634720474 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606c009420 con 0x7f6070155670 2023-10-06T04:36:32.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.934+0000 7f9e81223700 1 -- start start 2023-10-06T04:36:32.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.934+0000 7f2650f2f700 1 -- 172.21.15.8:0/633376724 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f264c1561c0 msgr2=0x7f264c0c7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.934+0000 7f2650f2f700 1 --2- 172.21.15.8:0/633376724 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f264c1561c0 0x7f264c0c7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.934+0000 7f2650f2f700 1 -- 172.21.15.8:0/633376724 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f264c0687c0 msgr2=0x7f264c0ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.934+0000 7f2650f2f700 1 --2- 172.21.15.8:0/633376724 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f264c0687c0 0x7f264c0ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.934+0000 7f2650f2f700 1 -- 172.21.15.8:0/633376724 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f264400bcf0 con 0x7f264c0ca490 2023-10-06T04:36:32.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.934+0000 7f2651f31700 1 --2- 172.21.15.8:0/633376724 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f264c1561c0 0x7f264c0c7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:36:32.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.934+0000 7f6075d70700 1 --2- 172.21.15.8:0/3634720474 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6070155670 0x7f60700b05b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6070065830 tx=0x7f606c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.934+0000 7fa3fb1d7700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3f40c9dd0 0x7fa3f41596e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.934+0000 7fa3fb1d7700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa3f4159c20 0x7fa3f415a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.934+0000 7fa3fb1d7700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3f40caf80 con 0x7fa3f4159310 2023-10-06T04:36:32.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.934+0000 7fa3fb1d7700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f40cb410 con 0x7fa3f4159c20 2023-10-06T04:36:32.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.934+0000 7fa3fb1d7700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f40ca370 con 0x7fa3f40c9dd0 2023-10-06T04:36:32.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.934+0000 7fa3f9774700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa3f4159c20 0x7fa3f415a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.934+0000 7f2650f2f700 1 --2- 172.21.15.8:0/633376724 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f264c0ca490 0x7f264c168aa0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f263c00ec80 tx=0x7f263c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.934+0000 7fa3f9774700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa3f4159c20 0x7fa3f415a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38652/0 (socket says 172.21.15.8:38652) 2023-10-06T04:36:32.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.934+0000 7fa3f9774700 1 -- 172.21.15.8:0/445953439 learned_addr learned my addr 172.21.15.8:0/445953439 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:32.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.934+0000 7fb19659c700 1 --2- 172.21.15.8:0/344308666 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb178066f80 0x7fb178069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.934+0000 7fa3f9774700 1 -- 172.21.15.8:0/445953439 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3f40c9dd0 msgr2=0x7fa3f41596e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:36:32.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.934+0000 7fa3f9774700 1 --2- 172.21.15.8:0/445953439 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3f40c9dd0 0x7fa3f41596e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.934+0000 7fa3f9774700 1 -- 172.21.15.8:0/445953439 >> v1:172.21.15.8:6789/0 conn(0x7fa3f4159310 legacy=0x7fa3f40c7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:32.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.935+0000 7fa3f9774700 1 -- 172.21.15.8:0/445953439 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f40ca650 con 0x7fa3f4159c20 2023-10-06T04:36:32.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.935+0000 7fa3f9774700 1 --2- 172.21.15.8:0/445953439 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3f4159c20 0x7fa3f415a0a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa3e40099b0 tx=0x7fa3e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92460e7c21ac056d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.935+0000 7f26417fa700 1 -- 172.21.15.8:0/633376724 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263c00c850 con 0x7f264c0ca490 2023-10-06T04:36:32.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.935+0000 7f26417fa700 1 -- 172.21.15.8:0/633376724 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263c00c9b0 con 0x7f264c0ca490 2023-10-06T04:36:32.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.935+0000 7f26417fa700 1 -- 172.21.15.8:0/633376724 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263c00cd50 con 0x7f264c0ca490 2023-10-06T04:36:32.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.935+0000 7f2653994700 1 -- 172.21.15.8:0/633376724 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f264c0c4700 con 0x7f264c0ca490 2023-10-06T04:36:32.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.935+0000 7f2653994700 1 -- 172.21.15.8:0/633376724 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f264c0c4cc0 con 0x7f264c0ca490 2023-10-06T04:36:32.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.935+0000 7fcfa11dd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf9c06b300 0x7fcf9c157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.935+0000 7fcfa11dd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf9c155680 0x7fcf9c158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.935+0000 7fcfa11dd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf9c1592b0 0x7fcf9c159750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.935+0000 7fcfa11dd700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c16e1b0 con 0x7fcf9c1592b0 2023-10-06T04:36:32.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.935+0000 7fcfa11dd700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c0c5000 con 0x7fcf9c155680 2023-10-06T04:36:32.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.935+0000 7fcfa11dd700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c0c52e0 con 0x7fcf9c06b300 2023-10-06T04:36:32.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.934+0000 7f60667fc700 1 -- 172.21.15.8:0/3634720474 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c01f070 con 0x7f6070155670 2023-10-06T04:36:32.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.934+0000 7f60667fc700 1 -- 172.21.15.8:0/3634720474 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606c00bd40 con 0x7f6070155670 2023-10-06T04:36:32.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.934+0000 7f60667fc700 1 -- 172.21.15.8:0/3634720474 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c01a650 con 0x7f6070155670 2023-10-06T04:36:32.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.934+0000 7f60787d5700 1 -- 172.21.15.8:0/3634720474 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60700b0fc0 con 0x7f6070155670 2023-10-06T04:36:32.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.934+0000 7f60787d5700 1 -- 172.21.15.8:0/3634720474 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60700b1580 con 0x7f6070155670 2023-10-06T04:36:32.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.935+0000 7fcf9a59c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf9c155680 0x7fcf9c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.935+0000 7fcf9a59c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf9c155680 0x7fcf9c158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.8:35494/0 (socket says 172.21.15.8:35494) 2023-10-06T04:36:32.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.935+0000 7fcf9a59c700 1 -- 172.21.15.8:0/3115136632 learned_addr learned my addr 172.21.15.8:0/3115136632 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:32.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.935+0000 7f9e81223700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e640051c0 0x7f9e7c0c5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.935+0000 7f9e81223700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e7c15d280 0x7f9e7c144090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.935+0000 7f9e81223700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e7c0a5e00 0x7f9e7c0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.935+0000 7f9e81223700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c15da60 con 0x7f9e7c15d280 2023-10-06T04:36:32.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.935+0000 7f9e81223700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c0a67c0 con 0x7f9e7c0a5e00 2023-10-06T04:36:32.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.935+0000 7f9e81223700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c0c5470 con 0x7f9e640051c0 2023-10-06T04:36:32.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.935+0000 7f9e7a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e7c15d280 0x7f9e7c144090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.935+0000 7f9e7a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e7c15d280 0x7f9e7c144090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38658/0 (socket says 172.21.15.8:38658) 2023-10-06T04:36:32.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.935+0000 7f9e7a59c700 1 -- 172.21.15.8:0/3587312487 learned_addr learned my addr 172.21.15.8:0/3587312487 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:32.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.936+0000 7fcf9b59e700 1 --2- 172.21.15.8:0/3115136632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf9c1592b0 0x7fcf9c159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.936+0000 7fcf9ad9d700 1 --2- 172.21.15.8:0/3115136632 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf9c06b300 0x7fcf9c157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.935+0000 7f9e7a59c700 1 -- 172.21.15.8:0/3587312487 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e640051c0 msgr2=0x7f9e7c0c5900 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T04:36:32.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.935+0000 7f9e7a59c700 1 --2- 172.21.15.8:0/3587312487 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e640051c0 0x7f9e7c0c5900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.936+0000 7f9e7a59c700 1 -- 172.21.15.8:0/3587312487 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e7c0a5e00 msgr2=0x7f9e7c0a6280 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T04:36:32.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.936+0000 7f9e7a59c700 1 --2- 172.21.15.8:0/3587312487 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e7c0a5e00 0x7f9e7c0a6280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.936+0000 7f9e7a59c700 1 -- 172.21.15.8:0/3587312487 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e7c0c4e60 con 0x7f9e7c15d280 2023-10-06T04:36:32.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.936+0000 7f9e7a59c700 1 --2- 172.21.15.8:0/3587312487 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e7c15d280 0x7f9e7c144090 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9e74030c30 tx=0x7f9e74001820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.936+0000 7fa3f37fe700 1 -- 172.21.15.8:0/445953439 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e400b820 con 0x7fa3f4159c20 2023-10-06T04:36:32.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.936+0000 7fa3f37fe700 1 -- 172.21.15.8:0/445953439 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e400b980 con 0x7fa3f4159c20 2023-10-06T04:36:32.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.936+0000 7fa3f37fe700 1 -- 172.21.15.8:0/445953439 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e400bd40 con 0x7fa3f4159c20 2023-10-06T04:36:32.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.937+0000 7fa3fb1d7700 1 -- 172.21.15.8:0/445953439 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3f4159c20 msgr2=0x7fa3f415a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.937+0000 7fa3fb1d7700 1 --2- 172.21.15.8:0/445953439 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3f4159c20 0x7fa3f415a0a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa3e40099b0 tx=0x7fa3e4009250 comp rx=0 tx=0).stop 2023-10-06T04:36:32.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.936+0000 7fcf9b59e700 1 -- 172.21.15.8:0/3115136632 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf9c06b300 msgr2=0x7fcf9c157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.936+0000 7fcf9b59e700 1 --2- 172.21.15.8:0/3115136632 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf9c06b300 0x7fcf9c157bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.936+0000 7fcf9b59e700 1 -- 172.21.15.8:0/3115136632 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf9c155680 msgr2=0x7fcf9c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.936+0000 7fcf9b59e700 1 --2- 172.21.15.8:0/3115136632 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf9c155680 0x7fcf9c158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.936+0000 7fcf9b59e700 1 -- 172.21.15.8:0/3115136632 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf90008570 con 0x7fcf9c1592b0 2023-10-06T04:36:32.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.936+0000 7fcf9b59e700 1 --2- 172.21.15.8:0/3115136632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf9c1592b0 0x7fcf9c159750 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcf9400bad0 tx=0x7fcf94009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.937+0000 7fcf82ffd700 1 -- 172.21.15.8:0/3115136632 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9400c840 con 0x7fcf9c1592b0 2023-10-06T04:36:32.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.937+0000 7fcf82ffd700 1 -- 172.21.15.8:0/3115136632 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9400c9c0 con 0x7fcf9c1592b0 2023-10-06T04:36:32.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.937+0000 7fcf82ffd700 1 -- 172.21.15.8:0/3115136632 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9400cd80 con 0x7fcf9c1592b0 2023-10-06T04:36:32.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.937+0000 7fcfa11dd700 1 -- 172.21.15.8:0/3115136632 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf9c0c55c0 con 0x7fcf9c1592b0 2023-10-06T04:36:32.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.937+0000 7fcfa11dd700 1 -- 172.21.15.8:0/3115136632 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf9c159c90 con 0x7fcf9c1592b0 2023-10-06T04:36:32.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.937+0000 7fc6d9ffb700 1 -- 172.21.15.8:0/1152947211 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc6dc01d070 con 0x7fc6e41552a0 2023-10-06T04:36:32.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.936+0000 7fb19659c700 1 --2- 172.21.15.8:0/344308666 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb178066f80 0x7fb178069430 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb190002230 tx=0x7fb190009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.936+0000 7fb1867fc700 1 -- 172.21.15.8:0/344308666 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb18c051da0 con 0x7fb19815d910 2023-10-06T04:36:32.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.937+0000 7f9e62ffd700 1 -- 172.21.15.8:0/3587312487 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7402e7c0 con 0x7f9e7c15d280 2023-10-06T04:36:32.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.937+0000 7f9e62ffd700 1 -- 172.21.15.8:0/3587312487 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7402e940 con 0x7f9e7c15d280 2023-10-06T04:36:32.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.937+0000 7f9e62ffd700 1 -- 172.21.15.8:0/3587312487 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7402ed00 con 0x7f9e7c15d280 2023-10-06T04:36:32.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.938+0000 7fa3fb1d7700 1 -- 172.21.15.8:0/445953439 shutdown_connections 2023-10-06T04:36:32.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.938+0000 7fa3fb1d7700 1 --2- 172.21.15.8:0/445953439 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3f4159c20 0x7fa3f415a0a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.938+0000 7fa3fb1d7700 1 --2- 172.21.15.8:0/445953439 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3f40c9dd0 0x7fa3f41596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.938+0000 7fa3fb1d7700 1 -- 172.21.15.8:0/445953439 >> 172.21.15.8:0/445953439 conn(0x7fa3f40cbff0 msgr2=0x7fa3f40cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:32.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.938+0000 7fa3fb1d7700 1 -- 172.21.15.8:0/445953439 shutdown_connections 2023-10-06T04:36:32.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.937+0000 7f2653994700 1 -- 172.21.15.8:0/633376724 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f264c0c4ee0 con 0x7f264c0ca490 2023-10-06T04:36:32.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.937+0000 7f26417fa700 1 -- 172.21.15.8:0/633376724 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f263c013680 con 0x7f264c0ca490 2023-10-06T04:36:32.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.938+0000 7f26417fa700 1 --2- 172.21.15.8:0/633376724 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2630067000 0x7f26300694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.938+0000 7f26417fa700 1 -- 172.21.15.8:0/633376724 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f263c084b60 con 0x7f264c0ca490 2023-10-06T04:36:32.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.938+0000 7f2651730700 1 --2- 172.21.15.8:0/633376724 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2630067000 0x7f26300694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.938+0000 7fc6d9ffb700 1 --2- 172.21.15.8:0/1152947211 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc6c8067000 0x7fc6c80694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.938+0000 7fc6d9ffb700 1 -- 172.21.15.8:0/1152947211 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fc6dc088920 con 0x7fc6e41552a0 2023-10-06T04:36:32.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.938+0000 7f9e81223700 1 -- 172.21.15.8:0/3587312487 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e7c15d780 con 0x7f9e7c15d280 2023-10-06T04:36:32.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.938+0000 7f9e81223700 1 -- 172.21.15.8:0/3587312487 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e7c155f40 con 0x7f9e7c15d280 2023-10-06T04:36:32.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.939+0000 7f2651730700 1 --2- 172.21.15.8:0/633376724 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2630067000 0x7f26300694b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f264c06d9d0 tx=0x7f264401a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.938+0000 7fc6e91bf700 1 --2- 172.21.15.8:0/1152947211 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc6c8067000 0x7fc6c80694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.938+0000 7f60667fc700 1 -- 172.21.15.8:0/3634720474 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f606c01aa00 con 0x7f6070155670 2023-10-06T04:36:32.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.939+0000 7f60667fc700 1 --2- 172.21.15.8:0/3634720474 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6054067080 0x7f6054069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.939+0000 7f60667fc700 1 -- 172.21.15.8:0/3634720474 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f606c085f10 con 0x7f6070155670 2023-10-06T04:36:32.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.939+0000 7f6076571700 1 --2- 172.21.15.8:0/3634720474 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6054067080 0x7f6054069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.939+0000 7f9e81223700 1 -- 172.21.15.8:0/3587312487 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e7c0c4c90 con 0x7f9e7c15d280 2023-10-06T04:36:32.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.938+0000 7fa3fb1d7700 1 -- 172.21.15.8:0/445953439 wait complete. 2023-10-06T04:36:32.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.939+0000 7fa3fb1d7700 1 Processor -- start 2023-10-06T04:36:32.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.940+0000 7f6076571700 1 --2- 172.21.15.8:0/3634720474 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6054067080 0x7f6054069530 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6060007fd0 tx=0x7f6060007b00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.940+0000 7f60787d5700 1 -- 172.21.15.8:0/3634720474 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60580052b0 con 0x7f6070155670 2023-10-06T04:36:32.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.940+0000 7fa3fb1d7700 1 -- start start 2023-10-06T04:36:32.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.940+0000 7fc6e91bf700 1 --2- 172.21.15.8:0/1152947211 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc6c8067000 0x7fc6c80694b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0006fd0 tx=0x7fc6e0006db0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.941+0000 7fc6d9ffb700 1 -- 172.21.15.8:0/1152947211 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc6dc0558a0 con 0x7fc6e41552a0 2023-10-06T04:36:32.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.941+0000 7fa3fb1d7700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3f40c9dd0 0x7fa3f4156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.941+0000 7fa3fb1d7700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3f4159310 0x7fa3f416a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.941+0000 7fa3fb1d7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3f4159c20 0x7fa3f40ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:32.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.941+0000 7fa3fb1d7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f40ab760 con 0x7fa3f4159c20 2023-10-06T04:36:32.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.941+0000 7fa3fb1d7700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f40ac790 con 0x7fa3f40c9dd0 2023-10-06T04:36:32.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.941+0000 7fa3fb1d7700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f40ab9d0 con 0x7fa3f4159310 2023-10-06T04:36:32.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.941+0000 7fa3f9774700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3f4159c20 0x7fa3f40ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.941+0000 7fa3f9774700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3f4159c20 0x7fa3f40ad000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38682/0 (socket says 172.21.15.8:38682) 2023-10-06T04:36:32.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.941+0000 7fa3f9774700 1 -- 172.21.15.8:0/2489213144 learned_addr learned my addr 172.21.15.8:0/2489213144 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:32.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.941+0000 7fa3f3fff700 1 --2- 172.21.15.8:0/2489213144 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3f4159310 0x7fa3f416a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.941+0000 7fa3f8f73700 1 --2- 172.21.15.8:0/2489213144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3f40c9dd0 0x7fa3f4156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:32.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.942+0000 7fa3f8f73700 1 -- 172.21.15.8:0/2489213144 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3f4159310 msgr2=0x7fa3f416a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.942+0000 7fa3f8f73700 1 --2- 172.21.15.8:0/2489213144 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3f4159310 0x7fa3f416a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.942+0000 7fa3f8f73700 1 -- 172.21.15.8:0/2489213144 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3f4159c20 msgr2=0x7fa3f40ad000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:32.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.942+0000 7fa3f8f73700 1 --2- 172.21.15.8:0/2489213144 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3f4159c20 0x7fa3f40ad000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:32.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.942+0000 7fa3f8f73700 1 -- 172.21.15.8:0/2489213144 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e40094f0 con 0x7fa3f40c9dd0 2023-10-06T04:36:32.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.942+0000 7fa3f8f73700 1 --2- 172.21.15.8:0/2489213144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3f40c9dd0 0x7fa3f4156b10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec00bb00 tx=0x7fa3ec009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:32.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.943+0000 7fa3f0ff9700 1 -- 172.21.15.8:0/2489213144 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec00c7c0 con 0x7fa3f40c9dd0 2023-10-06T04:36:32.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.943+0000 7fa3f0ff9700 1 -- 172.21.15.8:0/2489213144 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3ec00c960 con 0x7fa3f40c9dd0 2023-10-06T04:36:32.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.943+0000 7fa3f0ff9700 1 -- 172.21.15.8:0/2489213144 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec00cd20 con 0x7fa3f40c9dd0 2023-10-06T04:36:32.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.943+0000 7fa3fb1d7700 1 -- 172.21.15.8:0/2489213144 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f40abcb0 con 0x7fa3f40c9dd0 2023-10-06T04:36:33.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.943+0000 7fa3fb1d7700 1 -- 172.21.15.8:0/2489213144 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f40ac270 con 0x7fa3f40c9dd0 2023-10-06T04:36:33.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.944+0000 7fbc837ae700 1 Processor -- start 2023-10-06T04:36:33.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.944+0000 7fa3fb1d7700 1 -- 172.21.15.8:0/2489213144 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f40ac490 con 0x7fa3f40c9dd0 2023-10-06T04:36:33.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.944+0000 7fbc837ae700 1 -- start start 2023-10-06T04:36:33.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.944+0000 7f26417fa700 1 -- 172.21.15.8:0/633376724 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f263c051a00 con 0x7f264c0ca490 2023-10-06T04:36:33.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.941+0000 7fcfa11dd700 1 -- 172.21.15.8:0/3115136632 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf9c16e360 con 0x7fcf9c1592b0 2023-10-06T04:36:33.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.945+0000 7f60667fc700 1 -- 172.21.15.8:0/3634720474 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f606c052d10 con 0x7f6070155670 2023-10-06T04:36:33.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.945+0000 7fbc837ae700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbc7c0af420 0x7fbc7c0ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:33.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.945+0000 7fbc837ae700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc7c0b58f0 0x7fbc7c15d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:33.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.945+0000 7fa3f0ff9700 1 -- 172.21.15.8:0/2489213144 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa3ec014620 con 0x7fa3f40c9dd0 2023-10-06T04:36:33.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.945+0000 7fa3f0ff9700 1 --2- 172.21.15.8:0/2489213144 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa3e0067000 0x7fa3e00694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:33.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.945+0000 7fbc837ae700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc7c0cbec0 con 0x7fbc7c0cc350 2023-10-06T04:36:33.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.945+0000 7fbc837ae700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc7c0cb2b0 con 0x7fbc7c0af420 2023-10-06T04:36:33.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.945+0000 7fbc837ae700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c0cb590 con 0x7fbc7c0b58f0 2023-10-06T04:36:33.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.945+0000 7fa3f0ff9700 1 -- 172.21.15.8:0/2489213144 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa3ec084690 con 0x7fa3f40c9dd0 2023-10-06T04:36:33.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.946+0000 7fcf82ffd700 1 -- 172.21.15.8:0/3115136632 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcf94014620 con 0x7fcf9c1592b0 2023-10-06T04:36:33.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.947+0000 7fcf82ffd700 1 --2- 172.21.15.8:0/3115136632 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fcf88067000 0x7fcf880694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:33.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.947+0000 7fbc80d49700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc7c0b58f0 0x7fbc7c15d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:33.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.947+0000 7fcf82ffd700 1 -- 172.21.15.8:0/3115136632 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fcf94084fc0 con 0x7fcf9c1592b0 2023-10-06T04:36:33.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.947+0000 7fbc80d49700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc7c0b58f0 0x7fbc7c15d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.8:53346/0 (socket says 172.21.15.8:53346) 2023-10-06T04:36:33.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.947+0000 7fbc80d49700 1 -- 172.21.15.8:0/776170983 learned_addr learned my addr 172.21.15.8:0/776170983 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:33.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.947+0000 7fbc80d49700 1 -- 172.21.15.8:0/776170983 >> v2:172.21.15.8:3300/0 conn(0x7fbc7c0af420 msgr2=0x7fbc7c0ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:33.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.947+0000 7fbc80d49700 1 --2- 172.21.15.8:0/776170983 >> v2:172.21.15.8:3300/0 conn(0x7fbc7c0af420 0x7fbc7c0ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.947+0000 7fbc80d49700 1 -- 172.21.15.8:0/776170983 >> v1:172.21.15.184:6789/0 conn(0x7fbc7c0cc350 legacy=0x7fbc7c15dd20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:36:33.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.947+0000 7fbc80d49700 1 -- 172.21.15.8:0/776170983 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc7c0cb870 con 0x7fbc7c0b58f0 2023-10-06T04:36:33.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.947+0000 7fbc80d49700 1 --2- 172.21.15.8:0/776170983 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc7c0b58f0 0x7fbc7c15d7e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbc780099b0 tx=0x7fbc78009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75bf3662e229bb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:33.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.948+0000 7fbc73fff700 1 -- 172.21.15.8:0/776170983 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7800b8b0 con 0x7fbc7c0b58f0 2023-10-06T04:36:33.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.948+0000 7fbc73fff700 1 -- 172.21.15.8:0/776170983 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7800ba10 con 0x7fbc7c0b58f0 2023-10-06T04:36:33.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.948+0000 7fbc73fff700 1 -- 172.21.15.8:0/776170983 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7800bdb0 con 0x7fbc7c0b58f0 2023-10-06T04:36:33.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.949+0000 7fcf9ad9d700 1 --2- 172.21.15.8:0/3115136632 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fcf88067000 0x7fcf880694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:33.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.949+0000 7fbc837ae700 1 -- 172.21.15.8:0/776170983 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc7c0b58f0 msgr2=0x7fbc7c15d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:33.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.949+0000 7fbc837ae700 1 --2- 172.21.15.8:0/776170983 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc7c0b58f0 0x7fbc7c15d7e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbc780099b0 tx=0x7fbc78009250 comp rx=0 tx=0).stop 2023-10-06T04:36:33.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.949+0000 7fbc837ae700 1 -- 172.21.15.8:0/776170983 shutdown_connections 2023-10-06T04:36:33.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.949+0000 7fbc837ae700 1 --2- 172.21.15.8:0/776170983 >> v2:172.21.15.8:3300/0 conn(0x7fbc7c0af420 0x7fbc7c0ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.949+0000 7fbc837ae700 1 --2- 172.21.15.8:0/776170983 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc7c0b58f0 0x7fbc7c15d7e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.949+0000 7fbc837ae700 1 -- 172.21.15.8:0/776170983 >> 172.21.15.8:0/776170983 conn(0x7fbc7c0cce80 msgr2=0x7fbc7c0cd280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:33.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.949+0000 7fbc837ae700 1 -- 172.21.15.8:0/776170983 shutdown_connections 2023-10-06T04:36:33.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.949+0000 7fbc837ae700 1 -- 172.21.15.8:0/776170983 wait complete. 2023-10-06T04:36:33.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.949+0000 7fcf9ad9d700 1 --2- 172.21.15.8:0/3115136632 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fcf88067000 0x7fcf880694b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c009ca0 tx=0x7fcf8c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:33.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.950+0000 7fa3f0ff9700 1 -- 172.21.15.8:0/2489213144 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3ec04c5a0 con 0x7fa3f40c9dd0 2023-10-06T04:36:33.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.951+0000 7fbc837ae700 1 Processor -- start 2023-10-06T04:36:33.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.951+0000 7fbc837ae700 1 -- start start 2023-10-06T04:36:33.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.951+0000 7f9e62ffd700 1 -- 172.21.15.8:0/3587312487 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e74037650 con 0x7f9e7c15d280 2023-10-06T04:36:33.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.951+0000 7f9e62ffd700 1 --2- 172.21.15.8:0/3587312487 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9e68067080 0x7f9e68069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:33.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.951+0000 7f9e62ffd700 1 -- 172.21.15.8:0/3587312487 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9e740a7be0 con 0x7f9e7c15d280 2023-10-06T04:36:33.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.952+0000 7fa3f3fff700 1 --2- 172.21.15.8:0/2489213144 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa3e0067000 0x7fa3e00694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:33.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.952+0000 7f9e7ad9d700 1 --2- 172.21.15.8:0/3587312487 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9e68067080 0x7f9e68069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:33.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.952+0000 7f9e7ad9d700 1 --2- 172.21.15.8:0/3587312487 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9e68067080 0x7f9e68069530 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c007ae0 tx=0x7f9e6c0079d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:33.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.952+0000 7fbc837ae700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc7c0af420 0x7fbc7c1587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:33.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.952+0000 7fbc837ae700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc7c0b58f0 0x7fbc7c0c3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:33.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.952+0000 7fbc837ae700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc7c0cc350 0x7fbc7c0c4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:33.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.952+0000 7fbc837ae700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c0b2b40 con 0x7fbc7c0af420 2023-10-06T04:36:33.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.952+0000 7fbc837ae700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c0c7830 con 0x7fbc7c0cc350 2023-10-06T04:36:33.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.952+0000 7fbc837ae700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c158cf0 con 0x7fbc7c0b58f0 2023-10-06T04:36:33.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.953+0000 7fbc80d49700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc7c0b58f0 0x7fbc7c0c3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:33.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.953+0000 7fbc80d49700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc7c0b58f0 0x7fbc7c0c3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.8:53354/0 (socket says 172.21.15.8:53354) 2023-10-06T04:36:33.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.953+0000 7fbc80d49700 1 -- 172.21.15.8:0/760361312 learned_addr learned my addr 172.21.15.8:0/760361312 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:33.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.953+0000 7fbc8154a700 1 --2- 172.21.15.8:0/760361312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc7c0af420 0x7fbc7c1587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:33.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.953+0000 7fbc8154a700 1 -- 172.21.15.8:0/760361312 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc7c0b58f0 msgr2=0x7fbc7c0c3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:33.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.953+0000 7fbc8154a700 1 --2- 172.21.15.8:0/760361312 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc7c0b58f0 0x7fbc7c0c3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.953+0000 7fbc8154a700 1 -- 172.21.15.8:0/760361312 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc7c0cc350 msgr2=0x7fbc7c0c4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:33.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.953+0000 7fbc8154a700 1 --2- 172.21.15.8:0/760361312 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc7c0cc350 0x7fbc7c0c4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.953+0000 7fbc8154a700 1 -- 172.21.15.8:0/760361312 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc780094f0 con 0x7fbc7c0af420 2023-10-06T04:36:33.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.953+0000 7fbc8154a700 1 --2- 172.21.15.8:0/760361312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc7c0af420 0x7fbc7c1587b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c00b630 tx=0x7fbc6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:33.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.954+0000 7fa3f3fff700 1 --2- 172.21.15.8:0/2489213144 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa3e0067000 0x7fa3e00694b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40ab380 tx=0x7fa3e8009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:33.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.958+0000 7fcf82ffd700 1 -- 172.21.15.8:0/3115136632 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcf94051f40 con 0x7fcf9c1592b0 2023-10-06T04:36:33.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.959+0000 7f9e62ffd700 1 -- 172.21.15.8:0/3587312487 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e74074a60 con 0x7f9e7c15d280 2023-10-06T04:36:33.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.959+0000 7fbc717fa700 1 -- 172.21.15.8:0/760361312 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c00f510 con 0x7fbc7c0af420 2023-10-06T04:36:33.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.959+0000 7fbc717fa700 1 -- 172.21.15.8:0/760361312 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6c00f670 con 0x7fbc7c0af420 2023-10-06T04:36:33.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.959+0000 7fbc837ae700 1 -- 172.21.15.8:0/760361312 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc7c0ca4d0 con 0x7fbc7c0af420 2023-10-06T04:36:33.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.959+0000 7fbc717fa700 1 -- 172.21.15.8:0/760361312 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c00fa30 con 0x7fbc7c0af420 2023-10-06T04:36:33.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.959+0000 7fbc837ae700 1 -- 172.21.15.8:0/760361312 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc7c0c74c0 con 0x7fbc7c0af420 2023-10-06T04:36:33.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.962+0000 7fbc837ae700 1 -- 172.21.15.8:0/760361312 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc7c0646e0 con 0x7fbc7c0af420 2023-10-06T04:36:33.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.974+0000 7fbc717fa700 1 -- 172.21.15.8:0/760361312 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbc6c024430 con 0x7fbc7c0af420 2023-10-06T04:36:33.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.974+0000 7fbc717fa700 1 --2- 172.21.15.8:0/760361312 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fbc60066fb0 0x7fbc60069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:33.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.974+0000 7fbc717fa700 1 -- 172.21.15.8:0/760361312 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fbc6c084f30 con 0x7fbc7c0af420 2023-10-06T04:36:33.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.974+0000 7fbc717fa700 1 -- 172.21.15.8:0/760361312 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc6c0853c0 con 0x7fbc7c0af420 2023-10-06T04:36:33.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.975+0000 7fbc80d49700 1 --2- 172.21.15.8:0/760361312 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fbc60066fb0 0x7fbc60069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:33.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:32.976+0000 7fbc80d49700 1 --2- 172.21.15.8:0/760361312 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fbc60066fb0 0x7fbc60069460 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbc78003080 tx=0x7fbc78016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:33.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.334+0000 7fb19cf3d700 1 -- 172.21.15.8:0/344308666 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb1980c4d50 con 0x7fb19815d910 2023-10-06T04:36:33.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.342+0000 7f9e81223700 1 -- 172.21.15.8:0/3587312487 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9e7c0c55e0 con 0x7f9e7c15d280 2023-10-06T04:36:33.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.342+0000 7fb1867fc700 1 -- 172.21.15.8:0/344308666 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb1980c4d50 con 0x7fb19815d910 2023-10-06T04:36:33.411 INFO:teuthology.orchestra.run.smithi008.stdout:55834574854 2023-10-06T04:36:33.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.345+0000 7f9e62ffd700 1 -- 172.21.15.8:0/3587312487 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9e7402ee60 con 0x7f9e7c15d280 2023-10-06T04:36:33.412 INFO:teuthology.orchestra.run.smithi008.stdout:55834574855 2023-10-06T04:36:33.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.347+0000 7fc6ebc24700 1 -- 172.21.15.8:0/1152947211 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fc6e41514d0 con 0x7fc6e41552a0 2023-10-06T04:36:33.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.348+0000 7fc6d9ffb700 1 -- 172.21.15.8:0/1152947211 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc6dc02e090 con 0x7fc6e41552a0 2023-10-06T04:36:33.413 INFO:teuthology.orchestra.run.smithi008.stdout:55834574856 2023-10-06T04:36:33.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.349+0000 7f9e81223700 1 -- 172.21.15.8:0/3587312487 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9e68067080 msgr2=0x7f9e68069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:33.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.349+0000 7f9e81223700 1 --2- 172.21.15.8:0/3587312487 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9e68067080 0x7f9e68069530 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c007ae0 tx=0x7f9e6c0079d0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.349+0000 7f9e81223700 1 -- 172.21.15.8:0/3587312487 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e7c15d280 msgr2=0x7f9e7c144090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:33.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.349+0000 7f9e81223700 1 --2- 172.21.15.8:0/3587312487 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e7c15d280 0x7f9e7c144090 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9e74030c30 tx=0x7f9e74001820 comp rx=0 tx=0).stop 2023-10-06T04:36:33.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.352+0000 7f9e81223700 1 -- 172.21.15.8:0/3587312487 shutdown_connections 2023-10-06T04:36:33.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.352+0000 7f9e81223700 1 --2- 172.21.15.8:0/3587312487 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9e68067080 0x7f9e68069530 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c007ae0 tx=0x7f9e6c0079d0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.352+0000 7f9e81223700 1 --2- 172.21.15.8:0/3587312487 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e7c0a5e00 0x7f9e7c0a6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.352+0000 7f9e81223700 1 --2- 172.21.15.8:0/3587312487 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e640051c0 0x7f9e7c0c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.352+0000 7f9e81223700 1 --2- 172.21.15.8:0/3587312487 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e7c15d280 0x7f9e7c144090 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.352+0000 7f9e81223700 1 -- 172.21.15.8:0/3587312487 >> 172.21.15.8:0/3587312487 conn(0x7f9e7c0680a0 msgr2=0x7f9e7c069410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:33.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.352+0000 7f9e81223700 1 -- 172.21.15.8:0/3587312487 shutdown_connections 2023-10-06T04:36:33.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.352+0000 7fb19cf3d700 1 -- 172.21.15.8:0/344308666 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb178066f80 msgr2=0x7fb178069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:33.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.352+0000 7fb19cf3d700 1 --2- 172.21.15.8:0/344308666 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb178066f80 0x7fb178069430 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb190002230 tx=0x7fb190009040 comp rx=0 tx=0).stop 2023-10-06T04:36:33.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.352+0000 7fb19cf3d700 1 -- 172.21.15.8:0/344308666 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb19815d910 msgr2=0x7fb198171840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:33.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.352+0000 7fb19cf3d700 1 --2- 172.21.15.8:0/344308666 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb19815d910 0x7fb198171840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb18c00e950 tx=0x7fb18c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.352+0000 7f9e81223700 1 -- 172.21.15.8:0/3587312487 wait complete. 2023-10-06T04:36:33.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.352+0000 7fb19cf3d700 1 -- 172.21.15.8:0/344308666 shutdown_connections 2023-10-06T04:36:33.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.352+0000 7fb19cf3d700 1 --2- 172.21.15.8:0/344308666 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb178066f80 0x7fb178069430 secure :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb190002230 tx=0x7fb190009040 comp rx=0 tx=0).stop 2023-10-06T04:36:33.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.352+0000 7fb19cf3d700 1 --2- 172.21.15.8:0/344308666 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb19815d910 0x7fb198171840 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.352+0000 7fb19cf3d700 1 --2- 172.21.15.8:0/344308666 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1980699d0 0x7fb19816f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.352+0000 7fb19cf3d700 1 --2- 172.21.15.8:0/344308666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1980ca000 0x7fb198171000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.352+0000 7fb19cf3d700 1 -- 172.21.15.8:0/344308666 >> 172.21.15.8:0/344308666 conn(0x7fb1980cc430 msgr2=0x7fb19806b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:33.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.353+0000 7fc6ebc24700 1 -- 172.21.15.8:0/1152947211 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc6c8067000 msgr2=0x7fc6c80694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:33.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.353+0000 7fc6ebc24700 1 --2- 172.21.15.8:0/1152947211 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc6c8067000 0x7fc6c80694b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0006fd0 tx=0x7fc6e0006db0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.353+0000 7fc6ebc24700 1 -- 172.21.15.8:0/1152947211 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6e41552a0 msgr2=0x7fc6e4148200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:33.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.353+0000 7fc6ebc24700 1 --2- 172.21.15.8:0/1152947211 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6e41552a0 0x7fc6e4148200 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4159c20 tx=0x7fc6dc01b000 comp rx=0 tx=0).stop 2023-10-06T04:36:33.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.354+0000 7fc6ebc24700 1 -- 172.21.15.8:0/1152947211 shutdown_connections 2023-10-06T04:36:33.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.354+0000 7fc6ebc24700 1 --2- 172.21.15.8:0/1152947211 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc6c8067000 0x7fc6c80694b0 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0006fd0 tx=0x7fc6e0006db0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.354+0000 7fc6ebc24700 1 --2- 172.21.15.8:0/1152947211 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6e4148a70 0x7fc6e40aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.354+0000 7fc6ebc24700 1 --2- 172.21.15.8:0/1152947211 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6e41552a0 0x7fc6e4148200 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.354+0000 7fc6ebc24700 1 --2- 172.21.15.8:0/1152947211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6e4155670 0x7fc6e40ad690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.354+0000 7fc6ebc24700 1 -- 172.21.15.8:0/1152947211 >> 172.21.15.8:0/1152947211 conn(0x7fc6e40cbff0 msgr2=0x7fc6e414f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:33.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.354+0000 7fb19cf3d700 1 -- 172.21.15.8:0/344308666 shutdown_connections 2023-10-06T04:36:33.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.355+0000 7fb19cf3d700 1 -- 172.21.15.8:0/344308666 wait complete. 2023-10-06T04:36:33.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.359+0000 7fc6ebc24700 1 -- 172.21.15.8:0/1152947211 shutdown_connections 2023-10-06T04:36:33.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.359+0000 7fc6ebc24700 1 -- 172.21.15.8:0/1152947211 wait complete. 2023-10-06T04:36:33.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.369+0000 7fa3fb1d7700 1 -- 172.21.15.8:0/2489213144 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa3f4071550 con 0x7fa3f40c9dd0 2023-10-06T04:36:33.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.371+0000 7f2653994700 1 -- 172.21.15.8:0/633376724 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f264c071550 con 0x7f264c0ca490 2023-10-06T04:36:33.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.372+0000 7fcfa11dd700 1 -- 172.21.15.8:0/3115136632 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fcf9c04c380 con 0x7fcf9c1592b0 2023-10-06T04:36:33.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.372+0000 7f60787d5700 1 -- 172.21.15.8:0/3634720474 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f6058005560 con 0x7f6070155670 2023-10-06T04:36:33.420 INFO:teuthology.orchestra.run.smithi008.stdout:55834574855 2023-10-06T04:36:33.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.373+0000 7fcf82ffd700 1 -- 172.21.15.8:0/3115136632 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcf94022090 con 0x7fcf9c1592b0 2023-10-06T04:36:33.421 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2023-10-06T04:36:33.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.372+0000 7f26417fa700 1 -- 172.21.15.8:0/633376724 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f263c055020 con 0x7f264c0ca490 2023-10-06T04:36:33.421 INFO:teuthology.orchestra.run.smithi008.stdout:55834574855 2023-10-06T04:36:33.422 DEBUG:teuthology.parallel:result is None 2023-10-06T04:36:33.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.373+0000 7f60667fc700 1 -- 172.21.15.8:0/3634720474 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f606c028030 con 0x7f6070155670 2023-10-06T04:36:33.422 INFO:teuthology.orchestra.run.smithi008.stdout:55834574856 2023-10-06T04:36:33.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.375+0000 7fcfa11dd700 1 -- 172.21.15.8:0/3115136632 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fcf88067000 msgr2=0x7fcf880694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:33.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.375+0000 7fcfa11dd700 1 --2- 172.21.15.8:0/3115136632 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fcf88067000 0x7fcf880694b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c009ca0 tx=0x7fcf8c008040 comp rx=0 tx=0).stop 2023-10-06T04:36:33.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.375+0000 7fcfa11dd700 1 -- 172.21.15.8:0/3115136632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf9c1592b0 msgr2=0x7fcf9c159750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:33.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.375+0000 7fcfa11dd700 1 --2- 172.21.15.8:0/3115136632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf9c1592b0 0x7fcf9c159750 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcf9400bad0 tx=0x7fcf94009780 comp rx=0 tx=0).stop 2023-10-06T04:36:33.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.375+0000 7fcfa11dd700 1 -- 172.21.15.8:0/3115136632 shutdown_connections 2023-10-06T04:36:33.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.375+0000 7fcfa11dd700 1 --2- 172.21.15.8:0/3115136632 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fcf88067000 0x7fcf880694b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.375+0000 7fcfa11dd700 1 --2- 172.21.15.8:0/3115136632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcf9c1592b0 0x7fcf9c159750 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.375+0000 7fcfa11dd700 1 --2- 172.21.15.8:0/3115136632 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf9c06b300 0x7fcf9c157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.375+0000 7fcfa11dd700 1 --2- 172.21.15.8:0/3115136632 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf9c155680 0x7fcf9c158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.375+0000 7fcfa11dd700 1 -- 172.21.15.8:0/3115136632 >> 172.21.15.8:0/3115136632 conn(0x7fcf9c0ccf40 msgr2=0x7fcf9c06d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:33.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.376+0000 7f2653994700 1 -- 172.21.15.8:0/633376724 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2630067000 msgr2=0x7f26300694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:33.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.376+0000 7f2653994700 1 --2- 172.21.15.8:0/633376724 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2630067000 0x7f26300694b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f264c06d9d0 tx=0x7f264401a000 comp rx=0 tx=0).stop 2023-10-06T04:36:33.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.376+0000 7f2653994700 1 -- 172.21.15.8:0/633376724 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f264c0ca490 msgr2=0x7f264c168aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:33.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.376+0000 7f2653994700 1 --2- 172.21.15.8:0/633376724 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f264c0ca490 0x7f264c168aa0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f263c00ec80 tx=0x7f263c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.376+0000 7f60787d5700 1 -- 172.21.15.8:0/3634720474 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6054067080 msgr2=0x7f6054069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:33.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.376+0000 7f60787d5700 1 --2- 172.21.15.8:0/3634720474 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6054067080 0x7f6054069530 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6060007fd0 tx=0x7f6060007b00 comp rx=0 tx=0).stop 2023-10-06T04:36:33.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.376+0000 7f60787d5700 1 -- 172.21.15.8:0/3634720474 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6070155670 msgr2=0x7f60700b05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:33.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.376+0000 7f60787d5700 1 --2- 172.21.15.8:0/3634720474 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6070155670 0x7f60700b05b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6070065830 tx=0x7f606c017000 comp rx=0 tx=0).stop 2023-10-06T04:36:33.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.377+0000 7f60787d5700 1 -- 172.21.15.8:0/3634720474 shutdown_connections 2023-10-06T04:36:33.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.377+0000 7f60787d5700 1 --2- 172.21.15.8:0/3634720474 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6054067080 0x7f6054069530 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.377+0000 7f60787d5700 1 --2- 172.21.15.8:0/3634720474 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f607016da30 0x7f60700c7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.377+0000 7f60787d5700 1 --2- 172.21.15.8:0/3634720474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60701552a0 0x7f60700c4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.377+0000 7f60787d5700 1 --2- 172.21.15.8:0/3634720474 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6070155670 0x7f60700b05b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.377+0000 7f60787d5700 1 -- 172.21.15.8:0/3634720474 >> 172.21.15.8:0/3634720474 conn(0x7f60700cbff0 msgr2=0x7f60700c9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:33.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.377+0000 7fcfa11dd700 1 -- 172.21.15.8:0/3115136632 shutdown_connections 2023-10-06T04:36:33.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.377+0000 7fcfa11dd700 1 -- 172.21.15.8:0/3115136632 wait complete. 2023-10-06T04:36:33.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.377+0000 7f2653994700 1 -- 172.21.15.8:0/633376724 shutdown_connections 2023-10-06T04:36:33.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.377+0000 7f2653994700 1 --2- 172.21.15.8:0/633376724 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2630067000 0x7f26300694b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.377+0000 7f2653994700 1 --2- 172.21.15.8:0/633376724 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f264c1561c0 0x7f264c0c7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.377+0000 7f2653994700 1 --2- 172.21.15.8:0/633376724 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f264c0687c0 0x7f264c0ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.377+0000 7f2653994700 1 --2- 172.21.15.8:0/633376724 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f264c0ca490 0x7f264c168aa0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.377+0000 7f2653994700 1 -- 172.21.15.8:0/633376724 >> 172.21.15.8:0/633376724 conn(0x7f264c0c9330 msgr2=0x7f264c0ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:33.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.377+0000 7f2653994700 1 -- 172.21.15.8:0/633376724 shutdown_connections 2023-10-06T04:36:33.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.377+0000 7f2653994700 1 -- 172.21.15.8:0/633376724 wait complete. 2023-10-06T04:36:33.428 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2023-10-06T04:36:33.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.379+0000 7f60787d5700 1 -- 172.21.15.8:0/3634720474 shutdown_connections 2023-10-06T04:36:33.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.379+0000 7f60787d5700 1 -- 172.21.15.8:0/3634720474 wait complete. 2023-10-06T04:36:33.429 DEBUG:teuthology.parallel:result is None 2023-10-06T04:36:33.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.379+0000 7fa3f0ff9700 1 -- 172.21.15.8:0/2489213144 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa3ec051530 con 0x7fa3f40c9dd0 2023-10-06T04:36:33.429 INFO:teuthology.orchestra.run.smithi008.stdout:55834574854 2023-10-06T04:36:33.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.381+0000 7fa3fb1d7700 1 -- 172.21.15.8:0/2489213144 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa3e0067000 msgr2=0x7fa3e00694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:33.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.381+0000 7fa3fb1d7700 1 --2- 172.21.15.8:0/2489213144 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa3e0067000 0x7fa3e00694b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40ab380 tx=0x7fa3e8009060 comp rx=0 tx=0).stop 2023-10-06T04:36:33.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.381+0000 7fa3fb1d7700 1 -- 172.21.15.8:0/2489213144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3f40c9dd0 msgr2=0x7fa3f4156b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:33.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.381+0000 7fa3fb1d7700 1 --2- 172.21.15.8:0/2489213144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3f40c9dd0 0x7fa3f4156b10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec00bb00 tx=0x7fa3ec009780 comp rx=0 tx=0).stop 2023-10-06T04:36:33.431 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2023-10-06T04:36:33.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.387+0000 7fa3fb1d7700 1 -- 172.21.15.8:0/2489213144 shutdown_connections 2023-10-06T04:36:33.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.387+0000 7fa3fb1d7700 1 --2- 172.21.15.8:0/2489213144 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa3e0067000 0x7fa3e00694b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.387+0000 7fa3fb1d7700 1 --2- 172.21.15.8:0/2489213144 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3f4159c20 0x7fa3f40ad000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.387+0000 7fa3fb1d7700 1 --2- 172.21.15.8:0/2489213144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3f40c9dd0 0x7fa3f4156b10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.387+0000 7fa3fb1d7700 1 --2- 172.21.15.8:0/2489213144 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3f4159310 0x7fa3f416a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.387+0000 7fa3fb1d7700 1 -- 172.21.15.8:0/2489213144 >> 172.21.15.8:0/2489213144 conn(0x7fa3f40cbff0 msgr2=0x7fa3f415ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:33.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.387+0000 7fa3fb1d7700 1 -- 172.21.15.8:0/2489213144 shutdown_connections 2023-10-06T04:36:33.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.387+0000 7fa3fb1d7700 1 -- 172.21.15.8:0/2489213144 wait complete. 2023-10-06T04:36:33.433 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2023-10-06T04:36:33.433 DEBUG:teuthology.parallel:result is None 2023-10-06T04:36:33.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2023-10-06T04:36:33.434 DEBUG:teuthology.parallel:result is None 2023-10-06T04:36:33.435 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.5 2023-10-06T04:36:33.435 DEBUG:teuthology.parallel:result is None 2023-10-06T04:36:33.436 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-10-06T04:36:33.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.404+0000 7fbc837ae700 1 -- 172.21.15.8:0/760361312 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fbc7c159b90 con 0x7fbc7c0af420 2023-10-06T04:36:33.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.404+0000 7fbc717fa700 1 -- 172.21.15.8:0/760361312 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbc6c051e60 con 0x7fbc7c0af420 2023-10-06T04:36:33.436 DEBUG:teuthology.parallel:result is None 2023-10-06T04:36:33.437 INFO:teuthology.orchestra.run.smithi008.stdout:55834574854 2023-10-06T04:36:33.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.406+0000 7fbc837ae700 1 -- 172.21.15.8:0/760361312 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fbc60066fb0 msgr2=0x7fbc60069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:33.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.406+0000 7fbc837ae700 1 --2- 172.21.15.8:0/760361312 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fbc60066fb0 0x7fbc60069460 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbc78003080 tx=0x7fbc78016000 comp rx=0 tx=0).stop 2023-10-06T04:36:33.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.406+0000 7fbc837ae700 1 -- 172.21.15.8:0/760361312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc7c0af420 msgr2=0x7fbc7c1587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:33.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.406+0000 7fbc837ae700 1 --2- 172.21.15.8:0/760361312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc7c0af420 0x7fbc7c1587b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c00b630 tx=0x7fbc6c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.406+0000 7fbc837ae700 1 -- 172.21.15.8:0/760361312 shutdown_connections 2023-10-06T04:36:33.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.406+0000 7fbc837ae700 1 --2- 172.21.15.8:0/760361312 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fbc60066fb0 0x7fbc60069460 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.406+0000 7fbc837ae700 1 --2- 172.21.15.8:0/760361312 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc7c0cc350 0x7fbc7c0c4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.406+0000 7fbc837ae700 1 --2- 172.21.15.8:0/760361312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc7c0af420 0x7fbc7c1587b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.406+0000 7fbc837ae700 1 --2- 172.21.15.8:0/760361312 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc7c0b58f0 0x7fbc7c0c3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:33.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.406+0000 7fbc837ae700 1 -- 172.21.15.8:0/760361312 >> 172.21.15.8:0/760361312 conn(0x7fbc7c0cce80 msgr2=0x7fbc7c15e490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:33.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.406+0000 7fbc837ae700 1 -- 172.21.15.8:0/760361312 shutdown_connections 2023-10-06T04:36:33.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:33.406+0000 7fbc837ae700 1 -- 172.21.15.8:0/760361312 wait complete. 2023-10-06T04:36:33.439 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2023-10-06T04:36:34.432 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T04:36:34.440 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T04:36:34.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.568+0000 7fd89fb29700 1 Processor -- start 2023-10-06T04:36:34.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.568+0000 7fd89fb29700 1 -- start start 2023-10-06T04:36:34.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.569+0000 7fd89fb29700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd89814c880 0x7fd89806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:34.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.569+0000 7fd89fb29700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8980c76c0 0x7fd8980c1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:34.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.569+0000 7fd89fb29700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8980c0fc0 con 0x7fd89806de00 2023-10-06T04:36:34.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.569+0000 7fd89fb29700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd89806ed00 con 0x7fd89814c880 2023-10-06T04:36:34.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.569+0000 7fd89fb29700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd89806e250 con 0x7fd8980c76c0 2023-10-06T04:36:34.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.569+0000 7fd89d8c5700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd89814c880 0x7fd89806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:34.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.569+0000 7fd89d0c4700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fd89806de00 0x7fd8980c6fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:52504/0 (socket says 172.21.15.8:52504) 2023-10-06T04:36:34.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.569+0000 7fd89d0c4700 1 -- 172.21.15.8:0/2161620255 learned_addr learned my addr 172.21.15.8:0/2161620255 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:34.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.569+0000 7fd89e0c6700 1 --2- 172.21.15.8:0/2161620255 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8980c76c0 0x7fd8980c1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:34.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.569+0000 7fd89d8c5700 1 -- 172.21.15.8:0/2161620255 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8980c76c0 msgr2=0x7fd8980c1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:34.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.569+0000 7fd89d8c5700 1 --2- 172.21.15.8:0/2161620255 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8980c76c0 0x7fd8980c1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:34.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.569+0000 7fd89d8c5700 1 -- 172.21.15.8:0/2161620255 >> v1:172.21.15.8:6789/0 conn(0x7fd89806de00 legacy=0x7fd8980c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:34.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.569+0000 7fd89d8c5700 1 -- 172.21.15.8:0/2161620255 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89806e460 con 0x7fd89814c880 2023-10-06T04:36:34.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.569+0000 7fd89d8c5700 1 --2- 172.21.15.8:0/2161620255 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd89814c880 0x7fd89806d8c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd888009e60 tx=0x7fd888009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=483e386ab8dc1efc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:34.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.570+0000 7fd89c8c3700 1 -- 172.21.15.8:0/2161620255 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88800e070 con 0x7fd89814c880 2023-10-06T04:36:34.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.570+0000 7fd89c8c3700 1 -- 172.21.15.8:0/2161620255 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88800bc30 con 0x7fd89814c880 2023-10-06T04:36:34.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.570+0000 7fd89c8c3700 1 -- 172.21.15.8:0/2161620255 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd888012430 con 0x7fd89814c880 2023-10-06T04:36:34.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.570+0000 7fd89fb29700 1 -- 172.21.15.8:0/2161620255 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd89814c880 msgr2=0x7fd89806d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:34.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.570+0000 7fd89fb29700 1 --2- 172.21.15.8:0/2161620255 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd89814c880 0x7fd89806d8c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd888009e60 tx=0x7fd888009780 comp rx=0 tx=0).stop 2023-10-06T04:36:34.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.570+0000 7fd89fb29700 1 -- 172.21.15.8:0/2161620255 shutdown_connections 2023-10-06T04:36:34.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.570+0000 7fd89fb29700 1 --2- 172.21.15.8:0/2161620255 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8980c76c0 0x7fd8980c1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:34.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.570+0000 7fd89fb29700 1 --2- 172.21.15.8:0/2161620255 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd89814c880 0x7fd89806d8c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:34.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.570+0000 7fd89fb29700 1 -- 172.21.15.8:0/2161620255 >> 172.21.15.8:0/2161620255 conn(0x7fd8980680a0 msgr2=0x7fd8980cbff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:34.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.570+0000 7fd89fb29700 1 -- 172.21.15.8:0/2161620255 shutdown_connections 2023-10-06T04:36:34.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.570+0000 7fd89fb29700 1 -- 172.21.15.8:0/2161620255 wait complete. 2023-10-06T04:36:34.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.572+0000 7fd89fb29700 1 Processor -- start 2023-10-06T04:36:34.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.572+0000 7fd89fb29700 1 -- start start 2023-10-06T04:36:34.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.572+0000 7fd89fb29700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd89806de00 0x7fd898141d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:34.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.572+0000 7fd89fb29700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8980c76c0 0x7fd8981554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:34.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.572+0000 7fd89fb29700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd89814c880 0x7fd898155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:34.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.572+0000 7fd89fb29700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89806b720 con 0x7fd8980c76c0 2023-10-06T04:36:34.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.572+0000 7fd89fb29700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8980c4190 con 0x7fd89806de00 2023-10-06T04:36:34.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.572+0000 7fd89fb29700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd89806aaa0 con 0x7fd89814c880 2023-10-06T04:36:34.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.572+0000 7fd89d0c4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8980c76c0 0x7fd8981554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:34.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.573+0000 7fd89d0c4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8980c76c0 0x7fd8981554c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36242/0 (socket says 172.21.15.8:36242) 2023-10-06T04:36:34.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.573+0000 7fd89d0c4700 1 -- 172.21.15.8:0/4146632751 learned_addr learned my addr 172.21.15.8:0/4146632751 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:34.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.573+0000 7fd89e0c6700 1 --2- 172.21.15.8:0/4146632751 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd89814c880 0x7fd898155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:34.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.573+0000 7fd89d8c5700 1 --2- 172.21.15.8:0/4146632751 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd89806de00 0x7fd898141d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:34.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.573+0000 7fd89d0c4700 1 -- 172.21.15.8:0/4146632751 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd89814c880 msgr2=0x7fd898155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:34.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.573+0000 7fd89d0c4700 1 --2- 172.21.15.8:0/4146632751 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd89814c880 0x7fd898155a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:34.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.573+0000 7fd89d0c4700 1 -- 172.21.15.8:0/4146632751 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd89806de00 msgr2=0x7fd898141d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:34.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.573+0000 7fd89d0c4700 1 --2- 172.21.15.8:0/4146632751 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd89806de00 0x7fd898141d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:34.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.573+0000 7fd89d0c4700 1 -- 172.21.15.8:0/4146632751 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd888009a20 con 0x7fd8980c76c0 2023-10-06T04:36:34.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.573+0000 7fd89e0c6700 1 --2- 172.21.15.8:0/4146632751 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd89814c880 0x7fd898155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:34.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.573+0000 7fd89d0c4700 1 --2- 172.21.15.8:0/4146632751 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8980c76c0 0x7fd8981554c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd88c00e9d0 tx=0x7fd88c00c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:34.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.573+0000 7fd895ffb700 1 -- 172.21.15.8:0/4146632751 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c005b30 con 0x7fd8980c76c0 2023-10-06T04:36:34.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.573+0000 7fd895ffb700 1 -- 172.21.15.8:0/4146632751 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88c005c90 con 0x7fd8980c76c0 2023-10-06T04:36:34.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.573+0000 7fd895ffb700 1 -- 172.21.15.8:0/4146632751 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c004a80 con 0x7fd8980c76c0 2023-10-06T04:36:34.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.573+0000 7fd89fb29700 1 -- 172.21.15.8:0/4146632751 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd89806ad80 con 0x7fd8980c76c0 2023-10-06T04:36:34.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.573+0000 7fd89fb29700 1 -- 172.21.15.8:0/4146632751 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd898142250 con 0x7fd8980c76c0 2023-10-06T04:36:34.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.574+0000 7fd89fb29700 1 -- 172.21.15.8:0/4146632751 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8980c4320 con 0x7fd8980c76c0 2023-10-06T04:36:34.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.575+0000 7fd895ffb700 1 -- 172.21.15.8:0/4146632751 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd88c0070f0 con 0x7fd8980c76c0 2023-10-06T04:36:34.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.575+0000 7fd895ffb700 1 --2- 172.21.15.8:0/4146632751 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd884066f30 0x7fd8840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:34.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.575+0000 7fd895ffb700 1 -- 172.21.15.8:0/4146632751 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd88c086ce0 con 0x7fd8980c76c0 2023-10-06T04:36:34.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.575+0000 7fd89d8c5700 1 --2- 172.21.15.8:0/4146632751 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd884066f30 0x7fd8840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:34.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.576+0000 7fd89d8c5700 1 --2- 172.21.15.8:0/4146632751 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd884066f30 0x7fd8840693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd888009e60 tx=0x7fd888019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:34.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.580+0000 7fd895ffb700 1 -- 172.21.15.8:0/4146632751 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd88c053b80 con 0x7fd8980c76c0 2023-10-06T04:36:34.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.604+0000 7f7b7532c700 1 Processor -- start 2023-10-06T04:36:34.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.604+0000 7f7b7532c700 1 -- start start 2023-10-06T04:36:34.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.605+0000 7f7b7532c700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7b7006e8c0 0x7f7b7013f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:34.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.605+0000 7f7b7532c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b7013fcd0 0x7f7b700cab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:34.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.605+0000 7f7b7532c700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b700c95b0 con 0x7f7b7006e4f0 2023-10-06T04:36:34.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.605+0000 7f7b7532c700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b70140110 con 0x7f7b7006e8c0 2023-10-06T04:36:34.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.605+0000 7f7b7532c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7006bb00 con 0x7f7b7013fcd0 2023-10-06T04:36:34.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.605+0000 7f7b6e7fc700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7b7006e8c0 0x7f7b7013f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:34.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.605+0000 7f7b6effd700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f7b7006e4f0 0x7f7b700c8ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:52520/0 (socket says 172.21.15.8:52520) 2023-10-06T04:36:34.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.605+0000 7f7b6e7fc700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7b7006e8c0 0x7f7b7013f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36252/0 (socket says 172.21.15.8:36252) 2023-10-06T04:36:34.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.605+0000 7f7b6effd700 1 -- 172.21.15.8:0/2554095533 learned_addr learned my addr 172.21.15.8:0/2554095533 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:34.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.605+0000 7f7b6f7fe700 1 --2- 172.21.15.8:0/2554095533 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b7013fcd0 0x7f7b700cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:34.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.605+0000 7f7b6e7fc700 1 -- 172.21.15.8:0/2554095533 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b7013fcd0 msgr2=0x7f7b700cab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:34.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.605+0000 7f7b6e7fc700 1 --2- 172.21.15.8:0/2554095533 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b7013fcd0 0x7f7b700cab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:34.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.605+0000 7f7b6e7fc700 1 -- 172.21.15.8:0/2554095533 >> v1:172.21.15.8:6789/0 conn(0x7f7b7006e4f0 legacy=0x7f7b700c8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:34.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.606+0000 7f7b6e7fc700 1 -- 172.21.15.8:0/2554095533 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b7006bde0 con 0x7f7b7006e8c0 2023-10-06T04:36:34.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.606+0000 7f7b6e7fc700 1 --2- 172.21.15.8:0/2554095533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b7006e8c0 0x7f7b7013f790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7b580098e0 tx=0x7f7b580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca046f2eaa492e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:34.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.606+0000 7f7b6dffb700 1 -- 172.21.15.8:0/2554095533 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b58009e80 con 0x7f7b7006e8c0 2023-10-06T04:36:34.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.606+0000 7f7b6dffb700 1 -- 172.21.15.8:0/2554095533 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5800b860 con 0x7f7b7006e8c0 2023-10-06T04:36:34.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.606+0000 7f7b6dffb700 1 -- 172.21.15.8:0/2554095533 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5800bbe0 con 0x7f7b7006e8c0 2023-10-06T04:36:34.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.606+0000 7f7b7532c700 1 -- 172.21.15.8:0/2554095533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b7006e8c0 msgr2=0x7f7b7013f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:34.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.606+0000 7f7b7532c700 1 --2- 172.21.15.8:0/2554095533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b7006e8c0 0x7f7b7013f790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7b580098e0 tx=0x7f7b580091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:34.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.606+0000 7f7b7532c700 1 -- 172.21.15.8:0/2554095533 shutdown_connections 2023-10-06T04:36:34.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.606+0000 7f7b7532c700 1 --2- 172.21.15.8:0/2554095533 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b7013fcd0 0x7f7b700cab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:34.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.606+0000 7f7b7532c700 1 --2- 172.21.15.8:0/2554095533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b7006e8c0 0x7f7b7013f790 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:34.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.606+0000 7f7b7532c700 1 -- 172.21.15.8:0/2554095533 >> 172.21.15.8:0/2554095533 conn(0x7f7b700ccfa0 msgr2=0x7f7b700cd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:34.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.606+0000 7f7b7532c700 1 -- 172.21.15.8:0/2554095533 shutdown_connections 2023-10-06T04:36:34.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.607+0000 7f7b7532c700 1 -- 172.21.15.8:0/2554095533 wait complete. 2023-10-06T04:36:34.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.608+0000 7f7b7532c700 1 Processor -- start 2023-10-06T04:36:34.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.608+0000 7f7b7532c700 1 -- start start 2023-10-06T04:36:34.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.609+0000 7f7b7532c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b7006e4f0 0x7f7b701530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:34.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.609+0000 7f7b7532c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b7013fcd0 0x7f7b7015b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:34.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.609+0000 7f7b7532c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b701587e0 0x7f7b7015b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:34.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.609+0000 7f7b7532c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b701570c0 con 0x7f7b7006e4f0 2023-10-06T04:36:34.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.609+0000 7f7b7532c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b70153610 con 0x7f7b7013fcd0 2023-10-06T04:36:34.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.609+0000 7f7b7532c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b70159170 con 0x7f7b701587e0 2023-10-06T04:36:34.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.609+0000 7f7b6effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b7006e4f0 0x7f7b701530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:34.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.609+0000 7f7b6effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b7006e4f0 0x7f7b701530d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36260/0 (socket says 172.21.15.8:36260) 2023-10-06T04:36:34.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.609+0000 7f7b6effd700 1 -- 172.21.15.8:0/1804150116 learned_addr learned my addr 172.21.15.8:0/1804150116 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:34.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.609+0000 7f7b6f7fe700 1 --2- 172.21.15.8:0/1804150116 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b701587e0 0x7f7b7015b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:34.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.609+0000 7f7b6e7fc700 1 --2- 172.21.15.8:0/1804150116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b7013fcd0 0x7f7b7015b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:34.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.609+0000 7f7b6effd700 1 -- 172.21.15.8:0/1804150116 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b701587e0 msgr2=0x7f7b7015b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:34.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.609+0000 7f7b6effd700 1 --2- 172.21.15.8:0/1804150116 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b701587e0 0x7f7b7015b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:34.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.609+0000 7f7b6effd700 1 -- 172.21.15.8:0/1804150116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b7013fcd0 msgr2=0x7f7b7015b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:34.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.609+0000 7f7b6effd700 1 --2- 172.21.15.8:0/1804150116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b7013fcd0 0x7f7b7015b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:34.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.609+0000 7f7b6effd700 1 -- 172.21.15.8:0/1804150116 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b58009420 con 0x7f7b7006e4f0 2023-10-06T04:36:34.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.609+0000 7f7b6e7fc700 1 --2- 172.21.15.8:0/1804150116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b7013fcd0 0x7f7b7015b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:34.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.609+0000 7f7b6effd700 1 --2- 172.21.15.8:0/1804150116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b7006e4f0 0x7f7b701530d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7b6000efc0 tx=0x7f7b60001b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:34.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.609+0000 7f7b66ffd700 1 -- 172.21.15.8:0/1804150116 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6000cea0 con 0x7f7b7006e4f0 2023-10-06T04:36:34.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.609+0000 7f7b66ffd700 1 -- 172.21.15.8:0/1804150116 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b60004bb0 con 0x7f7b7006e4f0 2023-10-06T04:36:34.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.609+0000 7f7b7532c700 1 -- 172.21.15.8:0/1804150116 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b70159450 con 0x7f7b7006e4f0 2023-10-06T04:36:34.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.609+0000 7f7b66ffd700 1 -- 172.21.15.8:0/1804150116 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b60011470 con 0x7f7b7006e4f0 2023-10-06T04:36:34.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.609+0000 7f7b7532c700 1 -- 172.21.15.8:0/1804150116 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b70156a70 con 0x7f7b7006e4f0 2023-10-06T04:36:34.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.610+0000 7f7b7532c700 1 -- 172.21.15.8:0/1804150116 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b7004c380 con 0x7f7b7006e4f0 2023-10-06T04:36:34.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.611+0000 7f7b66ffd700 1 -- 172.21.15.8:0/1804150116 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7b60011860 con 0x7f7b7006e4f0 2023-10-06T04:36:34.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.612+0000 7f7b66ffd700 1 --2- 172.21.15.8:0/1804150116 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7b50066f30 0x7f7b500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:34.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.612+0000 7f7b66ffd700 1 -- 172.21.15.8:0/1804150116 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7b60087560 con 0x7f7b7006e4f0 2023-10-06T04:36:34.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.612+0000 7f7b6e7fc700 1 --2- 172.21.15.8:0/1804150116 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7b50066f30 0x7f7b500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:34.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.612+0000 7f7b6e7fc700 1 --2- 172.21.15.8:0/1804150116 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7b50066f30 0x7f7b500693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7b7006ec90 tx=0x7f7b58017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:34.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.616+0000 7f7b66ffd700 1 -- 172.21.15.8:0/1804150116 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7b60054400 con 0x7f7b7006e4f0 2023-10-06T04:36:34.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.779+0000 7fd89fb29700 1 -- 172.21.15.8:0/4146632751 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd898071550 con 0x7fd8980c76c0 2023-10-06T04:36:34.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.779+0000 7fd895ffb700 1 -- 172.21.15.8:0/4146632751 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd88c0571a0 con 0x7fd8980c76c0 2023-10-06T04:36:34.782 INFO:teuthology.orchestra.run.smithi008.stdout:55834574854 2023-10-06T04:36:34.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.781+0000 7fd89fb29700 1 -- 172.21.15.8:0/4146632751 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd884066f30 msgr2=0x7fd8840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:34.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.781+0000 7fd89fb29700 1 --2- 172.21.15.8:0/4146632751 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd884066f30 0x7fd8840693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd888009e60 tx=0x7fd888019000 comp rx=0 tx=0).stop 2023-10-06T04:36:34.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.781+0000 7fd89fb29700 1 -- 172.21.15.8:0/4146632751 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8980c76c0 msgr2=0x7fd8981554c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:34.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.781+0000 7fd89fb29700 1 --2- 172.21.15.8:0/4146632751 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8980c76c0 0x7fd8981554c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd88c00e9d0 tx=0x7fd88c00c270 comp rx=0 tx=0).stop 2023-10-06T04:36:34.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.781+0000 7fd89fb29700 1 -- 172.21.15.8:0/4146632751 shutdown_connections 2023-10-06T04:36:34.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.781+0000 7fd89fb29700 1 --2- 172.21.15.8:0/4146632751 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd884066f30 0x7fd8840693e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:34.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.781+0000 7fd89fb29700 1 --2- 172.21.15.8:0/4146632751 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd89814c880 0x7fd898155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:34.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.781+0000 7fd89fb29700 1 --2- 172.21.15.8:0/4146632751 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd89806de00 0x7fd898141d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:34.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.781+0000 7fd89fb29700 1 --2- 172.21.15.8:0/4146632751 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8980c76c0 0x7fd8981554c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:34.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.781+0000 7fd89fb29700 1 -- 172.21.15.8:0/4146632751 >> 172.21.15.8:0/4146632751 conn(0x7fd8980680a0 msgr2=0x7fd898157040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:34.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.781+0000 7fd89fb29700 1 -- 172.21.15.8:0/4146632751 shutdown_connections 2023-10-06T04:36:34.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.782+0000 7fd89fb29700 1 -- 172.21.15.8:0/4146632751 wait complete. 2023-10-06T04:36:34.796 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2023-10-06T04:36:34.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.812+0000 7f7b7532c700 1 -- 172.21.15.8:0/1804150116 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f7b700c95b0 con 0x7f7b7006e4f0 2023-10-06T04:36:34.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.813+0000 7f7b66ffd700 1 -- 172.21.15.8:0/1804150116 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7b700c95b0 con 0x7f7b7006e4f0 2023-10-06T04:36:34.815 INFO:teuthology.orchestra.run.smithi008.stdout:55834574854 2023-10-06T04:36:34.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.815+0000 7f7b7532c700 1 -- 172.21.15.8:0/1804150116 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7b50066f30 msgr2=0x7f7b500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:34.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.815+0000 7f7b7532c700 1 --2- 172.21.15.8:0/1804150116 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7b50066f30 0x7f7b500693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7b7006ec90 tx=0x7f7b58017000 comp rx=0 tx=0).stop 2023-10-06T04:36:34.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.815+0000 7f7b7532c700 1 -- 172.21.15.8:0/1804150116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b7006e4f0 msgr2=0x7f7b701530d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:34.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.815+0000 7f7b7532c700 1 --2- 172.21.15.8:0/1804150116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b7006e4f0 0x7f7b701530d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7b6000efc0 tx=0x7f7b60001b60 comp rx=0 tx=0).stop 2023-10-06T04:36:34.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.815+0000 7f7b7532c700 1 -- 172.21.15.8:0/1804150116 shutdown_connections 2023-10-06T04:36:34.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.815+0000 7f7b7532c700 1 --2- 172.21.15.8:0/1804150116 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7b50066f30 0x7f7b500693e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:34.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.815+0000 7f7b7532c700 1 --2- 172.21.15.8:0/1804150116 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b701587e0 0x7f7b7015b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:34.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.815+0000 7f7b7532c700 1 --2- 172.21.15.8:0/1804150116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b7006e4f0 0x7f7b701530d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:34.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.815+0000 7f7b7532c700 1 --2- 172.21.15.8:0/1804150116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b7013fcd0 0x7f7b7015b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:34.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.815+0000 7f7b7532c700 1 -- 172.21.15.8:0/1804150116 >> 172.21.15.8:0/1804150116 conn(0x7f7b700ccfa0 msgr2=0x7f7b70155060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:34.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.815+0000 7f7b7532c700 1 -- 172.21.15.8:0/1804150116 shutdown_connections 2023-10-06T04:36:34.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:34.815+0000 7f7b7532c700 1 -- 172.21.15.8:0/1804150116 wait complete. 2023-10-06T04:36:34.829 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2023-10-06T04:36:35.797 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T04:36:35.830 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T04:36:35.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.934+0000 7f2949e48700 1 Processor -- start 2023-10-06T04:36:35.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.934+0000 7f2949e48700 1 -- start start 2023-10-06T04:36:35.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.935+0000 7f2949e48700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2944156fd0 0x7f29440aa2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:35.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.935+0000 7f2949e48700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29440af290 0x7f294415d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:35.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.935+0000 7f2949e48700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f294415a990 con 0x7f29441573a0 2023-10-06T04:36:35.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.935+0000 7f2949e48700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2944159dc0 con 0x7f2944156fd0 2023-10-06T04:36:35.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.935+0000 7f2949e48700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f294415a060 con 0x7f29440af290 2023-10-06T04:36:35.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.935+0000 7f2943fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29440af290 0x7f294415d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:35.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.935+0000 7f29437fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2944156fd0 0x7f29440aa2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:35.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.935+0000 7f29437fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2944156fd0 0x7f29440aa2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.8:49398/0 (socket says 172.21.15.8:49398) 2023-10-06T04:36:35.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.935+0000 7f2943fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29440af290 0x7f294415d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.8:60582/0 (socket says 172.21.15.8:60582) 2023-10-06T04:36:35.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.935+0000 7f29437fe700 1 -- 172.21.15.8:0/48205390 learned_addr learned my addr 172.21.15.8:0/48205390 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:35.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.935+0000 7f2943fff700 1 -- 172.21.15.8:0/48205390 >> v2:172.21.15.184:3300/0 conn(0x7f2944156fd0 msgr2=0x7f29440aa2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:35.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.935+0000 7f2943fff700 1 --2- 172.21.15.8:0/48205390 >> v2:172.21.15.184:3300/0 conn(0x7f2944156fd0 0x7f29440aa2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:35.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.935+0000 7f2943fff700 1 -- 172.21.15.8:0/48205390 >> v1:172.21.15.184:6789/0 conn(0x7f29441573a0 legacy=0x7f29440aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:35.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.935+0000 7f2943fff700 1 -- 172.21.15.8:0/48205390 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f294415a340 con 0x7f29440af290 2023-10-06T04:36:35.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.935+0000 7f29437fe700 1 --2- 172.21.15.8:0/48205390 >> v2:172.21.15.184:3300/0 conn(0x7f2944156fd0 0x7f29440aa2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:36:35.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.936+0000 7f2943fff700 1 --2- 172.21.15.8:0/48205390 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29440af290 0x7f294415d2b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f293c009e60 tx=0x7f293c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7225149978443e33 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:35.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.936+0000 7f29427fc700 1 -- 172.21.15.8:0/48205390 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c00e070 con 0x7f29440af290 2023-10-06T04:36:35.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.936+0000 7f29427fc700 1 -- 172.21.15.8:0/48205390 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293c00bb60 con 0x7f29440af290 2023-10-06T04:36:35.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.936+0000 7f29427fc700 1 -- 172.21.15.8:0/48205390 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c012430 con 0x7f29440af290 2023-10-06T04:36:35.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.936+0000 7f2949e48700 1 -- 172.21.15.8:0/48205390 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29440af290 msgr2=0x7f294415d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:35.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.936+0000 7f2949e48700 1 --2- 172.21.15.8:0/48205390 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29440af290 0x7f294415d2b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f293c009e60 tx=0x7f293c009780 comp rx=0 tx=0).stop 2023-10-06T04:36:35.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.936+0000 7f2949e48700 1 -- 172.21.15.8:0/48205390 shutdown_connections 2023-10-06T04:36:35.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.936+0000 7f2949e48700 1 --2- 172.21.15.8:0/48205390 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29440af290 0x7f294415d2b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:35.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.936+0000 7f2949e48700 1 --2- 172.21.15.8:0/48205390 >> v2:172.21.15.184:3300/0 conn(0x7f2944156fd0 0x7f29440aa2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:35.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.936+0000 7f2949e48700 1 -- 172.21.15.8:0/48205390 >> 172.21.15.8:0/48205390 conn(0x7f294406a770 msgr2=0x7f294406ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:35.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.936+0000 7f2949e48700 1 -- 172.21.15.8:0/48205390 shutdown_connections 2023-10-06T04:36:35.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.936+0000 7f2949e48700 1 -- 172.21.15.8:0/48205390 wait complete. 2023-10-06T04:36:35.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.938+0000 7f2949e48700 1 Processor -- start 2023-10-06T04:36:35.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.938+0000 7f2949e48700 1 -- start start 2023-10-06T04:36:35.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.938+0000 7f2949e48700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29440af290 0x7f29441506f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:35.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.938+0000 7f2949e48700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2944156fd0 0x7f29440abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:35.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.939+0000 7f2949e48700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29441573a0 0x7f29440ac310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:35.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.939+0000 7f2949e48700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29440aea60 con 0x7f29441573a0 2023-10-06T04:36:35.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.939+0000 7f2949e48700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29440aed40 con 0x7f29440af290 2023-10-06T04:36:35.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.939+0000 7f2949e48700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29440af020 con 0x7f2944156fd0 2023-10-06T04:36:35.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.939+0000 7f2943fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29441573a0 0x7f29440ac310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:35.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.939+0000 7f2943fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29441573a0 0x7f29440ac310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36266/0 (socket says 172.21.15.8:36266) 2023-10-06T04:36:35.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.939+0000 7f2943fff700 1 -- 172.21.15.8:0/949272248 learned_addr learned my addr 172.21.15.8:0/949272248 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:35.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.939+0000 7f2942ffd700 1 --2- 172.21.15.8:0/949272248 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2944156fd0 0x7f29440abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:35.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.939+0000 7f29437fe700 1 --2- 172.21.15.8:0/949272248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29440af290 0x7f29441506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:35.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.939+0000 7f2943fff700 1 -- 172.21.15.8:0/949272248 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2944156fd0 msgr2=0x7f29440abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:35.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.939+0000 7f2943fff700 1 --2- 172.21.15.8:0/949272248 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2944156fd0 0x7f29440abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:35.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.939+0000 7f2943fff700 1 -- 172.21.15.8:0/949272248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29440af290 msgr2=0x7f29441506f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:35.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.939+0000 7f2943fff700 1 --2- 172.21.15.8:0/949272248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29440af290 0x7f29441506f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:35.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.939+0000 7f2943fff700 1 -- 172.21.15.8:0/949272248 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29340094f0 con 0x7f29441573a0 2023-10-06T04:36:35.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.939+0000 7f2943fff700 1 --2- 172.21.15.8:0/949272248 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29441573a0 0x7f29440ac310 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f294415a1a0 tx=0x7f293c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:35.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.939+0000 7f292b7fe700 1 -- 172.21.15.8:0/949272248 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c025440 con 0x7f29441573a0 2023-10-06T04:36:35.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.939+0000 7f292b7fe700 1 -- 172.21.15.8:0/949272248 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293c0255c0 con 0x7f29441573a0 2023-10-06T04:36:35.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.939+0000 7f2949e48700 1 -- 172.21.15.8:0/949272248 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f293c009a20 con 0x7f29441573a0 2023-10-06T04:36:35.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.939+0000 7f292b7fe700 1 -- 172.21.15.8:0/949272248 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c025980 con 0x7f29441573a0 2023-10-06T04:36:35.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.940+0000 7f2949e48700 1 -- 172.21.15.8:0/949272248 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29440b0a70 con 0x7f29441573a0 2023-10-06T04:36:35.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.940+0000 7f2949e48700 1 -- 172.21.15.8:0/949272248 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29440b0c90 con 0x7f29441573a0 2023-10-06T04:36:35.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.941+0000 7f292b7fe700 1 -- 172.21.15.8:0/949272248 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f293c003050 con 0x7f29441573a0 2023-10-06T04:36:35.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.941+0000 7f292b7fe700 1 --2- 172.21.15.8:0/949272248 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2930066f30 0x7f29300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:35.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.942+0000 7f292b7fe700 1 -- 172.21.15.8:0/949272248 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f293c086930 con 0x7f29441573a0 2023-10-06T04:36:35.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.942+0000 7f29437fe700 1 --2- 172.21.15.8:0/949272248 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2930066f30 0x7f29300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:35.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.942+0000 7f29437fe700 1 --2- 172.21.15.8:0/949272248 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2930066f30 0x7f29300693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f29441568f0 tx=0x7f2934009250 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:35.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.946+0000 7f292b7fe700 1 -- 172.21.15.8:0/949272248 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f293c053750 con 0x7f29441573a0 2023-10-06T04:36:35.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.971+0000 7ff14227a700 1 Processor -- start 2023-10-06T04:36:35.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.971+0000 7ff14227a700 1 -- start start 2023-10-06T04:36:35.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.972+0000 7ff14227a700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff13c156e30 0x7ff13c0cf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:35.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.972+0000 7ff14227a700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff13c15b490 0x7ff13c0b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:35.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.972+0000 7ff14227a700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff13c0b2620 con 0x7ff13c0b1c70 2023-10-06T04:36:35.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.972+0000 7ff14227a700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff13c0cf370 con 0x7ff13c156e30 2023-10-06T04:36:35.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.972+0000 7ff14227a700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff13c0ce800 con 0x7ff13c15b490 2023-10-06T04:36:35.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.972+0000 7ff141278700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff13c156e30 0x7ff13c0cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:35.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.972+0000 7ff141278700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff13c156e30 0x7ff13c0cf800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36282/0 (socket says 172.21.15.8:36282) 2023-10-06T04:36:35.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.972+0000 7ff140a77700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ff13c0b1c70 0x7ff13c15ad80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:52522/0 (socket says 172.21.15.8:52522) 2023-10-06T04:36:35.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.972+0000 7ff141278700 1 -- 172.21.15.8:0/1922508400 learned_addr learned my addr 172.21.15.8:0/1922508400 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:35.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.972+0000 7ff141a79700 1 --2- 172.21.15.8:0/1922508400 >> v2:172.21.15.184:3300/0 conn(0x7ff13c15b490 0x7ff13c0b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:35.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.972+0000 7ff141278700 1 -- 172.21.15.8:0/1922508400 >> v2:172.21.15.184:3300/0 conn(0x7ff13c15b490 msgr2=0x7ff13c0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:35.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.972+0000 7ff141278700 1 --2- 172.21.15.8:0/1922508400 >> v2:172.21.15.184:3300/0 conn(0x7ff13c15b490 0x7ff13c0b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:35.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.972+0000 7ff141278700 1 -- 172.21.15.8:0/1922508400 >> v1:172.21.15.8:6789/0 conn(0x7ff13c0b1c70 legacy=0x7ff13c15ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:35.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.972+0000 7ff141278700 1 -- 172.21.15.8:0/1922508400 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13c0cea60 con 0x7ff13c156e30 2023-10-06T04:36:35.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.972+0000 7ff13bfff700 1 -- 172.21.15.8:0/1922508400 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 914386370 0 0) 0x7ff13c0b2620 con 0x7ff13c0b1c70 2023-10-06T04:36:35.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.972+0000 7ff141a79700 1 --2- 172.21.15.8:0/1922508400 >> v2:172.21.15.184:3300/0 conn(0x7ff13c15b490 0x7ff13c0b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:35.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.973+0000 7ff141278700 1 --2- 172.21.15.8:0/1922508400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff13c156e30 0x7ff13c0cf800 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff13c159ef0 tx=0x7ff134009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6a1df7e202be38a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:35.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.973+0000 7ff13bfff700 1 -- 172.21.15.8:0/1922508400 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13400b860 con 0x7ff13c156e30 2023-10-06T04:36:35.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.973+0000 7ff13bfff700 1 -- 172.21.15.8:0/1922508400 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13400b9c0 con 0x7ff13c156e30 2023-10-06T04:36:35.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.973+0000 7ff13bfff700 1 -- 172.21.15.8:0/1922508400 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13400bd60 con 0x7ff13c156e30 2023-10-06T04:36:35.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.973+0000 7ff14227a700 1 -- 172.21.15.8:0/1922508400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff13c156e30 msgr2=0x7ff13c0cf800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:35.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.973+0000 7ff14227a700 1 --2- 172.21.15.8:0/1922508400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff13c156e30 0x7ff13c0cf800 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff13c159ef0 tx=0x7ff134009250 comp rx=0 tx=0).stop 2023-10-06T04:36:35.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.973+0000 7ff14227a700 1 -- 172.21.15.8:0/1922508400 shutdown_connections 2023-10-06T04:36:35.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.974+0000 7ff14227a700 1 --2- 172.21.15.8:0/1922508400 >> v2:172.21.15.184:3300/0 conn(0x7ff13c15b490 0x7ff13c0b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:35.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.974+0000 7ff14227a700 1 --2- 172.21.15.8:0/1922508400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff13c156e30 0x7ff13c0cf800 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:35.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.974+0000 7ff14227a700 1 -- 172.21.15.8:0/1922508400 >> 172.21.15.8:0/1922508400 conn(0x7ff13c06ed00 msgr2=0x7ff13c06f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:35.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.974+0000 7ff14227a700 1 -- 172.21.15.8:0/1922508400 shutdown_connections 2023-10-06T04:36:35.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.974+0000 7ff14227a700 1 -- 172.21.15.8:0/1922508400 wait complete. 2023-10-06T04:36:35.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.975+0000 7ff14227a700 1 Processor -- start 2023-10-06T04:36:35.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.975+0000 7ff14227a700 1 -- start start 2023-10-06T04:36:35.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.976+0000 7ff14227a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff13c0b1c70 0x7ff13c151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:35.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.976+0000 7ff14227a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff13c156e30 0x7ff13c0c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:35.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.976+0000 7ff14227a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff13c15b490 0x7ff13c169790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:35.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.976+0000 7ff14227a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c16abd0 con 0x7ff13c0b1c70 2023-10-06T04:36:35.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.976+0000 7ff14227a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c169fb0 con 0x7ff13c15b490 2023-10-06T04:36:35.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.976+0000 7ff14227a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c16a290 con 0x7ff13c156e30 2023-10-06T04:36:35.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.976+0000 7ff141278700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff13c0b1c70 0x7ff13c151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:35.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.976+0000 7ff141278700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff13c0b1c70 0x7ff13c151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36298/0 (socket says 172.21.15.8:36298) 2023-10-06T04:36:35.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.976+0000 7ff141278700 1 -- 172.21.15.8:0/1808218210 learned_addr learned my addr 172.21.15.8:0/1808218210 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:35.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.976+0000 7ff140a77700 1 --2- 172.21.15.8:0/1808218210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff13c156e30 0x7ff13c0c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:35.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.976+0000 7ff141a79700 1 --2- 172.21.15.8:0/1808218210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff13c15b490 0x7ff13c169790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:35.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.976+0000 7ff141278700 1 -- 172.21.15.8:0/1808218210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff13c156e30 msgr2=0x7ff13c0c5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:35.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.976+0000 7ff141278700 1 --2- 172.21.15.8:0/1808218210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff13c156e30 0x7ff13c0c5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:35.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.976+0000 7ff141278700 1 -- 172.21.15.8:0/1808218210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff13c15b490 msgr2=0x7ff13c169790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:35.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.976+0000 7ff141278700 1 --2- 172.21.15.8:0/1808218210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff13c15b490 0x7ff13c169790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:35.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.976+0000 7ff141278700 1 -- 172.21.15.8:0/1808218210 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1340094f0 con 0x7ff13c0b1c70 2023-10-06T04:36:35.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.976+0000 7ff140a77700 1 --2- 172.21.15.8:0/1808218210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff13c156e30 0x7ff13c0c5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:35.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.976+0000 7ff141278700 1 --2- 172.21.15.8:0/1808218210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff13c0b1c70 0x7ff13c151e60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff134009290 tx=0x7ff134017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:35.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.976+0000 7ff1397fa700 1 -- 172.21.15.8:0/1808218210 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff134011e60 con 0x7ff13c0b1c70 2023-10-06T04:36:35.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.976+0000 7ff1397fa700 1 -- 172.21.15.8:0/1808218210 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13401f070 con 0x7ff13c0b1c70 2023-10-06T04:36:35.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.976+0000 7ff14227a700 1 -- 172.21.15.8:0/1808218210 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff13c16a570 con 0x7ff13c0b1c70 2023-10-06T04:36:35.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.977+0000 7ff1397fa700 1 -- 172.21.15.8:0/1808218210 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13401a870 con 0x7ff13c0b1c70 2023-10-06T04:36:35.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.977+0000 7ff14227a700 1 -- 172.21.15.8:0/1808218210 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff13c0b47f0 con 0x7ff13c0b1c70 2023-10-06T04:36:35.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.977+0000 7ff14227a700 1 -- 172.21.15.8:0/1808218210 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff13c16a7b0 con 0x7ff13c0b1c70 2023-10-06T04:36:35.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.978+0000 7ff1397fa700 1 -- 172.21.15.8:0/1808218210 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff13401abe0 con 0x7ff13c0b1c70 2023-10-06T04:36:35.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.979+0000 7ff1397fa700 1 --2- 172.21.15.8:0/1808218210 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff128066f30 0x7ff1280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:35.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.979+0000 7ff1397fa700 1 -- 172.21.15.8:0/1808218210 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff134021070 con 0x7ff13c0b1c70 2023-10-06T04:36:35.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.979+0000 7ff140a77700 1 --2- 172.21.15.8:0/1808218210 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff128066f30 0x7ff1280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:35.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.979+0000 7ff140a77700 1 --2- 172.21.15.8:0/1808218210 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff128066f30 0x7ff1280693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0b53e0 tx=0x7ff130007c90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:35.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:35.987+0000 7ff1397fa700 1 -- 172.21.15.8:0/1808218210 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff13c16a7b0 con 0x7ff13c0b1c70 2023-10-06T04:36:36.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.148+0000 7f2949e48700 1 -- 172.21.15.8:0/949272248 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f29440652c0 con 0x7f29441573a0 2023-10-06T04:36:36.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.148+0000 7f292b7fe700 1 -- 172.21.15.8:0/949272248 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f293c056d70 con 0x7f29441573a0 2023-10-06T04:36:36.151 INFO:teuthology.orchestra.run.smithi008.stdout:55834574855 2023-10-06T04:36:36.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.150+0000 7f2949e48700 1 -- 172.21.15.8:0/949272248 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2930066f30 msgr2=0x7f29300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:36.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.150+0000 7f2949e48700 1 --2- 172.21.15.8:0/949272248 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2930066f30 0x7f29300693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f29441568f0 tx=0x7f2934009250 comp rx=0 tx=0).stop 2023-10-06T04:36:36.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.150+0000 7f2949e48700 1 -- 172.21.15.8:0/949272248 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29441573a0 msgr2=0x7f29440ac310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:36.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.150+0000 7f2949e48700 1 --2- 172.21.15.8:0/949272248 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29441573a0 0x7f29440ac310 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f294415a1a0 tx=0x7f293c019000 comp rx=0 tx=0).stop 2023-10-06T04:36:36.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.150+0000 7f2949e48700 1 -- 172.21.15.8:0/949272248 shutdown_connections 2023-10-06T04:36:36.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.150+0000 7f2949e48700 1 --2- 172.21.15.8:0/949272248 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2930066f30 0x7f29300693e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:36.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.150+0000 7f2949e48700 1 --2- 172.21.15.8:0/949272248 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29441573a0 0x7f29440ac310 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:36.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.150+0000 7f2949e48700 1 --2- 172.21.15.8:0/949272248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29440af290 0x7f29441506f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:36.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.150+0000 7f2949e48700 1 --2- 172.21.15.8:0/949272248 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2944156fd0 0x7f29440abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:36.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.150+0000 7f2949e48700 1 -- 172.21.15.8:0/949272248 >> 172.21.15.8:0/949272248 conn(0x7f294406a770 msgr2=0x7f2944151c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:36.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.150+0000 7f2949e48700 1 -- 172.21.15.8:0/949272248 shutdown_connections 2023-10-06T04:36:36.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.150+0000 7f2949e48700 1 -- 172.21.15.8:0/949272248 wait complete. 2023-10-06T04:36:36.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2023-10-06T04:36:36.166 DEBUG:teuthology.parallel:result is None 2023-10-06T04:36:36.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.182+0000 7ff14227a700 1 -- 172.21.15.8:0/1808218210 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff13c16a9a0 con 0x7ff13c0b1c70 2023-10-06T04:36:36.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.182+0000 7ff1397fa700 1 -- 172.21.15.8:0/1808218210 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff13c16a9a0 con 0x7ff13c0b1c70 2023-10-06T04:36:36.185 INFO:teuthology.orchestra.run.smithi008.stdout:55834574855 2023-10-06T04:36:36.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.184+0000 7ff14227a700 1 -- 172.21.15.8:0/1808218210 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff128066f30 msgr2=0x7ff1280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:36.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.184+0000 7ff14227a700 1 --2- 172.21.15.8:0/1808218210 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff128066f30 0x7ff1280693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0b53e0 tx=0x7ff130007c90 comp rx=0 tx=0).stop 2023-10-06T04:36:36.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.184+0000 7ff14227a700 1 -- 172.21.15.8:0/1808218210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff13c0b1c70 msgr2=0x7ff13c151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:36.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.184+0000 7ff14227a700 1 --2- 172.21.15.8:0/1808218210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff13c0b1c70 0x7ff13c151e60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff134009290 tx=0x7ff134017000 comp rx=0 tx=0).stop 2023-10-06T04:36:36.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.184+0000 7ff14227a700 1 -- 172.21.15.8:0/1808218210 shutdown_connections 2023-10-06T04:36:36.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.184+0000 7ff14227a700 1 --2- 172.21.15.8:0/1808218210 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff128066f30 0x7ff1280693e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:36.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.184+0000 7ff14227a700 1 --2- 172.21.15.8:0/1808218210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff13c15b490 0x7ff13c169790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:36.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.184+0000 7ff14227a700 1 --2- 172.21.15.8:0/1808218210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff13c0b1c70 0x7ff13c151e60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:36.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.184+0000 7ff14227a700 1 --2- 172.21.15.8:0/1808218210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff13c156e30 0x7ff13c0c5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:36.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.184+0000 7ff14227a700 1 -- 172.21.15.8:0/1808218210 >> 172.21.15.8:0/1808218210 conn(0x7ff13c06ed00 msgr2=0x7ff13c155120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:36.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.184+0000 7ff14227a700 1 -- 172.21.15.8:0/1808218210 shutdown_connections 2023-10-06T04:36:36.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.184+0000 7ff14227a700 1 -- 172.21.15.8:0/1808218210 wait complete. 2023-10-06T04:36:36.199 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2023-10-06T04:36:36.199 DEBUG:teuthology.parallel:result is None 2023-10-06T04:36:36.199 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T04:36:36.199 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:36:36.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.356+0000 7f07cd318700 1 Processor -- start 2023-10-06T04:36:36.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.356+0000 7f07cd318700 1 -- start start 2023-10-06T04:36:36.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.357+0000 7f07cd318700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07c80d0aa0 0x7f07c81649b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:36.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.357+0000 7f07cd318700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c80cc4c0 con 0x7f07c80cb360 2023-10-06T04:36:36.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.357+0000 7f07cd318700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c80cb8b0 con 0x7f07c80af680 2023-10-06T04:36:36.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.357+0000 7f07cd318700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c815d460 con 0x7f07c80d0aa0 2023-10-06T04:36:36.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.357+0000 7f07c67fc700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f07c80cb360 0x7f07c80d0390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:52538/0 (socket says 172.21.15.8:52538) 2023-10-06T04:36:36.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.357+0000 7f07c67fc700 1 -- 172.21.15.8:0/3371773810 learned_addr learned my addr 172.21.15.8:0/3371773810 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:36.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.357+0000 7f07c77fe700 1 --2- 172.21.15.8:0/3371773810 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07c80d0aa0 0x7f07c81649b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:36.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.357+0000 7f07c5ffb700 1 -- 172.21.15.8:0/3371773810 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2466450138 0 0) 0x7f07c80cc4c0 con 0x7f07c80cb360 2023-10-06T04:36:36.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.357+0000 7f07c5ffb700 1 -- 172.21.15.8:0/3371773810 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07b4003570 con 0x7f07c80cb360 2023-10-06T04:36:36.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.357+0000 7f07c5ffb700 1 -- 172.21.15.8:0/3371773810 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014819538 0 0) 0x7f07c80cb8b0 con 0x7f07c80af680 2023-10-06T04:36:36.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.357+0000 7f07c77fe700 1 -- 172.21.15.8:0/3371773810 >> v1:172.21.15.184:6789/0 conn(0x7f07c80af680 legacy=0x7f07c815e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:36.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.357+0000 7f07c77fe700 1 -- 172.21.15.8:0/3371773810 >> v1:172.21.15.8:6789/0 conn(0x7f07c80cb360 legacy=0x7f07c80d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:36.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.357+0000 7f07c77fe700 1 -- 172.21.15.8:0/3371773810 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c80cbb90 con 0x7f07c80d0aa0 2023-10-06T04:36:36.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.357+0000 7f07c77fe700 1 --2- 172.21.15.8:0/3371773810 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07c80d0aa0 0x7f07c81649b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f07c0009e90 tx=0x7f07c0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc167509dc65c79b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:36.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.357+0000 7f07c5ffb700 1 -- 172.21.15.8:0/3371773810 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c000e070 con 0x7f07c80d0aa0 2023-10-06T04:36:36.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.358+0000 7f07c5ffb700 1 -- 172.21.15.8:0/3371773810 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07c000bc30 con 0x7f07c80d0aa0 2023-10-06T04:36:36.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.358+0000 7f07c5ffb700 1 -- 172.21.15.8:0/3371773810 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c0012430 con 0x7f07c80d0aa0 2023-10-06T04:36:36.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.358+0000 7f07cd318700 1 -- 172.21.15.8:0/3371773810 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07c80d0aa0 msgr2=0x7f07c81649b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:36.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.358+0000 7f07cd318700 1 --2- 172.21.15.8:0/3371773810 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07c80d0aa0 0x7f07c81649b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f07c0009e90 tx=0x7f07c0009780 comp rx=0 tx=0).stop 2023-10-06T04:36:36.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.358+0000 7f07cd318700 1 -- 172.21.15.8:0/3371773810 shutdown_connections 2023-10-06T04:36:36.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.358+0000 7f07cd318700 1 --2- 172.21.15.8:0/3371773810 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07c80d0aa0 0x7f07c81649b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:36.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.358+0000 7f07cd318700 1 -- 172.21.15.8:0/3371773810 >> 172.21.15.8:0/3371773810 conn(0x7f07c80633d0 msgr2=0x7f07c80637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:36.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.358+0000 7f07cd318700 1 -- 172.21.15.8:0/3371773810 shutdown_connections 2023-10-06T04:36:36.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.358+0000 7f07cd318700 1 -- 172.21.15.8:0/3371773810 wait complete. 2023-10-06T04:36:36.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.359+0000 7f07cd318700 1 Processor -- start 2023-10-06T04:36:36.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.359+0000 7f07cd318700 1 -- start start 2023-10-06T04:36:36.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.360+0000 7f07cd318700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07c80af680 0x7f07c814bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:36.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.360+0000 7f07cd318700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07c80cb360 0x7f07c80b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:36.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.360+0000 7f07cd318700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07c80d0aa0 0x7f07c815be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:36.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.360+0000 7f07cd318700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c814c0d0 con 0x7f07c80af680 2023-10-06T04:36:36.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.360+0000 7f07cd318700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c80b3da0 con 0x7f07c80d0aa0 2023-10-06T04:36:36.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.360+0000 7f07cd318700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c80b31d0 con 0x7f07c80cb360 2023-10-06T04:36:36.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.360+0000 7f07c6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07c80af680 0x7f07c814bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:36.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.360+0000 7f07c6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07c80af680 0x7f07c814bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36314/0 (socket says 172.21.15.8:36314) 2023-10-06T04:36:36.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.360+0000 7f07c6ffd700 1 -- 172.21.15.8:0/1684888816 learned_addr learned my addr 172.21.15.8:0/1684888816 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:36.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.360+0000 7f07c77fe700 1 --2- 172.21.15.8:0/1684888816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07c80d0aa0 0x7f07c815be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:36.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.360+0000 7f07c67fc700 1 --2- 172.21.15.8:0/1684888816 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07c80cb360 0x7f07c80b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:36.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.361+0000 7f07c6ffd700 1 -- 172.21.15.8:0/1684888816 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07c80cb360 msgr2=0x7f07c80b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:36.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.361+0000 7f07c6ffd700 1 --2- 172.21.15.8:0/1684888816 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07c80cb360 0x7f07c80b4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:36.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.361+0000 7f07c6ffd700 1 -- 172.21.15.8:0/1684888816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07c80d0aa0 msgr2=0x7f07c815be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:36.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.361+0000 7f07c6ffd700 1 --2- 172.21.15.8:0/1684888816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07c80d0aa0 0x7f07c815be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:36.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.361+0000 7f07c6ffd700 1 -- 172.21.15.8:0/1684888816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c0009a20 con 0x7f07c80af680 2023-10-06T04:36:36.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.361+0000 7f07c6ffd700 1 --2- 172.21.15.8:0/1684888816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07c80af680 0x7f07c814bb90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f07b800c530 tx=0x7f07b800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:36.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.361+0000 7f07beffd700 1 -- 172.21.15.8:0/1684888816 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b8011590 con 0x7f07c80af680 2023-10-06T04:36:36.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.361+0000 7f07beffd700 1 -- 172.21.15.8:0/1684888816 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b8011710 con 0x7f07c80af680 2023-10-06T04:36:36.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.361+0000 7f07cd318700 1 -- 172.21.15.8:0/1684888816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07c80b3470 con 0x7f07c80af680 2023-10-06T04:36:36.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.361+0000 7f07beffd700 1 -- 172.21.15.8:0/1684888816 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b8011ad0 con 0x7f07c80af680 2023-10-06T04:36:36.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.361+0000 7f07cd318700 1 -- 172.21.15.8:0/1684888816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c80b3a30 con 0x7f07c80af680 2023-10-06T04:36:36.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.362+0000 7f07cd318700 1 -- 172.21.15.8:0/1684888816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c8071550 con 0x7f07c80af680 2023-10-06T04:36:36.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.362+0000 7f07beffd700 1 -- 172.21.15.8:0/1684888816 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f07b801b3b0 con 0x7f07c80af680 2023-10-06T04:36:36.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.363+0000 7f07beffd700 1 --2- 172.21.15.8:0/1684888816 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f07a8066f30 0x7f07a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:36.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.363+0000 7f07beffd700 1 -- 172.21.15.8:0/1684888816 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f07b8083d40 con 0x7f07c80af680 2023-10-06T04:36:36.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.363+0000 7f07c67fc700 1 --2- 172.21.15.8:0/1684888816 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f07a8066f30 0x7f07a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:36.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.363+0000 7f07c67fc700 1 --2- 172.21.15.8:0/1684888816 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f07a8066f30 0x7f07a80693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f07c80b4340 tx=0x7f07b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:36.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.367+0000 7f07beffd700 1 -- 172.21.15.8:0/1684888816 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f07b8050b60 con 0x7f07c80af680 2023-10-06T04:36:36.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.557+0000 7f07cd318700 1 -- 172.21.15.8:0/1684888816 --> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f07c80b3ee0 con 0x7f07a8066f30 2023-10-06T04:36:36.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.568+0000 7f07beffd700 1 -- 172.21.15.8:0/1684888816 <== mgr.4105 v2:172.21.15.184:6832/90283 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367606 (secure 0 0 0) 0x7f07b000f620 con 0x7f07a8066f30 2023-10-06T04:36:36.574 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:36:36.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.571+0000 7f07cd318700 1 -- 172.21.15.8:0/1684888816 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f07a8066f30 msgr2=0x7f07a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:36.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.571+0000 7f07cd318700 1 --2- 172.21.15.8:0/1684888816 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f07a8066f30 0x7f07a80693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f07c80b4340 tx=0x7f07b0009040 comp rx=0 tx=0).stop 2023-10-06T04:36:36.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.571+0000 7f07cd318700 1 -- 172.21.15.8:0/1684888816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07c80af680 msgr2=0x7f07c814bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:36.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.571+0000 7f07cd318700 1 --2- 172.21.15.8:0/1684888816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07c80af680 0x7f07c814bb90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f07b800c530 tx=0x7f07b800c840 comp rx=0 tx=0).stop 2023-10-06T04:36:36.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.572+0000 7f07cd318700 1 -- 172.21.15.8:0/1684888816 shutdown_connections 2023-10-06T04:36:36.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.572+0000 7f07cd318700 1 --2- 172.21.15.8:0/1684888816 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f07a8066f30 0x7f07a80693e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:36.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.572+0000 7f07cd318700 1 --2- 172.21.15.8:0/1684888816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07c80d0aa0 0x7f07c815be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:36.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.572+0000 7f07cd318700 1 --2- 172.21.15.8:0/1684888816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07c80af680 0x7f07c814bb90 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:36.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.572+0000 7f07cd318700 1 --2- 172.21.15.8:0/1684888816 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07c80cb360 0x7f07c80b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:36.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.572+0000 7f07cd318700 1 -- 172.21.15.8:0/1684888816 >> 172.21.15.8:0/1684888816 conn(0x7f07c80633d0 msgr2=0x7f07c80b0740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:36.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.572+0000 7f07cd318700 1 -- 172.21.15.8:0/1684888816 shutdown_connections 2023-10-06T04:36:36.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.572+0000 7f07cd318700 1 -- 172.21.15.8:0/1684888816 wait complete. 2023-10-06T04:36:36.578 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-06T04:36:36.586 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2023-10-06T04:36:34.634549+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594852,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381596,"kb_used_data":3292,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593124,"statfs":{"total":773094113280,"available":770655358976,"internally_reserved":0,"allocated":3371008,"data_stored":2062434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2178,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003345"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.272647+0000","last_change":"2023-10-06T04:36:17.255009+0000","last_active":"2023-10-06T04:36:21.272647+0000","last_peered":"2023-10-06T04:36:21.272647+0000","last_clean":"2023-10-06T04:36:21.272647+0000","last_became_active":"2023-10-06T04:36:17.254704+0000","last_became_peered":"2023-10-06T04:36:17.254704+0000","last_unstale":"2023-10-06T04:36:21.272647+0000","last_undegraded":"2023-10-06T04:36:21.272647+0000","last_fullsized":"2023-10-06T04:36:21.272647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:45:34.132581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291077+0000","last_change":"2023-10-06T04:36:17.256537+0000","last_active":"2023-10-06T04:36:21.291077+0000","last_peered":"2023-10-06T04:36:21.291077+0000","last_clean":"2023-10-06T04:36:21.291077+0000","last_became_active":"2023-10-06T04:36:17.256004+0000","last_became_peered":"2023-10-06T04:36:17.256004+0000","last_unstale":"2023-10-06T04:36:21.291077+0000","last_undegraded":"2023-10-06T04:36:21.291077+0000","last_fullsized":"2023-10-06T04:36:21.291077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:02.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.281626+0000","last_change":"2023-10-06T04:36:17.251532+0000","last_active":"2023-10-06T04:36:21.281626+0000","last_peered":"2023-10-06T04:36:21.281626+0000","last_clean":"2023-10-06T04:36:21.281626+0000","last_became_active":"2023-10-06T04:36:17.250378+0000","last_became_peered":"2023-10-06T04:36:17.250378+0000","last_unstale":"2023-10-06T04:36:21.281626+0000","last_undegraded":"2023-10-06T04:36:21.281626+0000","last_fullsized":"2023-10-06T04:36:21.281626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:10.868173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.283431+0000","last_change":"2023-10-06T04:36:17.256131+0000","last_active":"2023-10-06T04:36:21.283431+0000","last_peered":"2023-10-06T04:36:21.283431+0000","last_clean":"2023-10-06T04:36:21.283431+0000","last_became_active":"2023-10-06T04:36:17.255865+0000","last_became_peered":"2023-10-06T04:36:17.255865+0000","last_unstale":"2023-10-06T04:36:21.283431+0000","last_undegraded":"2023-10-06T04:36:21.283431+0000","last_fullsized":"2023-10-06T04:36:21.283431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:40.502199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.284418+0000","last_change":"2023-10-06T04:36:17.247145+0000","last_active":"2023-10-06T04:36:21.284418+0000","last_peered":"2023-10-06T04:36:21.284418+0000","last_clean":"2023-10-06T04:36:21.284418+0000","last_became_active":"2023-10-06T04:36:17.246879+0000","last_became_peered":"2023-10-06T04:36:17.246879+0000","last_unstale":"2023-10-06T04:36:21.284418+0000","last_undegraded":"2023-10-06T04:36:21.284418+0000","last_fullsized":"2023-10-06T04:36:21.284418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:23:08.806295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280687+0000","last_change":"2023-10-06T04:36:17.252945+0000","last_active":"2023-10-06T04:36:21.280687+0000","last_peered":"2023-10-06T04:36:21.280687+0000","last_clean":"2023-10-06T04:36:21.280687+0000","last_became_active":"2023-10-06T04:36:17.252697+0000","last_became_peered":"2023-10-06T04:36:17.252697+0000","last_unstale":"2023-10-06T04:36:21.280687+0000","last_undegraded":"2023-10-06T04:36:21.280687+0000","last_fullsized":"2023-10-06T04:36:21.280687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:56.005620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291321+0000","last_change":"2023-10-06T04:36:17.259179+0000","last_active":"2023-10-06T04:36:21.291321+0000","last_peered":"2023-10-06T04:36:21.291321+0000","last_clean":"2023-10-06T04:36:21.291321+0000","last_became_active":"2023-10-06T04:36:17.258896+0000","last_became_peered":"2023-10-06T04:36:17.258896+0000","last_unstale":"2023-10-06T04:36:21.291321+0000","last_undegraded":"2023-10-06T04:36:21.291321+0000","last_fullsized":"2023-10-06T04:36:21.291321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:06.137894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.290396+0000","last_change":"2023-10-06T04:36:17.251370+0000","last_active":"2023-10-06T04:36:21.290396+0000","last_peered":"2023-10-06T04:36:21.290396+0000","last_clean":"2023-10-06T04:36:21.290396+0000","last_became_active":"2023-10-06T04:36:17.251111+0000","last_became_peered":"2023-10-06T04:36:17.251111+0000","last_unstale":"2023-10-06T04:36:21.290396+0000","last_undegraded":"2023-10-06T04:36:21.290396+0000","last_fullsized":"2023-10-06T04:36:21.290396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:01:35.146203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276077+0000","last_change":"2023-10-06T04:36:17.247564+0000","last_active":"2023-10-06T04:36:21.276077+0000","last_peered":"2023-10-06T04:36:21.276077+0000","last_clean":"2023-10-06T04:36:21.276077+0000","last_became_active":"2023-10-06T04:36:17.247306+0000","last_became_peered":"2023-10-06T04:36:17.247306+0000","last_unstale":"2023-10-06T04:36:21.276077+0000","last_undegraded":"2023-10-06T04:36:21.276077+0000","last_fullsized":"2023-10-06T04:36:21.276077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:02.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291293+0000","last_change":"2023-10-06T04:36:17.256706+0000","last_active":"2023-10-06T04:36:21.291293+0000","last_peered":"2023-10-06T04:36:21.291293+0000","last_clean":"2023-10-06T04:36:21.291293+0000","last_became_active":"2023-10-06T04:36:17.256322+0000","last_became_peered":"2023-10-06T04:36:17.256322+0000","last_unstale":"2023-10-06T04:36:21.291293+0000","last_undegraded":"2023-10-06T04:36:21.291293+0000","last_fullsized":"2023-10-06T04:36:21.291293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:23:08.806295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.281544+0000","last_change":"2023-10-06T04:36:17.266725+0000","last_active":"2023-10-06T04:36:21.281544+0000","last_peered":"2023-10-06T04:36:21.281544+0000","last_clean":"2023-10-06T04:36:21.281544+0000","last_became_active":"2023-10-06T04:36:17.266037+0000","last_became_peered":"2023-10-06T04:36:17.266037+0000","last_unstale":"2023-10-06T04:36:21.281544+0000","last_undegraded":"2023-10-06T04:36:21.281544+0000","last_fullsized":"2023-10-06T04:36:21.281544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:35.000504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.272228+0000","last_change":"2023-10-06T04:36:17.244295+0000","last_active":"2023-10-06T04:36:21.272228+0000","last_peered":"2023-10-06T04:36:21.272228+0000","last_clean":"2023-10-06T04:36:21.272228+0000","last_became_active":"2023-10-06T04:36:17.244029+0000","last_became_peered":"2023-10-06T04:36:17.244029+0000","last_unstale":"2023-10-06T04:36:21.272228+0000","last_undegraded":"2023-10-06T04:36:21.272228+0000","last_fullsized":"2023-10-06T04:36:21.272228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:11.610976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.272361+0000","last_change":"2023-10-06T04:36:17.247080+0000","last_active":"2023-10-06T04:36:21.272361+0000","last_peered":"2023-10-06T04:36:21.272361+0000","last_clean":"2023-10-06T04:36:21.272361+0000","last_became_active":"2023-10-06T04:36:17.246794+0000","last_became_peered":"2023-10-06T04:36:17.246794+0000","last_unstale":"2023-10-06T04:36:21.272361+0000","last_undegraded":"2023-10-06T04:36:21.272361+0000","last_fullsized":"2023-10-06T04:36:21.272361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:13.150215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291383+0000","last_change":"2023-10-06T04:36:17.258372+0000","last_active":"2023-10-06T04:36:21.291383+0000","last_peered":"2023-10-06T04:36:21.291383+0000","last_clean":"2023-10-06T04:36:21.291383+0000","last_became_active":"2023-10-06T04:36:17.258116+0000","last_became_peered":"2023-10-06T04:36:17.258116+0000","last_unstale":"2023-10-06T04:36:21.291383+0000","last_undegraded":"2023-10-06T04:36:21.291383+0000","last_fullsized":"2023-10-06T04:36:21.291383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:15.884489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291099+0000","last_change":"2023-10-06T04:36:17.259309+0000","last_active":"2023-10-06T04:36:21.291099+0000","last_peered":"2023-10-06T04:36:21.291099+0000","last_clean":"2023-10-06T04:36:21.291099+0000","last_became_active":"2023-10-06T04:36:17.259048+0000","last_became_peered":"2023-10-06T04:36:17.259048+0000","last_unstale":"2023-10-06T04:36:21.291099+0000","last_undegraded":"2023-10-06T04:36:21.291099+0000","last_fullsized":"2023-10-06T04:36:21.291099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:03.209071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280262+0000","last_change":"2023-10-06T04:36:17.248671+0000","last_active":"2023-10-06T04:36:21.280262+0000","last_peered":"2023-10-06T04:36:21.280262+0000","last_clean":"2023-10-06T04:36:21.280262+0000","last_became_active":"2023-10-06T04:36:17.248389+0000","last_became_peered":"2023-10-06T04:36:17.248389+0000","last_unstale":"2023-10-06T04:36:21.280262+0000","last_undegraded":"2023-10-06T04:36:21.280262+0000","last_fullsized":"2023-10-06T04:36:21.280262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:32.568497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276165+0000","last_change":"2023-10-06T04:36:17.253794+0000","last_active":"2023-10-06T04:36:21.276165+0000","last_peered":"2023-10-06T04:36:21.276165+0000","last_clean":"2023-10-06T04:36:21.276165+0000","last_became_active":"2023-10-06T04:36:17.253556+0000","last_became_peered":"2023-10-06T04:36:17.253556+0000","last_unstale":"2023-10-06T04:36:21.276165+0000","last_undegraded":"2023-10-06T04:36:21.276165+0000","last_fullsized":"2023-10-06T04:36:21.276165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:53.436742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.281355+0000","last_change":"2023-10-06T04:36:17.248844+0000","last_active":"2023-10-06T04:36:21.281355+0000","last_peered":"2023-10-06T04:36:21.281355+0000","last_clean":"2023-10-06T04:36:21.281355+0000","last_became_active":"2023-10-06T04:36:17.248564+0000","last_became_peered":"2023-10-06T04:36:17.248564+0000","last_unstale":"2023-10-06T04:36:21.281355+0000","last_undegraded":"2023-10-06T04:36:21.281355+0000","last_fullsized":"2023-10-06T04:36:21.281355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:09:48.312479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.272565+0000","last_change":"2023-10-06T04:36:17.250339+0000","last_active":"2023-10-06T04:36:21.272565+0000","last_peered":"2023-10-06T04:36:21.272565+0000","last_clean":"2023-10-06T04:36:21.272565+0000","last_became_active":"2023-10-06T04:36:17.250051+0000","last_became_peered":"2023-10-06T04:36:17.250051+0000","last_unstale":"2023-10-06T04:36:21.272565+0000","last_undegraded":"2023-10-06T04:36:21.272565+0000","last_fullsized":"2023-10-06T04:36:21.272565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:43.576906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280996+0000","last_change":"2023-10-06T04:36:17.250606+0000","last_active":"2023-10-06T04:36:21.280996+0000","last_peered":"2023-10-06T04:36:21.280996+0000","last_clean":"2023-10-06T04:36:21.280996+0000","last_became_active":"2023-10-06T04:36:17.250295+0000","last_became_peered":"2023-10-06T04:36:17.250295+0000","last_unstale":"2023-10-06T04:36:21.280996+0000","last_undegraded":"2023-10-06T04:36:21.280996+0000","last_fullsized":"2023-10-06T04:36:21.280996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:52.945703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.292940+0000","last_change":"2023-10-06T04:36:17.260489+0000","last_active":"2023-10-06T04:36:21.292940+0000","last_peered":"2023-10-06T04:36:21.292940+0000","last_clean":"2023-10-06T04:36:21.292940+0000","last_became_active":"2023-10-06T04:36:17.259923+0000","last_became_peered":"2023-10-06T04:36:17.259923+0000","last_unstale":"2023-10-06T04:36:21.292940+0000","last_undegraded":"2023-10-06T04:36:21.292940+0000","last_fullsized":"2023-10-06T04:36:21.292940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:53.436742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.278618+0000","last_change":"2023-10-06T04:36:17.248545+0000","last_active":"2023-10-06T04:36:21.278618+0000","last_peered":"2023-10-06T04:36:21.278618+0000","last_clean":"2023-10-06T04:36:21.278618+0000","last_became_active":"2023-10-06T04:36:17.248276+0000","last_became_peered":"2023-10-06T04:36:17.248276+0000","last_unstale":"2023-10-06T04:36:21.278618+0000","last_undegraded":"2023-10-06T04:36:21.278618+0000","last_fullsized":"2023-10-06T04:36:21.278618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:35:27.605631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276071+0000","last_change":"2023-10-06T04:36:17.252822+0000","last_active":"2023-10-06T04:36:21.276071+0000","last_peered":"2023-10-06T04:36:21.276071+0000","last_clean":"2023-10-06T04:36:21.276071+0000","last_became_active":"2023-10-06T04:36:17.252543+0000","last_became_peered":"2023-10-06T04:36:17.252543+0000","last_unstale":"2023-10-06T04:36:21.276071+0000","last_undegraded":"2023-10-06T04:36:21.276071+0000","last_fullsized":"2023-10-06T04:36:21.276071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:12.881884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.290615+0000","last_change":"2023-10-06T04:36:17.260460+0000","last_active":"2023-10-06T04:36:21.290615+0000","last_peered":"2023-10-06T04:36:21.290615+0000","last_clean":"2023-10-06T04:36:21.290615+0000","last_became_active":"2023-10-06T04:36:17.260121+0000","last_became_peered":"2023-10-06T04:36:17.260121+0000","last_unstale":"2023-10-06T04:36:21.290615+0000","last_undegraded":"2023-10-06T04:36:21.290615+0000","last_fullsized":"2023-10-06T04:36:21.290615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:02.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276878+0000","last_change":"2023-10-06T04:36:17.252219+0000","last_active":"2023-10-06T04:36:21.276878+0000","last_peered":"2023-10-06T04:36:21.276878+0000","last_clean":"2023-10-06T04:36:21.276878+0000","last_became_active":"2023-10-06T04:36:17.251409+0000","last_became_peered":"2023-10-06T04:36:17.251409+0000","last_unstale":"2023-10-06T04:36:21.276878+0000","last_undegraded":"2023-10-06T04:36:21.276878+0000","last_fullsized":"2023-10-06T04:36:21.276878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:23:08.806295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.279778+0000","last_change":"2023-10-06T04:36:17.246611+0000","last_active":"2023-10-06T04:36:21.279778+0000","last_peered":"2023-10-06T04:36:21.279778+0000","last_clean":"2023-10-06T04:36:21.279778+0000","last_became_active":"2023-10-06T04:36:17.246330+0000","last_became_peered":"2023-10-06T04:36:17.246330+0000","last_unstale":"2023-10-06T04:36:21.279778+0000","last_undegraded":"2023-10-06T04:36:21.279778+0000","last_fullsized":"2023-10-06T04:36:21.279778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:33.859609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291627+0000","last_change":"2023-10-06T04:36:17.257554+0000","last_active":"2023-10-06T04:36:21.291627+0000","last_peered":"2023-10-06T04:36:21.291627+0000","last_clean":"2023-10-06T04:36:21.291627+0000","last_became_active":"2023-10-06T04:36:17.256991+0000","last_became_peered":"2023-10-06T04:36:17.256991+0000","last_unstale":"2023-10-06T04:36:21.291627+0000","last_undegraded":"2023-10-06T04:36:21.291627+0000","last_fullsized":"2023-10-06T04:36:21.291627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:53.436742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.299304+0000","last_change":"2023-10-06T04:36:21.295618+0000","last_active":"2023-10-06T04:36:21.299304+0000","last_peered":"2023-10-06T04:36:21.299304+0000","last_clean":"2023-10-06T04:36:21.299304+0000","last_became_active":"2023-10-06T04:36:21.295184+0000","last_became_peered":"2023-10-06T04:36:21.295184+0000","last_unstale":"2023-10-06T04:36:21.299304+0000","last_undegraded":"2023-10-06T04:36:21.299304+0000","last_fullsized":"2023-10-06T04:36:21.299304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:20:30.698636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280678+0000","last_change":"2023-10-06T04:36:16.230697+0000","last_active":"2023-10-06T04:36:21.280678+0000","last_peered":"2023-10-06T04:36:21.280678+0000","last_clean":"2023-10-06T04:36:21.280678+0000","last_became_active":"2023-10-06T04:36:16.230463+0000","last_became_peered":"2023-10-06T04:36:16.230463+0000","last_unstale":"2023-10-06T04:36:21.280678+0000","last_undegraded":"2023-10-06T04:36:21.280678+0000","last_fullsized":"2023-10-06T04:36:21.280678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:42.572631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.279718+0000","last_change":"2023-10-06T04:36:17.250531+0000","last_active":"2023-10-06T04:36:21.279718+0000","last_peered":"2023-10-06T04:36:21.279718+0000","last_clean":"2023-10-06T04:36:21.279718+0000","last_became_active":"2023-10-06T04:36:17.250025+0000","last_became_peered":"2023-10-06T04:36:17.250025+0000","last_unstale":"2023-10-06T04:36:21.279718+0000","last_undegraded":"2023-10-06T04:36:21.279718+0000","last_fullsized":"2023-10-06T04:36:21.279718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:14.615096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.303903+0000","last_change":"2023-10-06T04:36:21.293815+0000","last_active":"2023-10-06T04:36:21.303903+0000","last_peered":"2023-10-06T04:36:21.303903+0000","last_clean":"2023-10-06T04:36:21.303903+0000","last_became_active":"2023-10-06T04:36:21.292202+0000","last_became_peered":"2023-10-06T04:36:21.292202+0000","last_unstale":"2023-10-06T04:36:21.303903+0000","last_undegraded":"2023-10-06T04:36:21.303903+0000","last_fullsized":"2023-10-06T04:36:21.303903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:39.050172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.282090+0000","last_change":"2023-10-06T04:36:16.232507+0000","last_active":"2023-10-06T04:36:21.282090+0000","last_peered":"2023-10-06T04:36:21.282090+0000","last_clean":"2023-10-06T04:36:21.282090+0000","last_became_active":"2023-10-06T04:36:16.232152+0000","last_became_peered":"2023-10-06T04:36:16.232152+0000","last_unstale":"2023-10-06T04:36:21.282090+0000","last_undegraded":"2023-10-06T04:36:21.282090+0000","last_fullsized":"2023-10-06T04:36:21.282090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:12.145940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.278617+0000","last_change":"2023-10-06T04:36:17.254040+0000","last_active":"2023-10-06T04:36:21.278617+0000","last_peered":"2023-10-06T04:36:21.278617+0000","last_clean":"2023-10-06T04:36:21.278617+0000","last_became_active":"2023-10-06T04:36:17.252810+0000","last_became_peered":"2023-10-06T04:36:17.252810+0000","last_unstale":"2023-10-06T04:36:21.278617+0000","last_undegraded":"2023-10-06T04:36:21.278617+0000","last_fullsized":"2023-10-06T04:36:21.278617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:15:51.848244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.295280+0000","last_change":"2023-10-06T04:36:21.290604+0000","last_active":"2023-10-06T04:36:21.295280+0000","last_peered":"2023-10-06T04:36:21.295280+0000","last_clean":"2023-10-06T04:36:21.295280+0000","last_became_active":"2023-10-06T04:36:21.290250+0000","last_became_peered":"2023-10-06T04:36:21.290250+0000","last_unstale":"2023-10-06T04:36:21.295280+0000","last_undegraded":"2023-10-06T04:36:21.295280+0000","last_fullsized":"2023-10-06T04:36:21.295280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:06:31.394534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.277373+0000","last_change":"2023-10-06T04:36:16.226122+0000","last_active":"2023-10-06T04:36:21.277373+0000","last_peered":"2023-10-06T04:36:21.277373+0000","last_clean":"2023-10-06T04:36:21.277373+0000","last_became_active":"2023-10-06T04:36:16.225815+0000","last_became_peered":"2023-10-06T04:36:16.225815+0000","last_unstale":"2023-10-06T04:36:21.277373+0000","last_undegraded":"2023-10-06T04:36:21.277373+0000","last_fullsized":"2023-10-06T04:36:21.277373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:58:31.078830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.286372+0000","last_change":"2023-10-06T04:36:17.250474+0000","last_active":"2023-10-06T04:36:21.286372+0000","last_peered":"2023-10-06T04:36:21.286372+0000","last_clean":"2023-10-06T04:36:21.286372+0000","last_became_active":"2023-10-06T04:36:17.250205+0000","last_became_peered":"2023-10-06T04:36:17.250205+0000","last_unstale":"2023-10-06T04:36:21.286372+0000","last_undegraded":"2023-10-06T04:36:21.286372+0000","last_fullsized":"2023-10-06T04:36:21.286372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:46.694413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.306587+0000","last_change":"2023-10-06T04:36:21.301478+0000","last_active":"2023-10-06T04:36:21.306587+0000","last_peered":"2023-10-06T04:36:21.306587+0000","last_clean":"2023-10-06T04:36:21.306587+0000","last_became_active":"2023-10-06T04:36:21.300836+0000","last_became_peered":"2023-10-06T04:36:21.300836+0000","last_unstale":"2023-10-06T04:36:21.306587+0000","last_undegraded":"2023-10-06T04:36:21.306587+0000","last_fullsized":"2023-10-06T04:36:21.306587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:00.055287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276255+0000","last_change":"2023-10-06T04:36:16.231833+0000","last_active":"2023-10-06T04:36:21.276255+0000","last_peered":"2023-10-06T04:36:21.276255+0000","last_clean":"2023-10-06T04:36:21.276255+0000","last_became_active":"2023-10-06T04:36:16.231263+0000","last_became_peered":"2023-10-06T04:36:16.231263+0000","last_unstale":"2023-10-06T04:36:21.276255+0000","last_undegraded":"2023-10-06T04:36:21.276255+0000","last_fullsized":"2023-10-06T04:36:21.276255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:45:33.128307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.277178+0000","last_change":"2023-10-06T04:36:17.250303+0000","last_active":"2023-10-06T04:36:21.277178+0000","last_peered":"2023-10-06T04:36:21.277178+0000","last_clean":"2023-10-06T04:36:21.277178+0000","last_became_active":"2023-10-06T04:36:17.250033+0000","last_became_peered":"2023-10-06T04:36:17.250033+0000","last_unstale":"2023-10-06T04:36:21.277178+0000","last_undegraded":"2023-10-06T04:36:21.277178+0000","last_fullsized":"2023-10-06T04:36:21.277178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:35.000504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.309264+0000","last_change":"2023-10-06T04:36:21.302970+0000","last_active":"2023-10-06T04:36:21.309264+0000","last_peered":"2023-10-06T04:36:21.309264+0000","last_clean":"2023-10-06T04:36:21.309264+0000","last_became_active":"2023-10-06T04:36:21.302562+0000","last_became_peered":"2023-10-06T04:36:21.302562+0000","last_unstale":"2023-10-06T04:36:21.309264+0000","last_undegraded":"2023-10-06T04:36:21.309264+0000","last_fullsized":"2023-10-06T04:36:21.309264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:53.314660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291194+0000","last_change":"2023-10-06T04:36:16.230552+0000","last_active":"2023-10-06T04:36:21.291194+0000","last_peered":"2023-10-06T04:36:21.291194+0000","last_clean":"2023-10-06T04:36:21.291194+0000","last_became_active":"2023-10-06T04:36:16.230077+0000","last_became_peered":"2023-10-06T04:36:16.230077+0000","last_unstale":"2023-10-06T04:36:21.291194+0000","last_undegraded":"2023-10-06T04:36:21.291194+0000","last_fullsized":"2023-10-06T04:36:21.291194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:51:43.351582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.275705+0000","last_change":"2023-10-06T04:36:17.253484+0000","last_active":"2023-10-06T04:36:21.275705+0000","last_peered":"2023-10-06T04:36:21.275705+0000","last_clean":"2023-10-06T04:36:21.275705+0000","last_became_active":"2023-10-06T04:36:17.253217+0000","last_became_peered":"2023-10-06T04:36:17.253217+0000","last_unstale":"2023-10-06T04:36:21.275705+0000","last_undegraded":"2023-10-06T04:36:21.275705+0000","last_fullsized":"2023-10-06T04:36:21.275705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:23:08.806295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.301600+0000","last_change":"2023-10-06T04:36:21.296152+0000","last_active":"2023-10-06T04:36:21.301600+0000","last_peered":"2023-10-06T04:36:21.301600+0000","last_clean":"2023-10-06T04:36:21.301600+0000","last_became_active":"2023-10-06T04:36:21.295728+0000","last_became_peered":"2023-10-06T04:36:21.295728+0000","last_unstale":"2023-10-06T04:36:21.301600+0000","last_undegraded":"2023-10-06T04:36:21.301600+0000","last_fullsized":"2023-10-06T04:36:21.301600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:44.809580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.292523+0000","last_change":"2023-10-06T04:36:16.237564+0000","last_active":"2023-10-06T04:36:21.292523+0000","last_peered":"2023-10-06T04:36:21.292523+0000","last_clean":"2023-10-06T04:36:21.292523+0000","last_became_active":"2023-10-06T04:36:16.237309+0000","last_became_peered":"2023-10-06T04:36:16.237309+0000","last_unstale":"2023-10-06T04:36:21.292523+0000","last_undegraded":"2023-10-06T04:36:21.292523+0000","last_fullsized":"2023-10-06T04:36:21.292523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:47.521994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.281533+0000","last_change":"2023-10-06T04:36:17.256321+0000","last_active":"2023-10-06T04:36:21.281533+0000","last_peered":"2023-10-06T04:36:21.281533+0000","last_clean":"2023-10-06T04:36:21.281533+0000","last_became_active":"2023-10-06T04:36:17.256041+0000","last_became_peered":"2023-10-06T04:36:17.256041+0000","last_unstale":"2023-10-06T04:36:21.281533+0000","last_undegraded":"2023-10-06T04:36:21.281533+0000","last_fullsized":"2023-10-06T04:36:21.281533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:22.912226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.303744+0000","last_change":"2023-10-06T04:36:21.300383+0000","last_active":"2023-10-06T04:36:21.303744+0000","last_peered":"2023-10-06T04:36:21.303744+0000","last_clean":"2023-10-06T04:36:21.303744+0000","last_became_active":"2023-10-06T04:36:21.299968+0000","last_became_peered":"2023-10-06T04:36:21.299968+0000","last_unstale":"2023-10-06T04:36:21.303744+0000","last_undegraded":"2023-10-06T04:36:21.303744+0000","last_fullsized":"2023-10-06T04:36:21.303744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:22:34.846112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T04:36:27.099477+0000","last_change":"2023-10-06T04:36:16.229754+0000","last_active":"2023-10-06T04:36:27.099477+0000","last_peered":"2023-10-06T04:36:27.099477+0000","last_clean":"2023-10-06T04:36:27.099477+0000","last_became_active":"2023-10-06T04:36:16.229482+0000","last_became_peered":"2023-10-06T04:36:16.229482+0000","last_unstale":"2023-10-06T04:36:27.099477+0000","last_undegraded":"2023-10-06T04:36:27.099477+0000","last_fullsized":"2023-10-06T04:36:27.099477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:12.145940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280792+0000","last_change":"2023-10-06T04:36:17.254403+0000","last_active":"2023-10-06T04:36:21.280792+0000","last_peered":"2023-10-06T04:36:21.280792+0000","last_clean":"2023-10-06T04:36:21.280792+0000","last_became_active":"2023-10-06T04:36:17.254147+0000","last_became_peered":"2023-10-06T04:36:17.254147+0000","last_unstale":"2023-10-06T04:36:21.280792+0000","last_undegraded":"2023-10-06T04:36:21.280792+0000","last_fullsized":"2023-10-06T04:36:21.280792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:03.209071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.303821+0000","last_change":"2023-10-06T04:36:21.298829+0000","last_active":"2023-10-06T04:36:21.303821+0000","last_peered":"2023-10-06T04:36:21.303821+0000","last_clean":"2023-10-06T04:36:21.303821+0000","last_became_active":"2023-10-06T04:36:21.298456+0000","last_became_peered":"2023-10-06T04:36:21.298456+0000","last_unstale":"2023-10-06T04:36:21.303821+0000","last_undegraded":"2023-10-06T04:36:21.303821+0000","last_fullsized":"2023-10-06T04:36:21.303821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:52.989017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.292810+0000","last_change":"2023-10-06T04:36:16.235605+0000","last_active":"2023-10-06T04:36:21.292810+0000","last_peered":"2023-10-06T04:36:21.292810+0000","last_clean":"2023-10-06T04:36:21.292810+0000","last_became_active":"2023-10-06T04:36:16.235280+0000","last_became_peered":"2023-10-06T04:36:16.235280+0000","last_unstale":"2023-10-06T04:36:21.292810+0000","last_undegraded":"2023-10-06T04:36:21.292810+0000","last_fullsized":"2023-10-06T04:36:21.292810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:37.729642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.281044+0000","last_change":"2023-10-06T04:36:17.255715+0000","last_active":"2023-10-06T04:36:21.281044+0000","last_peered":"2023-10-06T04:36:21.281044+0000","last_clean":"2023-10-06T04:36:21.281044+0000","last_became_active":"2023-10-06T04:36:17.255461+0000","last_became_peered":"2023-10-06T04:36:17.255461+0000","last_unstale":"2023-10-06T04:36:21.281044+0000","last_undegraded":"2023-10-06T04:36:21.281044+0000","last_fullsized":"2023-10-06T04:36:21.281044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:28:24.765888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.301636+0000","last_change":"2023-10-06T04:36:21.294549+0000","last_active":"2023-10-06T04:36:21.301636+0000","last_peered":"2023-10-06T04:36:21.301636+0000","last_clean":"2023-10-06T04:36:21.301636+0000","last_became_active":"2023-10-06T04:36:21.293440+0000","last_became_peered":"2023-10-06T04:36:21.293440+0000","last_unstale":"2023-10-06T04:36:21.301636+0000","last_undegraded":"2023-10-06T04:36:21.301636+0000","last_fullsized":"2023-10-06T04:36:21.301636+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:42.828588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.278781+0000","last_change":"2023-10-06T04:36:16.226258+0000","last_active":"2023-10-06T04:36:21.278781+0000","last_peered":"2023-10-06T04:36:21.278781+0000","last_clean":"2023-10-06T04:36:21.278781+0000","last_became_active":"2023-10-06T04:36:16.225988+0000","last_became_peered":"2023-10-06T04:36:16.225988+0000","last_unstale":"2023-10-06T04:36:21.278781+0000","last_undegraded":"2023-10-06T04:36:21.278781+0000","last_fullsized":"2023-10-06T04:36:21.278781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:54.757446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291513+0000","last_change":"2023-10-06T04:36:17.257055+0000","last_active":"2023-10-06T04:36:21.291513+0000","last_peered":"2023-10-06T04:36:21.291513+0000","last_clean":"2023-10-06T04:36:21.291513+0000","last_became_active":"2023-10-06T04:36:17.256355+0000","last_became_peered":"2023-10-06T04:36:17.256355+0000","last_unstale":"2023-10-06T04:36:21.291513+0000","last_undegraded":"2023-10-06T04:36:21.291513+0000","last_fullsized":"2023-10-06T04:36:21.291513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:11.333475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.297023+0000","last_change":"2023-10-06T04:36:21.293305+0000","last_active":"2023-10-06T04:36:21.297023+0000","last_peered":"2023-10-06T04:36:21.297023+0000","last_clean":"2023-10-06T04:36:21.297023+0000","last_became_active":"2023-10-06T04:36:21.291331+0000","last_became_peered":"2023-10-06T04:36:21.291331+0000","last_unstale":"2023-10-06T04:36:21.297023+0000","last_undegraded":"2023-10-06T04:36:21.297023+0000","last_fullsized":"2023-10-06T04:36:21.297023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:14:57.032741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291211+0000","last_change":"2023-10-06T04:36:16.235344+0000","last_active":"2023-10-06T04:36:21.291211+0000","last_peered":"2023-10-06T04:36:21.291211+0000","last_clean":"2023-10-06T04:36:21.291211+0000","last_became_active":"2023-10-06T04:36:16.235092+0000","last_became_peered":"2023-10-06T04:36:16.235092+0000","last_unstale":"2023-10-06T04:36:21.291211+0000","last_undegraded":"2023-10-06T04:36:21.291211+0000","last_fullsized":"2023-10-06T04:36:21.291211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:40.040325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.278875+0000","last_change":"2023-10-06T04:36:17.252187+0000","last_active":"2023-10-06T04:36:21.278875+0000","last_peered":"2023-10-06T04:36:21.278875+0000","last_clean":"2023-10-06T04:36:21.278875+0000","last_became_active":"2023-10-06T04:36:17.251853+0000","last_became_peered":"2023-10-06T04:36:17.251853+0000","last_unstale":"2023-10-06T04:36:21.278875+0000","last_undegraded":"2023-10-06T04:36:21.278875+0000","last_fullsized":"2023-10-06T04:36:21.278875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:01:35.146203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.307146+0000","last_change":"2023-10-06T04:36:21.302469+0000","last_active":"2023-10-06T04:36:21.307146+0000","last_peered":"2023-10-06T04:36:21.307146+0000","last_clean":"2023-10-06T04:36:21.307146+0000","last_became_active":"2023-10-06T04:36:21.302085+0000","last_became_peered":"2023-10-06T04:36:21.302085+0000","last_unstale":"2023-10-06T04:36:21.307146+0000","last_undegraded":"2023-10-06T04:36:21.307146+0000","last_fullsized":"2023-10-06T04:36:21.307146+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:06:31.394534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.288489+0000","last_change":"2023-10-06T04:36:16.236074+0000","last_active":"2023-10-06T04:36:21.288489+0000","last_peered":"2023-10-06T04:36:21.288489+0000","last_clean":"2023-10-06T04:36:21.288489+0000","last_became_active":"2023-10-06T04:36:16.235777+0000","last_became_peered":"2023-10-06T04:36:16.235777+0000","last_unstale":"2023-10-06T04:36:21.288489+0000","last_undegraded":"2023-10-06T04:36:21.288489+0000","last_fullsized":"2023-10-06T04:36:21.288489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:42:27.974066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.279446+0000","last_change":"2023-10-06T04:36:17.259778+0000","last_active":"2023-10-06T04:36:21.279446+0000","last_peered":"2023-10-06T04:36:21.279446+0000","last_clean":"2023-10-06T04:36:21.279446+0000","last_became_active":"2023-10-06T04:36:17.259529+0000","last_became_peered":"2023-10-06T04:36:17.259529+0000","last_unstale":"2023-10-06T04:36:21.279446+0000","last_undegraded":"2023-10-06T04:36:21.279446+0000","last_fullsized":"2023-10-06T04:36:21.279446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:02.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.309340+0000","last_change":"2023-10-06T04:36:21.305292+0000","last_active":"2023-10-06T04:36:21.309340+0000","last_peered":"2023-10-06T04:36:21.309340+0000","last_clean":"2023-10-06T04:36:21.309340+0000","last_became_active":"2023-10-06T04:36:21.304899+0000","last_became_peered":"2023-10-06T04:36:21.304899+0000","last_unstale":"2023-10-06T04:36:21.309340+0000","last_undegraded":"2023-10-06T04:36:21.309340+0000","last_fullsized":"2023-10-06T04:36:21.309340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:30.790855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.296904+0000","last_change":"2023-10-06T04:36:16.235873+0000","last_active":"2023-10-06T04:36:21.296904+0000","last_peered":"2023-10-06T04:36:21.296904+0000","last_clean":"2023-10-06T04:36:21.296904+0000","last_became_active":"2023-10-06T04:36:16.235577+0000","last_became_peered":"2023-10-06T04:36:16.235577+0000","last_unstale":"2023-10-06T04:36:21.296904+0000","last_undegraded":"2023-10-06T04:36:21.296904+0000","last_fullsized":"2023-10-06T04:36:21.296904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:39.497925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.290348+0000","last_change":"2023-10-06T04:36:17.256627+0000","last_active":"2023-10-06T04:36:21.290348+0000","last_peered":"2023-10-06T04:36:21.290348+0000","last_clean":"2023-10-06T04:36:21.290348+0000","last_became_active":"2023-10-06T04:36:17.256351+0000","last_became_peered":"2023-10-06T04:36:17.256351+0000","last_unstale":"2023-10-06T04:36:21.290348+0000","last_undegraded":"2023-10-06T04:36:21.290348+0000","last_fullsized":"2023-10-06T04:36:21.290348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:18.298620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.299923+0000","last_change":"2023-10-06T04:36:21.292866+0000","last_active":"2023-10-06T04:36:21.299923+0000","last_peered":"2023-10-06T04:36:21.299923+0000","last_clean":"2023-10-06T04:36:21.299923+0000","last_became_active":"2023-10-06T04:36:21.292441+0000","last_became_peered":"2023-10-06T04:36:21.292441+0000","last_unstale":"2023-10-06T04:36:21.299923+0000","last_undegraded":"2023-10-06T04:36:21.299923+0000","last_fullsized":"2023-10-06T04:36:21.299923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:29.699781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.293323+0000","last_change":"2023-10-06T04:36:16.235438+0000","last_active":"2023-10-06T04:36:21.293323+0000","last_peered":"2023-10-06T04:36:21.293323+0000","last_clean":"2023-10-06T04:36:21.293323+0000","last_became_active":"2023-10-06T04:36:16.235142+0000","last_became_peered":"2023-10-06T04:36:16.235142+0000","last_unstale":"2023-10-06T04:36:21.293323+0000","last_undegraded":"2023-10-06T04:36:21.293323+0000","last_fullsized":"2023-10-06T04:36:21.293323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:45.690139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280210+0000","last_change":"2023-10-06T04:36:17.262198+0000","last_active":"2023-10-06T04:36:21.280210+0000","last_peered":"2023-10-06T04:36:21.280210+0000","last_clean":"2023-10-06T04:36:21.280210+0000","last_became_active":"2023-10-06T04:36:17.261922+0000","last_became_peered":"2023-10-06T04:36:17.261922+0000","last_unstale":"2023-10-06T04:36:21.280210+0000","last_undegraded":"2023-10-06T04:36:21.280210+0000","last_fullsized":"2023-10-06T04:36:21.280210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:52.911614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.302413+0000","last_change":"2023-10-06T04:36:21.301322+0000","last_active":"2023-10-06T04:36:21.302413+0000","last_peered":"2023-10-06T04:36:21.302413+0000","last_clean":"2023-10-06T04:36:21.302413+0000","last_became_active":"2023-10-06T04:36:21.300972+0000","last_became_peered":"2023-10-06T04:36:21.300972+0000","last_unstale":"2023-10-06T04:36:21.302413+0000","last_undegraded":"2023-10-06T04:36:21.302413+0000","last_fullsized":"2023-10-06T04:36:21.302413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:16.931552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.292453+0000","last_change":"2023-10-06T04:36:16.231930+0000","last_active":"2023-10-06T04:36:21.292453+0000","last_peered":"2023-10-06T04:36:21.292453+0000","last_clean":"2023-10-06T04:36:21.292453+0000","last_became_active":"2023-10-06T04:36:16.231670+0000","last_became_peered":"2023-10-06T04:36:16.231670+0000","last_unstale":"2023-10-06T04:36:21.292453+0000","last_undegraded":"2023-10-06T04:36:21.292453+0000","last_fullsized":"2023-10-06T04:36:21.292453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:14.880214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.283773+0000","last_change":"2023-10-06T04:36:17.257608+0000","last_active":"2023-10-06T04:36:21.283773+0000","last_peered":"2023-10-06T04:36:21.283773+0000","last_clean":"2023-10-06T04:36:21.283773+0000","last_became_active":"2023-10-06T04:36:17.257367+0000","last_became_peered":"2023-10-06T04:36:17.257367+0000","last_unstale":"2023-10-06T04:36:21.283773+0000","last_undegraded":"2023-10-06T04:36:21.283773+0000","last_fullsized":"2023-10-06T04:36:21.283773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:48.526269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.290478+0000","last_change":"2023-10-06T04:36:21.289073+0000","last_active":"2023-10-06T04:36:21.290478+0000","last_peered":"2023-10-06T04:36:21.290478+0000","last_clean":"2023-10-06T04:36:21.290478+0000","last_became_active":"2023-10-06T04:36:21.288651+0000","last_became_peered":"2023-10-06T04:36:21.288651+0000","last_unstale":"2023-10-06T04:36:21.290478+0000","last_undegraded":"2023-10-06T04:36:21.290478+0000","last_fullsized":"2023-10-06T04:36:21.290478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:23:12.855962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291282+0000","last_change":"2023-10-06T04:36:16.238006+0000","last_active":"2023-10-06T04:36:21.291282+0000","last_peered":"2023-10-06T04:36:21.291282+0000","last_clean":"2023-10-06T04:36:21.291282+0000","last_became_active":"2023-10-06T04:36:16.237733+0000","last_became_peered":"2023-10-06T04:36:16.237733+0000","last_unstale":"2023-10-06T04:36:21.291282+0000","last_undegraded":"2023-10-06T04:36:21.291282+0000","last_fullsized":"2023-10-06T04:36:21.291282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:45:33.128307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.284558+0000","last_change":"2023-10-06T04:36:17.248071+0000","last_active":"2023-10-06T04:36:21.284558+0000","last_peered":"2023-10-06T04:36:21.284558+0000","last_clean":"2023-10-06T04:36:21.284558+0000","last_became_active":"2023-10-06T04:36:17.247774+0000","last_became_peered":"2023-10-06T04:36:17.247774+0000","last_unstale":"2023-10-06T04:36:21.284558+0000","last_undegraded":"2023-10-06T04:36:21.284558+0000","last_fullsized":"2023-10-06T04:36:21.284558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:06.137894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.303676+0000","last_change":"2023-10-06T04:36:21.302376+0000","last_active":"2023-10-06T04:36:21.303676+0000","last_peered":"2023-10-06T04:36:21.303676+0000","last_clean":"2023-10-06T04:36:21.303676+0000","last_became_active":"2023-10-06T04:36:21.301996+0000","last_became_peered":"2023-10-06T04:36:21.301996+0000","last_unstale":"2023-10-06T04:36:21.303676+0000","last_undegraded":"2023-10-06T04:36:21.303676+0000","last_fullsized":"2023-10-06T04:36:21.303676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:35:31.655298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.275570+0000","last_change":"2023-10-06T04:36:16.226105+0000","last_active":"2023-10-06T04:36:21.275570+0000","last_peered":"2023-10-06T04:36:21.275570+0000","last_clean":"2023-10-06T04:36:21.275570+0000","last_became_active":"2023-10-06T04:36:16.225746+0000","last_became_peered":"2023-10-06T04:36:16.225746+0000","last_unstale":"2023-10-06T04:36:21.275570+0000","last_undegraded":"2023-10-06T04:36:21.275570+0000","last_fullsized":"2023-10-06T04:36:21.275570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:10.606701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280903+0000","last_change":"2023-10-06T04:36:17.248063+0000","last_active":"2023-10-06T04:36:21.280903+0000","last_peered":"2023-10-06T04:36:21.280903+0000","last_clean":"2023-10-06T04:36:21.280903+0000","last_became_active":"2023-10-06T04:36:17.247756+0000","last_became_peered":"2023-10-06T04:36:17.247756+0000","last_unstale":"2023-10-06T04:36:21.280903+0000","last_undegraded":"2023-10-06T04:36:21.280903+0000","last_fullsized":"2023-10-06T04:36:21.280903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:15:51.848244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.300498+0000","last_change":"2023-10-06T04:36:21.295888+0000","last_active":"2023-10-06T04:36:21.300498+0000","last_peered":"2023-10-06T04:36:21.300498+0000","last_clean":"2023-10-06T04:36:21.300498+0000","last_became_active":"2023-10-06T04:36:21.295493+0000","last_became_peered":"2023-10-06T04:36:21.295493+0000","last_unstale":"2023-10-06T04:36:21.300498+0000","last_undegraded":"2023-10-06T04:36:21.300498+0000","last_fullsized":"2023-10-06T04:36:21.300498+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:36.618164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.283866+0000","last_change":"2023-10-06T04:36:16.235993+0000","last_active":"2023-10-06T04:36:21.283866+0000","last_peered":"2023-10-06T04:36:21.283866+0000","last_clean":"2023-10-06T04:36:21.283866+0000","last_became_active":"2023-10-06T04:36:16.235737+0000","last_became_peered":"2023-10-06T04:36:16.235737+0000","last_unstale":"2023-10-06T04:36:21.283866+0000","last_undegraded":"2023-10-06T04:36:21.283866+0000","last_fullsized":"2023-10-06T04:36:21.283866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:51:43.351582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.281338+0000","last_change":"2023-10-06T04:36:17.251705+0000","last_active":"2023-10-06T04:36:21.281338+0000","last_peered":"2023-10-06T04:36:21.281338+0000","last_clean":"2023-10-06T04:36:21.281338+0000","last_became_active":"2023-10-06T04:36:17.251306+0000","last_became_peered":"2023-10-06T04:36:17.251306+0000","last_unstale":"2023-10-06T04:36:21.281338+0000","last_undegraded":"2023-10-06T04:36:21.281338+0000","last_fullsized":"2023-10-06T04:36:21.281338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:53.016887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.303623+0000","last_change":"2023-10-06T04:36:21.296312+0000","last_active":"2023-10-06T04:36:21.303623+0000","last_peered":"2023-10-06T04:36:21.303623+0000","last_clean":"2023-10-06T04:36:21.303623+0000","last_became_active":"2023-10-06T04:36:21.294384+0000","last_became_peered":"2023-10-06T04:36:21.294384+0000","last_unstale":"2023-10-06T04:36:21.303623+0000","last_undegraded":"2023-10-06T04:36:21.303623+0000","last_fullsized":"2023-10-06T04:36:21.303623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:22:34.846112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280043+0000","last_change":"2023-10-06T04:36:16.234482+0000","last_active":"2023-10-06T04:36:21.280043+0000","last_peered":"2023-10-06T04:36:21.280043+0000","last_clean":"2023-10-06T04:36:21.280043+0000","last_became_active":"2023-10-06T04:36:16.234239+0000","last_became_peered":"2023-10-06T04:36:16.234239+0000","last_unstale":"2023-10-06T04:36:21.280043+0000","last_undegraded":"2023-10-06T04:36:21.280043+0000","last_fullsized":"2023-10-06T04:36:21.280043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:51:43.351582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.281261+0000","last_change":"2023-10-06T04:36:17.254931+0000","last_active":"2023-10-06T04:36:21.281261+0000","last_peered":"2023-10-06T04:36:21.281261+0000","last_clean":"2023-10-06T04:36:21.281261+0000","last_became_active":"2023-10-06T04:36:17.254674+0000","last_became_peered":"2023-10-06T04:36:17.254674+0000","last_unstale":"2023-10-06T04:36:21.281261+0000","last_undegraded":"2023-10-06T04:36:21.281261+0000","last_fullsized":"2023-10-06T04:36:21.281261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:06.137894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.296227+0000","last_change":"2023-10-06T04:36:21.294775+0000","last_active":"2023-10-06T04:36:21.296227+0000","last_peered":"2023-10-06T04:36:21.296227+0000","last_clean":"2023-10-06T04:36:21.296227+0000","last_became_active":"2023-10-06T04:36:21.294362+0000","last_became_peered":"2023-10-06T04:36:21.294362+0000","last_unstale":"2023-10-06T04:36:21.296227+0000","last_undegraded":"2023-10-06T04:36:21.296227+0000","last_fullsized":"2023-10-06T04:36:21.296227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:37.257094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.277076+0000","last_change":"2023-10-06T04:36:16.234752+0000","last_active":"2023-10-06T04:36:21.277076+0000","last_peered":"2023-10-06T04:36:21.277076+0000","last_clean":"2023-10-06T04:36:21.277076+0000","last_became_active":"2023-10-06T04:36:16.230744+0000","last_became_peered":"2023-10-06T04:36:16.230744+0000","last_unstale":"2023-10-06T04:36:21.277076+0000","last_undegraded":"2023-10-06T04:36:21.277076+0000","last_fullsized":"2023-10-06T04:36:21.277076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:32.855334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276381+0000","last_change":"2023-10-06T04:36:17.255101+0000","last_active":"2023-10-06T04:36:21.276381+0000","last_peered":"2023-10-06T04:36:21.276381+0000","last_clean":"2023-10-06T04:36:21.276381+0000","last_became_active":"2023-10-06T04:36:17.254846+0000","last_became_peered":"2023-10-06T04:36:17.254846+0000","last_unstale":"2023-10-06T04:36:21.276381+0000","last_undegraded":"2023-10-06T04:36:21.276381+0000","last_fullsized":"2023-10-06T04:36:21.276381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:01:35.146203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.303559+0000","last_change":"2023-10-06T04:36:21.295704+0000","last_active":"2023-10-06T04:36:21.303559+0000","last_peered":"2023-10-06T04:36:21.303559+0000","last_clean":"2023-10-06T04:36:21.303559+0000","last_became_active":"2023-10-06T04:36:21.295333+0000","last_became_peered":"2023-10-06T04:36:21.295333+0000","last_unstale":"2023-10-06T04:36:21.303559+0000","last_undegraded":"2023-10-06T04:36:21.303559+0000","last_fullsized":"2023-10-06T04:36:21.303559+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:21:19.303096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.277832+0000","last_change":"2023-10-06T04:36:16.227900+0000","last_active":"2023-10-06T04:36:21.277832+0000","last_peered":"2023-10-06T04:36:21.277832+0000","last_clean":"2023-10-06T04:36:21.277832+0000","last_became_active":"2023-10-06T04:36:16.227587+0000","last_became_peered":"2023-10-06T04:36:16.227587+0000","last_unstale":"2023-10-06T04:36:21.277832+0000","last_undegraded":"2023-10-06T04:36:21.277832+0000","last_fullsized":"2023-10-06T04:36:21.277832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:54.757446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.281521+0000","last_change":"2023-10-06T04:36:11.192215+0000","last_active":"2023-10-06T04:36:21.281521+0000","last_peered":"2023-10-06T04:36:21.281521+0000","last_clean":"2023-10-06T04:36:21.281521+0000","last_became_active":"2023-10-06T04:36:11.191953+0000","last_became_peered":"2023-10-06T04:36:11.191953+0000","last_unstale":"2023-10-06T04:36:21.281521+0000","last_undegraded":"2023-10-06T04:36:21.281521+0000","last_fullsized":"2023-10-06T04:36:21.281521+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:37.026121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.277485+0000","last_change":"2023-10-06T04:36:17.254170+0000","last_active":"2023-10-06T04:36:21.277485+0000","last_peered":"2023-10-06T04:36:21.277485+0000","last_clean":"2023-10-06T04:36:21.277485+0000","last_became_active":"2023-10-06T04:36:17.253910+0000","last_became_peered":"2023-10-06T04:36:17.253910+0000","last_unstale":"2023-10-06T04:36:21.277485+0000","last_undegraded":"2023-10-06T04:36:21.277485+0000","last_fullsized":"2023-10-06T04:36:21.277485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:18.298620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.296974+0000","last_change":"2023-10-06T04:36:21.291691+0000","last_active":"2023-10-06T04:36:21.296974+0000","last_peered":"2023-10-06T04:36:21.296974+0000","last_clean":"2023-10-06T04:36:21.296974+0000","last_became_active":"2023-10-06T04:36:21.291287+0000","last_became_peered":"2023-10-06T04:36:21.291287+0000","last_unstale":"2023-10-06T04:36:21.296974+0000","last_undegraded":"2023-10-06T04:36:21.296974+0000","last_fullsized":"2023-10-06T04:36:21.296974+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:59:55.077526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280946+0000","last_change":"2023-10-06T04:36:11.184555+0000","last_active":"2023-10-06T04:36:21.280946+0000","last_peered":"2023-10-06T04:36:21.280946+0000","last_clean":"2023-10-06T04:36:21.280946+0000","last_became_active":"2023-10-06T04:36:11.184229+0000","last_became_peered":"2023-10-06T04:36:11.184229+0000","last_unstale":"2023-10-06T04:36:21.280946+0000","last_undegraded":"2023-10-06T04:36:21.280946+0000","last_fullsized":"2023-10-06T04:36:21.280946+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:19.938716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.295381+0000","last_change":"2023-10-06T04:36:16.227655+0000","last_active":"2023-10-06T04:36:21.295381+0000","last_peered":"2023-10-06T04:36:21.295381+0000","last_clean":"2023-10-06T04:36:21.295381+0000","last_became_active":"2023-10-06T04:36:16.227033+0000","last_became_peered":"2023-10-06T04:36:16.227033+0000","last_unstale":"2023-10-06T04:36:21.295381+0000","last_undegraded":"2023-10-06T04:36:21.295381+0000","last_fullsized":"2023-10-06T04:36:21.295381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:10.606701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280143+0000","last_change":"2023-10-06T04:36:17.250515+0000","last_active":"2023-10-06T04:36:21.280143+0000","last_peered":"2023-10-06T04:36:21.280143+0000","last_clean":"2023-10-06T04:36:21.280143+0000","last_became_active":"2023-10-06T04:36:17.250192+0000","last_became_peered":"2023-10-06T04:36:17.250192+0000","last_unstale":"2023-10-06T04:36:21.280143+0000","last_undegraded":"2023-10-06T04:36:21.280143+0000","last_fullsized":"2023-10-06T04:36:21.280143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:25.650113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.304036+0000","last_change":"2023-10-06T04:36:21.298658+0000","last_active":"2023-10-06T04:36:21.304036+0000","last_peered":"2023-10-06T04:36:21.304036+0000","last_clean":"2023-10-06T04:36:21.304036+0000","last_became_active":"2023-10-06T04:36:21.298118+0000","last_became_peered":"2023-10-06T04:36:21.298118+0000","last_unstale":"2023-10-06T04:36:21.304036+0000","last_undegraded":"2023-10-06T04:36:21.304036+0000","last_fullsized":"2023-10-06T04:36:21.304036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:38.096649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276479+0000","last_change":"2023-10-06T04:36:11.184460+0000","last_active":"2023-10-06T04:36:21.276479+0000","last_peered":"2023-10-06T04:36:21.276479+0000","last_clean":"2023-10-06T04:36:21.276479+0000","last_became_active":"2023-10-06T04:36:11.184119+0000","last_became_peered":"2023-10-06T04:36:11.184119+0000","last_unstale":"2023-10-06T04:36:21.276479+0000","last_undegraded":"2023-10-06T04:36:21.276479+0000","last_fullsized":"2023-10-06T04:36:21.276479+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:37.026121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":166,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.290702+0000","last_change":"2023-10-06T04:36:12.183155+0000","last_active":"2023-10-06T04:36:21.290702+0000","last_peered":"2023-10-06T04:36:21.290702+0000","last_clean":"2023-10-06T04:36:21.290702+0000","last_became_active":"2023-10-06T04:36:12.182903+0000","last_became_peered":"2023-10-06T04:36:12.182903+0000","last_unstale":"2023-10-06T04:36:21.290702+0000","last_undegraded":"2023-10-06T04:36:21.290702+0000","last_fullsized":"2023-10-06T04:36:21.290702+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:11.171104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:11.171104+0000","last_clean_scrub_stamp":"2023-10-06T04:36:11.171104+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:38:54.323364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.275958+0000","last_change":"2023-10-06T04:36:16.228034+0000","last_active":"2023-10-06T04:36:21.275958+0000","last_peered":"2023-10-06T04:36:21.275958+0000","last_clean":"2023-10-06T04:36:21.275958+0000","last_became_active":"2023-10-06T04:36:16.227743+0000","last_became_peered":"2023-10-06T04:36:16.227743+0000","last_unstale":"2023-10-06T04:36:21.275958+0000","last_undegraded":"2023-10-06T04:36:21.275958+0000","last_fullsized":"2023-10-06T04:36:21.275958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:12.145940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.278791+0000","last_change":"2023-10-06T04:36:17.257761+0000","last_active":"2023-10-06T04:36:21.278791+0000","last_peered":"2023-10-06T04:36:21.278791+0000","last_clean":"2023-10-06T04:36:21.278791+0000","last_became_active":"2023-10-06T04:36:17.257238+0000","last_became_peered":"2023-10-06T04:36:17.257238+0000","last_unstale":"2023-10-06T04:36:21.278791+0000","last_undegraded":"2023-10-06T04:36:21.278791+0000","last_fullsized":"2023-10-06T04:36:21.278791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:03.209071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.300390+0000","last_change":"2023-10-06T04:36:21.296982+0000","last_active":"2023-10-06T04:36:21.300390+0000","last_peered":"2023-10-06T04:36:21.300390+0000","last_clean":"2023-10-06T04:36:21.300390+0000","last_became_active":"2023-10-06T04:36:21.296294+0000","last_became_peered":"2023-10-06T04:36:21.296294+0000","last_unstale":"2023-10-06T04:36:21.300390+0000","last_undegraded":"2023-10-06T04:36:21.300390+0000","last_fullsized":"2023-10-06T04:36:21.300390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:39.050172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.292995+0000","last_change":"2023-10-06T04:36:11.193056+0000","last_active":"2023-10-06T04:36:21.292995+0000","last_peered":"2023-10-06T04:36:21.292995+0000","last_clean":"2023-10-06T04:36:21.292995+0000","last_became_active":"2023-10-06T04:36:11.192712+0000","last_became_peered":"2023-10-06T04:36:11.192712+0000","last_unstale":"2023-10-06T04:36:21.292995+0000","last_undegraded":"2023-10-06T04:36:21.292995+0000","last_fullsized":"2023-10-06T04:36:21.292995+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:00.008654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.278242+0000","last_change":"2023-10-06T04:36:16.234660+0000","last_active":"2023-10-06T04:36:21.278242+0000","last_peered":"2023-10-06T04:36:21.278242+0000","last_clean":"2023-10-06T04:36:21.278242+0000","last_became_active":"2023-10-06T04:36:16.234357+0000","last_became_peered":"2023-10-06T04:36:16.234357+0000","last_unstale":"2023-10-06T04:36:21.278242+0000","last_undegraded":"2023-10-06T04:36:21.278242+0000","last_fullsized":"2023-10-06T04:36:21.278242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:42:27.974066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276281+0000","last_change":"2023-10-06T04:36:17.251700+0000","last_active":"2023-10-06T04:36:21.276281+0000","last_peered":"2023-10-06T04:36:21.276281+0000","last_clean":"2023-10-06T04:36:21.276281+0000","last_became_active":"2023-10-06T04:36:17.251034+0000","last_became_peered":"2023-10-06T04:36:17.251034+0000","last_unstale":"2023-10-06T04:36:21.276281+0000","last_undegraded":"2023-10-06T04:36:21.276281+0000","last_fullsized":"2023-10-06T04:36:21.276281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:11.333475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.309325+0000","last_change":"2023-10-06T04:36:21.305039+0000","last_active":"2023-10-06T04:36:21.309325+0000","last_peered":"2023-10-06T04:36:21.309325+0000","last_clean":"2023-10-06T04:36:21.309325+0000","last_became_active":"2023-10-06T04:36:21.304584+0000","last_became_peered":"2023-10-06T04:36:21.304584+0000","last_unstale":"2023-10-06T04:36:21.309325+0000","last_undegraded":"2023-10-06T04:36:21.309325+0000","last_fullsized":"2023-10-06T04:36:21.309325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:07.162250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.290530+0000","last_change":"2023-10-06T04:36:11.192701+0000","last_active":"2023-10-06T04:36:21.290530+0000","last_peered":"2023-10-06T04:36:21.290530+0000","last_clean":"2023-10-06T04:36:21.290530+0000","last_became_active":"2023-10-06T04:36:11.192335+0000","last_became_peered":"2023-10-06T04:36:11.192335+0000","last_unstale":"2023-10-06T04:36:21.290530+0000","last_undegraded":"2023-10-06T04:36:21.290530+0000","last_fullsized":"2023-10-06T04:36:21.290530+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:18.643570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276668+0000","last_change":"2023-10-06T04:36:16.234341+0000","last_active":"2023-10-06T04:36:21.276668+0000","last_peered":"2023-10-06T04:36:21.276668+0000","last_clean":"2023-10-06T04:36:21.276668+0000","last_became_active":"2023-10-06T04:36:16.230428+0000","last_became_peered":"2023-10-06T04:36:16.230428+0000","last_unstale":"2023-10-06T04:36:21.276668+0000","last_undegraded":"2023-10-06T04:36:21.276668+0000","last_fullsized":"2023-10-06T04:36:21.276668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:39.497925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291935+0000","last_change":"2023-10-06T04:36:17.263627+0000","last_active":"2023-10-06T04:36:21.291935+0000","last_peered":"2023-10-06T04:36:21.291935+0000","last_clean":"2023-10-06T04:36:21.291935+0000","last_became_active":"2023-10-06T04:36:17.263090+0000","last_became_peered":"2023-10-06T04:36:17.263090+0000","last_unstale":"2023-10-06T04:36:21.291935+0000","last_undegraded":"2023-10-06T04:36:21.291935+0000","last_fullsized":"2023-10-06T04:36:21.291935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:38.733916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.305005+0000","last_change":"2023-10-06T04:36:21.302935+0000","last_active":"2023-10-06T04:36:21.305005+0000","last_peered":"2023-10-06T04:36:21.305005+0000","last_clean":"2023-10-06T04:36:21.305005+0000","last_became_active":"2023-10-06T04:36:21.302531+0000","last_became_peered":"2023-10-06T04:36:21.302531+0000","last_unstale":"2023-10-06T04:36:21.305005+0000","last_undegraded":"2023-10-06T04:36:21.305005+0000","last_fullsized":"2023-10-06T04:36:21.305005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:53.314660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.290636+0000","last_change":"2023-10-06T04:36:11.193497+0000","last_active":"2023-10-06T04:36:21.290636+0000","last_peered":"2023-10-06T04:36:21.290636+0000","last_clean":"2023-10-06T04:36:21.290636+0000","last_became_active":"2023-10-06T04:36:11.193215+0000","last_became_peered":"2023-10-06T04:36:11.193215+0000","last_unstale":"2023-10-06T04:36:21.290636+0000","last_undegraded":"2023-10-06T04:36:21.290636+0000","last_fullsized":"2023-10-06T04:36:21.290636+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:07.497987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280777+0000","last_change":"2023-10-06T04:36:16.228895+0000","last_active":"2023-10-06T04:36:21.280777+0000","last_peered":"2023-10-06T04:36:21.280777+0000","last_clean":"2023-10-06T04:36:21.280777+0000","last_became_active":"2023-10-06T04:36:16.228165+0000","last_became_peered":"2023-10-06T04:36:16.228165+0000","last_unstale":"2023-10-06T04:36:21.280777+0000","last_undegraded":"2023-10-06T04:36:21.280777+0000","last_fullsized":"2023-10-06T04:36:21.280777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:10.606701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.282559+0000","last_change":"2023-10-06T04:36:17.245277+0000","last_active":"2023-10-06T04:36:21.282559+0000","last_peered":"2023-10-06T04:36:21.282559+0000","last_clean":"2023-10-06T04:36:21.282559+0000","last_became_active":"2023-10-06T04:36:17.245034+0000","last_became_peered":"2023-10-06T04:36:17.245034+0000","last_unstale":"2023-10-06T04:36:21.282559+0000","last_undegraded":"2023-10-06T04:36:21.282559+0000","last_fullsized":"2023-10-06T04:36:21.282559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:48.526269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.305149+0000","last_change":"2023-10-06T04:36:21.299758+0000","last_active":"2023-10-06T04:36:21.305149+0000","last_peered":"2023-10-06T04:36:21.305149+0000","last_clean":"2023-10-06T04:36:21.305149+0000","last_became_active":"2023-10-06T04:36:21.299383+0000","last_became_peered":"2023-10-06T04:36:21.299383+0000","last_unstale":"2023-10-06T04:36:21.305149+0000","last_undegraded":"2023-10-06T04:36:21.305149+0000","last_fullsized":"2023-10-06T04:36:21.305149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:29.699781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.283643+0000","last_change":"2023-10-06T04:36:11.193111+0000","last_active":"2023-10-06T04:36:21.283643+0000","last_peered":"2023-10-06T04:36:21.283643+0000","last_clean":"2023-10-06T04:36:21.283643+0000","last_became_active":"2023-10-06T04:36:11.192836+0000","last_became_peered":"2023-10-06T04:36:11.192836+0000","last_unstale":"2023-10-06T04:36:21.283643+0000","last_undegraded":"2023-10-06T04:36:21.283643+0000","last_fullsized":"2023-10-06T04:36:21.283643+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:19.938716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276725+0000","last_change":"2023-10-06T04:36:16.233274+0000","last_active":"2023-10-06T04:36:21.276725+0000","last_peered":"2023-10-06T04:36:21.276725+0000","last_clean":"2023-10-06T04:36:21.276725+0000","last_became_active":"2023-10-06T04:36:16.232385+0000","last_became_peered":"2023-10-06T04:36:16.232385+0000","last_unstale":"2023-10-06T04:36:21.276725+0000","last_undegraded":"2023-10-06T04:36:21.276725+0000","last_fullsized":"2023-10-06T04:36:21.276725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:51:43.351582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.284374+0000","last_change":"2023-10-06T04:36:17.251317+0000","last_active":"2023-10-06T04:36:21.284374+0000","last_peered":"2023-10-06T04:36:21.284374+0000","last_clean":"2023-10-06T04:36:21.284374+0000","last_became_active":"2023-10-06T04:36:17.251156+0000","last_became_peered":"2023-10-06T04:36:17.251156+0000","last_unstale":"2023-10-06T04:36:21.284374+0000","last_undegraded":"2023-10-06T04:36:21.284374+0000","last_fullsized":"2023-10-06T04:36:21.284374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:14.615096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.305152+0000","last_change":"2023-10-06T04:36:21.303952+0000","last_active":"2023-10-06T04:36:21.305152+0000","last_peered":"2023-10-06T04:36:21.305152+0000","last_clean":"2023-10-06T04:36:21.305152+0000","last_became_active":"2023-10-06T04:36:21.303042+0000","last_became_peered":"2023-10-06T04:36:21.303042+0000","last_unstale":"2023-10-06T04:36:21.305152+0000","last_undegraded":"2023-10-06T04:36:21.305152+0000","last_fullsized":"2023-10-06T04:36:21.305152+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:00.910253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.286309+0000","last_change":"2023-10-06T04:36:11.182804+0000","last_active":"2023-10-06T04:36:21.286309+0000","last_peered":"2023-10-06T04:36:21.286309+0000","last_clean":"2023-10-06T04:36:21.286309+0000","last_became_active":"2023-10-06T04:36:11.182575+0000","last_became_peered":"2023-10-06T04:36:11.182575+0000","last_unstale":"2023-10-06T04:36:21.286309+0000","last_undegraded":"2023-10-06T04:36:21.286309+0000","last_fullsized":"2023-10-06T04:36:21.286309+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:07.497987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291508+0000","last_change":"2023-10-06T04:36:16.237994+0000","last_active":"2023-10-06T04:36:21.291508+0000","last_peered":"2023-10-06T04:36:21.291508+0000","last_clean":"2023-10-06T04:36:21.291508+0000","last_became_active":"2023-10-06T04:36:16.237722+0000","last_became_peered":"2023-10-06T04:36:16.237722+0000","last_unstale":"2023-10-06T04:36:21.291508+0000","last_undegraded":"2023-10-06T04:36:21.291508+0000","last_fullsized":"2023-10-06T04:36:21.291508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:54.757446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.281269+0000","last_change":"2023-10-06T04:36:17.251489+0000","last_active":"2023-10-06T04:36:21.281269+0000","last_peered":"2023-10-06T04:36:21.281269+0000","last_clean":"2023-10-06T04:36:21.281269+0000","last_became_active":"2023-10-06T04:36:17.251233+0000","last_became_peered":"2023-10-06T04:36:17.251233+0000","last_unstale":"2023-10-06T04:36:21.281269+0000","last_undegraded":"2023-10-06T04:36:21.281269+0000","last_fullsized":"2023-10-06T04:36:21.281269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:18.298620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.298102+0000","last_change":"2023-10-06T04:36:21.293975+0000","last_active":"2023-10-06T04:36:21.298102+0000","last_peered":"2023-10-06T04:36:21.298102+0000","last_clean":"2023-10-06T04:36:21.298102+0000","last_became_active":"2023-10-06T04:36:21.293578+0000","last_became_peered":"2023-10-06T04:36:21.293578+0000","last_unstale":"2023-10-06T04:36:21.298102+0000","last_undegraded":"2023-10-06T04:36:21.298102+0000","last_fullsized":"2023-10-06T04:36:21.298102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:14.917841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.284317+0000","last_change":"2023-10-06T04:36:16.229589+0000","last_active":"2023-10-06T04:36:21.284317+0000","last_peered":"2023-10-06T04:36:21.284317+0000","last_clean":"2023-10-06T04:36:21.284317+0000","last_became_active":"2023-10-06T04:36:16.229178+0000","last_became_peered":"2023-10-06T04:36:16.229178+0000","last_unstale":"2023-10-06T04:36:21.284317+0000","last_undegraded":"2023-10-06T04:36:21.284317+0000","last_fullsized":"2023-10-06T04:36:21.284317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:51:43.351582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.272441+0000","last_change":"2023-10-06T04:36:17.250854+0000","last_active":"2023-10-06T04:36:21.272441+0000","last_peered":"2023-10-06T04:36:21.272441+0000","last_clean":"2023-10-06T04:36:21.272441+0000","last_became_active":"2023-10-06T04:36:17.250610+0000","last_became_peered":"2023-10-06T04:36:17.250610+0000","last_unstale":"2023-10-06T04:36:21.272441+0000","last_undegraded":"2023-10-06T04:36:21.272441+0000","last_fullsized":"2023-10-06T04:36:21.272441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:55.761720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.309362+0000","last_change":"2023-10-06T04:36:21.306750+0000","last_active":"2023-10-06T04:36:21.309362+0000","last_peered":"2023-10-06T04:36:21.309362+0000","last_clean":"2023-10-06T04:36:21.309362+0000","last_became_active":"2023-10-06T04:36:21.306419+0000","last_became_peered":"2023-10-06T04:36:21.306419+0000","last_unstale":"2023-10-06T04:36:21.309362+0000","last_undegraded":"2023-10-06T04:36:21.309362+0000","last_fullsized":"2023-10-06T04:36:21.309362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:52.989017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291179+0000","last_change":"2023-10-06T04:36:16.233250+0000","last_active":"2023-10-06T04:36:21.291179+0000","last_peered":"2023-10-06T04:36:21.291179+0000","last_clean":"2023-10-06T04:36:21.291179+0000","last_became_active":"2023-10-06T04:36:16.232939+0000","last_became_peered":"2023-10-06T04:36:16.232939+0000","last_unstale":"2023-10-06T04:36:21.291179+0000","last_undegraded":"2023-10-06T04:36:21.291179+0000","last_fullsized":"2023-10-06T04:36:21.291179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:42.572631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280600+0000","last_change":"2023-10-06T04:36:17.261079+0000","last_active":"2023-10-06T04:36:21.280600+0000","last_peered":"2023-10-06T04:36:21.280600+0000","last_clean":"2023-10-06T04:36:21.280600+0000","last_became_active":"2023-10-06T04:36:17.260815+0000","last_became_peered":"2023-10-06T04:36:17.260815+0000","last_unstale":"2023-10-06T04:36:21.280600+0000","last_undegraded":"2023-10-06T04:36:21.280600+0000","last_fullsized":"2023-10-06T04:36:21.280600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:14.615096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.303853+0000","last_change":"2023-10-06T04:36:21.297230+0000","last_active":"2023-10-06T04:36:21.303853+0000","last_peered":"2023-10-06T04:36:21.303853+0000","last_clean":"2023-10-06T04:36:21.303853+0000","last_became_active":"2023-10-06T04:36:21.296880+0000","last_became_peered":"2023-10-06T04:36:21.296880+0000","last_unstale":"2023-10-06T04:36:21.303853+0000","last_undegraded":"2023-10-06T04:36:21.303853+0000","last_fullsized":"2023-10-06T04:36:21.303853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:02.285634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291398+0000","last_change":"2023-10-06T04:36:16.232832+0000","last_active":"2023-10-06T04:36:21.291398+0000","last_peered":"2023-10-06T04:36:21.291398+0000","last_clean":"2023-10-06T04:36:21.291398+0000","last_became_active":"2023-10-06T04:36:16.232556+0000","last_became_peered":"2023-10-06T04:36:16.232556+0000","last_unstale":"2023-10-06T04:36:21.291398+0000","last_undegraded":"2023-10-06T04:36:21.291398+0000","last_fullsized":"2023-10-06T04:36:21.291398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:10.606701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280531+0000","last_change":"2023-10-06T04:36:17.247689+0000","last_active":"2023-10-06T04:36:21.280531+0000","last_peered":"2023-10-06T04:36:21.280531+0000","last_clean":"2023-10-06T04:36:21.280531+0000","last_became_active":"2023-10-06T04:36:17.247409+0000","last_became_peered":"2023-10-06T04:36:17.247409+0000","last_unstale":"2023-10-06T04:36:21.280531+0000","last_undegraded":"2023-10-06T04:36:21.280531+0000","last_fullsized":"2023-10-06T04:36:21.280531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:35:27.605631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.304354+0000","last_change":"2023-10-06T04:36:21.302319+0000","last_active":"2023-10-06T04:36:21.304354+0000","last_peered":"2023-10-06T04:36:21.304354+0000","last_clean":"2023-10-06T04:36:21.304354+0000","last_became_active":"2023-10-06T04:36:21.301959+0000","last_became_peered":"2023-10-06T04:36:21.301959+0000","last_unstale":"2023-10-06T04:36:21.304354+0000","last_undegraded":"2023-10-06T04:36:21.304354+0000","last_fullsized":"2023-10-06T04:36:21.304354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:18.466700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.277468+0000","last_change":"2023-10-06T04:36:16.228609+0000","last_active":"2023-10-06T04:36:21.277468+0000","last_peered":"2023-10-06T04:36:21.277468+0000","last_clean":"2023-10-06T04:36:21.277468+0000","last_became_active":"2023-10-06T04:36:16.228294+0000","last_became_peered":"2023-10-06T04:36:16.228294+0000","last_unstale":"2023-10-06T04:36:21.277468+0000","last_undegraded":"2023-10-06T04:36:21.277468+0000","last_fullsized":"2023-10-06T04:36:21.277468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:40.040325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.275892+0000","last_change":"2023-10-06T04:36:17.246675+0000","last_active":"2023-10-06T04:36:21.275892+0000","last_peered":"2023-10-06T04:36:21.275892+0000","last_clean":"2023-10-06T04:36:21.275892+0000","last_became_active":"2023-10-06T04:36:17.246403+0000","last_became_peered":"2023-10-06T04:36:17.246403+0000","last_unstale":"2023-10-06T04:36:21.275892+0000","last_undegraded":"2023-10-06T04:36:21.275892+0000","last_fullsized":"2023-10-06T04:36:21.275892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:35:27.605631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.298091+0000","last_change":"2023-10-06T04:36:21.293736+0000","last_active":"2023-10-06T04:36:21.298091+0000","last_peered":"2023-10-06T04:36:21.298091+0000","last_clean":"2023-10-06T04:36:21.298091+0000","last_became_active":"2023-10-06T04:36:21.293317+0000","last_became_peered":"2023-10-06T04:36:21.293317+0000","last_unstale":"2023-10-06T04:36:21.298091+0000","last_undegraded":"2023-10-06T04:36:21.298091+0000","last_fullsized":"2023-10-06T04:36:21.298091+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:00.910253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276350+0000","last_change":"2023-10-06T04:36:16.232060+0000","last_active":"2023-10-06T04:36:21.276350+0000","last_peered":"2023-10-06T04:36:21.276350+0000","last_clean":"2023-10-06T04:36:21.276350+0000","last_became_active":"2023-10-06T04:36:16.231602+0000","last_became_peered":"2023-10-06T04:36:16.231602+0000","last_unstale":"2023-10-06T04:36:21.276350+0000","last_undegraded":"2023-10-06T04:36:21.276350+0000","last_fullsized":"2023-10-06T04:36:21.276350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:32.855334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.279896+0000","last_change":"2023-10-06T04:36:17.252345+0000","last_active":"2023-10-06T04:36:21.279896+0000","last_peered":"2023-10-06T04:36:21.279896+0000","last_clean":"2023-10-06T04:36:21.279896+0000","last_became_active":"2023-10-06T04:36:17.250338+0000","last_became_peered":"2023-10-06T04:36:17.250338+0000","last_unstale":"2023-10-06T04:36:21.279896+0000","last_undegraded":"2023-10-06T04:36:21.279896+0000","last_fullsized":"2023-10-06T04:36:21.279896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:28:24.765888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.290285+0000","last_change":"2023-10-06T04:36:17.261636+0000","last_active":"2023-10-06T04:36:21.290285+0000","last_peered":"2023-10-06T04:36:21.290285+0000","last_clean":"2023-10-06T04:36:21.290285+0000","last_became_active":"2023-10-06T04:36:17.261392+0000","last_became_peered":"2023-10-06T04:36:17.261392+0000","last_unstale":"2023-10-06T04:36:21.290285+0000","last_undegraded":"2023-10-06T04:36:21.290285+0000","last_fullsized":"2023-10-06T04:36:21.290285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:41.044599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.275984+0000","last_change":"2023-10-06T04:36:17.255595+0000","last_active":"2023-10-06T04:36:21.275984+0000","last_peered":"2023-10-06T04:36:21.275984+0000","last_clean":"2023-10-06T04:36:21.275984+0000","last_became_active":"2023-10-06T04:36:17.255326+0000","last_became_peered":"2023-10-06T04:36:17.255326+0000","last_unstale":"2023-10-06T04:36:21.275984+0000","last_undegraded":"2023-10-06T04:36:21.275984+0000","last_fullsized":"2023-10-06T04:36:21.275984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:56.005620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280802+0000","last_change":"2023-10-06T04:36:17.266065+0000","last_active":"2023-10-06T04:36:21.280802+0000","last_peered":"2023-10-06T04:36:21.280802+0000","last_clean":"2023-10-06T04:36:21.280802+0000","last_became_active":"2023-10-06T04:36:17.264225+0000","last_became_peered":"2023-10-06T04:36:17.264225+0000","last_unstale":"2023-10-06T04:36:21.280802+0000","last_undegraded":"2023-10-06T04:36:21.280802+0000","last_fullsized":"2023-10-06T04:36:21.280802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:12.881884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.277129+0000","last_change":"2023-10-06T04:36:17.253460+0000","last_active":"2023-10-06T04:36:21.277129+0000","last_peered":"2023-10-06T04:36:21.277129+0000","last_clean":"2023-10-06T04:36:21.277129+0000","last_became_active":"2023-10-06T04:36:17.253170+0000","last_became_peered":"2023-10-06T04:36:17.253170+0000","last_unstale":"2023-10-06T04:36:21.277129+0000","last_undegraded":"2023-10-06T04:36:21.277129+0000","last_fullsized":"2023-10-06T04:36:21.277129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:25.650113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276624+0000","last_change":"2023-10-06T04:36:17.257970+0000","last_active":"2023-10-06T04:36:21.276624+0000","last_peered":"2023-10-06T04:36:21.276624+0000","last_clean":"2023-10-06T04:36:21.276624+0000","last_became_active":"2023-10-06T04:36:17.257685+0000","last_became_peered":"2023-10-06T04:36:17.257685+0000","last_unstale":"2023-10-06T04:36:21.276624+0000","last_undegraded":"2023-10-06T04:36:21.276624+0000","last_fullsized":"2023-10-06T04:36:21.276624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:15.884489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298156,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073684,"statfs":{"total":96636764160,"available":96331452416,"internally_reserved":0,"allocated":888832,"data_stored":703756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":266240,"data_stored":109458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.125999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.4870000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298128,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073712,"statfs":{"total":96636764160,"available":96331481088,"internally_reserved":0,"allocated":860160,"data_stored":699826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":266240,"data_stored":109034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":108480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":266240,"data_stored":108570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":286720,"data_stored":113228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":274432,"data_stored":110082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:36:36.597 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:36:36.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.743+0000 7f40ae155700 1 Processor -- start 2023-10-06T04:36:36.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.743+0000 7f40ae155700 1 -- start start 2023-10-06T04:36:36.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.744+0000 7f40ae155700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f40a8153740 0x7f40a8153b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:36.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.744+0000 7f40ae155700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f40a815a7b0 0x7f40a80cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:36.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.744+0000 7f40ae155700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40a815d8e0 0x7f40a80696c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:36.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.744+0000 7f40ae155700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40a815d170 con 0x7f40a815a7b0 2023-10-06T04:36:36.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.744+0000 7f40ae155700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40a80ca990 con 0x7f40a8153740 2023-10-06T04:36:36.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.744+0000 7f40ae155700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a80cac70 con 0x7f40a815d8e0 2023-10-06T04:36:36.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.744+0000 7f40ac952700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f40a815a7b0 0x7f40a80cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:36.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.744+0000 7f40ac952700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f40a815a7b0 0x7f40a80cfa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36316/0 (socket says 172.21.15.8:36316) 2023-10-06T04:36:36.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.744+0000 7f40ac952700 1 -- 172.21.15.8:0/3989475770 learned_addr learned my addr 172.21.15.8:0/3989475770 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:36.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.744+0000 7f40ad954700 1 --2- 172.21.15.8:0/3989475770 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40a815d8e0 0x7f40a80696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:36.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.744+0000 7f40ad153700 1 --2- 172.21.15.8:0/3989475770 >> v2:172.21.15.184:3300/0 conn(0x7f40a8153740 0x7f40a8153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:36.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.744+0000 7f40ac952700 1 -- 172.21.15.8:0/3989475770 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40a815d8e0 msgr2=0x7f40a80696c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:36.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.744+0000 7f40ac952700 1 --2- 172.21.15.8:0/3989475770 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40a815d8e0 0x7f40a80696c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:36.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.744+0000 7f40ac952700 1 -- 172.21.15.8:0/3989475770 >> v2:172.21.15.184:3300/0 conn(0x7f40a8153740 msgr2=0x7f40a8153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:36.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.744+0000 7f40ac952700 1 --2- 172.21.15.8:0/3989475770 >> v2:172.21.15.184:3300/0 conn(0x7f40a8153740 0x7f40a8153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:36.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.744+0000 7f40ac952700 1 -- 172.21.15.8:0/3989475770 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a80caf50 con 0x7f40a815a7b0 2023-10-06T04:36:36.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.744+0000 7f40ad153700 1 --2- 172.21.15.8:0/3989475770 >> v2:172.21.15.184:3300/0 conn(0x7f40a8153740 0x7f40a8153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:36:36.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.745+0000 7f40ac952700 1 --2- 172.21.15.8:0/3989475770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40a815a7b0 0x7f40a80cfa70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f40a80692b0 tx=0x7f409c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36cd5ecd6ee14b6a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:36.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.745+0000 7f40a7fff700 1 -- 172.21.15.8:0/3989475770 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c00b860 con 0x7f40a815a7b0 2023-10-06T04:36:36.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.745+0000 7f40a7fff700 1 -- 172.21.15.8:0/3989475770 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409c00b9c0 con 0x7f40a815a7b0 2023-10-06T04:36:36.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.745+0000 7f40a7fff700 1 -- 172.21.15.8:0/3989475770 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c00bd60 con 0x7f40a815a7b0 2023-10-06T04:36:36.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.745+0000 7f40ae155700 1 -- 172.21.15.8:0/3989475770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40a815a7b0 msgr2=0x7f40a80cfa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:36.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.745+0000 7f40ae155700 1 --2- 172.21.15.8:0/3989475770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40a815a7b0 0x7f40a80cfa70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f40a80692b0 tx=0x7f409c009250 comp rx=0 tx=0).stop 2023-10-06T04:36:36.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.745+0000 7f40ae155700 1 -- 172.21.15.8:0/3989475770 shutdown_connections 2023-10-06T04:36:36.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.745+0000 7f40ae155700 1 --2- 172.21.15.8:0/3989475770 >> v2:172.21.15.184:3300/0 conn(0x7f40a8153740 0x7f40a8153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:36.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.745+0000 7f40ae155700 1 --2- 172.21.15.8:0/3989475770 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40a815d8e0 0x7f40a80696c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:36.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.745+0000 7f40ae155700 1 --2- 172.21.15.8:0/3989475770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40a815a7b0 0x7f40a80cfa70 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:36.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.745+0000 7f40ae155700 1 -- 172.21.15.8:0/3989475770 >> 172.21.15.8:0/3989475770 conn(0x7f40a80d02b0 msgr2=0x7f40a80d06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:36.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.745+0000 7f40ae155700 1 -- 172.21.15.8:0/3989475770 shutdown_connections 2023-10-06T04:36:36.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.745+0000 7f40ae155700 1 -- 172.21.15.8:0/3989475770 wait complete. 2023-10-06T04:36:36.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.746+0000 7f40ae155700 1 Processor -- start 2023-10-06T04:36:36.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.746+0000 7f40ae155700 1 -- start start 2023-10-06T04:36:36.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.747+0000 7f40ae155700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40a8153740 0x7f40a80afe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:36.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.747+0000 7f40ae155700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40a815a7b0 0x7f40a80c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:36.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.747+0000 7f40ae155700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40a815d8e0 0x7f40a80c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:36.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.747+0000 7f40ae155700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a80c5700 con 0x7f40a815d8e0 2023-10-06T04:36:36.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.747+0000 7f40ae155700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a80c6280 con 0x7f40a815a7b0 2023-10-06T04:36:36.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.747+0000 7f40ae155700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a8151700 con 0x7f40a8153740 2023-10-06T04:36:36.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.747+0000 7f40ad954700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40a815d8e0 0x7f40a80c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:36.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.747+0000 7f40ad954700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40a815d8e0 0x7f40a80c6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36326/0 (socket says 172.21.15.8:36326) 2023-10-06T04:36:36.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.747+0000 7f40ad954700 1 -- 172.21.15.8:0/2772167364 learned_addr learned my addr 172.21.15.8:0/2772167364 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:36.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.747+0000 7f40ad153700 1 --2- 172.21.15.8:0/2772167364 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40a8153740 0x7f40a80afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:36.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.748+0000 7f40ac952700 1 --2- 172.21.15.8:0/2772167364 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40a815a7b0 0x7f40a80c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:36.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.748+0000 7f40ad954700 1 -- 172.21.15.8:0/2772167364 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40a8153740 msgr2=0x7f40a80afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:36.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.748+0000 7f40ad954700 1 --2- 172.21.15.8:0/2772167364 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40a8153740 0x7f40a80afe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:36.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.748+0000 7f40ad954700 1 -- 172.21.15.8:0/2772167364 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40a815a7b0 msgr2=0x7f40a80c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:36.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.748+0000 7f40ad954700 1 --2- 172.21.15.8:0/2772167364 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40a815a7b0 0x7f40a80c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:36.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.748+0000 7f40ad954700 1 -- 172.21.15.8:0/2772167364 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f409c0094f0 con 0x7f40a815d8e0 2023-10-06T04:36:36.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.748+0000 7f40ad954700 1 --2- 172.21.15.8:0/2772167364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40a815d8e0 0x7f40a80c6c50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f409800d890 tx=0x7f4098008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:36.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.748+0000 7f40a57fa700 1 -- 172.21.15.8:0/2772167364 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40980125f0 con 0x7f40a815d8e0 2023-10-06T04:36:36.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.748+0000 7f40a57fa700 1 -- 172.21.15.8:0/2772167364 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4098012770 con 0x7f40a815d8e0 2023-10-06T04:36:36.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.748+0000 7f40a57fa700 1 -- 172.21.15.8:0/2772167364 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4098012b30 con 0x7f40a815d8e0 2023-10-06T04:36:36.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.748+0000 7f40ae155700 1 -- 172.21.15.8:0/2772167364 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a80c5950 con 0x7f40a815d8e0 2023-10-06T04:36:36.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.748+0000 7f40ae155700 1 -- 172.21.15.8:0/2772167364 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a80c5f10 con 0x7f40a815d8e0 2023-10-06T04:36:36.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.749+0000 7f40ae155700 1 -- 172.21.15.8:0/2772167364 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a80c63f0 con 0x7f40a815d8e0 2023-10-06T04:36:36.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.750+0000 7f40a57fa700 1 -- 172.21.15.8:0/2772167364 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f409801e460 con 0x7f40a815d8e0 2023-10-06T04:36:36.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.750+0000 7f40a57fa700 1 --2- 172.21.15.8:0/2772167364 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4094066f30 0x7f40940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:36.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.750+0000 7f40a57fa700 1 -- 172.21.15.8:0/2772167364 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4098084de0 con 0x7f40a815d8e0 2023-10-06T04:36:36.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.750+0000 7f40ad153700 1 --2- 172.21.15.8:0/2772167364 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4094066f30 0x7f40940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:36.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.751+0000 7f40ad153700 1 --2- 172.21.15.8:0/2772167364 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4094066f30 0x7f40940693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f40a000f600 tx=0x7f40a00077b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:36.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.754+0000 7f40a57fa700 1 -- 172.21.15.8:0/2772167364 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4098051c00 con 0x7f40a815d8e0 2023-10-06T04:36:36.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.944+0000 7f40ae155700 1 -- 172.21.15.8:0/2772167364 --> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f40a804c380 con 0x7f4094066f30 2023-10-06T04:36:36.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.955+0000 7f40a57fa700 1 -- 172.21.15.8:0/2772167364 <== mgr.4105 v2:172.21.15.184:6832/90283 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367620 (secure 0 0 0) 0x7f40a804c380 con 0x7f4094066f30 2023-10-06T04:36:36.962 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:36:36.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.958+0000 7f40ae155700 1 -- 172.21.15.8:0/2772167364 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4094066f30 msgr2=0x7f40940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:36.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.958+0000 7f40ae155700 1 --2- 172.21.15.8:0/2772167364 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4094066f30 0x7f40940693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f40a000f600 tx=0x7f40a00077b0 comp rx=0 tx=0).stop 2023-10-06T04:36:36.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.958+0000 7f40ae155700 1 -- 172.21.15.8:0/2772167364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40a815d8e0 msgr2=0x7f40a80c6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:36.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.958+0000 7f40ae155700 1 --2- 172.21.15.8:0/2772167364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40a815d8e0 0x7f40a80c6c50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f409800d890 tx=0x7f4098008040 comp rx=0 tx=0).stop 2023-10-06T04:36:36.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.958+0000 7f40ae155700 1 -- 172.21.15.8:0/2772167364 shutdown_connections 2023-10-06T04:36:36.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.958+0000 7f40ae155700 1 --2- 172.21.15.8:0/2772167364 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4094066f30 0x7f40940693e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:36.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.958+0000 7f40ae155700 1 --2- 172.21.15.8:0/2772167364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40a815d8e0 0x7f40a80c6c50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:36.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.958+0000 7f40ae155700 1 --2- 172.21.15.8:0/2772167364 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40a8153740 0x7f40a80afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:36.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.958+0000 7f40ae155700 1 --2- 172.21.15.8:0/2772167364 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40a815a7b0 0x7f40a80c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:36.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.958+0000 7f40ae155700 1 -- 172.21.15.8:0/2772167364 >> 172.21.15.8:0/2772167364 conn(0x7f40a80d02b0 msgr2=0x7f40a8152050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:36.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.958+0000 7f40ae155700 1 -- 172.21.15.8:0/2772167364 shutdown_connections 2023-10-06T04:36:36.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:36.958+0000 7f40ae155700 1 -- 172.21.15.8:0/2772167364 wait complete. 2023-10-06T04:36:36.967 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-06T04:36:36.973 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-10-06T04:36:36.635116+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594852,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381596,"kb_used_data":3292,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593124,"statfs":{"total":773094113280,"available":770655358976,"internally_reserved":0,"allocated":3371008,"data_stored":2062434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2178,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003445"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.272647+0000","last_change":"2023-10-06T04:36:17.255009+0000","last_active":"2023-10-06T04:36:21.272647+0000","last_peered":"2023-10-06T04:36:21.272647+0000","last_clean":"2023-10-06T04:36:21.272647+0000","last_became_active":"2023-10-06T04:36:17.254704+0000","last_became_peered":"2023-10-06T04:36:17.254704+0000","last_unstale":"2023-10-06T04:36:21.272647+0000","last_undegraded":"2023-10-06T04:36:21.272647+0000","last_fullsized":"2023-10-06T04:36:21.272647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:45:34.132581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291077+0000","last_change":"2023-10-06T04:36:17.256537+0000","last_active":"2023-10-06T04:36:21.291077+0000","last_peered":"2023-10-06T04:36:21.291077+0000","last_clean":"2023-10-06T04:36:21.291077+0000","last_became_active":"2023-10-06T04:36:17.256004+0000","last_became_peered":"2023-10-06T04:36:17.256004+0000","last_unstale":"2023-10-06T04:36:21.291077+0000","last_undegraded":"2023-10-06T04:36:21.291077+0000","last_fullsized":"2023-10-06T04:36:21.291077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:02.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.281626+0000","last_change":"2023-10-06T04:36:17.251532+0000","last_active":"2023-10-06T04:36:21.281626+0000","last_peered":"2023-10-06T04:36:21.281626+0000","last_clean":"2023-10-06T04:36:21.281626+0000","last_became_active":"2023-10-06T04:36:17.250378+0000","last_became_peered":"2023-10-06T04:36:17.250378+0000","last_unstale":"2023-10-06T04:36:21.281626+0000","last_undegraded":"2023-10-06T04:36:21.281626+0000","last_fullsized":"2023-10-06T04:36:21.281626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:10.868173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.283431+0000","last_change":"2023-10-06T04:36:17.256131+0000","last_active":"2023-10-06T04:36:21.283431+0000","last_peered":"2023-10-06T04:36:21.283431+0000","last_clean":"2023-10-06T04:36:21.283431+0000","last_became_active":"2023-10-06T04:36:17.255865+0000","last_became_peered":"2023-10-06T04:36:17.255865+0000","last_unstale":"2023-10-06T04:36:21.283431+0000","last_undegraded":"2023-10-06T04:36:21.283431+0000","last_fullsized":"2023-10-06T04:36:21.283431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:40.502199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.284418+0000","last_change":"2023-10-06T04:36:17.247145+0000","last_active":"2023-10-06T04:36:21.284418+0000","last_peered":"2023-10-06T04:36:21.284418+0000","last_clean":"2023-10-06T04:36:21.284418+0000","last_became_active":"2023-10-06T04:36:17.246879+0000","last_became_peered":"2023-10-06T04:36:17.246879+0000","last_unstale":"2023-10-06T04:36:21.284418+0000","last_undegraded":"2023-10-06T04:36:21.284418+0000","last_fullsized":"2023-10-06T04:36:21.284418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:23:08.806295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280687+0000","last_change":"2023-10-06T04:36:17.252945+0000","last_active":"2023-10-06T04:36:21.280687+0000","last_peered":"2023-10-06T04:36:21.280687+0000","last_clean":"2023-10-06T04:36:21.280687+0000","last_became_active":"2023-10-06T04:36:17.252697+0000","last_became_peered":"2023-10-06T04:36:17.252697+0000","last_unstale":"2023-10-06T04:36:21.280687+0000","last_undegraded":"2023-10-06T04:36:21.280687+0000","last_fullsized":"2023-10-06T04:36:21.280687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:56.005620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291321+0000","last_change":"2023-10-06T04:36:17.259179+0000","last_active":"2023-10-06T04:36:21.291321+0000","last_peered":"2023-10-06T04:36:21.291321+0000","last_clean":"2023-10-06T04:36:21.291321+0000","last_became_active":"2023-10-06T04:36:17.258896+0000","last_became_peered":"2023-10-06T04:36:17.258896+0000","last_unstale":"2023-10-06T04:36:21.291321+0000","last_undegraded":"2023-10-06T04:36:21.291321+0000","last_fullsized":"2023-10-06T04:36:21.291321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:06.137894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.290396+0000","last_change":"2023-10-06T04:36:17.251370+0000","last_active":"2023-10-06T04:36:21.290396+0000","last_peered":"2023-10-06T04:36:21.290396+0000","last_clean":"2023-10-06T04:36:21.290396+0000","last_became_active":"2023-10-06T04:36:17.251111+0000","last_became_peered":"2023-10-06T04:36:17.251111+0000","last_unstale":"2023-10-06T04:36:21.290396+0000","last_undegraded":"2023-10-06T04:36:21.290396+0000","last_fullsized":"2023-10-06T04:36:21.290396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:01:35.146203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276077+0000","last_change":"2023-10-06T04:36:17.247564+0000","last_active":"2023-10-06T04:36:21.276077+0000","last_peered":"2023-10-06T04:36:21.276077+0000","last_clean":"2023-10-06T04:36:21.276077+0000","last_became_active":"2023-10-06T04:36:17.247306+0000","last_became_peered":"2023-10-06T04:36:17.247306+0000","last_unstale":"2023-10-06T04:36:21.276077+0000","last_undegraded":"2023-10-06T04:36:21.276077+0000","last_fullsized":"2023-10-06T04:36:21.276077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:02.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291293+0000","last_change":"2023-10-06T04:36:17.256706+0000","last_active":"2023-10-06T04:36:21.291293+0000","last_peered":"2023-10-06T04:36:21.291293+0000","last_clean":"2023-10-06T04:36:21.291293+0000","last_became_active":"2023-10-06T04:36:17.256322+0000","last_became_peered":"2023-10-06T04:36:17.256322+0000","last_unstale":"2023-10-06T04:36:21.291293+0000","last_undegraded":"2023-10-06T04:36:21.291293+0000","last_fullsized":"2023-10-06T04:36:21.291293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:23:08.806295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.281544+0000","last_change":"2023-10-06T04:36:17.266725+0000","last_active":"2023-10-06T04:36:21.281544+0000","last_peered":"2023-10-06T04:36:21.281544+0000","last_clean":"2023-10-06T04:36:21.281544+0000","last_became_active":"2023-10-06T04:36:17.266037+0000","last_became_peered":"2023-10-06T04:36:17.266037+0000","last_unstale":"2023-10-06T04:36:21.281544+0000","last_undegraded":"2023-10-06T04:36:21.281544+0000","last_fullsized":"2023-10-06T04:36:21.281544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:35.000504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.272228+0000","last_change":"2023-10-06T04:36:17.244295+0000","last_active":"2023-10-06T04:36:21.272228+0000","last_peered":"2023-10-06T04:36:21.272228+0000","last_clean":"2023-10-06T04:36:21.272228+0000","last_became_active":"2023-10-06T04:36:17.244029+0000","last_became_peered":"2023-10-06T04:36:17.244029+0000","last_unstale":"2023-10-06T04:36:21.272228+0000","last_undegraded":"2023-10-06T04:36:21.272228+0000","last_fullsized":"2023-10-06T04:36:21.272228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:11.610976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.272361+0000","last_change":"2023-10-06T04:36:17.247080+0000","last_active":"2023-10-06T04:36:21.272361+0000","last_peered":"2023-10-06T04:36:21.272361+0000","last_clean":"2023-10-06T04:36:21.272361+0000","last_became_active":"2023-10-06T04:36:17.246794+0000","last_became_peered":"2023-10-06T04:36:17.246794+0000","last_unstale":"2023-10-06T04:36:21.272361+0000","last_undegraded":"2023-10-06T04:36:21.272361+0000","last_fullsized":"2023-10-06T04:36:21.272361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:13.150215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291383+0000","last_change":"2023-10-06T04:36:17.258372+0000","last_active":"2023-10-06T04:36:21.291383+0000","last_peered":"2023-10-06T04:36:21.291383+0000","last_clean":"2023-10-06T04:36:21.291383+0000","last_became_active":"2023-10-06T04:36:17.258116+0000","last_became_peered":"2023-10-06T04:36:17.258116+0000","last_unstale":"2023-10-06T04:36:21.291383+0000","last_undegraded":"2023-10-06T04:36:21.291383+0000","last_fullsized":"2023-10-06T04:36:21.291383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:15.884489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291099+0000","last_change":"2023-10-06T04:36:17.259309+0000","last_active":"2023-10-06T04:36:21.291099+0000","last_peered":"2023-10-06T04:36:21.291099+0000","last_clean":"2023-10-06T04:36:21.291099+0000","last_became_active":"2023-10-06T04:36:17.259048+0000","last_became_peered":"2023-10-06T04:36:17.259048+0000","last_unstale":"2023-10-06T04:36:21.291099+0000","last_undegraded":"2023-10-06T04:36:21.291099+0000","last_fullsized":"2023-10-06T04:36:21.291099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:03.209071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280262+0000","last_change":"2023-10-06T04:36:17.248671+0000","last_active":"2023-10-06T04:36:21.280262+0000","last_peered":"2023-10-06T04:36:21.280262+0000","last_clean":"2023-10-06T04:36:21.280262+0000","last_became_active":"2023-10-06T04:36:17.248389+0000","last_became_peered":"2023-10-06T04:36:17.248389+0000","last_unstale":"2023-10-06T04:36:21.280262+0000","last_undegraded":"2023-10-06T04:36:21.280262+0000","last_fullsized":"2023-10-06T04:36:21.280262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:32.568497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276165+0000","last_change":"2023-10-06T04:36:17.253794+0000","last_active":"2023-10-06T04:36:21.276165+0000","last_peered":"2023-10-06T04:36:21.276165+0000","last_clean":"2023-10-06T04:36:21.276165+0000","last_became_active":"2023-10-06T04:36:17.253556+0000","last_became_peered":"2023-10-06T04:36:17.253556+0000","last_unstale":"2023-10-06T04:36:21.276165+0000","last_undegraded":"2023-10-06T04:36:21.276165+0000","last_fullsized":"2023-10-06T04:36:21.276165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:53.436742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.281355+0000","last_change":"2023-10-06T04:36:17.248844+0000","last_active":"2023-10-06T04:36:21.281355+0000","last_peered":"2023-10-06T04:36:21.281355+0000","last_clean":"2023-10-06T04:36:21.281355+0000","last_became_active":"2023-10-06T04:36:17.248564+0000","last_became_peered":"2023-10-06T04:36:17.248564+0000","last_unstale":"2023-10-06T04:36:21.281355+0000","last_undegraded":"2023-10-06T04:36:21.281355+0000","last_fullsized":"2023-10-06T04:36:21.281355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:09:48.312479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.272565+0000","last_change":"2023-10-06T04:36:17.250339+0000","last_active":"2023-10-06T04:36:21.272565+0000","last_peered":"2023-10-06T04:36:21.272565+0000","last_clean":"2023-10-06T04:36:21.272565+0000","last_became_active":"2023-10-06T04:36:17.250051+0000","last_became_peered":"2023-10-06T04:36:17.250051+0000","last_unstale":"2023-10-06T04:36:21.272565+0000","last_undegraded":"2023-10-06T04:36:21.272565+0000","last_fullsized":"2023-10-06T04:36:21.272565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:43.576906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280996+0000","last_change":"2023-10-06T04:36:17.250606+0000","last_active":"2023-10-06T04:36:21.280996+0000","last_peered":"2023-10-06T04:36:21.280996+0000","last_clean":"2023-10-06T04:36:21.280996+0000","last_became_active":"2023-10-06T04:36:17.250295+0000","last_became_peered":"2023-10-06T04:36:17.250295+0000","last_unstale":"2023-10-06T04:36:21.280996+0000","last_undegraded":"2023-10-06T04:36:21.280996+0000","last_fullsized":"2023-10-06T04:36:21.280996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:52.945703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.292940+0000","last_change":"2023-10-06T04:36:17.260489+0000","last_active":"2023-10-06T04:36:21.292940+0000","last_peered":"2023-10-06T04:36:21.292940+0000","last_clean":"2023-10-06T04:36:21.292940+0000","last_became_active":"2023-10-06T04:36:17.259923+0000","last_became_peered":"2023-10-06T04:36:17.259923+0000","last_unstale":"2023-10-06T04:36:21.292940+0000","last_undegraded":"2023-10-06T04:36:21.292940+0000","last_fullsized":"2023-10-06T04:36:21.292940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:53.436742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.278618+0000","last_change":"2023-10-06T04:36:17.248545+0000","last_active":"2023-10-06T04:36:21.278618+0000","last_peered":"2023-10-06T04:36:21.278618+0000","last_clean":"2023-10-06T04:36:21.278618+0000","last_became_active":"2023-10-06T04:36:17.248276+0000","last_became_peered":"2023-10-06T04:36:17.248276+0000","last_unstale":"2023-10-06T04:36:21.278618+0000","last_undegraded":"2023-10-06T04:36:21.278618+0000","last_fullsized":"2023-10-06T04:36:21.278618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:35:27.605631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276071+0000","last_change":"2023-10-06T04:36:17.252822+0000","last_active":"2023-10-06T04:36:21.276071+0000","last_peered":"2023-10-06T04:36:21.276071+0000","last_clean":"2023-10-06T04:36:21.276071+0000","last_became_active":"2023-10-06T04:36:17.252543+0000","last_became_peered":"2023-10-06T04:36:17.252543+0000","last_unstale":"2023-10-06T04:36:21.276071+0000","last_undegraded":"2023-10-06T04:36:21.276071+0000","last_fullsized":"2023-10-06T04:36:21.276071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:12.881884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.290615+0000","last_change":"2023-10-06T04:36:17.260460+0000","last_active":"2023-10-06T04:36:21.290615+0000","last_peered":"2023-10-06T04:36:21.290615+0000","last_clean":"2023-10-06T04:36:21.290615+0000","last_became_active":"2023-10-06T04:36:17.260121+0000","last_became_peered":"2023-10-06T04:36:17.260121+0000","last_unstale":"2023-10-06T04:36:21.290615+0000","last_undegraded":"2023-10-06T04:36:21.290615+0000","last_fullsized":"2023-10-06T04:36:21.290615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:02.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276878+0000","last_change":"2023-10-06T04:36:17.252219+0000","last_active":"2023-10-06T04:36:21.276878+0000","last_peered":"2023-10-06T04:36:21.276878+0000","last_clean":"2023-10-06T04:36:21.276878+0000","last_became_active":"2023-10-06T04:36:17.251409+0000","last_became_peered":"2023-10-06T04:36:17.251409+0000","last_unstale":"2023-10-06T04:36:21.276878+0000","last_undegraded":"2023-10-06T04:36:21.276878+0000","last_fullsized":"2023-10-06T04:36:21.276878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:23:08.806295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.279778+0000","last_change":"2023-10-06T04:36:17.246611+0000","last_active":"2023-10-06T04:36:21.279778+0000","last_peered":"2023-10-06T04:36:21.279778+0000","last_clean":"2023-10-06T04:36:21.279778+0000","last_became_active":"2023-10-06T04:36:17.246330+0000","last_became_peered":"2023-10-06T04:36:17.246330+0000","last_unstale":"2023-10-06T04:36:21.279778+0000","last_undegraded":"2023-10-06T04:36:21.279778+0000","last_fullsized":"2023-10-06T04:36:21.279778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:33.859609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291627+0000","last_change":"2023-10-06T04:36:17.257554+0000","last_active":"2023-10-06T04:36:21.291627+0000","last_peered":"2023-10-06T04:36:21.291627+0000","last_clean":"2023-10-06T04:36:21.291627+0000","last_became_active":"2023-10-06T04:36:17.256991+0000","last_became_peered":"2023-10-06T04:36:17.256991+0000","last_unstale":"2023-10-06T04:36:21.291627+0000","last_undegraded":"2023-10-06T04:36:21.291627+0000","last_fullsized":"2023-10-06T04:36:21.291627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:53.436742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.299304+0000","last_change":"2023-10-06T04:36:21.295618+0000","last_active":"2023-10-06T04:36:21.299304+0000","last_peered":"2023-10-06T04:36:21.299304+0000","last_clean":"2023-10-06T04:36:21.299304+0000","last_became_active":"2023-10-06T04:36:21.295184+0000","last_became_peered":"2023-10-06T04:36:21.295184+0000","last_unstale":"2023-10-06T04:36:21.299304+0000","last_undegraded":"2023-10-06T04:36:21.299304+0000","last_fullsized":"2023-10-06T04:36:21.299304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:20:30.698636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280678+0000","last_change":"2023-10-06T04:36:16.230697+0000","last_active":"2023-10-06T04:36:21.280678+0000","last_peered":"2023-10-06T04:36:21.280678+0000","last_clean":"2023-10-06T04:36:21.280678+0000","last_became_active":"2023-10-06T04:36:16.230463+0000","last_became_peered":"2023-10-06T04:36:16.230463+0000","last_unstale":"2023-10-06T04:36:21.280678+0000","last_undegraded":"2023-10-06T04:36:21.280678+0000","last_fullsized":"2023-10-06T04:36:21.280678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:42.572631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.279718+0000","last_change":"2023-10-06T04:36:17.250531+0000","last_active":"2023-10-06T04:36:21.279718+0000","last_peered":"2023-10-06T04:36:21.279718+0000","last_clean":"2023-10-06T04:36:21.279718+0000","last_became_active":"2023-10-06T04:36:17.250025+0000","last_became_peered":"2023-10-06T04:36:17.250025+0000","last_unstale":"2023-10-06T04:36:21.279718+0000","last_undegraded":"2023-10-06T04:36:21.279718+0000","last_fullsized":"2023-10-06T04:36:21.279718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:14.615096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.303903+0000","last_change":"2023-10-06T04:36:21.293815+0000","last_active":"2023-10-06T04:36:21.303903+0000","last_peered":"2023-10-06T04:36:21.303903+0000","last_clean":"2023-10-06T04:36:21.303903+0000","last_became_active":"2023-10-06T04:36:21.292202+0000","last_became_peered":"2023-10-06T04:36:21.292202+0000","last_unstale":"2023-10-06T04:36:21.303903+0000","last_undegraded":"2023-10-06T04:36:21.303903+0000","last_fullsized":"2023-10-06T04:36:21.303903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:39.050172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.282090+0000","last_change":"2023-10-06T04:36:16.232507+0000","last_active":"2023-10-06T04:36:21.282090+0000","last_peered":"2023-10-06T04:36:21.282090+0000","last_clean":"2023-10-06T04:36:21.282090+0000","last_became_active":"2023-10-06T04:36:16.232152+0000","last_became_peered":"2023-10-06T04:36:16.232152+0000","last_unstale":"2023-10-06T04:36:21.282090+0000","last_undegraded":"2023-10-06T04:36:21.282090+0000","last_fullsized":"2023-10-06T04:36:21.282090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:12.145940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.278617+0000","last_change":"2023-10-06T04:36:17.254040+0000","last_active":"2023-10-06T04:36:21.278617+0000","last_peered":"2023-10-06T04:36:21.278617+0000","last_clean":"2023-10-06T04:36:21.278617+0000","last_became_active":"2023-10-06T04:36:17.252810+0000","last_became_peered":"2023-10-06T04:36:17.252810+0000","last_unstale":"2023-10-06T04:36:21.278617+0000","last_undegraded":"2023-10-06T04:36:21.278617+0000","last_fullsized":"2023-10-06T04:36:21.278617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:15:51.848244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.295280+0000","last_change":"2023-10-06T04:36:21.290604+0000","last_active":"2023-10-06T04:36:21.295280+0000","last_peered":"2023-10-06T04:36:21.295280+0000","last_clean":"2023-10-06T04:36:21.295280+0000","last_became_active":"2023-10-06T04:36:21.290250+0000","last_became_peered":"2023-10-06T04:36:21.290250+0000","last_unstale":"2023-10-06T04:36:21.295280+0000","last_undegraded":"2023-10-06T04:36:21.295280+0000","last_fullsized":"2023-10-06T04:36:21.295280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:06:31.394534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.277373+0000","last_change":"2023-10-06T04:36:16.226122+0000","last_active":"2023-10-06T04:36:21.277373+0000","last_peered":"2023-10-06T04:36:21.277373+0000","last_clean":"2023-10-06T04:36:21.277373+0000","last_became_active":"2023-10-06T04:36:16.225815+0000","last_became_peered":"2023-10-06T04:36:16.225815+0000","last_unstale":"2023-10-06T04:36:21.277373+0000","last_undegraded":"2023-10-06T04:36:21.277373+0000","last_fullsized":"2023-10-06T04:36:21.277373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:58:31.078830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.286372+0000","last_change":"2023-10-06T04:36:17.250474+0000","last_active":"2023-10-06T04:36:21.286372+0000","last_peered":"2023-10-06T04:36:21.286372+0000","last_clean":"2023-10-06T04:36:21.286372+0000","last_became_active":"2023-10-06T04:36:17.250205+0000","last_became_peered":"2023-10-06T04:36:17.250205+0000","last_unstale":"2023-10-06T04:36:21.286372+0000","last_undegraded":"2023-10-06T04:36:21.286372+0000","last_fullsized":"2023-10-06T04:36:21.286372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:46.694413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.306587+0000","last_change":"2023-10-06T04:36:21.301478+0000","last_active":"2023-10-06T04:36:21.306587+0000","last_peered":"2023-10-06T04:36:21.306587+0000","last_clean":"2023-10-06T04:36:21.306587+0000","last_became_active":"2023-10-06T04:36:21.300836+0000","last_became_peered":"2023-10-06T04:36:21.300836+0000","last_unstale":"2023-10-06T04:36:21.306587+0000","last_undegraded":"2023-10-06T04:36:21.306587+0000","last_fullsized":"2023-10-06T04:36:21.306587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:00.055287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276255+0000","last_change":"2023-10-06T04:36:16.231833+0000","last_active":"2023-10-06T04:36:21.276255+0000","last_peered":"2023-10-06T04:36:21.276255+0000","last_clean":"2023-10-06T04:36:21.276255+0000","last_became_active":"2023-10-06T04:36:16.231263+0000","last_became_peered":"2023-10-06T04:36:16.231263+0000","last_unstale":"2023-10-06T04:36:21.276255+0000","last_undegraded":"2023-10-06T04:36:21.276255+0000","last_fullsized":"2023-10-06T04:36:21.276255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:45:33.128307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.277178+0000","last_change":"2023-10-06T04:36:17.250303+0000","last_active":"2023-10-06T04:36:21.277178+0000","last_peered":"2023-10-06T04:36:21.277178+0000","last_clean":"2023-10-06T04:36:21.277178+0000","last_became_active":"2023-10-06T04:36:17.250033+0000","last_became_peered":"2023-10-06T04:36:17.250033+0000","last_unstale":"2023-10-06T04:36:21.277178+0000","last_undegraded":"2023-10-06T04:36:21.277178+0000","last_fullsized":"2023-10-06T04:36:21.277178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:35.000504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.309264+0000","last_change":"2023-10-06T04:36:21.302970+0000","last_active":"2023-10-06T04:36:21.309264+0000","last_peered":"2023-10-06T04:36:21.309264+0000","last_clean":"2023-10-06T04:36:21.309264+0000","last_became_active":"2023-10-06T04:36:21.302562+0000","last_became_peered":"2023-10-06T04:36:21.302562+0000","last_unstale":"2023-10-06T04:36:21.309264+0000","last_undegraded":"2023-10-06T04:36:21.309264+0000","last_fullsized":"2023-10-06T04:36:21.309264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:53.314660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291194+0000","last_change":"2023-10-06T04:36:16.230552+0000","last_active":"2023-10-06T04:36:21.291194+0000","last_peered":"2023-10-06T04:36:21.291194+0000","last_clean":"2023-10-06T04:36:21.291194+0000","last_became_active":"2023-10-06T04:36:16.230077+0000","last_became_peered":"2023-10-06T04:36:16.230077+0000","last_unstale":"2023-10-06T04:36:21.291194+0000","last_undegraded":"2023-10-06T04:36:21.291194+0000","last_fullsized":"2023-10-06T04:36:21.291194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:51:43.351582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.275705+0000","last_change":"2023-10-06T04:36:17.253484+0000","last_active":"2023-10-06T04:36:21.275705+0000","last_peered":"2023-10-06T04:36:21.275705+0000","last_clean":"2023-10-06T04:36:21.275705+0000","last_became_active":"2023-10-06T04:36:17.253217+0000","last_became_peered":"2023-10-06T04:36:17.253217+0000","last_unstale":"2023-10-06T04:36:21.275705+0000","last_undegraded":"2023-10-06T04:36:21.275705+0000","last_fullsized":"2023-10-06T04:36:21.275705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:23:08.806295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.301600+0000","last_change":"2023-10-06T04:36:21.296152+0000","last_active":"2023-10-06T04:36:21.301600+0000","last_peered":"2023-10-06T04:36:21.301600+0000","last_clean":"2023-10-06T04:36:21.301600+0000","last_became_active":"2023-10-06T04:36:21.295728+0000","last_became_peered":"2023-10-06T04:36:21.295728+0000","last_unstale":"2023-10-06T04:36:21.301600+0000","last_undegraded":"2023-10-06T04:36:21.301600+0000","last_fullsized":"2023-10-06T04:36:21.301600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:37:44.809580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.292523+0000","last_change":"2023-10-06T04:36:16.237564+0000","last_active":"2023-10-06T04:36:21.292523+0000","last_peered":"2023-10-06T04:36:21.292523+0000","last_clean":"2023-10-06T04:36:21.292523+0000","last_became_active":"2023-10-06T04:36:16.237309+0000","last_became_peered":"2023-10-06T04:36:16.237309+0000","last_unstale":"2023-10-06T04:36:21.292523+0000","last_undegraded":"2023-10-06T04:36:21.292523+0000","last_fullsized":"2023-10-06T04:36:21.292523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:47.521994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.281533+0000","last_change":"2023-10-06T04:36:17.256321+0000","last_active":"2023-10-06T04:36:21.281533+0000","last_peered":"2023-10-06T04:36:21.281533+0000","last_clean":"2023-10-06T04:36:21.281533+0000","last_became_active":"2023-10-06T04:36:17.256041+0000","last_became_peered":"2023-10-06T04:36:17.256041+0000","last_unstale":"2023-10-06T04:36:21.281533+0000","last_undegraded":"2023-10-06T04:36:21.281533+0000","last_fullsized":"2023-10-06T04:36:21.281533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:22.912226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.303744+0000","last_change":"2023-10-06T04:36:21.300383+0000","last_active":"2023-10-06T04:36:21.303744+0000","last_peered":"2023-10-06T04:36:21.303744+0000","last_clean":"2023-10-06T04:36:21.303744+0000","last_became_active":"2023-10-06T04:36:21.299968+0000","last_became_peered":"2023-10-06T04:36:21.299968+0000","last_unstale":"2023-10-06T04:36:21.303744+0000","last_undegraded":"2023-10-06T04:36:21.303744+0000","last_fullsized":"2023-10-06T04:36:21.303744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:22:34.846112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T04:36:27.099477+0000","last_change":"2023-10-06T04:36:16.229754+0000","last_active":"2023-10-06T04:36:27.099477+0000","last_peered":"2023-10-06T04:36:27.099477+0000","last_clean":"2023-10-06T04:36:27.099477+0000","last_became_active":"2023-10-06T04:36:16.229482+0000","last_became_peered":"2023-10-06T04:36:16.229482+0000","last_unstale":"2023-10-06T04:36:27.099477+0000","last_undegraded":"2023-10-06T04:36:27.099477+0000","last_fullsized":"2023-10-06T04:36:27.099477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:12.145940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280792+0000","last_change":"2023-10-06T04:36:17.254403+0000","last_active":"2023-10-06T04:36:21.280792+0000","last_peered":"2023-10-06T04:36:21.280792+0000","last_clean":"2023-10-06T04:36:21.280792+0000","last_became_active":"2023-10-06T04:36:17.254147+0000","last_became_peered":"2023-10-06T04:36:17.254147+0000","last_unstale":"2023-10-06T04:36:21.280792+0000","last_undegraded":"2023-10-06T04:36:21.280792+0000","last_fullsized":"2023-10-06T04:36:21.280792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:03.209071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.303821+0000","last_change":"2023-10-06T04:36:21.298829+0000","last_active":"2023-10-06T04:36:21.303821+0000","last_peered":"2023-10-06T04:36:21.303821+0000","last_clean":"2023-10-06T04:36:21.303821+0000","last_became_active":"2023-10-06T04:36:21.298456+0000","last_became_peered":"2023-10-06T04:36:21.298456+0000","last_unstale":"2023-10-06T04:36:21.303821+0000","last_undegraded":"2023-10-06T04:36:21.303821+0000","last_fullsized":"2023-10-06T04:36:21.303821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:52.989017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.292810+0000","last_change":"2023-10-06T04:36:16.235605+0000","last_active":"2023-10-06T04:36:21.292810+0000","last_peered":"2023-10-06T04:36:21.292810+0000","last_clean":"2023-10-06T04:36:21.292810+0000","last_became_active":"2023-10-06T04:36:16.235280+0000","last_became_peered":"2023-10-06T04:36:16.235280+0000","last_unstale":"2023-10-06T04:36:21.292810+0000","last_undegraded":"2023-10-06T04:36:21.292810+0000","last_fullsized":"2023-10-06T04:36:21.292810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:37.729642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.281044+0000","last_change":"2023-10-06T04:36:17.255715+0000","last_active":"2023-10-06T04:36:21.281044+0000","last_peered":"2023-10-06T04:36:21.281044+0000","last_clean":"2023-10-06T04:36:21.281044+0000","last_became_active":"2023-10-06T04:36:17.255461+0000","last_became_peered":"2023-10-06T04:36:17.255461+0000","last_unstale":"2023-10-06T04:36:21.281044+0000","last_undegraded":"2023-10-06T04:36:21.281044+0000","last_fullsized":"2023-10-06T04:36:21.281044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:28:24.765888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.301636+0000","last_change":"2023-10-06T04:36:21.294549+0000","last_active":"2023-10-06T04:36:21.301636+0000","last_peered":"2023-10-06T04:36:21.301636+0000","last_clean":"2023-10-06T04:36:21.301636+0000","last_became_active":"2023-10-06T04:36:21.293440+0000","last_became_peered":"2023-10-06T04:36:21.293440+0000","last_unstale":"2023-10-06T04:36:21.301636+0000","last_undegraded":"2023-10-06T04:36:21.301636+0000","last_fullsized":"2023-10-06T04:36:21.301636+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:42.828588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.278781+0000","last_change":"2023-10-06T04:36:16.226258+0000","last_active":"2023-10-06T04:36:21.278781+0000","last_peered":"2023-10-06T04:36:21.278781+0000","last_clean":"2023-10-06T04:36:21.278781+0000","last_became_active":"2023-10-06T04:36:16.225988+0000","last_became_peered":"2023-10-06T04:36:16.225988+0000","last_unstale":"2023-10-06T04:36:21.278781+0000","last_undegraded":"2023-10-06T04:36:21.278781+0000","last_fullsized":"2023-10-06T04:36:21.278781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:54.757446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291513+0000","last_change":"2023-10-06T04:36:17.257055+0000","last_active":"2023-10-06T04:36:21.291513+0000","last_peered":"2023-10-06T04:36:21.291513+0000","last_clean":"2023-10-06T04:36:21.291513+0000","last_became_active":"2023-10-06T04:36:17.256355+0000","last_became_peered":"2023-10-06T04:36:17.256355+0000","last_unstale":"2023-10-06T04:36:21.291513+0000","last_undegraded":"2023-10-06T04:36:21.291513+0000","last_fullsized":"2023-10-06T04:36:21.291513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:11.333475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.297023+0000","last_change":"2023-10-06T04:36:21.293305+0000","last_active":"2023-10-06T04:36:21.297023+0000","last_peered":"2023-10-06T04:36:21.297023+0000","last_clean":"2023-10-06T04:36:21.297023+0000","last_became_active":"2023-10-06T04:36:21.291331+0000","last_became_peered":"2023-10-06T04:36:21.291331+0000","last_unstale":"2023-10-06T04:36:21.297023+0000","last_undegraded":"2023-10-06T04:36:21.297023+0000","last_fullsized":"2023-10-06T04:36:21.297023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:14:57.032741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291211+0000","last_change":"2023-10-06T04:36:16.235344+0000","last_active":"2023-10-06T04:36:21.291211+0000","last_peered":"2023-10-06T04:36:21.291211+0000","last_clean":"2023-10-06T04:36:21.291211+0000","last_became_active":"2023-10-06T04:36:16.235092+0000","last_became_peered":"2023-10-06T04:36:16.235092+0000","last_unstale":"2023-10-06T04:36:21.291211+0000","last_undegraded":"2023-10-06T04:36:21.291211+0000","last_fullsized":"2023-10-06T04:36:21.291211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:40.040325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.278875+0000","last_change":"2023-10-06T04:36:17.252187+0000","last_active":"2023-10-06T04:36:21.278875+0000","last_peered":"2023-10-06T04:36:21.278875+0000","last_clean":"2023-10-06T04:36:21.278875+0000","last_became_active":"2023-10-06T04:36:17.251853+0000","last_became_peered":"2023-10-06T04:36:17.251853+0000","last_unstale":"2023-10-06T04:36:21.278875+0000","last_undegraded":"2023-10-06T04:36:21.278875+0000","last_fullsized":"2023-10-06T04:36:21.278875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:01:35.146203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.307146+0000","last_change":"2023-10-06T04:36:21.302469+0000","last_active":"2023-10-06T04:36:21.307146+0000","last_peered":"2023-10-06T04:36:21.307146+0000","last_clean":"2023-10-06T04:36:21.307146+0000","last_became_active":"2023-10-06T04:36:21.302085+0000","last_became_peered":"2023-10-06T04:36:21.302085+0000","last_unstale":"2023-10-06T04:36:21.307146+0000","last_undegraded":"2023-10-06T04:36:21.307146+0000","last_fullsized":"2023-10-06T04:36:21.307146+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:06:31.394534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.288489+0000","last_change":"2023-10-06T04:36:16.236074+0000","last_active":"2023-10-06T04:36:21.288489+0000","last_peered":"2023-10-06T04:36:21.288489+0000","last_clean":"2023-10-06T04:36:21.288489+0000","last_became_active":"2023-10-06T04:36:16.235777+0000","last_became_peered":"2023-10-06T04:36:16.235777+0000","last_unstale":"2023-10-06T04:36:21.288489+0000","last_undegraded":"2023-10-06T04:36:21.288489+0000","last_fullsized":"2023-10-06T04:36:21.288489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:42:27.974066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.279446+0000","last_change":"2023-10-06T04:36:17.259778+0000","last_active":"2023-10-06T04:36:21.279446+0000","last_peered":"2023-10-06T04:36:21.279446+0000","last_clean":"2023-10-06T04:36:21.279446+0000","last_became_active":"2023-10-06T04:36:17.259529+0000","last_became_peered":"2023-10-06T04:36:17.259529+0000","last_unstale":"2023-10-06T04:36:21.279446+0000","last_undegraded":"2023-10-06T04:36:21.279446+0000","last_fullsized":"2023-10-06T04:36:21.279446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:02.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.309340+0000","last_change":"2023-10-06T04:36:21.305292+0000","last_active":"2023-10-06T04:36:21.309340+0000","last_peered":"2023-10-06T04:36:21.309340+0000","last_clean":"2023-10-06T04:36:21.309340+0000","last_became_active":"2023-10-06T04:36:21.304899+0000","last_became_peered":"2023-10-06T04:36:21.304899+0000","last_unstale":"2023-10-06T04:36:21.309340+0000","last_undegraded":"2023-10-06T04:36:21.309340+0000","last_fullsized":"2023-10-06T04:36:21.309340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:30.790855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.296904+0000","last_change":"2023-10-06T04:36:16.235873+0000","last_active":"2023-10-06T04:36:21.296904+0000","last_peered":"2023-10-06T04:36:21.296904+0000","last_clean":"2023-10-06T04:36:21.296904+0000","last_became_active":"2023-10-06T04:36:16.235577+0000","last_became_peered":"2023-10-06T04:36:16.235577+0000","last_unstale":"2023-10-06T04:36:21.296904+0000","last_undegraded":"2023-10-06T04:36:21.296904+0000","last_fullsized":"2023-10-06T04:36:21.296904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:39.497925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.290348+0000","last_change":"2023-10-06T04:36:17.256627+0000","last_active":"2023-10-06T04:36:21.290348+0000","last_peered":"2023-10-06T04:36:21.290348+0000","last_clean":"2023-10-06T04:36:21.290348+0000","last_became_active":"2023-10-06T04:36:17.256351+0000","last_became_peered":"2023-10-06T04:36:17.256351+0000","last_unstale":"2023-10-06T04:36:21.290348+0000","last_undegraded":"2023-10-06T04:36:21.290348+0000","last_fullsized":"2023-10-06T04:36:21.290348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:18.298620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.299923+0000","last_change":"2023-10-06T04:36:21.292866+0000","last_active":"2023-10-06T04:36:21.299923+0000","last_peered":"2023-10-06T04:36:21.299923+0000","last_clean":"2023-10-06T04:36:21.299923+0000","last_became_active":"2023-10-06T04:36:21.292441+0000","last_became_peered":"2023-10-06T04:36:21.292441+0000","last_unstale":"2023-10-06T04:36:21.299923+0000","last_undegraded":"2023-10-06T04:36:21.299923+0000","last_fullsized":"2023-10-06T04:36:21.299923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:29.699781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.293323+0000","last_change":"2023-10-06T04:36:16.235438+0000","last_active":"2023-10-06T04:36:21.293323+0000","last_peered":"2023-10-06T04:36:21.293323+0000","last_clean":"2023-10-06T04:36:21.293323+0000","last_became_active":"2023-10-06T04:36:16.235142+0000","last_became_peered":"2023-10-06T04:36:16.235142+0000","last_unstale":"2023-10-06T04:36:21.293323+0000","last_undegraded":"2023-10-06T04:36:21.293323+0000","last_fullsized":"2023-10-06T04:36:21.293323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:45.690139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280210+0000","last_change":"2023-10-06T04:36:17.262198+0000","last_active":"2023-10-06T04:36:21.280210+0000","last_peered":"2023-10-06T04:36:21.280210+0000","last_clean":"2023-10-06T04:36:21.280210+0000","last_became_active":"2023-10-06T04:36:17.261922+0000","last_became_peered":"2023-10-06T04:36:17.261922+0000","last_unstale":"2023-10-06T04:36:21.280210+0000","last_undegraded":"2023-10-06T04:36:21.280210+0000","last_fullsized":"2023-10-06T04:36:21.280210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:52.911614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.302413+0000","last_change":"2023-10-06T04:36:21.301322+0000","last_active":"2023-10-06T04:36:21.302413+0000","last_peered":"2023-10-06T04:36:21.302413+0000","last_clean":"2023-10-06T04:36:21.302413+0000","last_became_active":"2023-10-06T04:36:21.300972+0000","last_became_peered":"2023-10-06T04:36:21.300972+0000","last_unstale":"2023-10-06T04:36:21.302413+0000","last_undegraded":"2023-10-06T04:36:21.302413+0000","last_fullsized":"2023-10-06T04:36:21.302413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:16.931552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.292453+0000","last_change":"2023-10-06T04:36:16.231930+0000","last_active":"2023-10-06T04:36:21.292453+0000","last_peered":"2023-10-06T04:36:21.292453+0000","last_clean":"2023-10-06T04:36:21.292453+0000","last_became_active":"2023-10-06T04:36:16.231670+0000","last_became_peered":"2023-10-06T04:36:16.231670+0000","last_unstale":"2023-10-06T04:36:21.292453+0000","last_undegraded":"2023-10-06T04:36:21.292453+0000","last_fullsized":"2023-10-06T04:36:21.292453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:14.880214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.283773+0000","last_change":"2023-10-06T04:36:17.257608+0000","last_active":"2023-10-06T04:36:21.283773+0000","last_peered":"2023-10-06T04:36:21.283773+0000","last_clean":"2023-10-06T04:36:21.283773+0000","last_became_active":"2023-10-06T04:36:17.257367+0000","last_became_peered":"2023-10-06T04:36:17.257367+0000","last_unstale":"2023-10-06T04:36:21.283773+0000","last_undegraded":"2023-10-06T04:36:21.283773+0000","last_fullsized":"2023-10-06T04:36:21.283773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:48.526269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.290478+0000","last_change":"2023-10-06T04:36:21.289073+0000","last_active":"2023-10-06T04:36:21.290478+0000","last_peered":"2023-10-06T04:36:21.290478+0000","last_clean":"2023-10-06T04:36:21.290478+0000","last_became_active":"2023-10-06T04:36:21.288651+0000","last_became_peered":"2023-10-06T04:36:21.288651+0000","last_unstale":"2023-10-06T04:36:21.290478+0000","last_undegraded":"2023-10-06T04:36:21.290478+0000","last_fullsized":"2023-10-06T04:36:21.290478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:23:12.855962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291282+0000","last_change":"2023-10-06T04:36:16.238006+0000","last_active":"2023-10-06T04:36:21.291282+0000","last_peered":"2023-10-06T04:36:21.291282+0000","last_clean":"2023-10-06T04:36:21.291282+0000","last_became_active":"2023-10-06T04:36:16.237733+0000","last_became_peered":"2023-10-06T04:36:16.237733+0000","last_unstale":"2023-10-06T04:36:21.291282+0000","last_undegraded":"2023-10-06T04:36:21.291282+0000","last_fullsized":"2023-10-06T04:36:21.291282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:45:33.128307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.284558+0000","last_change":"2023-10-06T04:36:17.248071+0000","last_active":"2023-10-06T04:36:21.284558+0000","last_peered":"2023-10-06T04:36:21.284558+0000","last_clean":"2023-10-06T04:36:21.284558+0000","last_became_active":"2023-10-06T04:36:17.247774+0000","last_became_peered":"2023-10-06T04:36:17.247774+0000","last_unstale":"2023-10-06T04:36:21.284558+0000","last_undegraded":"2023-10-06T04:36:21.284558+0000","last_fullsized":"2023-10-06T04:36:21.284558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:06.137894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.303676+0000","last_change":"2023-10-06T04:36:21.302376+0000","last_active":"2023-10-06T04:36:21.303676+0000","last_peered":"2023-10-06T04:36:21.303676+0000","last_clean":"2023-10-06T04:36:21.303676+0000","last_became_active":"2023-10-06T04:36:21.301996+0000","last_became_peered":"2023-10-06T04:36:21.301996+0000","last_unstale":"2023-10-06T04:36:21.303676+0000","last_undegraded":"2023-10-06T04:36:21.303676+0000","last_fullsized":"2023-10-06T04:36:21.303676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:35:31.655298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.275570+0000","last_change":"2023-10-06T04:36:16.226105+0000","last_active":"2023-10-06T04:36:21.275570+0000","last_peered":"2023-10-06T04:36:21.275570+0000","last_clean":"2023-10-06T04:36:21.275570+0000","last_became_active":"2023-10-06T04:36:16.225746+0000","last_became_peered":"2023-10-06T04:36:16.225746+0000","last_unstale":"2023-10-06T04:36:21.275570+0000","last_undegraded":"2023-10-06T04:36:21.275570+0000","last_fullsized":"2023-10-06T04:36:21.275570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:10.606701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280903+0000","last_change":"2023-10-06T04:36:17.248063+0000","last_active":"2023-10-06T04:36:21.280903+0000","last_peered":"2023-10-06T04:36:21.280903+0000","last_clean":"2023-10-06T04:36:21.280903+0000","last_became_active":"2023-10-06T04:36:17.247756+0000","last_became_peered":"2023-10-06T04:36:17.247756+0000","last_unstale":"2023-10-06T04:36:21.280903+0000","last_undegraded":"2023-10-06T04:36:21.280903+0000","last_fullsized":"2023-10-06T04:36:21.280903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:15:51.848244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.300498+0000","last_change":"2023-10-06T04:36:21.295888+0000","last_active":"2023-10-06T04:36:21.300498+0000","last_peered":"2023-10-06T04:36:21.300498+0000","last_clean":"2023-10-06T04:36:21.300498+0000","last_became_active":"2023-10-06T04:36:21.295493+0000","last_became_peered":"2023-10-06T04:36:21.295493+0000","last_unstale":"2023-10-06T04:36:21.300498+0000","last_undegraded":"2023-10-06T04:36:21.300498+0000","last_fullsized":"2023-10-06T04:36:21.300498+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:36.618164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.283866+0000","last_change":"2023-10-06T04:36:16.235993+0000","last_active":"2023-10-06T04:36:21.283866+0000","last_peered":"2023-10-06T04:36:21.283866+0000","last_clean":"2023-10-06T04:36:21.283866+0000","last_became_active":"2023-10-06T04:36:16.235737+0000","last_became_peered":"2023-10-06T04:36:16.235737+0000","last_unstale":"2023-10-06T04:36:21.283866+0000","last_undegraded":"2023-10-06T04:36:21.283866+0000","last_fullsized":"2023-10-06T04:36:21.283866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:51:43.351582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.281338+0000","last_change":"2023-10-06T04:36:17.251705+0000","last_active":"2023-10-06T04:36:21.281338+0000","last_peered":"2023-10-06T04:36:21.281338+0000","last_clean":"2023-10-06T04:36:21.281338+0000","last_became_active":"2023-10-06T04:36:17.251306+0000","last_became_peered":"2023-10-06T04:36:17.251306+0000","last_unstale":"2023-10-06T04:36:21.281338+0000","last_undegraded":"2023-10-06T04:36:21.281338+0000","last_fullsized":"2023-10-06T04:36:21.281338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:53.016887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.303623+0000","last_change":"2023-10-06T04:36:21.296312+0000","last_active":"2023-10-06T04:36:21.303623+0000","last_peered":"2023-10-06T04:36:21.303623+0000","last_clean":"2023-10-06T04:36:21.303623+0000","last_became_active":"2023-10-06T04:36:21.294384+0000","last_became_peered":"2023-10-06T04:36:21.294384+0000","last_unstale":"2023-10-06T04:36:21.303623+0000","last_undegraded":"2023-10-06T04:36:21.303623+0000","last_fullsized":"2023-10-06T04:36:21.303623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:22:34.846112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280043+0000","last_change":"2023-10-06T04:36:16.234482+0000","last_active":"2023-10-06T04:36:21.280043+0000","last_peered":"2023-10-06T04:36:21.280043+0000","last_clean":"2023-10-06T04:36:21.280043+0000","last_became_active":"2023-10-06T04:36:16.234239+0000","last_became_peered":"2023-10-06T04:36:16.234239+0000","last_unstale":"2023-10-06T04:36:21.280043+0000","last_undegraded":"2023-10-06T04:36:21.280043+0000","last_fullsized":"2023-10-06T04:36:21.280043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:51:43.351582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.281261+0000","last_change":"2023-10-06T04:36:17.254931+0000","last_active":"2023-10-06T04:36:21.281261+0000","last_peered":"2023-10-06T04:36:21.281261+0000","last_clean":"2023-10-06T04:36:21.281261+0000","last_became_active":"2023-10-06T04:36:17.254674+0000","last_became_peered":"2023-10-06T04:36:17.254674+0000","last_unstale":"2023-10-06T04:36:21.281261+0000","last_undegraded":"2023-10-06T04:36:21.281261+0000","last_fullsized":"2023-10-06T04:36:21.281261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:06.137894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.296227+0000","last_change":"2023-10-06T04:36:21.294775+0000","last_active":"2023-10-06T04:36:21.296227+0000","last_peered":"2023-10-06T04:36:21.296227+0000","last_clean":"2023-10-06T04:36:21.296227+0000","last_became_active":"2023-10-06T04:36:21.294362+0000","last_became_peered":"2023-10-06T04:36:21.294362+0000","last_unstale":"2023-10-06T04:36:21.296227+0000","last_undegraded":"2023-10-06T04:36:21.296227+0000","last_fullsized":"2023-10-06T04:36:21.296227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:37.257094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.277076+0000","last_change":"2023-10-06T04:36:16.234752+0000","last_active":"2023-10-06T04:36:21.277076+0000","last_peered":"2023-10-06T04:36:21.277076+0000","last_clean":"2023-10-06T04:36:21.277076+0000","last_became_active":"2023-10-06T04:36:16.230744+0000","last_became_peered":"2023-10-06T04:36:16.230744+0000","last_unstale":"2023-10-06T04:36:21.277076+0000","last_undegraded":"2023-10-06T04:36:21.277076+0000","last_fullsized":"2023-10-06T04:36:21.277076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:32.855334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276381+0000","last_change":"2023-10-06T04:36:17.255101+0000","last_active":"2023-10-06T04:36:21.276381+0000","last_peered":"2023-10-06T04:36:21.276381+0000","last_clean":"2023-10-06T04:36:21.276381+0000","last_became_active":"2023-10-06T04:36:17.254846+0000","last_became_peered":"2023-10-06T04:36:17.254846+0000","last_unstale":"2023-10-06T04:36:21.276381+0000","last_undegraded":"2023-10-06T04:36:21.276381+0000","last_fullsized":"2023-10-06T04:36:21.276381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:01:35.146203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.303559+0000","last_change":"2023-10-06T04:36:21.295704+0000","last_active":"2023-10-06T04:36:21.303559+0000","last_peered":"2023-10-06T04:36:21.303559+0000","last_clean":"2023-10-06T04:36:21.303559+0000","last_became_active":"2023-10-06T04:36:21.295333+0000","last_became_peered":"2023-10-06T04:36:21.295333+0000","last_unstale":"2023-10-06T04:36:21.303559+0000","last_undegraded":"2023-10-06T04:36:21.303559+0000","last_fullsized":"2023-10-06T04:36:21.303559+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:21:19.303096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.277832+0000","last_change":"2023-10-06T04:36:16.227900+0000","last_active":"2023-10-06T04:36:21.277832+0000","last_peered":"2023-10-06T04:36:21.277832+0000","last_clean":"2023-10-06T04:36:21.277832+0000","last_became_active":"2023-10-06T04:36:16.227587+0000","last_became_peered":"2023-10-06T04:36:16.227587+0000","last_unstale":"2023-10-06T04:36:21.277832+0000","last_undegraded":"2023-10-06T04:36:21.277832+0000","last_fullsized":"2023-10-06T04:36:21.277832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:54.757446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.281521+0000","last_change":"2023-10-06T04:36:11.192215+0000","last_active":"2023-10-06T04:36:21.281521+0000","last_peered":"2023-10-06T04:36:21.281521+0000","last_clean":"2023-10-06T04:36:21.281521+0000","last_became_active":"2023-10-06T04:36:11.191953+0000","last_became_peered":"2023-10-06T04:36:11.191953+0000","last_unstale":"2023-10-06T04:36:21.281521+0000","last_undegraded":"2023-10-06T04:36:21.281521+0000","last_fullsized":"2023-10-06T04:36:21.281521+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:37.026121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.277485+0000","last_change":"2023-10-06T04:36:17.254170+0000","last_active":"2023-10-06T04:36:21.277485+0000","last_peered":"2023-10-06T04:36:21.277485+0000","last_clean":"2023-10-06T04:36:21.277485+0000","last_became_active":"2023-10-06T04:36:17.253910+0000","last_became_peered":"2023-10-06T04:36:17.253910+0000","last_unstale":"2023-10-06T04:36:21.277485+0000","last_undegraded":"2023-10-06T04:36:21.277485+0000","last_fullsized":"2023-10-06T04:36:21.277485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:18.298620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.296974+0000","last_change":"2023-10-06T04:36:21.291691+0000","last_active":"2023-10-06T04:36:21.296974+0000","last_peered":"2023-10-06T04:36:21.296974+0000","last_clean":"2023-10-06T04:36:21.296974+0000","last_became_active":"2023-10-06T04:36:21.291287+0000","last_became_peered":"2023-10-06T04:36:21.291287+0000","last_unstale":"2023-10-06T04:36:21.296974+0000","last_undegraded":"2023-10-06T04:36:21.296974+0000","last_fullsized":"2023-10-06T04:36:21.296974+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:59:55.077526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280946+0000","last_change":"2023-10-06T04:36:11.184555+0000","last_active":"2023-10-06T04:36:21.280946+0000","last_peered":"2023-10-06T04:36:21.280946+0000","last_clean":"2023-10-06T04:36:21.280946+0000","last_became_active":"2023-10-06T04:36:11.184229+0000","last_became_peered":"2023-10-06T04:36:11.184229+0000","last_unstale":"2023-10-06T04:36:21.280946+0000","last_undegraded":"2023-10-06T04:36:21.280946+0000","last_fullsized":"2023-10-06T04:36:21.280946+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:19.938716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.295381+0000","last_change":"2023-10-06T04:36:16.227655+0000","last_active":"2023-10-06T04:36:21.295381+0000","last_peered":"2023-10-06T04:36:21.295381+0000","last_clean":"2023-10-06T04:36:21.295381+0000","last_became_active":"2023-10-06T04:36:16.227033+0000","last_became_peered":"2023-10-06T04:36:16.227033+0000","last_unstale":"2023-10-06T04:36:21.295381+0000","last_undegraded":"2023-10-06T04:36:21.295381+0000","last_fullsized":"2023-10-06T04:36:21.295381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:10.606701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280143+0000","last_change":"2023-10-06T04:36:17.250515+0000","last_active":"2023-10-06T04:36:21.280143+0000","last_peered":"2023-10-06T04:36:21.280143+0000","last_clean":"2023-10-06T04:36:21.280143+0000","last_became_active":"2023-10-06T04:36:17.250192+0000","last_became_peered":"2023-10-06T04:36:17.250192+0000","last_unstale":"2023-10-06T04:36:21.280143+0000","last_undegraded":"2023-10-06T04:36:21.280143+0000","last_fullsized":"2023-10-06T04:36:21.280143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:25.650113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.304036+0000","last_change":"2023-10-06T04:36:21.298658+0000","last_active":"2023-10-06T04:36:21.304036+0000","last_peered":"2023-10-06T04:36:21.304036+0000","last_clean":"2023-10-06T04:36:21.304036+0000","last_became_active":"2023-10-06T04:36:21.298118+0000","last_became_peered":"2023-10-06T04:36:21.298118+0000","last_unstale":"2023-10-06T04:36:21.304036+0000","last_undegraded":"2023-10-06T04:36:21.304036+0000","last_fullsized":"2023-10-06T04:36:21.304036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:38.096649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276479+0000","last_change":"2023-10-06T04:36:11.184460+0000","last_active":"2023-10-06T04:36:21.276479+0000","last_peered":"2023-10-06T04:36:21.276479+0000","last_clean":"2023-10-06T04:36:21.276479+0000","last_became_active":"2023-10-06T04:36:11.184119+0000","last_became_peered":"2023-10-06T04:36:11.184119+0000","last_unstale":"2023-10-06T04:36:21.276479+0000","last_undegraded":"2023-10-06T04:36:21.276479+0000","last_fullsized":"2023-10-06T04:36:21.276479+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:37.026121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":166,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.290702+0000","last_change":"2023-10-06T04:36:12.183155+0000","last_active":"2023-10-06T04:36:21.290702+0000","last_peered":"2023-10-06T04:36:21.290702+0000","last_clean":"2023-10-06T04:36:21.290702+0000","last_became_active":"2023-10-06T04:36:12.182903+0000","last_became_peered":"2023-10-06T04:36:12.182903+0000","last_unstale":"2023-10-06T04:36:21.290702+0000","last_undegraded":"2023-10-06T04:36:21.290702+0000","last_fullsized":"2023-10-06T04:36:21.290702+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:11.171104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:11.171104+0000","last_clean_scrub_stamp":"2023-10-06T04:36:11.171104+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:38:54.323364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.275958+0000","last_change":"2023-10-06T04:36:16.228034+0000","last_active":"2023-10-06T04:36:21.275958+0000","last_peered":"2023-10-06T04:36:21.275958+0000","last_clean":"2023-10-06T04:36:21.275958+0000","last_became_active":"2023-10-06T04:36:16.227743+0000","last_became_peered":"2023-10-06T04:36:16.227743+0000","last_unstale":"2023-10-06T04:36:21.275958+0000","last_undegraded":"2023-10-06T04:36:21.275958+0000","last_fullsized":"2023-10-06T04:36:21.275958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:47:12.145940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.278791+0000","last_change":"2023-10-06T04:36:17.257761+0000","last_active":"2023-10-06T04:36:21.278791+0000","last_peered":"2023-10-06T04:36:21.278791+0000","last_clean":"2023-10-06T04:36:21.278791+0000","last_became_active":"2023-10-06T04:36:17.257238+0000","last_became_peered":"2023-10-06T04:36:17.257238+0000","last_unstale":"2023-10-06T04:36:21.278791+0000","last_undegraded":"2023-10-06T04:36:21.278791+0000","last_fullsized":"2023-10-06T04:36:21.278791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:03.209071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.300390+0000","last_change":"2023-10-06T04:36:21.296982+0000","last_active":"2023-10-06T04:36:21.300390+0000","last_peered":"2023-10-06T04:36:21.300390+0000","last_clean":"2023-10-06T04:36:21.300390+0000","last_became_active":"2023-10-06T04:36:21.296294+0000","last_became_peered":"2023-10-06T04:36:21.296294+0000","last_unstale":"2023-10-06T04:36:21.300390+0000","last_undegraded":"2023-10-06T04:36:21.300390+0000","last_fullsized":"2023-10-06T04:36:21.300390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:39.050172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.292995+0000","last_change":"2023-10-06T04:36:11.193056+0000","last_active":"2023-10-06T04:36:21.292995+0000","last_peered":"2023-10-06T04:36:21.292995+0000","last_clean":"2023-10-06T04:36:21.292995+0000","last_became_active":"2023-10-06T04:36:11.192712+0000","last_became_peered":"2023-10-06T04:36:11.192712+0000","last_unstale":"2023-10-06T04:36:21.292995+0000","last_undegraded":"2023-10-06T04:36:21.292995+0000","last_fullsized":"2023-10-06T04:36:21.292995+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:00.008654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.278242+0000","last_change":"2023-10-06T04:36:16.234660+0000","last_active":"2023-10-06T04:36:21.278242+0000","last_peered":"2023-10-06T04:36:21.278242+0000","last_clean":"2023-10-06T04:36:21.278242+0000","last_became_active":"2023-10-06T04:36:16.234357+0000","last_became_peered":"2023-10-06T04:36:16.234357+0000","last_unstale":"2023-10-06T04:36:21.278242+0000","last_undegraded":"2023-10-06T04:36:21.278242+0000","last_fullsized":"2023-10-06T04:36:21.278242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:42:27.974066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276281+0000","last_change":"2023-10-06T04:36:17.251700+0000","last_active":"2023-10-06T04:36:21.276281+0000","last_peered":"2023-10-06T04:36:21.276281+0000","last_clean":"2023-10-06T04:36:21.276281+0000","last_became_active":"2023-10-06T04:36:17.251034+0000","last_became_peered":"2023-10-06T04:36:17.251034+0000","last_unstale":"2023-10-06T04:36:21.276281+0000","last_undegraded":"2023-10-06T04:36:21.276281+0000","last_fullsized":"2023-10-06T04:36:21.276281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:11.333475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.309325+0000","last_change":"2023-10-06T04:36:21.305039+0000","last_active":"2023-10-06T04:36:21.309325+0000","last_peered":"2023-10-06T04:36:21.309325+0000","last_clean":"2023-10-06T04:36:21.309325+0000","last_became_active":"2023-10-06T04:36:21.304584+0000","last_became_peered":"2023-10-06T04:36:21.304584+0000","last_unstale":"2023-10-06T04:36:21.309325+0000","last_undegraded":"2023-10-06T04:36:21.309325+0000","last_fullsized":"2023-10-06T04:36:21.309325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:07.162250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.290530+0000","last_change":"2023-10-06T04:36:11.192701+0000","last_active":"2023-10-06T04:36:21.290530+0000","last_peered":"2023-10-06T04:36:21.290530+0000","last_clean":"2023-10-06T04:36:21.290530+0000","last_became_active":"2023-10-06T04:36:11.192335+0000","last_became_peered":"2023-10-06T04:36:11.192335+0000","last_unstale":"2023-10-06T04:36:21.290530+0000","last_undegraded":"2023-10-06T04:36:21.290530+0000","last_fullsized":"2023-10-06T04:36:21.290530+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:18.643570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276668+0000","last_change":"2023-10-06T04:36:16.234341+0000","last_active":"2023-10-06T04:36:21.276668+0000","last_peered":"2023-10-06T04:36:21.276668+0000","last_clean":"2023-10-06T04:36:21.276668+0000","last_became_active":"2023-10-06T04:36:16.230428+0000","last_became_peered":"2023-10-06T04:36:16.230428+0000","last_unstale":"2023-10-06T04:36:21.276668+0000","last_undegraded":"2023-10-06T04:36:21.276668+0000","last_fullsized":"2023-10-06T04:36:21.276668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:39.497925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291935+0000","last_change":"2023-10-06T04:36:17.263627+0000","last_active":"2023-10-06T04:36:21.291935+0000","last_peered":"2023-10-06T04:36:21.291935+0000","last_clean":"2023-10-06T04:36:21.291935+0000","last_became_active":"2023-10-06T04:36:17.263090+0000","last_became_peered":"2023-10-06T04:36:17.263090+0000","last_unstale":"2023-10-06T04:36:21.291935+0000","last_undegraded":"2023-10-06T04:36:21.291935+0000","last_fullsized":"2023-10-06T04:36:21.291935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:38.733916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.305005+0000","last_change":"2023-10-06T04:36:21.302935+0000","last_active":"2023-10-06T04:36:21.305005+0000","last_peered":"2023-10-06T04:36:21.305005+0000","last_clean":"2023-10-06T04:36:21.305005+0000","last_became_active":"2023-10-06T04:36:21.302531+0000","last_became_peered":"2023-10-06T04:36:21.302531+0000","last_unstale":"2023-10-06T04:36:21.305005+0000","last_undegraded":"2023-10-06T04:36:21.305005+0000","last_fullsized":"2023-10-06T04:36:21.305005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:53.314660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.290636+0000","last_change":"2023-10-06T04:36:11.193497+0000","last_active":"2023-10-06T04:36:21.290636+0000","last_peered":"2023-10-06T04:36:21.290636+0000","last_clean":"2023-10-06T04:36:21.290636+0000","last_became_active":"2023-10-06T04:36:11.193215+0000","last_became_peered":"2023-10-06T04:36:11.193215+0000","last_unstale":"2023-10-06T04:36:21.290636+0000","last_undegraded":"2023-10-06T04:36:21.290636+0000","last_fullsized":"2023-10-06T04:36:21.290636+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:07.497987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280777+0000","last_change":"2023-10-06T04:36:16.228895+0000","last_active":"2023-10-06T04:36:21.280777+0000","last_peered":"2023-10-06T04:36:21.280777+0000","last_clean":"2023-10-06T04:36:21.280777+0000","last_became_active":"2023-10-06T04:36:16.228165+0000","last_became_peered":"2023-10-06T04:36:16.228165+0000","last_unstale":"2023-10-06T04:36:21.280777+0000","last_undegraded":"2023-10-06T04:36:21.280777+0000","last_fullsized":"2023-10-06T04:36:21.280777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:10.606701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.282559+0000","last_change":"2023-10-06T04:36:17.245277+0000","last_active":"2023-10-06T04:36:21.282559+0000","last_peered":"2023-10-06T04:36:21.282559+0000","last_clean":"2023-10-06T04:36:21.282559+0000","last_became_active":"2023-10-06T04:36:17.245034+0000","last_became_peered":"2023-10-06T04:36:17.245034+0000","last_unstale":"2023-10-06T04:36:21.282559+0000","last_undegraded":"2023-10-06T04:36:21.282559+0000","last_fullsized":"2023-10-06T04:36:21.282559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:48.526269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.305149+0000","last_change":"2023-10-06T04:36:21.299758+0000","last_active":"2023-10-06T04:36:21.305149+0000","last_peered":"2023-10-06T04:36:21.305149+0000","last_clean":"2023-10-06T04:36:21.305149+0000","last_became_active":"2023-10-06T04:36:21.299383+0000","last_became_peered":"2023-10-06T04:36:21.299383+0000","last_unstale":"2023-10-06T04:36:21.305149+0000","last_undegraded":"2023-10-06T04:36:21.305149+0000","last_fullsized":"2023-10-06T04:36:21.305149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:29.699781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.283643+0000","last_change":"2023-10-06T04:36:11.193111+0000","last_active":"2023-10-06T04:36:21.283643+0000","last_peered":"2023-10-06T04:36:21.283643+0000","last_clean":"2023-10-06T04:36:21.283643+0000","last_became_active":"2023-10-06T04:36:11.192836+0000","last_became_peered":"2023-10-06T04:36:11.192836+0000","last_unstale":"2023-10-06T04:36:21.283643+0000","last_undegraded":"2023-10-06T04:36:21.283643+0000","last_fullsized":"2023-10-06T04:36:21.283643+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:19.938716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276725+0000","last_change":"2023-10-06T04:36:16.233274+0000","last_active":"2023-10-06T04:36:21.276725+0000","last_peered":"2023-10-06T04:36:21.276725+0000","last_clean":"2023-10-06T04:36:21.276725+0000","last_became_active":"2023-10-06T04:36:16.232385+0000","last_became_peered":"2023-10-06T04:36:16.232385+0000","last_unstale":"2023-10-06T04:36:21.276725+0000","last_undegraded":"2023-10-06T04:36:21.276725+0000","last_fullsized":"2023-10-06T04:36:21.276725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:51:43.351582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.284374+0000","last_change":"2023-10-06T04:36:17.251317+0000","last_active":"2023-10-06T04:36:21.284374+0000","last_peered":"2023-10-06T04:36:21.284374+0000","last_clean":"2023-10-06T04:36:21.284374+0000","last_became_active":"2023-10-06T04:36:17.251156+0000","last_became_peered":"2023-10-06T04:36:17.251156+0000","last_unstale":"2023-10-06T04:36:21.284374+0000","last_undegraded":"2023-10-06T04:36:21.284374+0000","last_fullsized":"2023-10-06T04:36:21.284374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:14.615096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.305152+0000","last_change":"2023-10-06T04:36:21.303952+0000","last_active":"2023-10-06T04:36:21.305152+0000","last_peered":"2023-10-06T04:36:21.305152+0000","last_clean":"2023-10-06T04:36:21.305152+0000","last_became_active":"2023-10-06T04:36:21.303042+0000","last_became_peered":"2023-10-06T04:36:21.303042+0000","last_unstale":"2023-10-06T04:36:21.305152+0000","last_undegraded":"2023-10-06T04:36:21.305152+0000","last_fullsized":"2023-10-06T04:36:21.305152+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:00.910253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.286309+0000","last_change":"2023-10-06T04:36:11.182804+0000","last_active":"2023-10-06T04:36:21.286309+0000","last_peered":"2023-10-06T04:36:21.286309+0000","last_clean":"2023-10-06T04:36:21.286309+0000","last_became_active":"2023-10-06T04:36:11.182575+0000","last_became_peered":"2023-10-06T04:36:11.182575+0000","last_unstale":"2023-10-06T04:36:21.286309+0000","last_undegraded":"2023-10-06T04:36:21.286309+0000","last_fullsized":"2023-10-06T04:36:21.286309+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:07.497987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291508+0000","last_change":"2023-10-06T04:36:16.237994+0000","last_active":"2023-10-06T04:36:21.291508+0000","last_peered":"2023-10-06T04:36:21.291508+0000","last_clean":"2023-10-06T04:36:21.291508+0000","last_became_active":"2023-10-06T04:36:16.237722+0000","last_became_peered":"2023-10-06T04:36:16.237722+0000","last_unstale":"2023-10-06T04:36:21.291508+0000","last_undegraded":"2023-10-06T04:36:21.291508+0000","last_fullsized":"2023-10-06T04:36:21.291508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:54.757446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.281269+0000","last_change":"2023-10-06T04:36:17.251489+0000","last_active":"2023-10-06T04:36:21.281269+0000","last_peered":"2023-10-06T04:36:21.281269+0000","last_clean":"2023-10-06T04:36:21.281269+0000","last_became_active":"2023-10-06T04:36:17.251233+0000","last_became_peered":"2023-10-06T04:36:17.251233+0000","last_unstale":"2023-10-06T04:36:21.281269+0000","last_undegraded":"2023-10-06T04:36:21.281269+0000","last_fullsized":"2023-10-06T04:36:21.281269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:18.298620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.298102+0000","last_change":"2023-10-06T04:36:21.293975+0000","last_active":"2023-10-06T04:36:21.298102+0000","last_peered":"2023-10-06T04:36:21.298102+0000","last_clean":"2023-10-06T04:36:21.298102+0000","last_became_active":"2023-10-06T04:36:21.293578+0000","last_became_peered":"2023-10-06T04:36:21.293578+0000","last_unstale":"2023-10-06T04:36:21.298102+0000","last_undegraded":"2023-10-06T04:36:21.298102+0000","last_fullsized":"2023-10-06T04:36:21.298102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:14.917841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.284317+0000","last_change":"2023-10-06T04:36:16.229589+0000","last_active":"2023-10-06T04:36:21.284317+0000","last_peered":"2023-10-06T04:36:21.284317+0000","last_clean":"2023-10-06T04:36:21.284317+0000","last_became_active":"2023-10-06T04:36:16.229178+0000","last_became_peered":"2023-10-06T04:36:16.229178+0000","last_unstale":"2023-10-06T04:36:21.284317+0000","last_undegraded":"2023-10-06T04:36:21.284317+0000","last_fullsized":"2023-10-06T04:36:21.284317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:51:43.351582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.272441+0000","last_change":"2023-10-06T04:36:17.250854+0000","last_active":"2023-10-06T04:36:21.272441+0000","last_peered":"2023-10-06T04:36:21.272441+0000","last_clean":"2023-10-06T04:36:21.272441+0000","last_became_active":"2023-10-06T04:36:17.250610+0000","last_became_peered":"2023-10-06T04:36:17.250610+0000","last_unstale":"2023-10-06T04:36:21.272441+0000","last_undegraded":"2023-10-06T04:36:21.272441+0000","last_fullsized":"2023-10-06T04:36:21.272441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:55.761720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.309362+0000","last_change":"2023-10-06T04:36:21.306750+0000","last_active":"2023-10-06T04:36:21.309362+0000","last_peered":"2023-10-06T04:36:21.309362+0000","last_clean":"2023-10-06T04:36:21.309362+0000","last_became_active":"2023-10-06T04:36:21.306419+0000","last_became_peered":"2023-10-06T04:36:21.306419+0000","last_unstale":"2023-10-06T04:36:21.309362+0000","last_undegraded":"2023-10-06T04:36:21.309362+0000","last_fullsized":"2023-10-06T04:36:21.309362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:52.989017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291179+0000","last_change":"2023-10-06T04:36:16.233250+0000","last_active":"2023-10-06T04:36:21.291179+0000","last_peered":"2023-10-06T04:36:21.291179+0000","last_clean":"2023-10-06T04:36:21.291179+0000","last_became_active":"2023-10-06T04:36:16.232939+0000","last_became_peered":"2023-10-06T04:36:16.232939+0000","last_unstale":"2023-10-06T04:36:21.291179+0000","last_undegraded":"2023-10-06T04:36:21.291179+0000","last_fullsized":"2023-10-06T04:36:21.291179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:42.572631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280600+0000","last_change":"2023-10-06T04:36:17.261079+0000","last_active":"2023-10-06T04:36:21.280600+0000","last_peered":"2023-10-06T04:36:21.280600+0000","last_clean":"2023-10-06T04:36:21.280600+0000","last_became_active":"2023-10-06T04:36:17.260815+0000","last_became_peered":"2023-10-06T04:36:17.260815+0000","last_unstale":"2023-10-06T04:36:21.280600+0000","last_undegraded":"2023-10-06T04:36:21.280600+0000","last_fullsized":"2023-10-06T04:36:21.280600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:14.615096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.303853+0000","last_change":"2023-10-06T04:36:21.297230+0000","last_active":"2023-10-06T04:36:21.303853+0000","last_peered":"2023-10-06T04:36:21.303853+0000","last_clean":"2023-10-06T04:36:21.303853+0000","last_became_active":"2023-10-06T04:36:21.296880+0000","last_became_peered":"2023-10-06T04:36:21.296880+0000","last_unstale":"2023-10-06T04:36:21.303853+0000","last_undegraded":"2023-10-06T04:36:21.303853+0000","last_fullsized":"2023-10-06T04:36:21.303853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:02.285634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.291398+0000","last_change":"2023-10-06T04:36:16.232832+0000","last_active":"2023-10-06T04:36:21.291398+0000","last_peered":"2023-10-06T04:36:21.291398+0000","last_clean":"2023-10-06T04:36:21.291398+0000","last_became_active":"2023-10-06T04:36:16.232556+0000","last_became_peered":"2023-10-06T04:36:16.232556+0000","last_unstale":"2023-10-06T04:36:21.291398+0000","last_undegraded":"2023-10-06T04:36:21.291398+0000","last_fullsized":"2023-10-06T04:36:21.291398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:10.606701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280531+0000","last_change":"2023-10-06T04:36:17.247689+0000","last_active":"2023-10-06T04:36:21.280531+0000","last_peered":"2023-10-06T04:36:21.280531+0000","last_clean":"2023-10-06T04:36:21.280531+0000","last_became_active":"2023-10-06T04:36:17.247409+0000","last_became_peered":"2023-10-06T04:36:17.247409+0000","last_unstale":"2023-10-06T04:36:21.280531+0000","last_undegraded":"2023-10-06T04:36:21.280531+0000","last_fullsized":"2023-10-06T04:36:21.280531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:35:27.605631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.304354+0000","last_change":"2023-10-06T04:36:21.302319+0000","last_active":"2023-10-06T04:36:21.304354+0000","last_peered":"2023-10-06T04:36:21.304354+0000","last_clean":"2023-10-06T04:36:21.304354+0000","last_became_active":"2023-10-06T04:36:21.301959+0000","last_became_peered":"2023-10-06T04:36:21.301959+0000","last_unstale":"2023-10-06T04:36:21.304354+0000","last_undegraded":"2023-10-06T04:36:21.304354+0000","last_fullsized":"2023-10-06T04:36:21.304354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:18.466700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.277468+0000","last_change":"2023-10-06T04:36:16.228609+0000","last_active":"2023-10-06T04:36:21.277468+0000","last_peered":"2023-10-06T04:36:21.277468+0000","last_clean":"2023-10-06T04:36:21.277468+0000","last_became_active":"2023-10-06T04:36:16.228294+0000","last_became_peered":"2023-10-06T04:36:16.228294+0000","last_unstale":"2023-10-06T04:36:21.277468+0000","last_undegraded":"2023-10-06T04:36:21.277468+0000","last_fullsized":"2023-10-06T04:36:21.277468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:40.040325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.275892+0000","last_change":"2023-10-06T04:36:17.246675+0000","last_active":"2023-10-06T04:36:21.275892+0000","last_peered":"2023-10-06T04:36:21.275892+0000","last_clean":"2023-10-06T04:36:21.275892+0000","last_became_active":"2023-10-06T04:36:17.246403+0000","last_became_peered":"2023-10-06T04:36:17.246403+0000","last_unstale":"2023-10-06T04:36:21.275892+0000","last_undegraded":"2023-10-06T04:36:21.275892+0000","last_fullsized":"2023-10-06T04:36:21.275892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:35:27.605631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.298091+0000","last_change":"2023-10-06T04:36:21.293736+0000","last_active":"2023-10-06T04:36:21.298091+0000","last_peered":"2023-10-06T04:36:21.298091+0000","last_clean":"2023-10-06T04:36:21.298091+0000","last_became_active":"2023-10-06T04:36:21.293317+0000","last_became_peered":"2023-10-06T04:36:21.293317+0000","last_unstale":"2023-10-06T04:36:21.298091+0000","last_undegraded":"2023-10-06T04:36:21.298091+0000","last_fullsized":"2023-10-06T04:36:21.298091+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:20.259779+0000","last_clean_scrub_stamp":"2023-10-06T04:36:20.259779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:00.910253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276350+0000","last_change":"2023-10-06T04:36:16.232060+0000","last_active":"2023-10-06T04:36:21.276350+0000","last_peered":"2023-10-06T04:36:21.276350+0000","last_clean":"2023-10-06T04:36:21.276350+0000","last_became_active":"2023-10-06T04:36:16.231602+0000","last_became_peered":"2023-10-06T04:36:16.231602+0000","last_unstale":"2023-10-06T04:36:21.276350+0000","last_undegraded":"2023-10-06T04:36:21.276350+0000","last_fullsized":"2023-10-06T04:36:21.276350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:15.205836+0000","last_clean_scrub_stamp":"2023-10-06T04:36:15.205836+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:32.855334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.279896+0000","last_change":"2023-10-06T04:36:17.252345+0000","last_active":"2023-10-06T04:36:21.279896+0000","last_peered":"2023-10-06T04:36:21.279896+0000","last_clean":"2023-10-06T04:36:21.279896+0000","last_became_active":"2023-10-06T04:36:17.250338+0000","last_became_peered":"2023-10-06T04:36:17.250338+0000","last_unstale":"2023-10-06T04:36:21.279896+0000","last_undegraded":"2023-10-06T04:36:21.279896+0000","last_fullsized":"2023-10-06T04:36:21.279896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:28:24.765888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.290285+0000","last_change":"2023-10-06T04:36:17.261636+0000","last_active":"2023-10-06T04:36:21.290285+0000","last_peered":"2023-10-06T04:36:21.290285+0000","last_clean":"2023-10-06T04:36:21.290285+0000","last_became_active":"2023-10-06T04:36:17.261392+0000","last_became_peered":"2023-10-06T04:36:17.261392+0000","last_unstale":"2023-10-06T04:36:21.290285+0000","last_undegraded":"2023-10-06T04:36:21.290285+0000","last_fullsized":"2023-10-06T04:36:21.290285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:41.044599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.275984+0000","last_change":"2023-10-06T04:36:17.255595+0000","last_active":"2023-10-06T04:36:21.275984+0000","last_peered":"2023-10-06T04:36:21.275984+0000","last_clean":"2023-10-06T04:36:21.275984+0000","last_became_active":"2023-10-06T04:36:17.255326+0000","last_became_peered":"2023-10-06T04:36:17.255326+0000","last_unstale":"2023-10-06T04:36:21.275984+0000","last_undegraded":"2023-10-06T04:36:21.275984+0000","last_fullsized":"2023-10-06T04:36:21.275984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:56.005620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.280802+0000","last_change":"2023-10-06T04:36:17.266065+0000","last_active":"2023-10-06T04:36:21.280802+0000","last_peered":"2023-10-06T04:36:21.280802+0000","last_clean":"2023-10-06T04:36:21.280802+0000","last_became_active":"2023-10-06T04:36:17.264225+0000","last_became_peered":"2023-10-06T04:36:17.264225+0000","last_unstale":"2023-10-06T04:36:21.280802+0000","last_undegraded":"2023-10-06T04:36:21.280802+0000","last_fullsized":"2023-10-06T04:36:21.280802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:12.881884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.277129+0000","last_change":"2023-10-06T04:36:17.253460+0000","last_active":"2023-10-06T04:36:21.277129+0000","last_peered":"2023-10-06T04:36:21.277129+0000","last_clean":"2023-10-06T04:36:21.277129+0000","last_became_active":"2023-10-06T04:36:17.253170+0000","last_became_peered":"2023-10-06T04:36:17.253170+0000","last_unstale":"2023-10-06T04:36:21.277129+0000","last_undegraded":"2023-10-06T04:36:21.277129+0000","last_fullsized":"2023-10-06T04:36:21.277129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:25.650113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:36:21.276624+0000","last_change":"2023-10-06T04:36:17.257970+0000","last_active":"2023-10-06T04:36:21.276624+0000","last_peered":"2023-10-06T04:36:21.276624+0000","last_clean":"2023-10-06T04:36:21.276624+0000","last_became_active":"2023-10-06T04:36:17.257685+0000","last_became_peered":"2023-10-06T04:36:17.257685+0000","last_unstale":"2023-10-06T04:36:21.276624+0000","last_undegraded":"2023-10-06T04:36:21.276624+0000","last_fullsized":"2023-10-06T04:36:21.276624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:16.210111+0000","last_clean_scrub_stamp":"2023-10-06T04:36:16.210111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:15.884489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298156,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073684,"statfs":{"total":96636764160,"available":96331452416,"internally_reserved":0,"allocated":888832,"data_stored":703756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":266240,"data_stored":109458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.125999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.4870000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298128,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073712,"statfs":{"total":96636764160,"available":96331481088,"internally_reserved":0,"allocated":860160,"data_stored":699826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":266240,"data_stored":109034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":108480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":266240,"data_stored":108570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":286720,"data_stored":113228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":274432,"data_stored":110082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:36:36.981 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T04:36:36.982 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-06T04:36:36.982 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-06T04:36:36.982 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-06T04:36:37.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.129+0000 7f2d7a60d700 1 Processor -- start 2023-10-06T04:36:37.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.129+0000 7f2d7a60d700 1 -- start start 2023-10-06T04:36:37.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.129+0000 7f2d7a60d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2d7415dd80 0x7f2d740b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:37.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.129+0000 7f2d7a60d700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d740c7290 con 0x7f2d740c6df0 2023-10-06T04:36:37.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.129+0000 7f2d7a60d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d740c53a0 con 0x7f2d74159960 2023-10-06T04:36:37.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.129+0000 7f2d7a60d700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d7415b470 con 0x7f2d7415dd80 2023-10-06T04:36:37.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.130+0000 7f2d737fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2d7415dd80 0x7f2d740b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:37.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.130+0000 7f2d78baa700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f2d740c6df0 0x7f2d740b1f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:52550/0 (socket says 172.21.15.8:52550) 2023-10-06T04:36:37.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.130+0000 7f2d78baa700 1 -- 172.21.15.8:0/1078084040 learned_addr learned my addr 172.21.15.8:0/1078084040 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:37.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.130+0000 7f2d737fe700 1 -- 172.21.15.8:0/1078084040 >> v1:172.21.15.184:6789/0 conn(0x7f2d74159960 legacy=0x7f2d7415d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:37.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.130+0000 7f2d737fe700 1 -- 172.21.15.8:0/1078084040 >> v1:172.21.15.8:6789/0 conn(0x7f2d740c6df0 legacy=0x7f2d740b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:37.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.130+0000 7f2d737fe700 1 -- 172.21.15.8:0/1078084040 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d740c5680 con 0x7f2d7415dd80 2023-10-06T04:36:37.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.130+0000 7f2d72ffd700 1 -- 172.21.15.8:0/1078084040 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 72808456 0 0) 0x7f2d740c7290 con 0x7f2d740c6df0 2023-10-06T04:36:37.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.130+0000 7f2d737fe700 1 --2- 172.21.15.8:0/1078084040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d7415dd80 0x7f2d740b4c00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2d680098e0 tx=0x7f2d680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e82c433143313f73 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:37.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.130+0000 7f2d72ffd700 1 -- 172.21.15.8:0/1078084040 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d68009e80 con 0x7f2d7415dd80 2023-10-06T04:36:37.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.130+0000 7f2d72ffd700 1 -- 172.21.15.8:0/1078084040 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6800b860 con 0x7f2d7415dd80 2023-10-06T04:36:37.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.130+0000 7f2d72ffd700 1 -- 172.21.15.8:0/1078084040 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6800bbe0 con 0x7f2d7415dd80 2023-10-06T04:36:37.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.131+0000 7f2d7a60d700 1 -- 172.21.15.8:0/1078084040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d7415dd80 msgr2=0x7f2d740b4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:37.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.131+0000 7f2d7a60d700 1 --2- 172.21.15.8:0/1078084040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d7415dd80 0x7f2d740b4c00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2d680098e0 tx=0x7f2d680091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:37.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.131+0000 7f2d7a60d700 1 -- 172.21.15.8:0/1078084040 shutdown_connections 2023-10-06T04:36:37.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.131+0000 7f2d7a60d700 1 --2- 172.21.15.8:0/1078084040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d7415dd80 0x7f2d740b4c00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:37.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.131+0000 7f2d7a60d700 1 -- 172.21.15.8:0/1078084040 >> 172.21.15.8:0/1078084040 conn(0x7f2d7406ed00 msgr2=0x7f2d7406f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:37.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.131+0000 7f2d7a60d700 1 -- 172.21.15.8:0/1078084040 shutdown_connections 2023-10-06T04:36:37.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.131+0000 7f2d7a60d700 1 -- 172.21.15.8:0/1078084040 wait complete. 2023-10-06T04:36:37.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.132+0000 7f2d7a60d700 1 Processor -- start 2023-10-06T04:36:37.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.132+0000 7f2d7a60d700 1 -- start start 2023-10-06T04:36:37.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.133+0000 7f2d7a60d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d740c6df0 0x7f2d74146ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:37.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.133+0000 7f2d7a60d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d74159960 0x7f2d740c9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:37.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.133+0000 7f2d7a60d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d7415dd80 0x7f2d740c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:37.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.133+0000 7f2d7a60d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7416aeb0 con 0x7f2d740c6df0 2023-10-06T04:36:37.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.133+0000 7f2d7a60d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d74147420 con 0x7f2d7415dd80 2023-10-06T04:36:37.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.133+0000 7f2d7a60d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d741555d0 con 0x7f2d74159960 2023-10-06T04:36:37.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.133+0000 7f2d73fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d740c6df0 0x7f2d74146ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:37.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.133+0000 7f2d73fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d740c6df0 0x7f2d74146ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36342/0 (socket says 172.21.15.8:36342) 2023-10-06T04:36:37.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.133+0000 7f2d73fff700 1 -- 172.21.15.8:0/3906377087 learned_addr learned my addr 172.21.15.8:0/3906377087 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:37.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.133+0000 7f2d737fe700 1 --2- 172.21.15.8:0/3906377087 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d74159960 0x7f2d740c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:37.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.133+0000 7f2d78baa700 1 --2- 172.21.15.8:0/3906377087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d7415dd80 0x7f2d740c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:37.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.133+0000 7f2d73fff700 1 -- 172.21.15.8:0/3906377087 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d74159960 msgr2=0x7f2d740c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:37.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.133+0000 7f2d73fff700 1 --2- 172.21.15.8:0/3906377087 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d74159960 0x7f2d740c9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:37.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.133+0000 7f2d73fff700 1 -- 172.21.15.8:0/3906377087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d7415dd80 msgr2=0x7f2d740c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:37.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.133+0000 7f2d73fff700 1 --2- 172.21.15.8:0/3906377087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d7415dd80 0x7f2d740c9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:37.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.133+0000 7f2d73fff700 1 -- 172.21.15.8:0/3906377087 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d68009420 con 0x7f2d740c6df0 2023-10-06T04:36:37.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.133+0000 7f2d78baa700 1 --2- 172.21.15.8:0/3906377087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d7415dd80 0x7f2d740c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:37.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.133+0000 7f2d737fe700 1 --2- 172.21.15.8:0/3906377087 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d74159960 0x7f2d740c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:37.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.133+0000 7f2d73fff700 1 --2- 172.21.15.8:0/3906377087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d740c6df0 0x7f2d74146ee0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2d6400c7c0 tx=0x7f2d64007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:37.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.133+0000 7f2d5bfff700 1 -- 172.21.15.8:0/3906377087 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d64011590 con 0x7f2d740c6df0 2023-10-06T04:36:37.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.134+0000 7f2d5bfff700 1 -- 172.21.15.8:0/3906377087 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d64011710 con 0x7f2d740c6df0 2023-10-06T04:36:37.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.134+0000 7f2d7a60d700 1 -- 172.21.15.8:0/3906377087 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d7416a230 con 0x7f2d740c6df0 2023-10-06T04:36:37.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.134+0000 7f2d5bfff700 1 -- 172.21.15.8:0/3906377087 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d64011ad0 con 0x7f2d740c6df0 2023-10-06T04:36:37.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.134+0000 7f2d7a60d700 1 -- 172.21.15.8:0/3906377087 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d7416a7f0 con 0x7f2d740c6df0 2023-10-06T04:36:37.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.134+0000 7f2d7a60d700 1 -- 172.21.15.8:0/3906377087 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d74071550 con 0x7f2d740c6df0 2023-10-06T04:36:37.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.135+0000 7f2d5bfff700 1 -- 172.21.15.8:0/3906377087 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2d6401b3b0 con 0x7f2d740c6df0 2023-10-06T04:36:37.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.135+0000 7f2d5bfff700 1 --2- 172.21.15.8:0/3906377087 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2d60066f30 0x7f2d600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:37.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.136+0000 7f2d5bfff700 1 -- 172.21.15.8:0/3906377087 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f2d64083e80 con 0x7f2d740c6df0 2023-10-06T04:36:37.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.136+0000 7f2d737fe700 1 --2- 172.21.15.8:0/3906377087 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2d60066f30 0x7f2d600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:37.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.136+0000 7f2d737fe700 1 --2- 172.21.15.8:0/3906377087 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2d60066f30 0x7f2d600693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2d7415e180 tx=0x7f2d68017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:37.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.140+0000 7f2d5bfff700 1 -- 172.21.15.8:0/3906377087 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d64050d50 con 0x7f2d740c6df0 2023-10-06T04:36:37.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.385+0000 7f2d7a60d700 1 -- 172.21.15.8:0/3906377087 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2d740c5960 con 0x7f2d740c6df0 2023-10-06T04:36:37.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.385+0000 7f2d5bfff700 1 -- 172.21.15.8:0/3906377087 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f2d64017020 con 0x7f2d740c6df0 2023-10-06T04:36:37.388 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:36:37.388 INFO:teuthology.orchestra.run.smithi008.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-06T04:36:37.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.387+0000 7f2d7a60d700 1 -- 172.21.15.8:0/3906377087 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2d60066f30 msgr2=0x7f2d600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:37.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.387+0000 7f2d7a60d700 1 --2- 172.21.15.8:0/3906377087 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2d60066f30 0x7f2d600693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2d7415e180 tx=0x7f2d68017000 comp rx=0 tx=0).stop 2023-10-06T04:36:37.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.387+0000 7f2d7a60d700 1 -- 172.21.15.8:0/3906377087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d740c6df0 msgr2=0x7f2d74146ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:37.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.387+0000 7f2d7a60d700 1 --2- 172.21.15.8:0/3906377087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d740c6df0 0x7f2d74146ee0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2d6400c7c0 tx=0x7f2d64007f70 comp rx=0 tx=0).stop 2023-10-06T04:36:37.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.387+0000 7f2d7a60d700 1 -- 172.21.15.8:0/3906377087 shutdown_connections 2023-10-06T04:36:37.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.387+0000 7f2d7a60d700 1 --2- 172.21.15.8:0/3906377087 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2d60066f30 0x7f2d600693e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:37.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.387+0000 7f2d7a60d700 1 --2- 172.21.15.8:0/3906377087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d7415dd80 0x7f2d740c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:37.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.387+0000 7f2d7a60d700 1 --2- 172.21.15.8:0/3906377087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d740c6df0 0x7f2d74146ee0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:37.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.387+0000 7f2d7a60d700 1 --2- 172.21.15.8:0/3906377087 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d74159960 0x7f2d740c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:37.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.387+0000 7f2d7a60d700 1 -- 172.21.15.8:0/3906377087 >> 172.21.15.8:0/3906377087 conn(0x7f2d7406ed00 msgr2=0x7f2d74158400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:37.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.387+0000 7f2d7a60d700 1 -- 172.21.15.8:0/3906377087 shutdown_connections 2023-10-06T04:36:37.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.387+0000 7f2d7a60d700 1 -- 172.21.15.8:0/3906377087 wait complete. 2023-10-06T04:36:37.402 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-06T04:36:37.402 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:36:37.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.519+0000 7f1dd6718700 1 Processor -- start 2023-10-06T04:36:37.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.519+0000 7f1dd6718700 1 -- start start 2023-10-06T04:36:37.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.520+0000 7f1dd6718700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1dd0153740 0x7f1dd0153b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:37.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.520+0000 7f1dd6718700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1dd015d8e0 0x7f1dd00696c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:37.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.520+0000 7f1dd6718700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd015d170 con 0x7f1dd015a7b0 2023-10-06T04:36:37.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.520+0000 7f1dd6718700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd00ca990 con 0x7f1dd015d8e0 2023-10-06T04:36:37.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.520+0000 7f1dd6718700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd00cac70 con 0x7f1dd0153740 2023-10-06T04:36:37.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.520+0000 7f1dd5f17700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1dd015d8e0 0x7f1dd00696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:37.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.520+0000 7f1dd5f17700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1dd015d8e0 0x7f1dd00696c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36352/0 (socket says 172.21.15.8:36352) 2023-10-06T04:36:37.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.520+0000 7f1dd5f17700 1 -- 172.21.15.8:0/913935006 learned_addr learned my addr 172.21.15.8:0/913935006 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:37.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.520+0000 7f1dd5716700 1 --2- 172.21.15.8:0/913935006 >> v2:172.21.15.184:3300/0 conn(0x7f1dd0153740 0x7f1dd0153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:37.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.520+0000 7f1dd5f17700 1 -- 172.21.15.8:0/913935006 >> v2:172.21.15.184:3300/0 conn(0x7f1dd0153740 msgr2=0x7f1dd0153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:37.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.520+0000 7f1dd5f17700 1 --2- 172.21.15.8:0/913935006 >> v2:172.21.15.184:3300/0 conn(0x7f1dd0153740 0x7f1dd0153b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:37.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.520+0000 7f1dd5f17700 1 -- 172.21.15.8:0/913935006 >> v1:172.21.15.184:6789/0 conn(0x7f1dd015a7b0 legacy=0x7f1dd00cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:37.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.520+0000 7f1dd5f17700 1 -- 172.21.15.8:0/913935006 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd00caf50 con 0x7f1dd015d8e0 2023-10-06T04:36:37.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.521+0000 7f1dd5f17700 1 --2- 172.21.15.8:0/913935006 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1dd015d8e0 0x7f1dd00696c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1dd00692b0 tx=0x7f1dc0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75af5e32c1e714b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:37.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.521+0000 7f1dcffff700 1 -- 172.21.15.8:0/913935006 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc000e070 con 0x7f1dd015d8e0 2023-10-06T04:36:37.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.521+0000 7f1dcffff700 1 -- 172.21.15.8:0/913935006 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc000ba10 con 0x7f1dd015d8e0 2023-10-06T04:36:37.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.521+0000 7f1dcffff700 1 -- 172.21.15.8:0/913935006 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc00092e0 con 0x7f1dd015d8e0 2023-10-06T04:36:37.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.521+0000 7f1dd6718700 1 -- 172.21.15.8:0/913935006 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1dd015d8e0 msgr2=0x7f1dd00696c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:37.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.521+0000 7f1dd6718700 1 --2- 172.21.15.8:0/913935006 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1dd015d8e0 0x7f1dd00696c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1dd00692b0 tx=0x7f1dc0009840 comp rx=0 tx=0).stop 2023-10-06T04:36:37.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.521+0000 7f1dd6718700 1 -- 172.21.15.8:0/913935006 shutdown_connections 2023-10-06T04:36:37.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.521+0000 7f1dd6718700 1 --2- 172.21.15.8:0/913935006 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1dd015d8e0 0x7f1dd00696c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:37.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.521+0000 7f1dd6718700 1 --2- 172.21.15.8:0/913935006 >> v2:172.21.15.184:3300/0 conn(0x7f1dd0153740 0x7f1dd0153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:37.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.521+0000 7f1dd6718700 1 -- 172.21.15.8:0/913935006 >> 172.21.15.8:0/913935006 conn(0x7f1dd00d02b0 msgr2=0x7f1dd00d06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:37.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.521+0000 7f1dd6718700 1 -- 172.21.15.8:0/913935006 shutdown_connections 2023-10-06T04:36:37.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.521+0000 7f1dd6718700 1 -- 172.21.15.8:0/913935006 wait complete. 2023-10-06T04:36:37.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.523+0000 7f1dd6718700 1 Processor -- start 2023-10-06T04:36:37.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.523+0000 7f1dd6718700 1 -- start start 2023-10-06T04:36:37.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.523+0000 7f1dd6718700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dd0153740 0x7f1dd0152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:37.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.523+0000 7f1dd6718700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1dd015a7b0 0x7f1dd00c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:37.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.523+0000 7f1dd6718700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1dd015d8e0 0x7f1dd00c6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:37.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.523+0000 7f1dd6718700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd00b3e00 con 0x7f1dd015d8e0 2023-10-06T04:36:37.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.523+0000 7f1dd6718700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd00b3180 con 0x7f1dd0153740 2023-10-06T04:36:37.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.523+0000 7f1dd6718700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd00b3460 con 0x7f1dd015a7b0 2023-10-06T04:36:37.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.523+0000 7f1dd5f17700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1dd015d8e0 0x7f1dd00c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:37.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.524+0000 7f1dd5f17700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1dd015d8e0 0x7f1dd00c6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36364/0 (socket says 172.21.15.8:36364) 2023-10-06T04:36:37.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.524+0000 7f1dd5f17700 1 -- 172.21.15.8:0/874312881 learned_addr learned my addr 172.21.15.8:0/874312881 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:37.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.524+0000 7f1dd4f15700 1 --2- 172.21.15.8:0/874312881 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1dd015a7b0 0x7f1dd00c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:37.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.524+0000 7f1dd5716700 1 --2- 172.21.15.8:0/874312881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dd0153740 0x7f1dd0152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:37.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.524+0000 7f1dd5f17700 1 -- 172.21.15.8:0/874312881 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1dd015a7b0 msgr2=0x7f1dd00c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:37.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.524+0000 7f1dd5f17700 1 --2- 172.21.15.8:0/874312881 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1dd015a7b0 0x7f1dd00c8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:37.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.524+0000 7f1dd5f17700 1 -- 172.21.15.8:0/874312881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dd0153740 msgr2=0x7f1dd0152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:37.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.524+0000 7f1dd5f17700 1 --2- 172.21.15.8:0/874312881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dd0153740 0x7f1dd0152000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:37.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.524+0000 7f1dd5f17700 1 -- 172.21.15.8:0/874312881 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc0009ae0 con 0x7f1dd015d8e0 2023-10-06T04:36:37.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.524+0000 7f1dd5f17700 1 --2- 172.21.15.8:0/874312881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1dd015d8e0 0x7f1dd00c6020 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1dd00894c0 tx=0x7f1dc0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:37.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.524+0000 7f1dcd7fa700 1 -- 172.21.15.8:0/874312881 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc0012e60 con 0x7f1dd015d8e0 2023-10-06T04:36:37.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.524+0000 7f1dcd7fa700 1 -- 172.21.15.8:0/874312881 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc001d420 con 0x7f1dd015d8e0 2023-10-06T04:36:37.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.524+0000 7f1dd6718700 1 -- 172.21.15.8:0/874312881 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd00b3740 con 0x7f1dd015d8e0 2023-10-06T04:36:37.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.524+0000 7f1dcd7fa700 1 -- 172.21.15.8:0/874312881 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc001d7e0 con 0x7f1dd015d8e0 2023-10-06T04:36:37.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.524+0000 7f1dd6718700 1 -- 172.21.15.8:0/874312881 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd00c9e20 con 0x7f1dd015d8e0 2023-10-06T04:36:37.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.525+0000 7f1dd6718700 1 -- 172.21.15.8:0/874312881 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd00b3f40 con 0x7f1dd015d8e0 2023-10-06T04:36:37.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.526+0000 7f1dcd7fa700 1 -- 172.21.15.8:0/874312881 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1dc001db90 con 0x7f1dd015d8e0 2023-10-06T04:36:37.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.526+0000 7f1dcd7fa700 1 --2- 172.21.15.8:0/874312881 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1dbc066f30 0x7f1dbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:37.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.526+0000 7f1dcd7fa700 1 -- 172.21.15.8:0/874312881 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1dc0086260 con 0x7f1dd015d8e0 2023-10-06T04:36:37.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.526+0000 7f1dd5716700 1 --2- 172.21.15.8:0/874312881 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1dbc066f30 0x7f1dbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:37.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.527+0000 7f1dd5716700 1 --2- 172.21.15.8:0/874312881 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1dbc066f30 0x7f1dbc0693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1dc800ab10 tx=0x7f1dc8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:37.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.531+0000 7f1dcd7fa700 1 -- 172.21.15.8:0/874312881 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1dd00b3f40 con 0x7f1dd015d8e0 2023-10-06T04:36:37.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.723+0000 7f1dd6718700 1 -- 172.21.15.8:0/874312881 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1dd00b3f40 con 0x7f1dd015d8e0 2023-10-06T04:36:37.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.724+0000 7f1dcd7fa700 1 -- 172.21.15.8:0/874312881 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f1dd00b3f40 con 0x7f1dd015d8e0 2023-10-06T04:36:37.727 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:36:37.727 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":25,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:36:21.690266+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:36:10.148177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:36:10.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:36:14.390671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:36:15.601089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:36:19.291300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.555871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.490505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.504578+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.517217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:05.991135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.537329+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.543232+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.443715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:36:37.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.726+0000 7f1dd6718700 1 -- 172.21.15.8:0/874312881 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1dbc066f30 msgr2=0x7f1dbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:37.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.726+0000 7f1dd6718700 1 --2- 172.21.15.8:0/874312881 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1dbc066f30 0x7f1dbc0693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1dc800ab10 tx=0x7f1dc8008040 comp rx=0 tx=0).stop 2023-10-06T04:36:37.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.726+0000 7f1dd6718700 1 -- 172.21.15.8:0/874312881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1dd015d8e0 msgr2=0x7f1dd00c6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:37.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.726+0000 7f1dd6718700 1 --2- 172.21.15.8:0/874312881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1dd015d8e0 0x7f1dd00c6020 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1dd00894c0 tx=0x7f1dc0017000 comp rx=0 tx=0).stop 2023-10-06T04:36:37.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.726+0000 7f1dd6718700 1 -- 172.21.15.8:0/874312881 shutdown_connections 2023-10-06T04:36:37.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.726+0000 7f1dd6718700 1 --2- 172.21.15.8:0/874312881 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1dbc066f30 0x7f1dbc0693e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:37.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.726+0000 7f1dd6718700 1 --2- 172.21.15.8:0/874312881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1dd015d8e0 0x7f1dd00c6020 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:37.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.726+0000 7f1dd6718700 1 --2- 172.21.15.8:0/874312881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dd0153740 0x7f1dd0152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:37.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.726+0000 7f1dd6718700 1 --2- 172.21.15.8:0/874312881 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1dd015a7b0 0x7f1dd00c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:37.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.726+0000 7f1dd6718700 1 -- 172.21.15.8:0/874312881 >> 172.21.15.8:0/874312881 conn(0x7f1dd00d02b0 msgr2=0x7f1dd0152dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:37.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.726+0000 7f1dd6718700 1 -- 172.21.15.8:0/874312881 shutdown_connections 2023-10-06T04:36:37.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.726+0000 7f1dd6718700 1 -- 172.21.15.8:0/874312881 wait complete. 2023-10-06T04:36:37.741 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:36:10.148177+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:36:10.684157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:36:14.390671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:36:15.601089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T04:36:19.291300+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:36:37.742 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:36:37.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.861+0000 7f97c34dc700 1 Processor -- start 2023-10-06T04:36:37.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.862+0000 7f97c34dc700 1 -- start start 2023-10-06T04:36:37.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.863+0000 7f97c34dc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97bc142cf0 0x7f97bc0b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:37.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.863+0000 7f97c34dc700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f97bc1430c0 0x7f97bc0cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:37.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.863+0000 7f97c34dc700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f97bc0cfee0 0x7f97bc0b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:37.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.863+0000 7f97c34dc700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97bc0cf510 con 0x7f97bc0cfee0 2023-10-06T04:36:37.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.863+0000 7f97c34dc700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97bc0ce6a0 con 0x7f97bc1430c0 2023-10-06T04:36:37.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.863+0000 7f97c34dc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc0ce900 con 0x7f97bc142cf0 2023-10-06T04:36:37.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.863+0000 7f97c1a79700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f97bc0cfee0 0x7f97bc0b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:37.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.863+0000 7f97c1a79700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f97bc0cfee0 0x7f97bc0b3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36368/0 (socket says 172.21.15.8:36368) 2023-10-06T04:36:37.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.863+0000 7f97c1a79700 1 -- 172.21.15.8:0/3171847444 learned_addr learned my addr 172.21.15.8:0/3171847444 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:37.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.863+0000 7f97c1278700 1 --2- 172.21.15.8:0/3171847444 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97bc142cf0 0x7f97bc0b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:37.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.863+0000 7f97c0a77700 1 --2- 172.21.15.8:0/3171847444 >> v2:172.21.15.184:3300/0 conn(0x7f97bc1430c0 0x7f97bc0cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:37.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.863+0000 7f97c1a79700 1 -- 172.21.15.8:0/3171847444 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97bc142cf0 msgr2=0x7f97bc0b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:37.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.863+0000 7f97c1a79700 1 --2- 172.21.15.8:0/3171847444 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97bc142cf0 0x7f97bc0b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:37.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.863+0000 7f97c1a79700 1 -- 172.21.15.8:0/3171847444 >> v2:172.21.15.184:3300/0 conn(0x7f97bc1430c0 msgr2=0x7f97bc0cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:37.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.863+0000 7f97c1a79700 1 --2- 172.21.15.8:0/3171847444 >> v2:172.21.15.184:3300/0 conn(0x7f97bc1430c0 0x7f97bc0cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:37.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.863+0000 7f97c1a79700 1 -- 172.21.15.8:0/3171847444 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97bc0cebe0 con 0x7f97bc0cfee0 2023-10-06T04:36:37.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.863+0000 7f97c0a77700 1 --2- 172.21.15.8:0/3171847444 >> v2:172.21.15.184:3300/0 conn(0x7f97bc1430c0 0x7f97bc0cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:36:37.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.863+0000 7f97c1a79700 1 --2- 172.21.15.8:0/3171847444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97bc0cfee0 0x7f97bc0b3790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f97bc068010 tx=0x7f97b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cfea765d1470bf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:37.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.863+0000 7f97bbfff700 1 -- 172.21.15.8:0/3171847444 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b400b860 con 0x7f97bc0cfee0 2023-10-06T04:36:37.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.863+0000 7f97bbfff700 1 -- 172.21.15.8:0/3171847444 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b400b9c0 con 0x7f97bc0cfee0 2023-10-06T04:36:37.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.863+0000 7f97bbfff700 1 -- 172.21.15.8:0/3171847444 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b400bd60 con 0x7f97bc0cfee0 2023-10-06T04:36:37.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.864+0000 7f97c34dc700 1 -- 172.21.15.8:0/3171847444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97bc0cfee0 msgr2=0x7f97bc0b3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:37.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.864+0000 7f97c34dc700 1 --2- 172.21.15.8:0/3171847444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97bc0cfee0 0x7f97bc0b3790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f97bc068010 tx=0x7f97b4009250 comp rx=0 tx=0).stop 2023-10-06T04:36:37.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.864+0000 7f97c34dc700 1 -- 172.21.15.8:0/3171847444 shutdown_connections 2023-10-06T04:36:37.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.864+0000 7f97c34dc700 1 --2- 172.21.15.8:0/3171847444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97bc0cfee0 0x7f97bc0b3790 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:37.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.864+0000 7f97c34dc700 1 --2- 172.21.15.8:0/3171847444 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97bc142cf0 0x7f97bc0b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:37.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.864+0000 7f97c34dc700 1 --2- 172.21.15.8:0/3171847444 >> v2:172.21.15.184:3300/0 conn(0x7f97bc1430c0 0x7f97bc0cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:37.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.864+0000 7f97c34dc700 1 -- 172.21.15.8:0/3171847444 >> 172.21.15.8:0/3171847444 conn(0x7f97bc06ed00 msgr2=0x7f97bc06f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:37.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.864+0000 7f97c34dc700 1 -- 172.21.15.8:0/3171847444 shutdown_connections 2023-10-06T04:36:37.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.864+0000 7f97c34dc700 1 -- 172.21.15.8:0/3171847444 wait complete. 2023-10-06T04:36:37.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.865+0000 7f97c34dc700 1 Processor -- start 2023-10-06T04:36:37.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.865+0000 7f97c34dc700 1 -- start start 2023-10-06T04:36:37.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.866+0000 7f97c34dc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97bc0cfee0 0x7f97bc13c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:37.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.866+0000 7f97c34dc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97bc142cf0 0x7f97bc1566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:37.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.866+0000 7f97c34dc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97bc1430c0 0x7f97bc13df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:37.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.866+0000 7f97c34dc700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc157b80 con 0x7f97bc0cfee0 2023-10-06T04:36:37.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.866+0000 7f97c34dc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc13cac0 con 0x7f97bc1430c0 2023-10-06T04:36:37.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.866+0000 7f97c34dc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc156bf0 con 0x7f97bc142cf0 2023-10-06T04:36:37.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.866+0000 7f97c1278700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97bc0cfee0 0x7f97bc13c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:37.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.866+0000 7f97c1278700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97bc0cfee0 0x7f97bc13c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36380/0 (socket says 172.21.15.8:36380) 2023-10-06T04:36:37.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.866+0000 7f97c1278700 1 -- 172.21.15.8:0/1690987592 learned_addr learned my addr 172.21.15.8:0/1690987592 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:37.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.866+0000 7f97c0a77700 1 --2- 172.21.15.8:0/1690987592 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97bc142cf0 0x7f97bc1566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:37.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.866+0000 7f97c1a79700 1 --2- 172.21.15.8:0/1690987592 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97bc1430c0 0x7f97bc13df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:37.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.867+0000 7f97c1278700 1 -- 172.21.15.8:0/1690987592 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97bc142cf0 msgr2=0x7f97bc1566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:37.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.867+0000 7f97c1278700 1 --2- 172.21.15.8:0/1690987592 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97bc142cf0 0x7f97bc1566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:37.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.867+0000 7f97c1278700 1 -- 172.21.15.8:0/1690987592 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97bc1430c0 msgr2=0x7f97bc13df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:37.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.867+0000 7f97c1278700 1 --2- 172.21.15.8:0/1690987592 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97bc1430c0 0x7f97bc13df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:37.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.867+0000 7f97c1278700 1 -- 172.21.15.8:0/1690987592 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b40094f0 con 0x7f97bc0cfee0 2023-10-06T04:36:37.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.867+0000 7f97c1278700 1 --2- 172.21.15.8:0/1690987592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97bc0cfee0 0x7f97bc13c580 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f97ac00e190 tx=0x7f97ac009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:37.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.867+0000 7f97b97fa700 1 -- 172.21.15.8:0/1690987592 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac00ecd0 con 0x7f97bc0cfee0 2023-10-06T04:36:37.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.867+0000 7f97b97fa700 1 -- 172.21.15.8:0/1690987592 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97ac00ee30 con 0x7f97bc0cfee0 2023-10-06T04:36:37.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.867+0000 7f97c34dc700 1 -- 172.21.15.8:0/1690987592 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97bc140550 con 0x7f97bc0cfee0 2023-10-06T04:36:37.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.867+0000 7f97b97fa700 1 -- 172.21.15.8:0/1690987592 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac014670 con 0x7f97bc0cfee0 2023-10-06T04:36:37.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.867+0000 7f97c34dc700 1 -- 172.21.15.8:0/1690987592 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97bc157810 con 0x7f97bc0cfee0 2023-10-06T04:36:37.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.868+0000 7f97c34dc700 1 -- 172.21.15.8:0/1690987592 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97bc157390 con 0x7f97bc0cfee0 2023-10-06T04:36:37.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.868+0000 7f97b97fa700 1 -- 172.21.15.8:0/1690987592 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f97ac014a20 con 0x7f97bc0cfee0 2023-10-06T04:36:37.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.869+0000 7f97b97fa700 1 --2- 172.21.15.8:0/1690987592 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f97a8066f30 0x7f97a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:37.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.869+0000 7f97b97fa700 1 -- 172.21.15.8:0/1690987592 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f97ac085040 con 0x7f97bc0cfee0 2023-10-06T04:36:37.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.869+0000 7f97c0a77700 1 --2- 172.21.15.8:0/1690987592 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f97a8066f30 0x7f97a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:37.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.869+0000 7f97c0a77700 1 --2- 172.21.15.8:0/1690987592 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f97a8066f30 0x7f97a80693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f97bc16cbb0 tx=0x7f97b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:37.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:37.873+0000 7f97b97fa700 1 -- 172.21.15.8:0/1690987592 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f97bc157390 con 0x7f97bc0cfee0 2023-10-06T04:36:38.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.065+0000 7f97c34dc700 1 -- 172.21.15.8:0/1690987592 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f97bc157390 con 0x7f97bc0cfee0 2023-10-06T04:36:38.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.065+0000 7f97b97fa700 1 -- 172.21.15.8:0/1690987592 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f97bc157390 con 0x7f97bc0cfee0 2023-10-06T04:36:38.067 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 8 2023-10-06T04:36:38.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.067+0000 7f97c34dc700 1 -- 172.21.15.8:0/1690987592 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f97a8066f30 msgr2=0x7f97a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:38.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.067+0000 7f97c34dc700 1 --2- 172.21.15.8:0/1690987592 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f97a8066f30 0x7f97a80693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f97bc16cbb0 tx=0x7f97b0008040 comp rx=0 tx=0).stop 2023-10-06T04:36:38.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.067+0000 7f97c34dc700 1 -- 172.21.15.8:0/1690987592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97bc0cfee0 msgr2=0x7f97bc13c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:38.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.067+0000 7f97c34dc700 1 --2- 172.21.15.8:0/1690987592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97bc0cfee0 0x7f97bc13c580 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f97ac00e190 tx=0x7f97ac009920 comp rx=0 tx=0).stop 2023-10-06T04:36:38.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.067+0000 7f97c34dc700 1 -- 172.21.15.8:0/1690987592 shutdown_connections 2023-10-06T04:36:38.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.067+0000 7f97c34dc700 1 --2- 172.21.15.8:0/1690987592 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f97a8066f30 0x7f97a80693e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:38.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.067+0000 7f97c34dc700 1 --2- 172.21.15.8:0/1690987592 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97bc1430c0 0x7f97bc13df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:38.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.067+0000 7f97c34dc700 1 --2- 172.21.15.8:0/1690987592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97bc0cfee0 0x7f97bc13c580 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:38.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.067+0000 7f97c34dc700 1 --2- 172.21.15.8:0/1690987592 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97bc142cf0 0x7f97bc1566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:38.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.067+0000 7f97c34dc700 1 -- 172.21.15.8:0/1690987592 >> 172.21.15.8:0/1690987592 conn(0x7f97bc06ed00 msgr2=0x7f97bc0b3790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:38.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.067+0000 7f97c34dc700 1 -- 172.21.15.8:0/1690987592 shutdown_connections 2023-10-06T04:36:38.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.067+0000 7f97c34dc700 1 -- 172.21.15.8:0/1690987592 wait complete. 2023-10-06T04:36:38.081 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:36:38.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.200+0000 7feca8fc5700 1 Processor -- start 2023-10-06T04:36:38.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.200+0000 7feca8fc5700 1 -- start start 2023-10-06T04:36:38.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.201+0000 7feca8fc5700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7feca40b3790 0x7feca40b3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:38.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.201+0000 7feca8fc5700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feca40cf510 con 0x7feca41430c0 2023-10-06T04:36:38.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.201+0000 7feca8fc5700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feca40ce6a0 con 0x7feca4142cf0 2023-10-06T04:36:38.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.201+0000 7feca8fc5700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feca40b40d0 con 0x7feca40b3790 2023-10-06T04:36:38.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.201+0000 7feca2d9d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7feca40b3790 0x7feca40b3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:38.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.201+0000 7feca2d9d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7feca40b3790 0x7feca40b3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36386/0 (socket says 172.21.15.8:36386) 2023-10-06T04:36:38.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.201+0000 7feca1d9b700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7feca41430c0 0x7feca40cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:52560/0 (socket says 172.21.15.8:52560) 2023-10-06T04:36:38.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.201+0000 7feca2d9d700 1 -- 172.21.15.8:0/2933438683 learned_addr learned my addr 172.21.15.8:0/2933438683 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:38.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.202+0000 7feca2d9d700 1 -- 172.21.15.8:0/2933438683 >> v1:172.21.15.184:6789/0 conn(0x7feca4142cf0 legacy=0x7feca40b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:38.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.202+0000 7feca2d9d700 1 -- 172.21.15.8:0/2933438683 >> v1:172.21.15.8:6789/0 conn(0x7feca41430c0 legacy=0x7feca40cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:38.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.202+0000 7feca159a700 1 -- 172.21.15.8:0/2933438683 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1704699575 0 0) 0x7feca40cf510 con 0x7feca41430c0 2023-10-06T04:36:38.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.202+0000 7feca2d9d700 1 -- 172.21.15.8:0/2933438683 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca40ce900 con 0x7feca40b3790 2023-10-06T04:36:38.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.202+0000 7feca2d9d700 1 --2- 172.21.15.8:0/2933438683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feca40b3790 0x7feca40b3b90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fec9c0099b0 tx=0x7fec9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11f494cad8d737c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:38.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.202+0000 7feca159a700 1 -- 172.21.15.8:0/2933438683 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c00b860 con 0x7feca40b3790 2023-10-06T04:36:38.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.202+0000 7feca159a700 1 -- 172.21.15.8:0/2933438683 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9c00b9c0 con 0x7feca40b3790 2023-10-06T04:36:38.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.202+0000 7feca159a700 1 -- 172.21.15.8:0/2933438683 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c00bd60 con 0x7feca40b3790 2023-10-06T04:36:38.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.203+0000 7feca8fc5700 1 -- 172.21.15.8:0/2933438683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feca40b3790 msgr2=0x7feca40b3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:38.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.203+0000 7feca8fc5700 1 --2- 172.21.15.8:0/2933438683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feca40b3790 0x7feca40b3b90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fec9c0099b0 tx=0x7fec9c009250 comp rx=0 tx=0).stop 2023-10-06T04:36:38.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.203+0000 7feca8fc5700 1 -- 172.21.15.8:0/2933438683 shutdown_connections 2023-10-06T04:36:38.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.203+0000 7feca8fc5700 1 --2- 172.21.15.8:0/2933438683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feca40b3790 0x7feca40b3b90 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:38.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.203+0000 7feca8fc5700 1 -- 172.21.15.8:0/2933438683 >> 172.21.15.8:0/2933438683 conn(0x7feca406ed00 msgr2=0x7feca406f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:38.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.203+0000 7feca8fc5700 1 -- 172.21.15.8:0/2933438683 shutdown_connections 2023-10-06T04:36:38.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.203+0000 7feca8fc5700 1 -- 172.21.15.8:0/2933438683 wait complete. 2023-10-06T04:36:38.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.204+0000 7feca8fc5700 1 Processor -- start 2023-10-06T04:36:38.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.204+0000 7feca8fc5700 1 -- start start 2023-10-06T04:36:38.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.205+0000 7feca8fc5700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feca40b3790 0x7feca40a9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:38.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.205+0000 7feca8fc5700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feca4142cf0 0x7feca40a9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:38.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.205+0000 7feca8fc5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feca41430c0 0x7feca4169ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:38.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.205+0000 7feca8fc5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca416b780 con 0x7feca41430c0 2023-10-06T04:36:38.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.205+0000 7feca8fc5700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca416ae50 con 0x7feca40b3790 2023-10-06T04:36:38.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.205+0000 7feca8fc5700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca416b130 con 0x7feca4142cf0 2023-10-06T04:36:38.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.205+0000 7feca2d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feca41430c0 0x7feca4169ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:38.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.205+0000 7feca2d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feca41430c0 0x7feca4169ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36394/0 (socket says 172.21.15.8:36394) 2023-10-06T04:36:38.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.205+0000 7feca2d9d700 1 -- 172.21.15.8:0/253196459 learned_addr learned my addr 172.21.15.8:0/253196459 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:38.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.205+0000 7feca1d9b700 1 --2- 172.21.15.8:0/253196459 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feca4142cf0 0x7feca40a9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:38.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.205+0000 7feca259c700 1 --2- 172.21.15.8:0/253196459 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feca40b3790 0x7feca40a9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:38.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.205+0000 7feca2d9d700 1 -- 172.21.15.8:0/253196459 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feca4142cf0 msgr2=0x7feca40a9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:38.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.205+0000 7feca2d9d700 1 --2- 172.21.15.8:0/253196459 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feca4142cf0 0x7feca40a9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:38.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.205+0000 7feca2d9d700 1 -- 172.21.15.8:0/253196459 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feca40b3790 msgr2=0x7feca40a9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:38.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.205+0000 7feca2d9d700 1 --2- 172.21.15.8:0/253196459 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feca40b3790 0x7feca40a9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:38.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.205+0000 7feca2d9d700 1 -- 172.21.15.8:0/253196459 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec9c0094f0 con 0x7feca41430c0 2023-10-06T04:36:38.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.205+0000 7feca2d9d700 1 --2- 172.21.15.8:0/253196459 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feca41430c0 0x7feca4169ae0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fec9c006f50 tx=0x7fec9c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:38.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.205+0000 7fec9a7fc700 1 -- 172.21.15.8:0/253196459 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c01f070 con 0x7feca41430c0 2023-10-06T04:36:38.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.205+0000 7fec9a7fc700 1 -- 172.21.15.8:0/253196459 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9c002f70 con 0x7feca41430c0 2023-10-06T04:36:38.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.205+0000 7feca8fc5700 1 -- 172.21.15.8:0/253196459 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca416b410 con 0x7feca41430c0 2023-10-06T04:36:38.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.205+0000 7fec9a7fc700 1 -- 172.21.15.8:0/253196459 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c011ea0 con 0x7feca41430c0 2023-10-06T04:36:38.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.205+0000 7feca8fc5700 1 -- 172.21.15.8:0/253196459 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca416a1e0 con 0x7feca41430c0 2023-10-06T04:36:38.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.206+0000 7feca8fc5700 1 -- 172.21.15.8:0/253196459 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feca416b930 con 0x7feca41430c0 2023-10-06T04:36:38.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.207+0000 7fec9a7fc700 1 -- 172.21.15.8:0/253196459 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fec9c023070 con 0x7feca41430c0 2023-10-06T04:36:38.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.207+0000 7fec9a7fc700 1 --2- 172.21.15.8:0/253196459 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fec84066f30 0x7fec840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:38.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.207+0000 7fec9a7fc700 1 -- 172.21.15.8:0/253196459 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fec9c085e80 con 0x7feca41430c0 2023-10-06T04:36:38.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.207+0000 7feca259c700 1 --2- 172.21.15.8:0/253196459 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fec84066f30 0x7fec840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:38.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.208+0000 7feca259c700 1 --2- 172.21.15.8:0/253196459 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fec84066f30 0x7fec840693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fec94007fd0 tx=0x7fec940016f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:38.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.212+0000 7fec9a7fc700 1 -- 172.21.15.8:0/253196459 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec9c052ce0 con 0x7feca41430c0 2023-10-06T04:36:38.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.405+0000 7feca8fc5700 1 -- 172.21.15.8:0/253196459 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feca4071550 con 0x7feca41430c0 2023-10-06T04:36:38.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.406+0000 7fec9a7fc700 1 -- 172.21.15.8:0/253196459 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fec9c0150a0 con 0x7feca41430c0 2023-10-06T04:36:38.408 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-06T04:36:38.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.408+0000 7feca8fc5700 1 -- 172.21.15.8:0/253196459 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fec84066f30 msgr2=0x7fec840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:38.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.408+0000 7feca8fc5700 1 --2- 172.21.15.8:0/253196459 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fec84066f30 0x7fec840693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fec94007fd0 tx=0x7fec940016f0 comp rx=0 tx=0).stop 2023-10-06T04:36:38.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.408+0000 7feca8fc5700 1 -- 172.21.15.8:0/253196459 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feca41430c0 msgr2=0x7feca4169ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:38.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.408+0000 7feca8fc5700 1 --2- 172.21.15.8:0/253196459 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feca41430c0 0x7feca4169ae0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fec9c006f50 tx=0x7fec9c017000 comp rx=0 tx=0).stop 2023-10-06T04:36:38.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.408+0000 7feca8fc5700 1 -- 172.21.15.8:0/253196459 shutdown_connections 2023-10-06T04:36:38.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.408+0000 7feca8fc5700 1 --2- 172.21.15.8:0/253196459 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fec84066f30 0x7fec840693e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:38.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.408+0000 7feca8fc5700 1 --2- 172.21.15.8:0/253196459 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feca41430c0 0x7feca4169ae0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:38.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.408+0000 7feca8fc5700 1 --2- 172.21.15.8:0/253196459 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feca40b3790 0x7feca40a9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:38.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.408+0000 7feca8fc5700 1 --2- 172.21.15.8:0/253196459 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feca4142cf0 0x7feca40a9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:38.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.408+0000 7feca8fc5700 1 -- 172.21.15.8:0/253196459 >> 172.21.15.8:0/253196459 conn(0x7feca406ed00 msgr2=0x7feca415bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:38.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.408+0000 7feca8fc5700 1 -- 172.21.15.8:0/253196459 shutdown_connections 2023-10-06T04:36:38.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.408+0000 7feca8fc5700 1 -- 172.21.15.8:0/253196459 wait complete. 2023-10-06T04:36:38.422 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:36:38.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.542+0000 7fe07f1c8700 1 Processor -- start 2023-10-06T04:36:38.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.542+0000 7fe07f1c8700 1 -- start start 2023-10-06T04:36:38.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.542+0000 7fe07f1c8700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe0780b3790 0x7fe0780b3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:38.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.542+0000 7fe07f1c8700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0780cf510 con 0x7fe078142cf0 2023-10-06T04:36:38.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.542+0000 7fe07f1c8700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0780ce6a0 con 0x7fe0781430c0 2023-10-06T04:36:38.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.542+0000 7fe07f1c8700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0780b40d0 con 0x7fe0780b3790 2023-10-06T04:36:38.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.543+0000 7fe07cf64700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe078142cf0 0x7fe0780b5cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:52570/0 (socket says 172.21.15.8:52570) 2023-10-06T04:36:38.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.543+0000 7fe07cf64700 1 -- 172.21.15.8:0/2007771048 learned_addr learned my addr 172.21.15.8:0/2007771048 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:38.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.543+0000 7fe07d765700 1 --2- 172.21.15.8:0/2007771048 >> v2:172.21.15.184:3300/0 conn(0x7fe0780b3790 0x7fe0780b3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:38.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.543+0000 7fe0777fe700 1 -- 172.21.15.8:0/2007771048 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3055626344 0 0) 0x7fe0780cf510 con 0x7fe078142cf0 2023-10-06T04:36:38.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.543+0000 7fe0777fe700 1 -- 172.21.15.8:0/2007771048 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe064003570 con 0x7fe078142cf0 2023-10-06T04:36:38.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.543+0000 7fe07d765700 1 -- 172.21.15.8:0/2007771048 >> v1:172.21.15.184:6789/0 conn(0x7fe0781430c0 legacy=0x7fe0780cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:38.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.543+0000 7fe0777fe700 1 -- 172.21.15.8:0/2007771048 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 668848293 0 0) 0x7fe0780ce6a0 con 0x7fe0781430c0 2023-10-06T04:36:38.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.543+0000 7fe07d765700 1 -- 172.21.15.8:0/2007771048 >> v1:172.21.15.8:6789/0 conn(0x7fe078142cf0 legacy=0x7fe0780b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:38.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.543+0000 7fe07d765700 1 -- 172.21.15.8:0/2007771048 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0780ce900 con 0x7fe0780b3790 2023-10-06T04:36:38.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.543+0000 7fe07d765700 1 --2- 172.21.15.8:0/2007771048 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0780b3790 0x7fe0780b3b90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe0600098e0 tx=0x7fe0600091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51225e858a4efce9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:38.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.543+0000 7fe0777fe700 1 -- 172.21.15.8:0/2007771048 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06000b640 con 0x7fe0780b3790 2023-10-06T04:36:38.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.543+0000 7fe0777fe700 1 -- 172.21.15.8:0/2007771048 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06000b7a0 con 0x7fe0780b3790 2023-10-06T04:36:38.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.543+0000 7fe0777fe700 1 -- 172.21.15.8:0/2007771048 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06000bb40 con 0x7fe0780b3790 2023-10-06T04:36:38.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.544+0000 7fe07f1c8700 1 -- 172.21.15.8:0/2007771048 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0780b3790 msgr2=0x7fe0780b3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:38.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.544+0000 7fe07f1c8700 1 --2- 172.21.15.8:0/2007771048 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0780b3790 0x7fe0780b3b90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe0600098e0 tx=0x7fe0600091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:38.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.544+0000 7fe07f1c8700 1 -- 172.21.15.8:0/2007771048 shutdown_connections 2023-10-06T04:36:38.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.544+0000 7fe07f1c8700 1 --2- 172.21.15.8:0/2007771048 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0780b3790 0x7fe0780b3b90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:38.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.544+0000 7fe07f1c8700 1 -- 172.21.15.8:0/2007771048 >> 172.21.15.8:0/2007771048 conn(0x7fe07806ed00 msgr2=0x7fe07806f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:38.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.544+0000 7fe07f1c8700 1 -- 172.21.15.8:0/2007771048 shutdown_connections 2023-10-06T04:36:38.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.544+0000 7fe07f1c8700 1 -- 172.21.15.8:0/2007771048 wait complete. 2023-10-06T04:36:38.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.545+0000 7fe07f1c8700 1 Processor -- start 2023-10-06T04:36:38.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.545+0000 7fe07f1c8700 1 -- start start 2023-10-06T04:36:38.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.546+0000 7fe07f1c8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0780b3790 0x7fe07813f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:38.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.546+0000 7fe07f1c8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe078142cf0 0x7fe078158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:38.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.546+0000 7fe07f1c8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0781430c0 0x7fe07816cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:38.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.546+0000 7fe07f1c8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0780c51f0 con 0x7fe0781430c0 2023-10-06T04:36:38.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.546+0000 7fe07f1c8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0780c5490 con 0x7fe0780b3790 2023-10-06T04:36:38.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.546+0000 7fe07f1c8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0780c5770 con 0x7fe078142cf0 2023-10-06T04:36:38.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.546+0000 7fe07d765700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0781430c0 0x7fe07816cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:38.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.546+0000 7fe07d765700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0781430c0 0x7fe07816cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36408/0 (socket says 172.21.15.8:36408) 2023-10-06T04:36:38.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.546+0000 7fe07d765700 1 -- 172.21.15.8:0/2280297570 learned_addr learned my addr 172.21.15.8:0/2280297570 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:38.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.546+0000 7fe07cf64700 1 --2- 172.21.15.8:0/2280297570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0780b3790 0x7fe07813f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:38.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.546+0000 7fe077fff700 1 --2- 172.21.15.8:0/2280297570 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe078142cf0 0x7fe078158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:38.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.546+0000 7fe07d765700 1 -- 172.21.15.8:0/2280297570 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe078142cf0 msgr2=0x7fe078158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:38.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.546+0000 7fe07d765700 1 --2- 172.21.15.8:0/2280297570 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe078142cf0 0x7fe078158f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:38.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.546+0000 7fe07d765700 1 -- 172.21.15.8:0/2280297570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0780b3790 msgr2=0x7fe07813f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:38.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.546+0000 7fe07d765700 1 --2- 172.21.15.8:0/2280297570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0780b3790 0x7fe07813f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:38.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.546+0000 7fe07d765700 1 -- 172.21.15.8:0/2280297570 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe060009420 con 0x7fe0781430c0 2023-10-06T04:36:38.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.547+0000 7fe07d765700 1 --2- 172.21.15.8:0/2280297570 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0781430c0 0x7fe07816cc50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe0780ce830 tx=0x7fe060017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:38.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.547+0000 7fe074ff9700 1 -- 172.21.15.8:0/2280297570 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06001f070 con 0x7fe0781430c0 2023-10-06T04:36:38.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.547+0000 7fe074ff9700 1 -- 172.21.15.8:0/2280297570 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe060002f70 con 0x7fe0781430c0 2023-10-06T04:36:38.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.547+0000 7fe07f1c8700 1 -- 172.21.15.8:0/2280297570 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe07813fe40 con 0x7fe0781430c0 2023-10-06T04:36:38.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.547+0000 7fe074ff9700 1 -- 172.21.15.8:0/2280297570 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06000bb40 con 0x7fe0781430c0 2023-10-06T04:36:38.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.547+0000 7fe07f1c8700 1 -- 172.21.15.8:0/2280297570 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe078140400 con 0x7fe0781430c0 2023-10-06T04:36:38.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.548+0000 7fe07f1c8700 1 -- 172.21.15.8:0/2280297570 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe078071550 con 0x7fe0781430c0 2023-10-06T04:36:38.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.548+0000 7fe074ff9700 1 -- 172.21.15.8:0/2280297570 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe060023070 con 0x7fe0781430c0 2023-10-06T04:36:38.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.548+0000 7fe074ff9700 1 --2- 172.21.15.8:0/2280297570 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe058066f30 0x7fe0580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:38.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.549+0000 7fe074ff9700 1 -- 172.21.15.8:0/2280297570 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe060085ed0 con 0x7fe0781430c0 2023-10-06T04:36:38.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.549+0000 7fe07cf64700 1 --2- 172.21.15.8:0/2280297570 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe058066f30 0x7fe0580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:38.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.549+0000 7fe07cf64700 1 --2- 172.21.15.8:0/2280297570 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe058066f30 0x7fe0580693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe070007fd0 tx=0x7fe070009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:38.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.553+0000 7fe074ff9700 1 -- 172.21.15.8:0/2280297570 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe060052cf0 con 0x7fe0781430c0 2023-10-06T04:36:38.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.746+0000 7fe07f1c8700 1 -- 172.21.15.8:0/2280297570 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe0781405f0 con 0x7fe0781430c0 2023-10-06T04:36:38.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.746+0000 7fe074ff9700 1 -- 172.21.15.8:0/2280297570 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe060015020 con 0x7fe0781430c0 2023-10-06T04:36:38.749 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-06T04:36:38.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.748+0000 7fe07f1c8700 1 -- 172.21.15.8:0/2280297570 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe058066f30 msgr2=0x7fe0580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:38.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.748+0000 7fe07f1c8700 1 --2- 172.21.15.8:0/2280297570 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe058066f30 0x7fe0580693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe070007fd0 tx=0x7fe070009040 comp rx=0 tx=0).stop 2023-10-06T04:36:38.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.748+0000 7fe07f1c8700 1 -- 172.21.15.8:0/2280297570 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0781430c0 msgr2=0x7fe07816cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:38.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.748+0000 7fe07f1c8700 1 --2- 172.21.15.8:0/2280297570 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0781430c0 0x7fe07816cc50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe0780ce830 tx=0x7fe060017000 comp rx=0 tx=0).stop 2023-10-06T04:36:38.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.748+0000 7fe07f1c8700 1 -- 172.21.15.8:0/2280297570 shutdown_connections 2023-10-06T04:36:38.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.748+0000 7fe07f1c8700 1 --2- 172.21.15.8:0/2280297570 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe058066f30 0x7fe0580693e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:38.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.748+0000 7fe07f1c8700 1 --2- 172.21.15.8:0/2280297570 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0781430c0 0x7fe07816cc50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:38.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.748+0000 7fe07f1c8700 1 --2- 172.21.15.8:0/2280297570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0780b3790 0x7fe07813f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:38.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.748+0000 7fe07f1c8700 1 --2- 172.21.15.8:0/2280297570 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe078142cf0 0x7fe078158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:38.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.748+0000 7fe07f1c8700 1 -- 172.21.15.8:0/2280297570 >> 172.21.15.8:0/2280297570 conn(0x7fe07806ed00 msgr2=0x7fe078070790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:38.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.748+0000 7fe07f1c8700 1 -- 172.21.15.8:0/2280297570 shutdown_connections 2023-10-06T04:36:38.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.748+0000 7fe07f1c8700 1 -- 172.21.15.8:0/2280297570 wait complete. 2023-10-06T04:36:38.763 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:36:38.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.884+0000 7f76c7eea700 1 Processor -- start 2023-10-06T04:36:38.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.884+0000 7f76c7eea700 1 -- start start 2023-10-06T04:36:38.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.885+0000 7f76c7eea700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76c01430c0 0x7f76c00cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:38.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.885+0000 7f76c7eea700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f76c00cfee0 0x7f76c00b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:38.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.885+0000 7f76c7eea700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76c00cf510 con 0x7f76c0142cf0 2023-10-06T04:36:38.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.885+0000 7f76c7eea700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76c00ce6a0 con 0x7f76c00cfee0 2023-10-06T04:36:38.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.885+0000 7f76c7eea700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c00ce900 con 0x7f76c01430c0 2023-10-06T04:36:38.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.885+0000 7f76c5485700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76c01430c0 0x7f76c00cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:38.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.885+0000 7f76c6487700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f76c00cfee0 0x7f76c00b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:38.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.885+0000 7f76c5485700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76c01430c0 0x7f76c00cf9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.8:60698/0 (socket says 172.21.15.8:60698) 2023-10-06T04:36:38.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.885+0000 7f76c5c86700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f76c0142cf0 0x7f76c00b5cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.8:48478/0 (socket says 172.21.15.8:48478) 2023-10-06T04:36:38.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.885+0000 7f76c5485700 1 -- 172.21.15.8:0/3209956161 learned_addr learned my addr 172.21.15.8:0/3209956161 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:38.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.885+0000 7f76c4c84700 1 -- 172.21.15.8:0/3209956161 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2295407234 0 0) 0x7f76c00cf510 con 0x7f76c0142cf0 2023-10-06T04:36:38.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.885+0000 7f76c4c84700 1 -- 172.21.15.8:0/3209956161 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76ac003570 con 0x7f76c0142cf0 2023-10-06T04:36:38.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.885+0000 7f76c5485700 1 -- 172.21.15.8:0/3209956161 >> v2:172.21.15.184:3300/0 conn(0x7f76c00cfee0 msgr2=0x7f76c00b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:38.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.885+0000 7f76c5485700 1 --2- 172.21.15.8:0/3209956161 >> v2:172.21.15.184:3300/0 conn(0x7f76c00cfee0 0x7f76c00b3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:38.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.885+0000 7f76c5485700 1 -- 172.21.15.8:0/3209956161 >> v1:172.21.15.184:6789/0 conn(0x7f76c0142cf0 legacy=0x7f76c00b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:38.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.885+0000 7f76c5485700 1 -- 172.21.15.8:0/3209956161 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c00cebe0 con 0x7f76c01430c0 2023-10-06T04:36:38.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.885+0000 7f76c6487700 1 --2- 172.21.15.8:0/3209956161 >> v2:172.21.15.184:3300/0 conn(0x7f76c00cfee0 0x7f76c00b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:36:38.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.886+0000 7f76c5485700 1 --2- 172.21.15.8:0/3209956161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76c01430c0 0x7f76c00cf9a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f76b00099b0 tx=0x7f76b0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a8bd656bb1ce438 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:38.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.886+0000 7f76c4c84700 1 -- 172.21.15.8:0/3209956161 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b000b680 con 0x7f76c01430c0 2023-10-06T04:36:38.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.886+0000 7f76c4c84700 1 -- 172.21.15.8:0/3209956161 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b000b7e0 con 0x7f76c01430c0 2023-10-06T04:36:38.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.886+0000 7f76c4c84700 1 -- 172.21.15.8:0/3209956161 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b000bb80 con 0x7f76c01430c0 2023-10-06T04:36:38.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.886+0000 7f76c7eea700 1 -- 172.21.15.8:0/3209956161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76c01430c0 msgr2=0x7f76c00cf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:38.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.886+0000 7f76c7eea700 1 --2- 172.21.15.8:0/3209956161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76c01430c0 0x7f76c00cf9a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f76b00099b0 tx=0x7f76b0009250 comp rx=0 tx=0).stop 2023-10-06T04:36:38.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.886+0000 7f76c7eea700 1 -- 172.21.15.8:0/3209956161 shutdown_connections 2023-10-06T04:36:38.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.886+0000 7f76c7eea700 1 --2- 172.21.15.8:0/3209956161 >> v2:172.21.15.184:3300/0 conn(0x7f76c00cfee0 0x7f76c00b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:38.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.886+0000 7f76c7eea700 1 --2- 172.21.15.8:0/3209956161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76c01430c0 0x7f76c00cf9a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:38.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.886+0000 7f76c7eea700 1 -- 172.21.15.8:0/3209956161 >> 172.21.15.8:0/3209956161 conn(0x7f76c006ed00 msgr2=0x7f76c006f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:38.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.887+0000 7f76c7eea700 1 -- 172.21.15.8:0/3209956161 shutdown_connections 2023-10-06T04:36:38.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.887+0000 7f76c7eea700 1 -- 172.21.15.8:0/3209956161 wait complete. 2023-10-06T04:36:38.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.888+0000 7f76c7eea700 1 Processor -- start 2023-10-06T04:36:38.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.888+0000 7f76c7eea700 1 -- start start 2023-10-06T04:36:38.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.888+0000 7f76c7eea700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76c00cfee0 0x7f76c0158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:38.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.888+0000 7f76c7eea700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76c0142cf0 0x7f76c015d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:38.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.888+0000 7f76c7eea700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76c01430c0 0x7f76c0141090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:38.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.888+0000 7f76c7eea700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c01696e0 con 0x7f76c0142cf0 2023-10-06T04:36:38.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.888+0000 7f76c7eea700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c0159350 con 0x7f76c00cfee0 2023-10-06T04:36:38.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.888+0000 7f76c7eea700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c015c250 con 0x7f76c01430c0 2023-10-06T04:36:38.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.888+0000 7f76c5485700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76c0142cf0 0x7f76c015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:38.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.888+0000 7f76c5485700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76c0142cf0 0x7f76c015d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36410/0 (socket says 172.21.15.8:36410) 2023-10-06T04:36:38.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.888+0000 7f76c5485700 1 -- 172.21.15.8:0/1472878376 learned_addr learned my addr 172.21.15.8:0/1472878376 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:38.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.889+0000 7f76c5c86700 1 --2- 172.21.15.8:0/1472878376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76c00cfee0 0x7f76c0158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:38.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.889+0000 7f76c6487700 1 --2- 172.21.15.8:0/1472878376 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76c01430c0 0x7f76c0141090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:38.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.889+0000 7f76c5485700 1 -- 172.21.15.8:0/1472878376 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76c01430c0 msgr2=0x7f76c0141090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:38.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.889+0000 7f76c5485700 1 --2- 172.21.15.8:0/1472878376 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76c01430c0 0x7f76c0141090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:38.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.889+0000 7f76c5485700 1 -- 172.21.15.8:0/1472878376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76c00cfee0 msgr2=0x7f76c0158e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:38.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.889+0000 7f76c5485700 1 --2- 172.21.15.8:0/1472878376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76c00cfee0 0x7f76c0158e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:38.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.889+0000 7f76c5485700 1 -- 172.21.15.8:0/1472878376 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b8009a20 con 0x7f76c0142cf0 2023-10-06T04:36:38.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.889+0000 7f76c5485700 1 --2- 172.21.15.8:0/1472878376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76c0142cf0 0x7f76c015d960 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f76b0009290 tx=0x7f76b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:38.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.889+0000 7f76b5ffb700 1 -- 172.21.15.8:0/1472878376 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b000bb60 con 0x7f76c0142cf0 2023-10-06T04:36:38.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.889+0000 7f76b5ffb700 1 -- 172.21.15.8:0/1472878376 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b001a450 con 0x7f76c0142cf0 2023-10-06T04:36:38.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.889+0000 7f76c7eea700 1 -- 172.21.15.8:0/1472878376 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b00094f0 con 0x7f76c0142cf0 2023-10-06T04:36:38.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.889+0000 7f76b5ffb700 1 -- 172.21.15.8:0/1472878376 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b001a7f0 con 0x7f76c0142cf0 2023-10-06T04:36:38.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.889+0000 7f76c7eea700 1 -- 172.21.15.8:0/1472878376 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c015c810 con 0x7f76c0142cf0 2023-10-06T04:36:38.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.890+0000 7f76c7eea700 1 -- 172.21.15.8:0/1472878376 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c0169900 con 0x7f76c0142cf0 2023-10-06T04:36:38.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.891+0000 7f76b5ffb700 1 -- 172.21.15.8:0/1472878376 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f76b001abe0 con 0x7f76c0142cf0 2023-10-06T04:36:38.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.891+0000 7f76b5ffb700 1 --2- 172.21.15.8:0/1472878376 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f76a4066f60 0x7f76a4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:38.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.891+0000 7f76b5ffb700 1 -- 172.21.15.8:0/1472878376 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f76b0086400 con 0x7f76c0142cf0 2023-10-06T04:36:38.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.891+0000 7f76c5c86700 1 --2- 172.21.15.8:0/1472878376 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f76a4066f60 0x7f76a4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:38.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.892+0000 7f76c5c86700 1 --2- 172.21.15.8:0/1472878376 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f76a4066f60 0x7f76a4069410 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f76bc004f70 tx=0x7f76bc007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:38.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:38.896+0000 7f76b5ffb700 1 -- 172.21.15.8:0/1472878376 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f76c0169900 con 0x7f76c0142cf0 2023-10-06T04:36:39.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.087+0000 7f76c7eea700 1 -- 172.21.15.8:0/1472878376 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f76c0169900 con 0x7f76c0142cf0 2023-10-06T04:36:39.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.088+0000 7f76b5ffb700 1 -- 172.21.15.8:0/1472878376 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f76c0169900 con 0x7f76c0142cf0 2023-10-06T04:36:39.090 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-06T04:36:39.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.090+0000 7f76c7eea700 1 -- 172.21.15.8:0/1472878376 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f76a4066f60 msgr2=0x7f76a4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:39.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.090+0000 7f76c7eea700 1 --2- 172.21.15.8:0/1472878376 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f76a4066f60 0x7f76a4069410 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f76bc004f70 tx=0x7f76bc007d40 comp rx=0 tx=0).stop 2023-10-06T04:36:39.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.090+0000 7f76c7eea700 1 -- 172.21.15.8:0/1472878376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76c0142cf0 msgr2=0x7f76c015d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:39.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.090+0000 7f76c7eea700 1 --2- 172.21.15.8:0/1472878376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76c0142cf0 0x7f76c015d960 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f76b0009290 tx=0x7f76b0017000 comp rx=0 tx=0).stop 2023-10-06T04:36:39.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.090+0000 7f76c7eea700 1 -- 172.21.15.8:0/1472878376 shutdown_connections 2023-10-06T04:36:39.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.090+0000 7f76c7eea700 1 --2- 172.21.15.8:0/1472878376 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f76a4066f60 0x7f76a4069410 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:39.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.090+0000 7f76c7eea700 1 --2- 172.21.15.8:0/1472878376 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76c01430c0 0x7f76c0141090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:39.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.090+0000 7f76c7eea700 1 --2- 172.21.15.8:0/1472878376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76c00cfee0 0x7f76c0158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:39.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.090+0000 7f76c7eea700 1 --2- 172.21.15.8:0/1472878376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76c0142cf0 0x7f76c015d960 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:39.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.090+0000 7f76c7eea700 1 -- 172.21.15.8:0/1472878376 >> 172.21.15.8:0/1472878376 conn(0x7f76c006ed00 msgr2=0x7f76c00b2500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:39.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.090+0000 7f76c7eea700 1 -- 172.21.15.8:0/1472878376 shutdown_connections 2023-10-06T04:36:39.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.090+0000 7f76c7eea700 1 -- 172.21.15.8:0/1472878376 wait complete. 2023-10-06T04:36:39.104 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T04:36:39.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.223+0000 7fa3ddea0700 1 Processor -- start 2023-10-06T04:36:39.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.223+0000 7fa3ddea0700 1 -- start start 2023-10-06T04:36:39.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.224+0000 7fa3ddea0700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa3d8142cf0 0x7fa3d80b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:39.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.224+0000 7fa3ddea0700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa3d80b3790 0x7fa3d80b3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:39.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.224+0000 7fa3ddea0700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d80cf510 con 0x7fa3d81430c0 2023-10-06T04:36:39.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.224+0000 7fa3ddea0700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3d80ce6a0 con 0x7fa3d80b3790 2023-10-06T04:36:39.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.224+0000 7fa3ddea0700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3d80b40d0 con 0x7fa3d8142cf0 2023-10-06T04:36:39.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.224+0000 7fa3d7fff700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa3d80b3790 0x7fa3d80b3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:39.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.224+0000 7fa3d7fff700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa3d80b3790 0x7fa3d80b3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36414/0 (socket says 172.21.15.8:36414) 2023-10-06T04:36:39.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.224+0000 7fa3d7fff700 1 -- 172.21.15.8:0/2463775908 learned_addr learned my addr 172.21.15.8:0/2463775908 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:39.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.225+0000 7fa3d77fe700 1 --2- 172.21.15.8:0/2463775908 >> v2:172.21.15.184:3300/0 conn(0x7fa3d8142cf0 0x7fa3d80b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:39.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.225+0000 7fa3d7fff700 1 -- 172.21.15.8:0/2463775908 >> v2:172.21.15.184:3300/0 conn(0x7fa3d8142cf0 msgr2=0x7fa3d80b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:39.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.225+0000 7fa3d7fff700 1 --2- 172.21.15.8:0/2463775908 >> v2:172.21.15.184:3300/0 conn(0x7fa3d8142cf0 0x7fa3d80b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:39.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.225+0000 7fa3d7fff700 1 -- 172.21.15.8:0/2463775908 >> v1:172.21.15.184:6789/0 conn(0x7fa3d81430c0 legacy=0x7fa3d80cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:39.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.225+0000 7fa3d7fff700 1 -- 172.21.15.8:0/2463775908 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d80ce900 con 0x7fa3d80b3790 2023-10-06T04:36:39.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.225+0000 7fa3d7fff700 1 --2- 172.21.15.8:0/2463775908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3d80b3790 0x7fa3d80b3b90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8089240 tx=0x7fa3d0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88937b3272aecbbc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:39.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.225+0000 7fa3d67fc700 1 -- 172.21.15.8:0/2463775908 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d000e070 con 0x7fa3d80b3790 2023-10-06T04:36:39.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.225+0000 7fa3d67fc700 1 -- 172.21.15.8:0/2463775908 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d000ba10 con 0x7fa3d80b3790 2023-10-06T04:36:39.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.225+0000 7fa3d67fc700 1 -- 172.21.15.8:0/2463775908 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d00092e0 con 0x7fa3d80b3790 2023-10-06T04:36:39.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.226+0000 7fa3ddea0700 1 -- 172.21.15.8:0/2463775908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3d80b3790 msgr2=0x7fa3d80b3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:39.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.226+0000 7fa3ddea0700 1 --2- 172.21.15.8:0/2463775908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3d80b3790 0x7fa3d80b3b90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8089240 tx=0x7fa3d0009840 comp rx=0 tx=0).stop 2023-10-06T04:36:39.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.226+0000 7fa3ddea0700 1 -- 172.21.15.8:0/2463775908 shutdown_connections 2023-10-06T04:36:39.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.226+0000 7fa3ddea0700 1 --2- 172.21.15.8:0/2463775908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3d80b3790 0x7fa3d80b3b90 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:39.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.226+0000 7fa3ddea0700 1 --2- 172.21.15.8:0/2463775908 >> v2:172.21.15.184:3300/0 conn(0x7fa3d8142cf0 0x7fa3d80b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:39.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.226+0000 7fa3ddea0700 1 -- 172.21.15.8:0/2463775908 >> 172.21.15.8:0/2463775908 conn(0x7fa3d806ed00 msgr2=0x7fa3d806f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:39.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.226+0000 7fa3ddea0700 1 -- 172.21.15.8:0/2463775908 shutdown_connections 2023-10-06T04:36:39.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.226+0000 7fa3ddea0700 1 -- 172.21.15.8:0/2463775908 wait complete. 2023-10-06T04:36:39.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.227+0000 7fa3ddea0700 1 Processor -- start 2023-10-06T04:36:39.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.227+0000 7fa3ddea0700 1 -- start start 2023-10-06T04:36:39.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.228+0000 7fa3ddea0700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3d80b3790 0x7fa3d8140280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:39.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.228+0000 7fa3ddea0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3d8142cf0 0x7fa3d815c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:39.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.228+0000 7fa3ddea0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3d81430c0 0x7fa3d80ad3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:39.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.228+0000 7fa3ddea0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d80aca00 con 0x7fa3d8142cf0 2023-10-06T04:36:39.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.228+0000 7fa3ddea0700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d815cba0 con 0x7fa3d81430c0 2023-10-06T04:36:39.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.228+0000 7fa3ddea0700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d80abe30 con 0x7fa3d80b3790 2023-10-06T04:36:39.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.228+0000 7fa3d6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3d8142cf0 0x7fa3d815c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:39.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.228+0000 7fa3d6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3d8142cf0 0x7fa3d815c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36420/0 (socket says 172.21.15.8:36420) 2023-10-06T04:36:39.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.228+0000 7fa3d6ffd700 1 -- 172.21.15.8:0/2726208803 learned_addr learned my addr 172.21.15.8:0/2726208803 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:39.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.228+0000 7fa3d77fe700 1 --2- 172.21.15.8:0/2726208803 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3d80b3790 0x7fa3d8140280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:39.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.228+0000 7fa3d7fff700 1 --2- 172.21.15.8:0/2726208803 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3d81430c0 0x7fa3d80ad3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:39.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.228+0000 7fa3d6ffd700 1 -- 172.21.15.8:0/2726208803 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3d80b3790 msgr2=0x7fa3d8140280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:39.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.228+0000 7fa3d6ffd700 1 --2- 172.21.15.8:0/2726208803 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3d80b3790 0x7fa3d8140280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:39.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.228+0000 7fa3d6ffd700 1 -- 172.21.15.8:0/2726208803 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3d81430c0 msgr2=0x7fa3d80ad3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:39.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.228+0000 7fa3d6ffd700 1 --2- 172.21.15.8:0/2726208803 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3d81430c0 0x7fa3d80ad3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:39.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.228+0000 7fa3d6ffd700 1 -- 172.21.15.8:0/2726208803 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d0009ae0 con 0x7fa3d8142cf0 2023-10-06T04:36:39.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.228+0000 7fa3d6ffd700 1 --2- 172.21.15.8:0/2726208803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3d8142cf0 0x7fa3d815c660 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc00b5e0 tx=0x7fa3cc009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:39.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.228+0000 7fa3bf7fe700 1 -- 172.21.15.8:0/2726208803 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc00f510 con 0x7fa3d8142cf0 2023-10-06T04:36:39.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.228+0000 7fa3bf7fe700 1 -- 172.21.15.8:0/2726208803 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3cc00f670 con 0x7fa3d8142cf0 2023-10-06T04:36:39.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.228+0000 7fa3ddea0700 1 -- 172.21.15.8:0/2726208803 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d80ac0d0 con 0x7fa3d8142cf0 2023-10-06T04:36:39.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.228+0000 7fa3bf7fe700 1 -- 172.21.15.8:0/2726208803 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc00fa30 con 0x7fa3d8142cf0 2023-10-06T04:36:39.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.228+0000 7fa3ddea0700 1 -- 172.21.15.8:0/2726208803 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d80ac690 con 0x7fa3d8142cf0 2023-10-06T04:36:39.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.229+0000 7fa3ddea0700 1 -- 172.21.15.8:0/2726208803 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3d8071550 con 0x7fa3d8142cf0 2023-10-06T04:36:39.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.230+0000 7fa3bf7fe700 1 -- 172.21.15.8:0/2726208803 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa3cc01a400 con 0x7fa3d8142cf0 2023-10-06T04:36:39.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.230+0000 7fa3bf7fe700 1 --2- 172.21.15.8:0/2726208803 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa3c4066f30 0x7fa3c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:39.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.230+0000 7fa3bf7fe700 1 -- 172.21.15.8:0/2726208803 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa3cc0844c0 con 0x7fa3d8142cf0 2023-10-06T04:36:39.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.230+0000 7fa3d77fe700 1 --2- 172.21.15.8:0/2726208803 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa3c4066f30 0x7fa3c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:39.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.231+0000 7fa3d77fe700 1 --2- 172.21.15.8:0/2726208803 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa3c4066f30 0x7fa3c40693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8006fd0 tx=0x7fa3c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:39.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.235+0000 7fa3bf7fe700 1 -- 172.21.15.8:0/2726208803 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3cc051240 con 0x7fa3d8142cf0 2023-10-06T04:36:39.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.425+0000 7fa3ddea0700 1 -- 172.21.15.8:0/2726208803 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa3d80cebe0 con 0x7fa3d8142cf0 2023-10-06T04:36:39.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.426+0000 7fa3bf7fe700 1 -- 172.21.15.8:0/2726208803 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa3cc054860 con 0x7fa3d8142cf0 2023-10-06T04:36:39.428 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-06T04:36:39.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.427+0000 7fa3ddea0700 1 -- 172.21.15.8:0/2726208803 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa3c4066f30 msgr2=0x7fa3c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:39.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.427+0000 7fa3ddea0700 1 --2- 172.21.15.8:0/2726208803 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa3c4066f30 0x7fa3c40693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8006fd0 tx=0x7fa3c8008040 comp rx=0 tx=0).stop 2023-10-06T04:36:39.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.428+0000 7fa3ddea0700 1 -- 172.21.15.8:0/2726208803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3d8142cf0 msgr2=0x7fa3d815c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:39.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.428+0000 7fa3ddea0700 1 --2- 172.21.15.8:0/2726208803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3d8142cf0 0x7fa3d815c660 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc00b5e0 tx=0x7fa3cc009120 comp rx=0 tx=0).stop 2023-10-06T04:36:39.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.428+0000 7fa3ddea0700 1 -- 172.21.15.8:0/2726208803 shutdown_connections 2023-10-06T04:36:39.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.428+0000 7fa3ddea0700 1 --2- 172.21.15.8:0/2726208803 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa3c4066f30 0x7fa3c40693e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:39.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.428+0000 7fa3ddea0700 1 --2- 172.21.15.8:0/2726208803 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3d81430c0 0x7fa3d80ad3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:39.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.428+0000 7fa3ddea0700 1 --2- 172.21.15.8:0/2726208803 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3d80b3790 0x7fa3d8140280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:39.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.428+0000 7fa3ddea0700 1 --2- 172.21.15.8:0/2726208803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3d8142cf0 0x7fa3d815c660 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:39.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.428+0000 7fa3ddea0700 1 -- 172.21.15.8:0/2726208803 >> 172.21.15.8:0/2726208803 conn(0x7fa3d806ed00 msgr2=0x7fa3d80b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:39.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.428+0000 7fa3ddea0700 1 -- 172.21.15.8:0/2726208803 shutdown_connections 2023-10-06T04:36:39.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.428+0000 7fa3ddea0700 1 -- 172.21.15.8:0/2726208803 wait complete. 2023-10-06T04:36:39.442 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:36:39.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.559+0000 7f2fadc35700 1 Processor -- start 2023-10-06T04:36:39.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.559+0000 7f2fadc35700 1 -- start start 2023-10-06T04:36:39.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.559+0000 7f2fadc35700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2fa80cc830 0x7f2fa806b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:39.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.559+0000 7f2fadc35700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fa806c0f0 con 0x7f2fa806bc90 2023-10-06T04:36:39.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.559+0000 7f2fadc35700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fa80ccca0 con 0x7f2fa8140c30 2023-10-06T04:36:39.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.559+0000 7f2fadc35700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fa80b11d0 con 0x7f2fa80cc830 2023-10-06T04:36:39.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.560+0000 7f2fa7fff700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f2fa806bc90 0x7f2fa80b1620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:52584/0 (socket says 172.21.15.8:52584) 2023-10-06T04:36:39.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.560+0000 7f2fa7fff700 1 -- 172.21.15.8:0/2232602689 learned_addr learned my addr 172.21.15.8:0/2232602689 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:39.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.560+0000 7f2fa6ffd700 1 --2- 172.21.15.8:0/2232602689 >> v2:172.21.15.184:3300/0 conn(0x7f2fa80cc830 0x7f2fa806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:39.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.560+0000 7f2fa67fc700 1 -- 172.21.15.8:0/2232602689 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1037022101 0 0) 0x7f2fa0001490 con 0x7f2fa806bc90 2023-10-06T04:36:39.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.560+0000 7f2fa67fc700 1 -- 172.21.15.8:0/2232602689 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f90003570 con 0x7f2fa806bc90 2023-10-06T04:36:39.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.560+0000 7f2fa67fc700 1 -- 172.21.15.8:0/2232602689 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2965814571 0 0) 0x7f2fa80ccca0 con 0x7f2fa8140c30 2023-10-06T04:36:39.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.560+0000 7f2fa67fc700 1 -- 172.21.15.8:0/2232602689 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fa0001490 con 0x7f2fa8140c30 2023-10-06T04:36:39.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.560+0000 7f2fa67fc700 1 -- 172.21.15.8:0/2232602689 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3217413118 0 0) 0x7f2f90003570 con 0x7f2fa806bc90 2023-10-06T04:36:39.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.560+0000 7f2fa6ffd700 1 -- 172.21.15.8:0/2232602689 >> v1:172.21.15.184:6789/0 conn(0x7f2fa8140c30 legacy=0x7f2fa80c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:39.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.560+0000 7f2fa6ffd700 1 -- 172.21.15.8:0/2232602689 >> v1:172.21.15.8:6789/0 conn(0x7f2fa806bc90 legacy=0x7f2fa80b1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:39.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.560+0000 7f2fa6ffd700 1 -- 172.21.15.8:0/2232602689 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa80cd790 con 0x7f2fa80cc830 2023-10-06T04:36:39.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.560+0000 7f2fa6ffd700 1 --2- 172.21.15.8:0/2232602689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fa80cc830 0x7f2fa806b750 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c0098e0 tx=0x7f2f9c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad2e52f243d88ec8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:39.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.561+0000 7f2fa67fc700 1 -- 172.21.15.8:0/2232602689 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa0001980 con 0x7f2fa80cc830 2023-10-06T04:36:39.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.561+0000 7f2fa67fc700 1 -- 172.21.15.8:0/2232602689 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9c011420 con 0x7f2fa80cc830 2023-10-06T04:36:39.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.561+0000 7f2fa67fc700 1 -- 172.21.15.8:0/2232602689 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c0117c0 con 0x7f2fa80cc830 2023-10-06T04:36:39.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.561+0000 7f2fadc35700 1 -- 172.21.15.8:0/2232602689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fa80cc830 msgr2=0x7f2fa806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:39.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.561+0000 7f2fadc35700 1 --2- 172.21.15.8:0/2232602689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fa80cc830 0x7f2fa806b750 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c0098e0 tx=0x7f2f9c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:39.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.561+0000 7f2fadc35700 1 -- 172.21.15.8:0/2232602689 shutdown_connections 2023-10-06T04:36:39.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.561+0000 7f2fadc35700 1 --2- 172.21.15.8:0/2232602689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fa80cc830 0x7f2fa806b750 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:39.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.561+0000 7f2fadc35700 1 -- 172.21.15.8:0/2232602689 >> 172.21.15.8:0/2232602689 conn(0x7f2fa80ce250 msgr2=0x7f2fa80ce650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:39.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.561+0000 7f2fadc35700 1 -- 172.21.15.8:0/2232602689 shutdown_connections 2023-10-06T04:36:39.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.561+0000 7f2fadc35700 1 -- 172.21.15.8:0/2232602689 wait complete. 2023-10-06T04:36:39.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.563+0000 7f2fadc35700 1 Processor -- start 2023-10-06T04:36:39.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.563+0000 7f2fadc35700 1 -- start start 2023-10-06T04:36:39.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.563+0000 7f2fadc35700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fa806bc90 0x7f2fa80c6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:39.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.563+0000 7f2fadc35700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fa80cc830 0x7f2fa80c7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:39.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.563+0000 7f2fadc35700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fa8140c30 0x7f2fa8131b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:39.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.563+0000 7f2fadc35700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa80c5cc0 con 0x7f2fa80cc830 2023-10-06T04:36:39.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.563+0000 7f2fadc35700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa80c6ed0 con 0x7f2fa806bc90 2023-10-06T04:36:39.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.563+0000 7f2fadc35700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa80c8160 con 0x7f2fa8140c30 2023-10-06T04:36:39.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.563+0000 7f2fa6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fa80cc830 0x7f2fa80c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:39.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.563+0000 7f2fa6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fa80cc830 0x7f2fa80c7c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36434/0 (socket says 172.21.15.8:36434) 2023-10-06T04:36:39.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.563+0000 7f2fa6ffd700 1 -- 172.21.15.8:0/1763648294 learned_addr learned my addr 172.21.15.8:0/1763648294 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:39.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.564+0000 7f2fa77fe700 1 --2- 172.21.15.8:0/1763648294 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fa806bc90 0x7f2fa80c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:39.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.564+0000 7f2fa7fff700 1 --2- 172.21.15.8:0/1763648294 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fa8140c30 0x7f2fa8131b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:39.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.564+0000 7f2fa6ffd700 1 -- 172.21.15.8:0/1763648294 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fa8140c30 msgr2=0x7f2fa8131b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:39.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.564+0000 7f2fa6ffd700 1 --2- 172.21.15.8:0/1763648294 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fa8140c30 0x7f2fa8131b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:39.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.564+0000 7f2fa6ffd700 1 -- 172.21.15.8:0/1763648294 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fa806bc90 msgr2=0x7f2fa80c6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:39.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.564+0000 7f2fa6ffd700 1 --2- 172.21.15.8:0/1763648294 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fa806bc90 0x7f2fa80c6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:39.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.564+0000 7f2fa6ffd700 1 -- 172.21.15.8:0/1763648294 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9c009420 con 0x7f2fa80cc830 2023-10-06T04:36:39.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.564+0000 7f2fa6ffd700 1 --2- 172.21.15.8:0/1763648294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fa80cc830 0x7f2fa80c7c20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c009ed0 tx=0x7f2f9c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:39.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.564+0000 7f2f8f7fe700 1 -- 172.21.15.8:0/1763648294 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c01cc80 con 0x7f2fa80cc830 2023-10-06T04:36:39.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.564+0000 7f2f8f7fe700 1 -- 172.21.15.8:0/1763648294 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9c01cde0 con 0x7f2fa80cc830 2023-10-06T04:36:39.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.564+0000 7f2fadc35700 1 -- 172.21.15.8:0/1763648294 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fa80c6500 con 0x7f2fa80cc830 2023-10-06T04:36:39.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.564+0000 7f2f8f7fe700 1 -- 172.21.15.8:0/1763648294 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c01a6a0 con 0x7f2fa80cc830 2023-10-06T04:36:39.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.564+0000 7f2fadc35700 1 -- 172.21.15.8:0/1763648294 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa80c76e0 con 0x7f2fa80cc830 2023-10-06T04:36:39.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.565+0000 7f2fadc35700 1 -- 172.21.15.8:0/1763648294 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fa80cc510 con 0x7f2fa80cc830 2023-10-06T04:36:39.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.566+0000 7f2f8f7fe700 1 -- 172.21.15.8:0/1763648294 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f9c01aa90 con 0x7f2fa80cc830 2023-10-06T04:36:39.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.566+0000 7f2f8f7fe700 1 --2- 172.21.15.8:0/1763648294 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2f94066f30 0x7f2f940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:39.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.566+0000 7f2f8f7fe700 1 -- 172.21.15.8:0/1763648294 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f2f9c086320 con 0x7f2fa80cc830 2023-10-06T04:36:39.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.566+0000 7f2fa77fe700 1 --2- 172.21.15.8:0/1763648294 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2f94066f30 0x7f2f940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:39.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.567+0000 7f2fa77fe700 1 --2- 172.21.15.8:0/1763648294 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2f94066f30 0x7f2f940693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2f98003820 tx=0x7f2f98009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:39.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.570+0000 7f2f8f7fe700 1 -- 172.21.15.8:0/1763648294 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f9c053140 con 0x7f2fa80cc830 2023-10-06T04:36:39.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.808+0000 7f2fadc35700 1 -- 172.21.15.8:0/1763648294 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2fa8071550 con 0x7f2fa80cc830 2023-10-06T04:36:39.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.808+0000 7f2f8f7fe700 1 -- 172.21.15.8:0/1763648294 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4587 (secure 0 0 0) 0x7f2f9c056760 con 0x7f2fa80cc830 2023-10-06T04:36:39.811 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:36:39.811 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/516627422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":516627422},{"type":"v1","addr":"172.21.15.8:6835","nonce":516627422}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/1078182353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1078182353},{"type":"v1","addr":"172.21.15.8:6834","nonce":1078182353}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/181555783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":181555783},{"type":"v1","addr":"172.21.15.184:6836","nonce":181555783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:36:16.632579+0000","modified":"2023-10-06T04:36:29.752096+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/2590100121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":2590100121},{"type":"v1","addr":"172.21.15.184:6837","nonce":2590100121}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:36:39.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.810+0000 7f2fadc35700 1 -- 172.21.15.8:0/1763648294 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2f94066f30 msgr2=0x7f2f940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:39.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.810+0000 7f2fadc35700 1 --2- 172.21.15.8:0/1763648294 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2f94066f30 0x7f2f940693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2f98003820 tx=0x7f2f98009040 comp rx=0 tx=0).stop 2023-10-06T04:36:39.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.810+0000 7f2fadc35700 1 -- 172.21.15.8:0/1763648294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fa80cc830 msgr2=0x7f2fa80c7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:39.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.810+0000 7f2fadc35700 1 --2- 172.21.15.8:0/1763648294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fa80cc830 0x7f2fa80c7c20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c009ed0 tx=0x7f2f9c016000 comp rx=0 tx=0).stop 2023-10-06T04:36:39.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.810+0000 7f2fadc35700 1 -- 172.21.15.8:0/1763648294 shutdown_connections 2023-10-06T04:36:39.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.810+0000 7f2fadc35700 1 --2- 172.21.15.8:0/1763648294 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2f94066f30 0x7f2f940693e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:39.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.810+0000 7f2fadc35700 1 --2- 172.21.15.8:0/1763648294 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fa8140c30 0x7f2fa8131b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:39.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.810+0000 7f2fadc35700 1 --2- 172.21.15.8:0/1763648294 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fa806bc90 0x7f2fa80c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:39.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.810+0000 7f2fadc35700 1 --2- 172.21.15.8:0/1763648294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fa80cc830 0x7f2fa80c7c20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:39.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.810+0000 7f2fadc35700 1 -- 172.21.15.8:0/1763648294 >> 172.21.15.8:0/1763648294 conn(0x7f2fa80ce250 msgr2=0x7f2fa80b1860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:39.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.811+0000 7f2fadc35700 1 -- 172.21.15.8:0/1763648294 shutdown_connections 2023-10-06T04:36:39.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.811+0000 7f2fadc35700 1 -- 172.21.15.8:0/1763648294 wait complete. 2023-10-06T04:36:39.814 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 9 2023-10-06T04:36:39.825 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:36:39.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.942+0000 7f9ae226e700 1 Processor -- start 2023-10-06T04:36:39.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.942+0000 7f9ae226e700 1 -- start start 2023-10-06T04:36:39.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.942+0000 7f9ae226e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9adc0cb360 0x7f9adc0d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:39.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.942+0000 7f9ae226e700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9adc0d08d0 0x7f9adc0cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:39.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.942+0000 7f9ae226e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9adc0cc4c0 con 0x7f9adc0af680 2023-10-06T04:36:39.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.942+0000 7f9ae226e700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9adc15d460 con 0x7f9adc0d08d0 2023-10-06T04:36:39.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.942+0000 7f9ae226e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9adc0d0d20 con 0x7f9adc0cb360 2023-10-06T04:36:39.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.943+0000 7f9ae080b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9adc0d08d0 0x7f9adc0cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:39.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.943+0000 7f9ae080b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9adc0d08d0 0x7f9adc0cc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36442/0 (socket says 172.21.15.8:36442) 2023-10-06T04:36:39.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.943+0000 7f9ae080b700 1 -- 172.21.15.8:0/4179879697 learned_addr learned my addr 172.21.15.8:0/4179879697 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:39.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.943+0000 7f9ae080b700 1 -- 172.21.15.8:0/4179879697 >> v2:172.21.15.184:3300/0 conn(0x7f9adc0cb360 msgr2=0x7f9adc0d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:39.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.943+0000 7f9adb7fe700 1 --2- 172.21.15.8:0/4179879697 >> v2:172.21.15.184:3300/0 conn(0x7f9adc0cb360 0x7f9adc0d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:39.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.943+0000 7f9ae080b700 1 --2- 172.21.15.8:0/4179879697 >> v2:172.21.15.184:3300/0 conn(0x7f9adc0cb360 0x7f9adc0d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:39.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.943+0000 7f9ae080b700 1 -- 172.21.15.8:0/4179879697 >> v1:172.21.15.184:6789/0 conn(0x7f9adc0af680 legacy=0x7f9adc15e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:39.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.943+0000 7f9ae080b700 1 -- 172.21.15.8:0/4179879697 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9adc0cb8b0 con 0x7f9adc0d08d0 2023-10-06T04:36:39.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.943+0000 7f9adb7fe700 1 --2- 172.21.15.8:0/4179879697 >> v2:172.21.15.184:3300/0 conn(0x7f9adc0cb360 0x7f9adc0d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:36:39.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.943+0000 7f9ae080b700 1 --2- 172.21.15.8:0/4179879697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9adc0d08d0 0x7f9adc0cc950 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9adc0b2f70 tx=0x7f9ad4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc4d0f091d181eb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:39.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.943+0000 7f9adaffd700 1 -- 172.21.15.8:0/4179879697 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad400e070 con 0x7f9adc0d08d0 2023-10-06T04:36:39.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.943+0000 7f9adaffd700 1 -- 172.21.15.8:0/4179879697 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad400ba10 con 0x7f9adc0d08d0 2023-10-06T04:36:39.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.943+0000 7f9adaffd700 1 -- 172.21.15.8:0/4179879697 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad40092e0 con 0x7f9adc0d08d0 2023-10-06T04:36:39.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.944+0000 7f9ae226e700 1 -- 172.21.15.8:0/4179879697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9adc0d08d0 msgr2=0x7f9adc0cc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:39.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.944+0000 7f9ae226e700 1 --2- 172.21.15.8:0/4179879697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9adc0d08d0 0x7f9adc0cc950 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9adc0b2f70 tx=0x7f9ad4009840 comp rx=0 tx=0).stop 2023-10-06T04:36:39.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.944+0000 7f9ae226e700 1 -- 172.21.15.8:0/4179879697 shutdown_connections 2023-10-06T04:36:39.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.944+0000 7f9ae226e700 1 --2- 172.21.15.8:0/4179879697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9adc0d08d0 0x7f9adc0cc950 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:39.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.944+0000 7f9ae226e700 1 --2- 172.21.15.8:0/4179879697 >> v2:172.21.15.184:3300/0 conn(0x7f9adc0cb360 0x7f9adc0d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:39.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.944+0000 7f9ae226e700 1 -- 172.21.15.8:0/4179879697 >> 172.21.15.8:0/4179879697 conn(0x7f9adc0633d0 msgr2=0x7f9adc0637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:39.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.944+0000 7f9ae226e700 1 -- 172.21.15.8:0/4179879697 shutdown_connections 2023-10-06T04:36:39.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.944+0000 7f9ae226e700 1 -- 172.21.15.8:0/4179879697 wait complete. 2023-10-06T04:36:39.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.945+0000 7f9ae226e700 1 Processor -- start 2023-10-06T04:36:39.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.945+0000 7f9ae226e700 1 -- start start 2023-10-06T04:36:39.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.946+0000 7f9ae226e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9adc0af680 0x7f9adc158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:39.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.946+0000 7f9ae226e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9adc0cb360 0x7f9adc0cf740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:39.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.946+0000 7f9ae226e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9adc0d08d0 0x7f9adc0cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:39.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.946+0000 7f9ae226e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9adc0c4a30 con 0x7f9adc0cb360 2023-10-06T04:36:39.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.946+0000 7f9ae226e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9adc0c3e20 con 0x7f9adc0d08d0 2023-10-06T04:36:39.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.946+0000 7f9ae226e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9adc0c4100 con 0x7f9adc0af680 2023-10-06T04:36:39.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.946+0000 7f9adb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9adc0cb360 0x7f9adc0cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:39.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.946+0000 7f9adb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9adc0cb360 0x7f9adc0cf740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36446/0 (socket says 172.21.15.8:36446) 2023-10-06T04:36:39.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.946+0000 7f9adb7fe700 1 -- 172.21.15.8:0/2455261626 learned_addr learned my addr 172.21.15.8:0/2455261626 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:39.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.946+0000 7f9ae080b700 1 --2- 172.21.15.8:0/2455261626 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9adc0d08d0 0x7f9adc0cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:39.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.946+0000 7f9adbfff700 1 --2- 172.21.15.8:0/2455261626 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9adc0af680 0x7f9adc158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:39.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.946+0000 7f9adb7fe700 1 -- 172.21.15.8:0/2455261626 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9adc0af680 msgr2=0x7f9adc158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:39.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.946+0000 7f9adb7fe700 1 --2- 172.21.15.8:0/2455261626 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9adc0af680 0x7f9adc158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:39.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.946+0000 7f9adb7fe700 1 -- 172.21.15.8:0/2455261626 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9adc0d08d0 msgr2=0x7f9adc0cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:39.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.946+0000 7f9adb7fe700 1 --2- 172.21.15.8:0/2455261626 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9adc0d08d0 0x7f9adc0cfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:39.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.946+0000 7f9adb7fe700 1 -- 172.21.15.8:0/2455261626 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad4009ae0 con 0x7f9adc0cb360 2023-10-06T04:36:39.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.946+0000 7f9adb7fe700 1 --2- 172.21.15.8:0/2455261626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9adc0cb360 0x7f9adc0cf740 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9acc00c830 tx=0x7f9acc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:39.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.947+0000 7f9ad3fff700 1 -- 172.21.15.8:0/2455261626 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc011600 con 0x7f9adc0cb360 2023-10-06T04:36:39.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.947+0000 7f9ad3fff700 1 -- 172.21.15.8:0/2455261626 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9acc011760 con 0x7f9adc0cb360 2023-10-06T04:36:39.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.947+0000 7f9ae226e700 1 -- 172.21.15.8:0/2455261626 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9adc0c43e0 con 0x7f9adc0cb360 2023-10-06T04:36:39.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.947+0000 7f9ad3fff700 1 -- 172.21.15.8:0/2455261626 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc011b20 con 0x7f9adc0cb360 2023-10-06T04:36:39.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.947+0000 7f9ae226e700 1 -- 172.21.15.8:0/2455261626 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9adc1589a0 con 0x7f9adc0cb360 2023-10-06T04:36:39.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.947+0000 7f9ae226e700 1 -- 172.21.15.8:0/2455261626 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9adc070f80 con 0x7f9adc0cb360 2023-10-06T04:36:39.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.948+0000 7f9ad3fff700 1 -- 172.21.15.8:0/2455261626 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9acc018360 con 0x7f9adc0cb360 2023-10-06T04:36:39.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.948+0000 7f9ad3fff700 1 --2- 172.21.15.8:0/2455261626 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9abc066f30 0x7f9abc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:39.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.948+0000 7f9ad3fff700 1 -- 172.21.15.8:0/2455261626 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9acc0848c0 con 0x7f9adc0cb360 2023-10-06T04:36:39.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.949+0000 7f9adbfff700 1 --2- 172.21.15.8:0/2455261626 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9abc066f30 0x7f9abc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:39.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.949+0000 7f9adbfff700 1 --2- 172.21.15.8:0/2455261626 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9abc066f30 0x7f9abc0693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4009af0 tx=0x7f9ac4009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:39.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:39.953+0000 7f9ad3fff700 1 -- 172.21.15.8:0/2455261626 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9acc0516e0 con 0x7f9adc0cb360 2023-10-06T04:36:40.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.149+0000 7f9ae226e700 1 -- 172.21.15.8:0/2455261626 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9adc071550 con 0x7f9adc0cb360 2023-10-06T04:36:40.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.150+0000 7f9ad3fff700 1 -- 172.21.15.8:0/2455261626 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f9acc054d00 con 0x7f9adc0cb360 2023-10-06T04:36:40.152 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:36:40.152 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":25,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:36:21.690266+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:36:10.148177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:36:10.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:36:14.390671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:36:15.601089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:36:19.291300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.555871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.490505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.504578+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.517217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:05.991135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.537329+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.543232+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.443715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:36:40.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.152+0000 7f9ae226e700 1 -- 172.21.15.8:0/2455261626 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9abc066f30 msgr2=0x7f9abc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:40.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.152+0000 7f9ae226e700 1 --2- 172.21.15.8:0/2455261626 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9abc066f30 0x7f9abc0693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4009af0 tx=0x7f9ac4009060 comp rx=0 tx=0).stop 2023-10-06T04:36:40.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.152+0000 7f9ae226e700 1 -- 172.21.15.8:0/2455261626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9adc0cb360 msgr2=0x7f9adc0cf740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:40.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.152+0000 7f9ae226e700 1 --2- 172.21.15.8:0/2455261626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9adc0cb360 0x7f9adc0cf740 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9acc00c830 tx=0x7f9acc008040 comp rx=0 tx=0).stop 2023-10-06T04:36:40.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.152+0000 7f9ae226e700 1 -- 172.21.15.8:0/2455261626 shutdown_connections 2023-10-06T04:36:40.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.152+0000 7f9ae226e700 1 --2- 172.21.15.8:0/2455261626 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9abc066f30 0x7f9abc0693e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:40.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.152+0000 7f9ae226e700 1 --2- 172.21.15.8:0/2455261626 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9adc0d08d0 0x7f9adc0cfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:40.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.152+0000 7f9ae226e700 1 --2- 172.21.15.8:0/2455261626 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9adc0af680 0x7f9adc158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:40.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.152+0000 7f9ae226e700 1 --2- 172.21.15.8:0/2455261626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9adc0cb360 0x7f9adc0cf740 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:40.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.152+0000 7f9ae226e700 1 -- 172.21.15.8:0/2455261626 >> 172.21.15.8:0/2455261626 conn(0x7f9adc0633d0 msgr2=0x7f9adc0b0700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:40.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.152+0000 7f9ae226e700 1 -- 172.21.15.8:0/2455261626 shutdown_connections 2023-10-06T04:36:40.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.152+0000 7f9ae226e700 1 -- 172.21.15.8:0/2455261626 wait complete. 2023-10-06T04:36:40.167 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:36:10.148177+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:36:10.684157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:36:14.390671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:36:15.601089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T04:36:19.291300+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:36:40.167 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:36:40.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.287+0000 7f519b59e700 1 Processor -- start 2023-10-06T04:36:40.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.287+0000 7f519b59e700 1 -- start start 2023-10-06T04:36:40.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.288+0000 7f519b59e700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f519c0b1c70 0x7f519c0b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:40.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.288+0000 7f519b59e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f519c15ad80 0x7f519c15b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:40.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.288+0000 7f519b59e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f519c0b2620 con 0x7f519c156e30 2023-10-06T04:36:40.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.288+0000 7f519b59e700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f519c0cf370 con 0x7f519c0b1c70 2023-10-06T04:36:40.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.288+0000 7f519b59e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f519c0ce800 con 0x7f519c15ad80 2023-10-06T04:36:40.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.288+0000 7f5199d9b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f519c0b1c70 0x7f519c0b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:40.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.288+0000 7f5199d9b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f519c0b1c70 0x7f519c0b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36456/0 (socket says 172.21.15.8:36456) 2023-10-06T04:36:40.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.288+0000 7f5199d9b700 1 -- 172.21.15.8:0/3540089378 learned_addr learned my addr 172.21.15.8:0/3540089378 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:40.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.288+0000 7f519ad9d700 1 --2- 172.21.15.8:0/3540089378 >> v2:172.21.15.184:3300/0 conn(0x7f519c15ad80 0x7f519c15b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:40.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.288+0000 7f5199d9b700 1 -- 172.21.15.8:0/3540089378 >> v2:172.21.15.184:3300/0 conn(0x7f519c15ad80 msgr2=0x7f519c15b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:40.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.288+0000 7f5199d9b700 1 --2- 172.21.15.8:0/3540089378 >> v2:172.21.15.184:3300/0 conn(0x7f519c15ad80 0x7f519c15b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:40.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.288+0000 7f5199d9b700 1 -- 172.21.15.8:0/3540089378 >> v1:172.21.15.184:6789/0 conn(0x7f519c156e30 legacy=0x7f519c0cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:40.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.288+0000 7f5199d9b700 1 -- 172.21.15.8:0/3540089378 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519c0cea60 con 0x7f519c0b1c70 2023-10-06T04:36:40.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.289+0000 7f5199d9b700 1 --2- 172.21.15.8:0/3540089378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f519c0b1c70 0x7f519c0b20e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f519c159ef0 tx=0x7f5184009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f00c1307913e1f08 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:40.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.289+0000 7f519959a700 1 -- 172.21.15.8:0/3540089378 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518400b820 con 0x7f519c0b1c70 2023-10-06T04:36:40.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.289+0000 7f519959a700 1 -- 172.21.15.8:0/3540089378 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518400b980 con 0x7f519c0b1c70 2023-10-06T04:36:40.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.289+0000 7f519959a700 1 -- 172.21.15.8:0/3540089378 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518400bd20 con 0x7f519c0b1c70 2023-10-06T04:36:40.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.289+0000 7f519b59e700 1 -- 172.21.15.8:0/3540089378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f519c0b1c70 msgr2=0x7f519c0b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:40.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.289+0000 7f519b59e700 1 --2- 172.21.15.8:0/3540089378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f519c0b1c70 0x7f519c0b20e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f519c159ef0 tx=0x7f5184009250 comp rx=0 tx=0).stop 2023-10-06T04:36:40.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.289+0000 7f519b59e700 1 -- 172.21.15.8:0/3540089378 shutdown_connections 2023-10-06T04:36:40.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.289+0000 7f519b59e700 1 --2- 172.21.15.8:0/3540089378 >> v2:172.21.15.184:3300/0 conn(0x7f519c15ad80 0x7f519c15b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:40.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.289+0000 7f519b59e700 1 --2- 172.21.15.8:0/3540089378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f519c0b1c70 0x7f519c0b20e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:40.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.289+0000 7f519b59e700 1 -- 172.21.15.8:0/3540089378 >> 172.21.15.8:0/3540089378 conn(0x7f519c06ed00 msgr2=0x7f519c06f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:40.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.289+0000 7f519b59e700 1 -- 172.21.15.8:0/3540089378 shutdown_connections 2023-10-06T04:36:40.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.289+0000 7f519b59e700 1 -- 172.21.15.8:0/3540089378 wait complete. 2023-10-06T04:36:40.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.290+0000 7f519b59e700 1 Processor -- start 2023-10-06T04:36:40.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.291+0000 7f519b59e700 1 -- start start 2023-10-06T04:36:40.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.291+0000 7f519b59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f519c0b1c70 0x7f519c16dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:40.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.291+0000 7f519b59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f519c156e30 0x7f519c14e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:40.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.291+0000 7f519b59e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f519c15ad80 0x7f519c15c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:40.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.291+0000 7f519b59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519c16d720 con 0x7f519c0b1c70 2023-10-06T04:36:40.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.291+0000 7f519b59e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519c14bf90 con 0x7f519c15ad80 2023-10-06T04:36:40.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.291+0000 7f519b59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f519c14c270 con 0x7f519c156e30 2023-10-06T04:36:40.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.291+0000 7f519a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f519c0b1c70 0x7f519c16dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:40.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.291+0000 7f519a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f519c0b1c70 0x7f519c16dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36468/0 (socket says 172.21.15.8:36468) 2023-10-06T04:36:40.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.291+0000 7f519a59c700 1 -- 172.21.15.8:0/3712623287 learned_addr learned my addr 172.21.15.8:0/3712623287 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:40.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.291+0000 7f5199d9b700 1 --2- 172.21.15.8:0/3712623287 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f519c156e30 0x7f519c14e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:40.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.291+0000 7f519ad9d700 1 --2- 172.21.15.8:0/3712623287 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f519c15ad80 0x7f519c15c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:40.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.292+0000 7f519a59c700 1 -- 172.21.15.8:0/3712623287 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f519c156e30 msgr2=0x7f519c14e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:40.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.292+0000 7f519a59c700 1 --2- 172.21.15.8:0/3712623287 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f519c156e30 0x7f519c14e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:40.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.292+0000 7f519a59c700 1 -- 172.21.15.8:0/3712623287 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f519c15ad80 msgr2=0x7f519c15c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:40.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.292+0000 7f519a59c700 1 --2- 172.21.15.8:0/3712623287 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f519c15ad80 0x7f519c15c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:40.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.292+0000 7f519a59c700 1 -- 172.21.15.8:0/3712623287 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51840094f0 con 0x7f519c0b1c70 2023-10-06T04:36:40.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.292+0000 7f519ad9d700 1 --2- 172.21.15.8:0/3712623287 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f519c15ad80 0x7f519c15c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:40.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.292+0000 7f519a59c700 1 --2- 172.21.15.8:0/3712623287 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f519c0b1c70 0x7f519c16dbb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f518c00c5d0 tx=0x7f518c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:40.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.292+0000 7f51927fc700 1 -- 172.21.15.8:0/3712623287 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518c011590 con 0x7f519c0b1c70 2023-10-06T04:36:40.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.292+0000 7f51927fc700 1 -- 172.21.15.8:0/3712623287 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518c011710 con 0x7f519c0b1c70 2023-10-06T04:36:40.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.292+0000 7f519b59e700 1 -- 172.21.15.8:0/3712623287 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f519c16d0d0 con 0x7f519c0b1c70 2023-10-06T04:36:40.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.292+0000 7f51927fc700 1 -- 172.21.15.8:0/3712623287 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518c011ad0 con 0x7f519c0b1c70 2023-10-06T04:36:40.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.292+0000 7f519b59e700 1 -- 172.21.15.8:0/3712623287 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f519c15c6d0 con 0x7f519c0b1c70 2023-10-06T04:36:40.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.293+0000 7f519b59e700 1 -- 172.21.15.8:0/3712623287 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f519c04c380 con 0x7f519c0b1c70 2023-10-06T04:36:40.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.293+0000 7f51927fc700 1 -- 172.21.15.8:0/3712623287 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f518c01c460 con 0x7f519c0b1c70 2023-10-06T04:36:40.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.294+0000 7f51927fc700 1 --2- 172.21.15.8:0/3712623287 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f517c066f30 0x7f517c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:40.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.294+0000 7f51927fc700 1 -- 172.21.15.8:0/3712623287 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f518c0846e0 con 0x7f519c0b1c70 2023-10-06T04:36:40.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.294+0000 7f5199d9b700 1 --2- 172.21.15.8:0/3712623287 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f517c066f30 0x7f517c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:40.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.294+0000 7f5199d9b700 1 --2- 172.21.15.8:0/3712623287 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f517c066f30 0x7f517c0693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f519c159ef0 tx=0x7f5184016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:40.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.298+0000 7f51927fc700 1 -- 172.21.15.8:0/3712623287 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f518c051500 con 0x7f519c0b1c70 2023-10-06T04:36:40.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.490+0000 7f519b59e700 1 -- 172.21.15.8:0/3712623287 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f519c0b3600 con 0x7f519c0b1c70 2023-10-06T04:36:40.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.491+0000 7f51927fc700 1 -- 172.21.15.8:0/3712623287 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f518c054b20 con 0x7f519c0b1c70 2023-10-06T04:36:40.493 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 8 2023-10-06T04:36:40.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.493+0000 7f519b59e700 1 -- 172.21.15.8:0/3712623287 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f517c066f30 msgr2=0x7f517c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:40.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.493+0000 7f519b59e700 1 --2- 172.21.15.8:0/3712623287 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f517c066f30 0x7f517c0693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f519c159ef0 tx=0x7f5184016000 comp rx=0 tx=0).stop 2023-10-06T04:36:40.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.493+0000 7f519b59e700 1 -- 172.21.15.8:0/3712623287 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f519c0b1c70 msgr2=0x7f519c16dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:40.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.493+0000 7f519b59e700 1 --2- 172.21.15.8:0/3712623287 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f519c0b1c70 0x7f519c16dbb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f518c00c5d0 tx=0x7f518c007f60 comp rx=0 tx=0).stop 2023-10-06T04:36:40.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.493+0000 7f519b59e700 1 -- 172.21.15.8:0/3712623287 shutdown_connections 2023-10-06T04:36:40.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.493+0000 7f519b59e700 1 --2- 172.21.15.8:0/3712623287 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f517c066f30 0x7f517c0693e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:40.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.493+0000 7f519b59e700 1 --2- 172.21.15.8:0/3712623287 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f519c15ad80 0x7f519c15c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:40.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.493+0000 7f519b59e700 1 --2- 172.21.15.8:0/3712623287 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f519c0b1c70 0x7f519c16dbb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:40.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.493+0000 7f519b59e700 1 --2- 172.21.15.8:0/3712623287 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f519c156e30 0x7f519c14e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:40.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.493+0000 7f519b59e700 1 -- 172.21.15.8:0/3712623287 >> 172.21.15.8:0/3712623287 conn(0x7f519c06ed00 msgr2=0x7f519c068210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:40.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.493+0000 7f519b59e700 1 -- 172.21.15.8:0/3712623287 shutdown_connections 2023-10-06T04:36:40.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.493+0000 7f519b59e700 1 -- 172.21.15.8:0/3712623287 wait complete. 2023-10-06T04:36:40.507 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:36:40.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.627+0000 7fdf2b0ec700 1 Processor -- start 2023-10-06T04:36:40.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.627+0000 7fdf2b0ec700 1 -- start start 2023-10-06T04:36:40.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.628+0000 7fdf2b0ec700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fdf24067ce0 0x7fdf2406f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:40.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.628+0000 7fdf2b0ec700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf240cacf0 0x7fdf2415a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:40.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.628+0000 7fdf2b0ec700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf2406ec40 con 0x7fdf24142ca0 2023-10-06T04:36:40.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.628+0000 7fdf2b0ec700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf2415ab60 con 0x7fdf24067ce0 2023-10-06T04:36:40.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.628+0000 7fdf2b0ec700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf240cb150 con 0x7fdf240cacf0 2023-10-06T04:36:40.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.628+0000 7fdf29689700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf240cacf0 0x7fdf2415a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:40.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.628+0000 7fdf29689700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf240cacf0 0x7fdf2415a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.8:60764/0 (socket says 172.21.15.8:60764) 2023-10-06T04:36:40.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.628+0000 7fdf29689700 1 -- 172.21.15.8:0/4097525318 learned_addr learned my addr 172.21.15.8:0/4097525318 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:40.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.628+0000 7fdf23fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fdf24067ce0 0x7fdf2406f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:40.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.628+0000 7fdf28e88700 1 --1- 172.21.15.8:0/4097525318 >> v1:172.21.15.184:6789/0 conn(0x7fdf24142ca0 0x7fdf240675d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.8:48518/0 (socket says 172.21.15.8:48518) 2023-10-06T04:36:40.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.628+0000 7fdf29689700 1 -- 172.21.15.8:0/4097525318 >> v2:172.21.15.184:3300/0 conn(0x7fdf24067ce0 msgr2=0x7fdf2406f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:40.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.628+0000 7fdf29689700 1 --2- 172.21.15.8:0/4097525318 >> v2:172.21.15.184:3300/0 conn(0x7fdf24067ce0 0x7fdf2406f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:40.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.628+0000 7fdf29689700 1 -- 172.21.15.8:0/4097525318 >> v1:172.21.15.184:6789/0 conn(0x7fdf24142ca0 legacy=0x7fdf240675d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:40.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.628+0000 7fdf29689700 1 -- 172.21.15.8:0/4097525318 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf240cb3f0 con 0x7fdf240cacf0 2023-10-06T04:36:40.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.628+0000 7fdf29689700 1 --2- 172.21.15.8:0/4097525318 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf240cacf0 0x7fdf2415a620 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c0099b0 tx=0x7fdf0c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9f07ae96e6c63a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:40.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.629+0000 7fdf237fe700 1 -- 172.21.15.8:0/4097525318 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c009ea0 con 0x7fdf240cacf0 2023-10-06T04:36:40.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.629+0000 7fdf237fe700 1 -- 172.21.15.8:0/4097525318 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf0c00b860 con 0x7fdf240cacf0 2023-10-06T04:36:40.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.629+0000 7fdf237fe700 1 -- 172.21.15.8:0/4097525318 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c00bc00 con 0x7fdf240cacf0 2023-10-06T04:36:40.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.629+0000 7fdf2b0ec700 1 -- 172.21.15.8:0/4097525318 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf240cacf0 msgr2=0x7fdf2415a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:40.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.629+0000 7fdf2b0ec700 1 --2- 172.21.15.8:0/4097525318 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf240cacf0 0x7fdf2415a620 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c0099b0 tx=0x7fdf0c009250 comp rx=0 tx=0).stop 2023-10-06T04:36:40.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.629+0000 7fdf2b0ec700 1 -- 172.21.15.8:0/4097525318 shutdown_connections 2023-10-06T04:36:40.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.629+0000 7fdf2b0ec700 1 --2- 172.21.15.8:0/4097525318 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf240cacf0 0x7fdf2415a620 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:40.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.629+0000 7fdf2b0ec700 1 --2- 172.21.15.8:0/4097525318 >> v2:172.21.15.184:3300/0 conn(0x7fdf24067ce0 0x7fdf2406f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:40.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.629+0000 7fdf2b0ec700 1 -- 172.21.15.8:0/4097525318 >> 172.21.15.8:0/4097525318 conn(0x7fdf240cd120 msgr2=0x7fdf240cd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:40.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.629+0000 7fdf2b0ec700 1 -- 172.21.15.8:0/4097525318 shutdown_connections 2023-10-06T04:36:40.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.629+0000 7fdf2b0ec700 1 -- 172.21.15.8:0/4097525318 wait complete. 2023-10-06T04:36:40.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.630+0000 7fdf2b0ec700 1 Processor -- start 2023-10-06T04:36:40.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.631+0000 7fdf2b0ec700 1 -- start start 2023-10-06T04:36:40.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.631+0000 7fdf2b0ec700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf24067ce0 0x7fdf241358b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:40.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.631+0000 7fdf2b0ec700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf240cacf0 0x7fdf2416ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:40.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.631+0000 7fdf2b0ec700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf24142ca0 0x7fdf2406b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:40.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.631+0000 7fdf2b0ec700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2416dc70 con 0x7fdf24142ca0 2023-10-06T04:36:40.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.631+0000 7fdf2b0ec700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2416d6b0 con 0x7fdf24067ce0 2023-10-06T04:36:40.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.631+0000 7fdf2b0ec700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2416d990 con 0x7fdf240cacf0 2023-10-06T04:36:40.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.631+0000 7fdf29689700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf24142ca0 0x7fdf2406b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:40.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.631+0000 7fdf29689700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf24142ca0 0x7fdf2406b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36474/0 (socket says 172.21.15.8:36474) 2023-10-06T04:36:40.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.631+0000 7fdf29689700 1 -- 172.21.15.8:0/1188938783 learned_addr learned my addr 172.21.15.8:0/1188938783 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:40.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.631+0000 7fdf23fff700 1 --2- 172.21.15.8:0/1188938783 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf240cacf0 0x7fdf2416ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:40.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.632+0000 7fdf28e88700 1 --2- 172.21.15.8:0/1188938783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf24067ce0 0x7fdf241358b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:40.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.632+0000 7fdf29689700 1 -- 172.21.15.8:0/1188938783 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf240cacf0 msgr2=0x7fdf2416ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:40.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.632+0000 7fdf29689700 1 --2- 172.21.15.8:0/1188938783 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf240cacf0 0x7fdf2416ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:40.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.632+0000 7fdf29689700 1 -- 172.21.15.8:0/1188938783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf24067ce0 msgr2=0x7fdf241358b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:40.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.632+0000 7fdf29689700 1 --2- 172.21.15.8:0/1188938783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf24067ce0 0x7fdf241358b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:40.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.632+0000 7fdf29689700 1 -- 172.21.15.8:0/1188938783 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0c0094f0 con 0x7fdf24142ca0 2023-10-06T04:36:40.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.632+0000 7fdf23fff700 1 --2- 172.21.15.8:0/1188938783 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf240cacf0 0x7fdf2416ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:36:40.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.632+0000 7fdf29689700 1 --2- 172.21.15.8:0/1188938783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf24142ca0 0x7fdf2406b740 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdf240cb290 tx=0x7fdf0c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:40.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.632+0000 7fdf20ff9700 1 -- 172.21.15.8:0/1188938783 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c00baa0 con 0x7fdf24142ca0 2023-10-06T04:36:40.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.632+0000 7fdf20ff9700 1 -- 172.21.15.8:0/1188938783 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf0c025420 con 0x7fdf24142ca0 2023-10-06T04:36:40.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.632+0000 7fdf2b0ec700 1 -- 172.21.15.8:0/1188938783 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf240c4370 con 0x7fdf24142ca0 2023-10-06T04:36:40.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.632+0000 7fdf20ff9700 1 -- 172.21.15.8:0/1188938783 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c00bc00 con 0x7fdf24142ca0 2023-10-06T04:36:40.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.632+0000 7fdf2b0ec700 1 -- 172.21.15.8:0/1188938783 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf24169680 con 0x7fdf24142ca0 2023-10-06T04:36:40.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.633+0000 7fdf2b0ec700 1 -- 172.21.15.8:0/1188938783 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf240c41d0 con 0x7fdf24142ca0 2023-10-06T04:36:40.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.633+0000 7fdf20ff9700 1 -- 172.21.15.8:0/1188938783 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf0c023070 con 0x7fdf24142ca0 2023-10-06T04:36:40.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.634+0000 7fdf20ff9700 1 --2- 172.21.15.8:0/1188938783 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fdf04066f30 0x7fdf040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:40.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.634+0000 7fdf20ff9700 1 -- 172.21.15.8:0/1188938783 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fdf0c086020 con 0x7fdf24142ca0 2023-10-06T04:36:40.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.634+0000 7fdf28e88700 1 --2- 172.21.15.8:0/1188938783 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fdf04066f30 0x7fdf040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:40.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.635+0000 7fdf28e88700 1 --2- 172.21.15.8:0/1188938783 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fdf04066f30 0x7fdf040693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c002020 tx=0x7fdf1c001a30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:40.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.638+0000 7fdf20ff9700 1 -- 172.21.15.8:0/1188938783 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf240c41d0 con 0x7fdf24142ca0 2023-10-06T04:36:40.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.829+0000 7fdf2b0ec700 1 -- 172.21.15.8:0/1188938783 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdf240c41d0 con 0x7fdf24142ca0 2023-10-06T04:36:40.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.830+0000 7fdf20ff9700 1 -- 172.21.15.8:0/1188938783 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdf240c41d0 con 0x7fdf24142ca0 2023-10-06T04:36:40.832 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-06T04:36:40.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.832+0000 7fdf2b0ec700 1 -- 172.21.15.8:0/1188938783 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fdf04066f30 msgr2=0x7fdf040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:40.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.832+0000 7fdf2b0ec700 1 --2- 172.21.15.8:0/1188938783 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fdf04066f30 0x7fdf040693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c002020 tx=0x7fdf1c001a30 comp rx=0 tx=0).stop 2023-10-06T04:36:40.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.832+0000 7fdf2b0ec700 1 -- 172.21.15.8:0/1188938783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf24142ca0 msgr2=0x7fdf2406b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:40.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.832+0000 7fdf2b0ec700 1 --2- 172.21.15.8:0/1188938783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf24142ca0 0x7fdf2406b740 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdf240cb290 tx=0x7fdf0c017000 comp rx=0 tx=0).stop 2023-10-06T04:36:40.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.832+0000 7fdf2b0ec700 1 -- 172.21.15.8:0/1188938783 shutdown_connections 2023-10-06T04:36:40.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.832+0000 7fdf2b0ec700 1 --2- 172.21.15.8:0/1188938783 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fdf04066f30 0x7fdf040693e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:40.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.832+0000 7fdf2b0ec700 1 --2- 172.21.15.8:0/1188938783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf24142ca0 0x7fdf2406b740 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:40.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.832+0000 7fdf2b0ec700 1 --2- 172.21.15.8:0/1188938783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf24067ce0 0x7fdf241358b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:40.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.832+0000 7fdf2b0ec700 1 --2- 172.21.15.8:0/1188938783 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf240cacf0 0x7fdf2416ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:40.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.832+0000 7fdf2b0ec700 1 -- 172.21.15.8:0/1188938783 >> 172.21.15.8:0/1188938783 conn(0x7fdf240cd120 msgr2=0x7fdf24141ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:40.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.832+0000 7fdf2b0ec700 1 -- 172.21.15.8:0/1188938783 shutdown_connections 2023-10-06T04:36:40.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.832+0000 7fdf2b0ec700 1 -- 172.21.15.8:0/1188938783 wait complete. 2023-10-06T04:36:40.847 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:36:40.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.966+0000 7fb958b46700 1 Processor -- start 2023-10-06T04:36:40.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.966+0000 7fb958b46700 1 -- start start 2023-10-06T04:36:40.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.967+0000 7fb958b46700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb9540c84c0 0x7fb95413f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:40.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.967+0000 7fb958b46700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb95406eb70 0x7fb95413fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:40.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.967+0000 7fb958b46700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb954140070 con 0x7fb95406e7a0 2023-10-06T04:36:40.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.967+0000 7fb958b46700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9540c9620 con 0x7fb95406eb70 2023-10-06T04:36:40.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.967+0000 7fb958b46700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9540c9a40 con 0x7fb9540c84c0 2023-10-06T04:36:40.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.967+0000 7fb952d9d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb95406eb70 0x7fb95413fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:40.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.967+0000 7fb952d9d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb95406eb70 0x7fb95413fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36480/0 (socket says 172.21.15.8:36480) 2023-10-06T04:36:40.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.968+0000 7fb952d9d700 1 -- 172.21.15.8:0/1191352834 learned_addr learned my addr 172.21.15.8:0/1191352834 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:40.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.968+0000 7fb951d9b700 1 --2- 172.21.15.8:0/1191352834 >> v2:172.21.15.184:3300/0 conn(0x7fb9540c84c0 0x7fb95413f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:40.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.968+0000 7fb952d9d700 1 -- 172.21.15.8:0/1191352834 >> v2:172.21.15.184:3300/0 conn(0x7fb9540c84c0 msgr2=0x7fb95413f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:40.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.968+0000 7fb952d9d700 1 --2- 172.21.15.8:0/1191352834 >> v2:172.21.15.184:3300/0 conn(0x7fb9540c84c0 0x7fb95413f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:40.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.968+0000 7fb952d9d700 1 -- 172.21.15.8:0/1191352834 >> v1:172.21.15.184:6789/0 conn(0x7fb95406e7a0 legacy=0x7fb95406b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:40.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.968+0000 7fb952d9d700 1 -- 172.21.15.8:0/1191352834 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9540c89a0 con 0x7fb95406eb70 2023-10-06T04:36:40.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.968+0000 7fb952d9d700 1 --2- 172.21.15.8:0/1191352834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb95406eb70 0x7fb95413fb30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb954065740 tx=0x7fb94c00ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8312a7fc6f84111 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:40.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.968+0000 7fb95159a700 1 -- 172.21.15.8:0/1191352834 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c010070 con 0x7fb95406eb70 2023-10-06T04:36:40.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.968+0000 7fb95159a700 1 -- 172.21.15.8:0/1191352834 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94c00ddd0 con 0x7fb95406eb70 2023-10-06T04:36:40.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.968+0000 7fb95159a700 1 -- 172.21.15.8:0/1191352834 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c00b320 con 0x7fb95406eb70 2023-10-06T04:36:40.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.969+0000 7fb958b46700 1 -- 172.21.15.8:0/1191352834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb95406eb70 msgr2=0x7fb95413fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:40.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.969+0000 7fb958b46700 1 --2- 172.21.15.8:0/1191352834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb95406eb70 0x7fb95413fb30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb954065740 tx=0x7fb94c00ba50 comp rx=0 tx=0).stop 2023-10-06T04:36:40.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.969+0000 7fb958b46700 1 -- 172.21.15.8:0/1191352834 shutdown_connections 2023-10-06T04:36:40.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.969+0000 7fb958b46700 1 --2- 172.21.15.8:0/1191352834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb95406eb70 0x7fb95413fb30 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:40.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.969+0000 7fb958b46700 1 --2- 172.21.15.8:0/1191352834 >> v2:172.21.15.184:3300/0 conn(0x7fb9540c84c0 0x7fb95413f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:40.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.969+0000 7fb958b46700 1 -- 172.21.15.8:0/1191352834 >> 172.21.15.8:0/1191352834 conn(0x7fb9540cd120 msgr2=0x7fb9540cd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:40.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.969+0000 7fb958b46700 1 -- 172.21.15.8:0/1191352834 shutdown_connections 2023-10-06T04:36:40.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.969+0000 7fb958b46700 1 -- 172.21.15.8:0/1191352834 wait complete. 2023-10-06T04:36:40.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.970+0000 7fb958b46700 1 Processor -- start 2023-10-06T04:36:40.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.970+0000 7fb958b46700 1 -- start start 2023-10-06T04:36:40.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.971+0000 7fb958b46700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb95406e7a0 0x7fb954166a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:40.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.971+0000 7fb958b46700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb95406eb70 0x7fb9540c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:40.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.971+0000 7fb958b46700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9540c84c0 0x7fb9540c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:40.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.971+0000 7fb958b46700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9540c6530 con 0x7fb95406e7a0 2023-10-06T04:36:40.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.971+0000 7fb958b46700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9540c5920 con 0x7fb9540c84c0 2023-10-06T04:36:40.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.971+0000 7fb958b46700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9540c5c00 con 0x7fb95406eb70 2023-10-06T04:36:40.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.971+0000 7fb95259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb95406e7a0 0x7fb954166a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:40.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.971+0000 7fb95259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb95406e7a0 0x7fb954166a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36486/0 (socket says 172.21.15.8:36486) 2023-10-06T04:36:40.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.971+0000 7fb95259c700 1 -- 172.21.15.8:0/964014018 learned_addr learned my addr 172.21.15.8:0/964014018 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:40.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.971+0000 7fb952d9d700 1 --2- 172.21.15.8:0/964014018 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9540c84c0 0x7fb9540c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:40.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.971+0000 7fb951d9b700 1 --2- 172.21.15.8:0/964014018 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb95406eb70 0x7fb9540c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:40.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.971+0000 7fb95259c700 1 -- 172.21.15.8:0/964014018 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb95406eb70 msgr2=0x7fb9540c69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:40.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.971+0000 7fb95259c700 1 --2- 172.21.15.8:0/964014018 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb95406eb70 0x7fb9540c69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:40.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.971+0000 7fb95259c700 1 -- 172.21.15.8:0/964014018 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9540c84c0 msgr2=0x7fb9540c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:40.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.971+0000 7fb95259c700 1 --2- 172.21.15.8:0/964014018 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9540c84c0 0x7fb9540c6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:40.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.971+0000 7fb95259c700 1 -- 172.21.15.8:0/964014018 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb94c00bcf0 con 0x7fb95406e7a0 2023-10-06T04:36:40.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.971+0000 7fb951d9b700 1 --2- 172.21.15.8:0/964014018 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb95406eb70 0x7fb9540c69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:40.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.971+0000 7fb95259c700 1 --2- 172.21.15.8:0/964014018 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb95406e7a0 0x7fb954166a90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb94400c590 tx=0x7fb94400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:40.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.971+0000 7fb94a7fc700 1 -- 172.21.15.8:0/964014018 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb944011590 con 0x7fb95406e7a0 2023-10-06T04:36:40.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.971+0000 7fb94a7fc700 1 -- 172.21.15.8:0/964014018 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb944011710 con 0x7fb95406e7a0 2023-10-06T04:36:40.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.971+0000 7fb958b46700 1 -- 172.21.15.8:0/964014018 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9540c5ee0 con 0x7fb95406e7a0 2023-10-06T04:36:40.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.971+0000 7fb94a7fc700 1 -- 172.21.15.8:0/964014018 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb944011ad0 con 0x7fb95406e7a0 2023-10-06T04:36:40.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.972+0000 7fb958b46700 1 -- 172.21.15.8:0/964014018 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9540c54f0 con 0x7fb95406e7a0 2023-10-06T04:36:40.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.973+0000 7fb958b46700 1 -- 172.21.15.8:0/964014018 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9540c6810 con 0x7fb95406e7a0 2023-10-06T04:36:40.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.973+0000 7fb94a7fc700 1 -- 172.21.15.8:0/964014018 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb94401b3b0 con 0x7fb95406e7a0 2023-10-06T04:36:40.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.973+0000 7fb94a7fc700 1 --2- 172.21.15.8:0/964014018 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb934066f30 0x7fb9340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:40.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.973+0000 7fb94a7fc700 1 -- 172.21.15.8:0/964014018 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb944083e90 con 0x7fb95406e7a0 2023-10-06T04:36:40.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.974+0000 7fb951d9b700 1 --2- 172.21.15.8:0/964014018 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb934066f30 0x7fb9340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:40.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.974+0000 7fb951d9b700 1 --2- 172.21.15.8:0/964014018 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb934066f30 0x7fb9340693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb9540b1a90 tx=0x7fb93c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:40.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:40.978+0000 7fb94a7fc700 1 -- 172.21.15.8:0/964014018 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb944050cb0 con 0x7fb95406e7a0 2023-10-06T04:36:41.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.170+0000 7fb958b46700 1 -- 172.21.15.8:0/964014018 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb9540ccef0 con 0x7fb95406e7a0 2023-10-06T04:36:41.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.170+0000 7fb94a7fc700 1 -- 172.21.15.8:0/964014018 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb944017020 con 0x7fb95406e7a0 2023-10-06T04:36:41.173 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-06T04:36:41.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.172+0000 7fb958b46700 1 -- 172.21.15.8:0/964014018 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb934066f30 msgr2=0x7fb9340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:41.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.172+0000 7fb958b46700 1 --2- 172.21.15.8:0/964014018 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb934066f30 0x7fb9340693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb9540b1a90 tx=0x7fb93c008040 comp rx=0 tx=0).stop 2023-10-06T04:36:41.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.172+0000 7fb958b46700 1 -- 172.21.15.8:0/964014018 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb95406e7a0 msgr2=0x7fb954166a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:41.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.172+0000 7fb958b46700 1 --2- 172.21.15.8:0/964014018 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb95406e7a0 0x7fb954166a90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb94400c590 tx=0x7fb94400c8a0 comp rx=0 tx=0).stop 2023-10-06T04:36:41.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.172+0000 7fb958b46700 1 -- 172.21.15.8:0/964014018 shutdown_connections 2023-10-06T04:36:41.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.172+0000 7fb958b46700 1 --2- 172.21.15.8:0/964014018 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb934066f30 0x7fb9340693e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:41.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.172+0000 7fb958b46700 1 --2- 172.21.15.8:0/964014018 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9540c84c0 0x7fb9540c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:41.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.172+0000 7fb958b46700 1 --2- 172.21.15.8:0/964014018 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb95406e7a0 0x7fb954166a90 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:41.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.172+0000 7fb958b46700 1 --2- 172.21.15.8:0/964014018 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb95406eb70 0x7fb9540c69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:41.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.173+0000 7fb958b46700 1 -- 172.21.15.8:0/964014018 >> 172.21.15.8:0/964014018 conn(0x7fb9540cd120 msgr2=0x7fb95413dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:41.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.173+0000 7fb958b46700 1 -- 172.21.15.8:0/964014018 shutdown_connections 2023-10-06T04:36:41.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.173+0000 7fb958b46700 1 -- 172.21.15.8:0/964014018 wait complete. 2023-10-06T04:36:41.187 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:36:41.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.308+0000 7f37b6c4d700 1 Processor -- start 2023-10-06T04:36:41.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.309+0000 7f37b6c4d700 1 -- start start 2023-10-06T04:36:41.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.309+0000 7f37b6c4d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37b00cb910 0x7f37b00cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:41.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.309+0000 7f37b6c4d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f37b00c8870 0x7f37b015d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:41.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.309+0000 7f37b6c4d700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b015db40 con 0x7f37b015d6e0 2023-10-06T04:36:41.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.309+0000 7f37b6c4d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37b00a9970 con 0x7f37b00c8870 2023-10-06T04:36:41.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.309+0000 7f37b6c4d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b00ab3f0 con 0x7f37b00cb910 2023-10-06T04:36:41.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.310+0000 7f37b644c700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f37b015d6e0 0x7f37b00675d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:52586/0 (socket says 172.21.15.8:52586) 2023-10-06T04:36:41.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.310+0000 7f37b644c700 1 -- 172.21.15.8:0/2663343599 learned_addr learned my addr 172.21.15.8:0/2663343599 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:41.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.310+0000 7f37b5c4b700 1 --2- 172.21.15.8:0/2663343599 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37b00cb910 0x7f37b00cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:41.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.310+0000 7f37b544a700 1 --2- 172.21.15.8:0/2663343599 >> v2:172.21.15.184:3300/0 conn(0x7f37b00c8870 0x7f37b015d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:41.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.310+0000 7f37b4c49700 1 -- 172.21.15.8:0/2663343599 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 121544608 0 0) 0x7f37a0001490 con 0x7f37b015d6e0 2023-10-06T04:36:41.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.310+0000 7f37b4c49700 1 -- 172.21.15.8:0/2663343599 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3798003570 con 0x7f37b015d6e0 2023-10-06T04:36:41.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.310+0000 7f37b5c4b700 1 -- 172.21.15.8:0/2663343599 >> v2:172.21.15.184:3300/0 conn(0x7f37b00c8870 msgr2=0x7f37b015d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:41.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.310+0000 7f37b5c4b700 1 --2- 172.21.15.8:0/2663343599 >> v2:172.21.15.184:3300/0 conn(0x7f37b00c8870 0x7f37b015d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:41.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.310+0000 7f37b5c4b700 1 -- 172.21.15.8:0/2663343599 >> v1:172.21.15.8:6789/0 conn(0x7f37b015d6e0 legacy=0x7f37b00675d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:41.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.310+0000 7f37b5c4b700 1 -- 172.21.15.8:0/2663343599 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b00c6fc0 con 0x7f37b00cb910 2023-10-06T04:36:41.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.310+0000 7f37b5c4b700 1 --2- 172.21.15.8:0/2663343599 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37b00cb910 0x7f37b00cbce0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f37b00a9b10 tx=0x7f37a80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7578b3aab8fe740 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:41.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.310+0000 7f37b4c49700 1 -- 172.21.15.8:0/2663343599 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a8011630 con 0x7f37b00cb910 2023-10-06T04:36:41.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.310+0000 7f37b4c49700 1 -- 172.21.15.8:0/2663343599 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a8011790 con 0x7f37b00cb910 2023-10-06T04:36:41.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.310+0000 7f37b4c49700 1 -- 172.21.15.8:0/2663343599 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a8011b50 con 0x7f37b00cb910 2023-10-06T04:36:41.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.311+0000 7f37b6c4d700 1 -- 172.21.15.8:0/2663343599 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37b00cb910 msgr2=0x7f37b00cbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:41.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.311+0000 7f37b6c4d700 1 --2- 172.21.15.8:0/2663343599 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37b00cb910 0x7f37b00cbce0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f37b00a9b10 tx=0x7f37a80091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:41.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.311+0000 7f37b6c4d700 1 -- 172.21.15.8:0/2663343599 shutdown_connections 2023-10-06T04:36:41.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.311+0000 7f37b6c4d700 1 --2- 172.21.15.8:0/2663343599 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37b00cb910 0x7f37b00cbce0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:41.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.311+0000 7f37b6c4d700 1 --2- 172.21.15.8:0/2663343599 >> v2:172.21.15.184:3300/0 conn(0x7f37b00c8870 0x7f37b015d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:41.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.311+0000 7f37b6c4d700 1 -- 172.21.15.8:0/2663343599 >> 172.21.15.8:0/2663343599 conn(0x7f37b00cd1a0 msgr2=0x7f37b00c9140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:41.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.311+0000 7f37b6c4d700 1 -- 172.21.15.8:0/2663343599 shutdown_connections 2023-10-06T04:36:41.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.311+0000 7f37b6c4d700 1 -- 172.21.15.8:0/2663343599 wait complete. 2023-10-06T04:36:41.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.312+0000 7f37b6c4d700 1 Processor -- start 2023-10-06T04:36:41.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.312+0000 7f37b6c4d700 1 -- start start 2023-10-06T04:36:41.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.313+0000 7f37b6c4d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37b00c8870 0x7f37b00b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:41.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.313+0000 7f37b6c4d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37b00cb910 0x7f37b0069fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:41.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.313+0000 7f37b6c4d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37b015d6e0 0x7f37b00c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:41.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.313+0000 7f37b6c4d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b006ad50 con 0x7f37b00cb910 2023-10-06T04:36:41.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.313+0000 7f37b6c4d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b00b2480 con 0x7f37b00c8870 2023-10-06T04:36:41.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.313+0000 7f37b6c4d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b00afc70 con 0x7f37b015d6e0 2023-10-06T04:36:41.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.313+0000 7f37b544a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37b00cb910 0x7f37b0069fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:41.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.313+0000 7f37b544a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37b00cb910 0x7f37b0069fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36500/0 (socket says 172.21.15.8:36500) 2023-10-06T04:36:41.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.313+0000 7f37b544a700 1 -- 172.21.15.8:0/2086620546 learned_addr learned my addr 172.21.15.8:0/2086620546 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:41.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.313+0000 7f37b5c4b700 1 --2- 172.21.15.8:0/2086620546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37b00c8870 0x7f37b00b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:41.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.313+0000 7f37b644c700 1 --2- 172.21.15.8:0/2086620546 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37b015d6e0 0x7f37b00c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:41.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.313+0000 7f37b544a700 1 -- 172.21.15.8:0/2086620546 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37b015d6e0 msgr2=0x7f37b00c3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:41.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.313+0000 7f37b544a700 1 --2- 172.21.15.8:0/2086620546 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37b015d6e0 0x7f37b00c3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:41.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.313+0000 7f37b544a700 1 -- 172.21.15.8:0/2086620546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37b00c8870 msgr2=0x7f37b00b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:41.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.313+0000 7f37b544a700 1 --2- 172.21.15.8:0/2086620546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37b00c8870 0x7f37b00b1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:41.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.313+0000 7f37b544a700 1 -- 172.21.15.8:0/2086620546 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a8009420 con 0x7f37b00cb910 2023-10-06T04:36:41.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.313+0000 7f37b544a700 1 --2- 172.21.15.8:0/2086620546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37b00cb910 0x7f37b0069fd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f37a400e930 tx=0x7f37a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:41.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.314+0000 7f37adffb700 1 -- 172.21.15.8:0/2086620546 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a4009510 con 0x7f37b00cb910 2023-10-06T04:36:41.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.314+0000 7f37adffb700 1 -- 172.21.15.8:0/2086620546 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a400c850 con 0x7f37b00cb910 2023-10-06T04:36:41.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.314+0000 7f37adffb700 1 -- 172.21.15.8:0/2086620546 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a400cc10 con 0x7f37b00cb910 2023-10-06T04:36:41.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.314+0000 7f37b6c4d700 1 -- 172.21.15.8:0/2086620546 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37b006aa70 con 0x7f37b00cb910 2023-10-06T04:36:41.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.314+0000 7f37b6c4d700 1 -- 172.21.15.8:0/2086620546 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b00af900 con 0x7f37b00cb910 2023-10-06T04:36:41.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.315+0000 7f37b6c4d700 1 -- 172.21.15.8:0/2086620546 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37b00af480 con 0x7f37b00cb910 2023-10-06T04:36:41.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.315+0000 7f37adffb700 1 -- 172.21.15.8:0/2086620546 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f37a4013470 con 0x7f37b00cb910 2023-10-06T04:36:41.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.315+0000 7f37adffb700 1 --2- 172.21.15.8:0/2086620546 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f379c066f30 0x7f379c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:41.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.316+0000 7f37adffb700 1 -- 172.21.15.8:0/2086620546 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f37a4084ac0 con 0x7f37b00cb910 2023-10-06T04:36:41.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.316+0000 7f37b5c4b700 1 --2- 172.21.15.8:0/2086620546 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f379c066f30 0x7f379c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:41.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.316+0000 7f37b5c4b700 1 --2- 172.21.15.8:0/2086620546 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f379c066f30 0x7f379c0693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f37b00a9b10 tx=0x7f37a8016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:41.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.320+0000 7f37adffb700 1 -- 172.21.15.8:0/2086620546 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f37b00af480 con 0x7f37b00cb910 2023-10-06T04:36:41.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.512+0000 7f37b6c4d700 1 -- 172.21.15.8:0/2086620546 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f37b00af480 con 0x7f37b00cb910 2023-10-06T04:36:41.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.513+0000 7f37adffb700 1 -- 172.21.15.8:0/2086620546 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f37b00af480 con 0x7f37b00cb910 2023-10-06T04:36:41.515 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-06T04:36:41.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.515+0000 7f37b6c4d700 1 -- 172.21.15.8:0/2086620546 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f379c066f30 msgr2=0x7f379c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:41.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.515+0000 7f37b6c4d700 1 --2- 172.21.15.8:0/2086620546 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f379c066f30 0x7f379c0693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f37b00a9b10 tx=0x7f37a8016000 comp rx=0 tx=0).stop 2023-10-06T04:36:41.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.515+0000 7f37b6c4d700 1 -- 172.21.15.8:0/2086620546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37b00cb910 msgr2=0x7f37b0069fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:41.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.515+0000 7f37b6c4d700 1 --2- 172.21.15.8:0/2086620546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37b00cb910 0x7f37b0069fd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f37a400e930 tx=0x7f37a40091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:41.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.515+0000 7f37b6c4d700 1 -- 172.21.15.8:0/2086620546 shutdown_connections 2023-10-06T04:36:41.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.515+0000 7f37b6c4d700 1 --2- 172.21.15.8:0/2086620546 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f379c066f30 0x7f379c0693e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:41.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.515+0000 7f37b6c4d700 1 --2- 172.21.15.8:0/2086620546 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37b015d6e0 0x7f37b00c3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:41.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.515+0000 7f37b6c4d700 1 --2- 172.21.15.8:0/2086620546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37b00c8870 0x7f37b00b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:41.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.515+0000 7f37b6c4d700 1 --2- 172.21.15.8:0/2086620546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37b00cb910 0x7f37b0069fd0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:41.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.515+0000 7f37b6c4d700 1 -- 172.21.15.8:0/2086620546 >> 172.21.15.8:0/2086620546 conn(0x7f37b00cd1a0 msgr2=0x7f37b0156b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:41.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.515+0000 7f37b6c4d700 1 -- 172.21.15.8:0/2086620546 shutdown_connections 2023-10-06T04:36:41.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.515+0000 7f37b6c4d700 1 -- 172.21.15.8:0/2086620546 wait complete. 2023-10-06T04:36:41.529 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T04:36:41.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.649+0000 7fae2fa3a700 1 Processor -- start 2023-10-06T04:36:41.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.649+0000 7fae2fa3a700 1 -- start start 2023-10-06T04:36:41.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.650+0000 7fae2fa3a700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fae281532d0 0x7fae280698d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:41.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.650+0000 7fae2fa3a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae28069e10 0x7fae28159530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:41.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.650+0000 7fae2fa3a700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fae281536a0 0x7fae28159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:41.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.650+0000 7fae2fa3a700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae2806a930 con 0x7fae281532d0 2023-10-06T04:36:41.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.650+0000 7fae2fa3a700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae280ca770 con 0x7fae281536a0 2023-10-06T04:36:41.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.650+0000 7fae2fa3a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae2806d6d0 con 0x7fae28069e10 2023-10-06T04:36:41.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.650+0000 7fae2d7d6700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fae281532d0 0x7fae280698d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:41.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.650+0000 7fae2d7d6700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fae281532d0 0x7fae280698d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36504/0 (socket says 172.21.15.8:36504) 2023-10-06T04:36:41.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.650+0000 7fae2d7d6700 1 -- 172.21.15.8:0/2973738043 learned_addr learned my addr 172.21.15.8:0/2973738043 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:41.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.650+0000 7fae2dfd7700 1 --2- 172.21.15.8:0/2973738043 >> v2:172.21.15.184:3300/0 conn(0x7fae281536a0 0x7fae28159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:41.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.650+0000 7fae2cfd5700 1 --2- 172.21.15.8:0/2973738043 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae28069e10 0x7fae28159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:41.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.650+0000 7fae2d7d6700 1 -- 172.21.15.8:0/2973738043 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae28069e10 msgr2=0x7fae28159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:41.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.650+0000 7fae2d7d6700 1 --2- 172.21.15.8:0/2973738043 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae28069e10 0x7fae28159530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:41.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.650+0000 7fae2d7d6700 1 -- 172.21.15.8:0/2973738043 >> v2:172.21.15.184:3300/0 conn(0x7fae281536a0 msgr2=0x7fae28159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:41.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.650+0000 7fae2d7d6700 1 --2- 172.21.15.8:0/2973738043 >> v2:172.21.15.184:3300/0 conn(0x7fae281536a0 0x7fae28159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:41.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.650+0000 7fae2d7d6700 1 -- 172.21.15.8:0/2973738043 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2806a370 con 0x7fae281532d0 2023-10-06T04:36:41.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.650+0000 7fae2d7d6700 1 --2- 172.21.15.8:0/2973738043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae281532d0 0x7fae280698d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fae28064db0 tx=0x7fae20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3170bd01fb4f5e97 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:41.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.650+0000 7fae27fff700 1 -- 172.21.15.8:0/2973738043 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2000b640 con 0x7fae281532d0 2023-10-06T04:36:41.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.651+0000 7fae27fff700 1 -- 172.21.15.8:0/2973738043 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2000b7a0 con 0x7fae281532d0 2023-10-06T04:36:41.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.651+0000 7fae27fff700 1 -- 172.21.15.8:0/2973738043 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2000bb60 con 0x7fae281532d0 2023-10-06T04:36:41.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.651+0000 7fae2fa3a700 1 -- 172.21.15.8:0/2973738043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae281532d0 msgr2=0x7fae280698d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:41.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.651+0000 7fae2fa3a700 1 --2- 172.21.15.8:0/2973738043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae281532d0 0x7fae280698d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fae28064db0 tx=0x7fae20009250 comp rx=0 tx=0).stop 2023-10-06T04:36:41.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.651+0000 7fae2fa3a700 1 -- 172.21.15.8:0/2973738043 shutdown_connections 2023-10-06T04:36:41.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.651+0000 7fae2fa3a700 1 --2- 172.21.15.8:0/2973738043 >> v2:172.21.15.184:3300/0 conn(0x7fae281536a0 0x7fae28159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:41.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.651+0000 7fae2fa3a700 1 --2- 172.21.15.8:0/2973738043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae281532d0 0x7fae280698d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:41.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.651+0000 7fae2fa3a700 1 --2- 172.21.15.8:0/2973738043 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae28069e10 0x7fae28159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:41.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.651+0000 7fae2fa3a700 1 -- 172.21.15.8:0/2973738043 >> 172.21.15.8:0/2973738043 conn(0x7fae280680a0 msgr2=0x7fae280cc020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:41.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.651+0000 7fae2fa3a700 1 -- 172.21.15.8:0/2973738043 shutdown_connections 2023-10-06T04:36:41.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.651+0000 7fae2fa3a700 1 -- 172.21.15.8:0/2973738043 wait complete. 2023-10-06T04:36:41.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.652+0000 7fae2fa3a700 1 Processor -- start 2023-10-06T04:36:41.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.653+0000 7fae2fa3a700 1 -- start start 2023-10-06T04:36:41.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.653+0000 7fae2fa3a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae28069e10 0x7fae28165b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:41.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.653+0000 7fae2fa3a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae281532d0 0x7fae280aedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:41.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.653+0000 7fae2fa3a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae281536a0 0x7fae280b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:41.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.653+0000 7fae2fa3a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae281673f0 con 0x7fae281536a0 2023-10-06T04:36:41.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.653+0000 7fae2fa3a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae28166050 con 0x7fae281532d0 2023-10-06T04:36:41.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.653+0000 7fae2fa3a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae281667e0 con 0x7fae28069e10 2023-10-06T04:36:41.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.654+0000 7fae2dfd7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae281536a0 0x7fae280b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:41.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.654+0000 7fae2dfd7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae281536a0 0x7fae280b0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36506/0 (socket says 172.21.15.8:36506) 2023-10-06T04:36:41.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.654+0000 7fae2dfd7700 1 -- 172.21.15.8:0/3216585102 learned_addr learned my addr 172.21.15.8:0/3216585102 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:41.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.654+0000 7fae2cfd5700 1 --2- 172.21.15.8:0/3216585102 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae281532d0 0x7fae280aedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:41.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.654+0000 7fae2d7d6700 1 --2- 172.21.15.8:0/3216585102 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae28069e10 0x7fae28165b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:41.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.654+0000 7fae2dfd7700 1 -- 172.21.15.8:0/3216585102 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae28069e10 msgr2=0x7fae28165b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:41.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.654+0000 7fae2dfd7700 1 --2- 172.21.15.8:0/3216585102 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae28069e10 0x7fae28165b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:41.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.654+0000 7fae2dfd7700 1 -- 172.21.15.8:0/3216585102 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae281532d0 msgr2=0x7fae280aedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:41.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.654+0000 7fae2dfd7700 1 --2- 172.21.15.8:0/3216585102 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae281532d0 0x7fae280aedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:41.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.654+0000 7fae2dfd7700 1 -- 172.21.15.8:0/3216585102 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae200094f0 con 0x7fae281536a0 2023-10-06T04:36:41.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.654+0000 7fae2d7d6700 1 --2- 172.21.15.8:0/3216585102 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae28069e10 0x7fae28165b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:41.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.654+0000 7fae2cfd5700 1 --2- 172.21.15.8:0/3216585102 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae281532d0 0x7fae280aedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:41.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.654+0000 7fae2dfd7700 1 --2- 172.21.15.8:0/3216585102 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae281536a0 0x7fae280b0ae0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fae18009e90 tx=0x7fae1800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:41.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.654+0000 7fae257fa700 1 -- 172.21.15.8:0/3216585102 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1800cc20 con 0x7fae281536a0 2023-10-06T04:36:41.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.654+0000 7fae257fa700 1 -- 172.21.15.8:0/3216585102 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1800f040 con 0x7fae281536a0 2023-10-06T04:36:41.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.654+0000 7fae257fa700 1 -- 172.21.15.8:0/3216585102 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae18014480 con 0x7fae281536a0 2023-10-06T04:36:41.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.654+0000 7fae2fa3a700 1 -- 172.21.15.8:0/3216585102 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae28166ac0 con 0x7fae281536a0 2023-10-06T04:36:41.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.654+0000 7fae2fa3a700 1 -- 172.21.15.8:0/3216585102 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae28167080 con 0x7fae281536a0 2023-10-06T04:36:41.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.655+0000 7fae2fa3a700 1 -- 172.21.15.8:0/3216585102 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae28071550 con 0x7fae281536a0 2023-10-06T04:36:41.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.656+0000 7fae257fa700 1 -- 172.21.15.8:0/3216585102 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fae18014830 con 0x7fae281536a0 2023-10-06T04:36:41.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.656+0000 7fae257fa700 1 --2- 172.21.15.8:0/3216585102 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fae14066f30 0x7fae140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:41.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.656+0000 7fae257fa700 1 -- 172.21.15.8:0/3216585102 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fae18085410 con 0x7fae281536a0 2023-10-06T04:36:41.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.656+0000 7fae2d7d6700 1 --2- 172.21.15.8:0/3216585102 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fae14066f30 0x7fae140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:41.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.657+0000 7fae2d7d6700 1 --2- 172.21.15.8:0/3216585102 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fae14066f30 0x7fae140693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fae28064db0 tx=0x7fae20018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:41.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.660+0000 7fae257fa700 1 -- 172.21.15.8:0/3216585102 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae18055cc0 con 0x7fae281536a0 2023-10-06T04:36:41.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.853+0000 7fae2fa3a700 1 -- 172.21.15.8:0/3216585102 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fae2806a650 con 0x7fae281536a0 2023-10-06T04:36:41.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.854+0000 7fae257fa700 1 -- 172.21.15.8:0/3216585102 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fae18055850 con 0x7fae281536a0 2023-10-06T04:36:41.856 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-06T04:36:41.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.856+0000 7fae2fa3a700 1 -- 172.21.15.8:0/3216585102 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fae14066f30 msgr2=0x7fae140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:41.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.856+0000 7fae2fa3a700 1 --2- 172.21.15.8:0/3216585102 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fae14066f30 0x7fae140693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fae28064db0 tx=0x7fae20018000 comp rx=0 tx=0).stop 2023-10-06T04:36:41.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.856+0000 7fae2fa3a700 1 -- 172.21.15.8:0/3216585102 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae281536a0 msgr2=0x7fae280b0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:41.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.856+0000 7fae2fa3a700 1 --2- 172.21.15.8:0/3216585102 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae281536a0 0x7fae280b0ae0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fae18009e90 tx=0x7fae1800b040 comp rx=0 tx=0).stop 2023-10-06T04:36:41.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.856+0000 7fae2fa3a700 1 -- 172.21.15.8:0/3216585102 shutdown_connections 2023-10-06T04:36:41.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.856+0000 7fae2fa3a700 1 --2- 172.21.15.8:0/3216585102 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fae14066f30 0x7fae140693e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:41.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.856+0000 7fae2fa3a700 1 --2- 172.21.15.8:0/3216585102 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae281536a0 0x7fae280b0ae0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:41.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.856+0000 7fae2fa3a700 1 --2- 172.21.15.8:0/3216585102 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae28069e10 0x7fae28165b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:41.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.856+0000 7fae2fa3a700 1 --2- 172.21.15.8:0/3216585102 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae281532d0 0x7fae280aedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:41.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.856+0000 7fae2fa3a700 1 -- 172.21.15.8:0/3216585102 >> 172.21.15.8:0/3216585102 conn(0x7fae280680a0 msgr2=0x7fae280c1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:41.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.856+0000 7fae2fa3a700 1 -- 172.21.15.8:0/3216585102 shutdown_connections 2023-10-06T04:36:41.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.856+0000 7fae2fa3a700 1 -- 172.21.15.8:0/3216585102 wait complete. 2023-10-06T04:36:41.870 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:36:41.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.985+0000 7f0aaa83e700 1 Processor -- start 2023-10-06T04:36:41.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.985+0000 7f0aaa83e700 1 -- start start 2023-10-06T04:36:41.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.986+0000 7f0aaa83e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f0aa40af680 0x7f0aa415e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:41.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.986+0000 7f0aaa83e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0aa40d0aa0 0x7f0aa40cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:41.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.986+0000 7f0aaa83e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa40cc4c0 con 0x7f0aa40cb360 2023-10-06T04:36:41.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.986+0000 7f0aaa83e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aa415d460 con 0x7f0aa40af680 2023-10-06T04:36:41.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.986+0000 7f0aaa83e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa415e580 con 0x7f0aa40d0aa0 2023-10-06T04:36:41.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.986+0000 7f0aa8ddb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0aa40d0aa0 0x7f0aa40cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:41.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.986+0000 7f0aa8ddb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0aa40d0aa0 0x7f0aa40cc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.8:60826/0 (socket says 172.21.15.8:60826) 2023-10-06T04:36:41.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.986+0000 7f0aa8ddb700 1 -- 172.21.15.8:0/55414445 learned_addr learned my addr 172.21.15.8:0/55414445 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:41.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.986+0000 7f0aa3fff700 1 --2- 172.21.15.8:0/55414445 >> v2:172.21.15.184:3300/0 conn(0x7f0aa40af680 0x7f0aa415e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:41.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.987+0000 7f0aa8ddb700 1 -- 172.21.15.8:0/55414445 >> v2:172.21.15.184:3300/0 conn(0x7f0aa40af680 msgr2=0x7f0aa415e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:41.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.987+0000 7f0aa8ddb700 1 --2- 172.21.15.8:0/55414445 >> v2:172.21.15.184:3300/0 conn(0x7f0aa40af680 0x7f0aa415e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:41.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.987+0000 7f0aa8ddb700 1 -- 172.21.15.8:0/55414445 >> v1:172.21.15.184:6789/0 conn(0x7f0aa40cb360 legacy=0x7f0aa40d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:41.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.987+0000 7f0aa8ddb700 1 -- 172.21.15.8:0/55414445 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa40cb8b0 con 0x7f0aa40d0aa0 2023-10-06T04:36:41.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.987+0000 7f0aa8ddb700 1 --2- 172.21.15.8:0/55414445 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0aa40d0aa0 0x7f0aa40cc950 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c009f20 tx=0x7f0a9c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=452eb16e644be15b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:41.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.987+0000 7f0aa2ffd700 1 -- 172.21.15.8:0/55414445 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c00e070 con 0x7f0aa40d0aa0 2023-10-06T04:36:41.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.987+0000 7f0aa2ffd700 1 -- 172.21.15.8:0/55414445 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9c00b9d0 con 0x7f0aa40d0aa0 2023-10-06T04:36:41.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.987+0000 7f0aa2ffd700 1 -- 172.21.15.8:0/55414445 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c0092e0 con 0x7f0aa40d0aa0 2023-10-06T04:36:41.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.988+0000 7f0aaa83e700 1 -- 172.21.15.8:0/55414445 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0aa40d0aa0 msgr2=0x7f0aa40cc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:41.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.988+0000 7f0aaa83e700 1 --2- 172.21.15.8:0/55414445 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0aa40d0aa0 0x7f0aa40cc950 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c009f20 tx=0x7f0a9c009840 comp rx=0 tx=0).stop 2023-10-06T04:36:41.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.988+0000 7f0aaa83e700 1 -- 172.21.15.8:0/55414445 shutdown_connections 2023-10-06T04:36:41.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.988+0000 7f0aaa83e700 1 --2- 172.21.15.8:0/55414445 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0aa40d0aa0 0x7f0aa40cc950 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:41.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.988+0000 7f0aaa83e700 1 --2- 172.21.15.8:0/55414445 >> v2:172.21.15.184:3300/0 conn(0x7f0aa40af680 0x7f0aa415e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:41.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.988+0000 7f0aaa83e700 1 -- 172.21.15.8:0/55414445 >> 172.21.15.8:0/55414445 conn(0x7f0aa40633d0 msgr2=0x7f0aa40637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:41.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.988+0000 7f0aaa83e700 1 -- 172.21.15.8:0/55414445 shutdown_connections 2023-10-06T04:36:41.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.988+0000 7f0aaa83e700 1 -- 172.21.15.8:0/55414445 wait complete. 2023-10-06T04:36:41.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.989+0000 7f0aaa83e700 1 Processor -- start 2023-10-06T04:36:41.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.989+0000 7f0aaa83e700 1 -- start start 2023-10-06T04:36:41.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.990+0000 7f0aaa83e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0aa40af680 0x7f0aa4158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:41.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.990+0000 7f0aaa83e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0aa40cb360 0x7f0aa4169a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:41.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.990+0000 7f0aaa83e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0aa40d0aa0 0x7f0aa415bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:41.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.990+0000 7f0aaa83e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa416a9c0 con 0x7f0aa40af680 2023-10-06T04:36:41.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.990+0000 7f0aaa83e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa416d510 con 0x7f0aa40d0aa0 2023-10-06T04:36:41.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.990+0000 7f0aaa83e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa416a400 con 0x7f0aa40cb360 2023-10-06T04:36:41.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.990+0000 7f0aa3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0aa40af680 0x7f0aa4158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:41.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.990+0000 7f0aa3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0aa40af680 0x7f0aa4158130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36508/0 (socket says 172.21.15.8:36508) 2023-10-06T04:36:41.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.990+0000 7f0aa3fff700 1 -- 172.21.15.8:0/679973365 learned_addr learned my addr 172.21.15.8:0/679973365 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:41.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.990+0000 7f0aa37fe700 1 --2- 172.21.15.8:0/679973365 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0aa40cb360 0x7f0aa4169a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:41.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.990+0000 7f0aa8ddb700 1 --2- 172.21.15.8:0/679973365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0aa40d0aa0 0x7f0aa415bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:41.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.990+0000 7f0aa3fff700 1 -- 172.21.15.8:0/679973365 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0aa40cb360 msgr2=0x7f0aa4169a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:41.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.990+0000 7f0aa3fff700 1 --2- 172.21.15.8:0/679973365 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0aa40cb360 0x7f0aa4169a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:41.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.990+0000 7f0aa3fff700 1 -- 172.21.15.8:0/679973365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0aa40d0aa0 msgr2=0x7f0aa415bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:41.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.990+0000 7f0aa3fff700 1 --2- 172.21.15.8:0/679973365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0aa40d0aa0 0x7f0aa415bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:41.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.990+0000 7f0aa3fff700 1 -- 172.21.15.8:0/679973365 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9c009ae0 con 0x7f0aa40af680 2023-10-06T04:36:41.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.990+0000 7f0aa3fff700 1 --2- 172.21.15.8:0/679973365 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0aa40af680 0x7f0aa4158130 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0a9400e960 tx=0x7f0a940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:41.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.990+0000 7f0a9bfff700 1 -- 172.21.15.8:0/679973365 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9400c850 con 0x7f0aa40af680 2023-10-06T04:36:41.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.990+0000 7f0a9bfff700 1 -- 172.21.15.8:0/679973365 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9400c9b0 con 0x7f0aa40af680 2023-10-06T04:36:41.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.990+0000 7f0aaa83e700 1 -- 172.21.15.8:0/679973365 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa416a6e0 con 0x7f0aa40af680 2023-10-06T04:36:41.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.991+0000 7f0a9bfff700 1 -- 172.21.15.8:0/679973365 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9400cd50 con 0x7f0aa40af680 2023-10-06T04:36:41.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.991+0000 7f0aaa83e700 1 -- 172.21.15.8:0/679973365 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa4158670 con 0x7f0aa40af680 2023-10-06T04:36:41.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.991+0000 7f0aaa83e700 1 -- 172.21.15.8:0/679973365 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa416d7f0 con 0x7f0aa40af680 2023-10-06T04:36:41.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.992+0000 7f0a9bfff700 1 -- 172.21.15.8:0/679973365 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0a94013680 con 0x7f0aa40af680 2023-10-06T04:36:41.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.992+0000 7f0a9bfff700 1 --2- 172.21.15.8:0/679973365 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f0a84066f30 0x7f0a840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:41.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.992+0000 7f0a9bfff700 1 -- 172.21.15.8:0/679973365 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0a94084bb0 con 0x7f0aa40af680 2023-10-06T04:36:41.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.992+0000 7f0aa37fe700 1 --2- 172.21.15.8:0/679973365 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f0a84066f30 0x7f0a840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:41.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.993+0000 7f0aa37fe700 1 --2- 172.21.15.8:0/679973365 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f0a84066f30 0x7f0a840693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0aa415d0e0 tx=0x7f0a8c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:41.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:41.997+0000 7f0a9bfff700 1 -- 172.21.15.8:0/679973365 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a940519d0 con 0x7f0aa40af680 2023-10-06T04:36:42.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.233+0000 7f0aaa83e700 1 -- 172.21.15.8:0/679973365 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0aa416d360 con 0x7f0aa40af680 2023-10-06T04:36:42.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.233+0000 7f0a9bfff700 1 -- 172.21.15.8:0/679973365 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4587 (secure 0 0 0) 0x7f0a94054ff0 con 0x7f0aa40af680 2023-10-06T04:36:42.236 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:36:42.236 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/516627422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":516627422},{"type":"v1","addr":"172.21.15.8:6835","nonce":516627422}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/1078182353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1078182353},{"type":"v1","addr":"172.21.15.8:6834","nonce":1078182353}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/181555783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":181555783},{"type":"v1","addr":"172.21.15.184:6836","nonce":181555783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:36:16.632579+0000","modified":"2023-10-06T04:36:29.752096+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/2590100121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":2590100121},{"type":"v1","addr":"172.21.15.184:6837","nonce":2590100121}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:36:42.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.236+0000 7f0aaa83e700 1 -- 172.21.15.8:0/679973365 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f0a84066f30 msgr2=0x7f0a840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:42.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.236+0000 7f0aaa83e700 1 --2- 172.21.15.8:0/679973365 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f0a84066f30 0x7f0a840693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0aa415d0e0 tx=0x7f0a8c009040 comp rx=0 tx=0).stop 2023-10-06T04:36:42.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.236+0000 7f0aaa83e700 1 -- 172.21.15.8:0/679973365 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0aa40af680 msgr2=0x7f0aa4158130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:42.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.236+0000 7f0aaa83e700 1 --2- 172.21.15.8:0/679973365 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0aa40af680 0x7f0aa4158130 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0a9400e960 tx=0x7f0a940091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:42.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.236+0000 7f0aaa83e700 1 -- 172.21.15.8:0/679973365 shutdown_connections 2023-10-06T04:36:42.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.236+0000 7f0aaa83e700 1 --2- 172.21.15.8:0/679973365 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f0a84066f30 0x7f0a840693e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:42.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.236+0000 7f0aaa83e700 1 --2- 172.21.15.8:0/679973365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0aa40d0aa0 0x7f0aa415bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:42.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.236+0000 7f0aaa83e700 1 --2- 172.21.15.8:0/679973365 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0aa40af680 0x7f0aa4158130 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:42.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.236+0000 7f0aaa83e700 1 --2- 172.21.15.8:0/679973365 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0aa40cb360 0x7f0aa4169a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:42.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.236+0000 7f0aaa83e700 1 -- 172.21.15.8:0/679973365 >> 172.21.15.8:0/679973365 conn(0x7f0aa40633d0 msgr2=0x7f0aa40ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:42.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.236+0000 7f0aaa83e700 1 -- 172.21.15.8:0/679973365 shutdown_connections 2023-10-06T04:36:42.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.236+0000 7f0aaa83e700 1 -- 172.21.15.8:0/679973365 wait complete. 2023-10-06T04:36:42.240 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 9 2023-10-06T04:36:42.250 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:36:42.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.366+0000 7f6f2f826700 1 Processor -- start 2023-10-06T04:36:42.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.367+0000 7f6f2f826700 1 -- start start 2023-10-06T04:36:42.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.367+0000 7f6f2f826700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6f280c99a0 0x7f6f2815a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:42.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.367+0000 7f6f2f826700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f28157540 con 0x7f6f280c7630 2023-10-06T04:36:42.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.367+0000 7f6f2f826700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f280ca030 con 0x7f6f28157170 2023-10-06T04:36:42.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.367+0000 7f6f2f826700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f280c9e20 con 0x7f6f280c99a0 2023-10-06T04:36:42.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.367+0000 7f6f2cdc1700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6f280c99a0 0x7f6f2815a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:42.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.368+0000 7f6f2ddc3700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f6f280c7630 0x7f6f280c7a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:52598/0 (socket says 172.21.15.8:52598) 2023-10-06T04:36:42.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.368+0000 7f6f2ddc3700 1 -- 172.21.15.8:0/2514828999 learned_addr learned my addr 172.21.15.8:0/2514828999 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:42.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.368+0000 7f6f2cdc1700 1 -- 172.21.15.8:0/2514828999 >> v1:172.21.15.184:6789/0 conn(0x7f6f28157170 legacy=0x7f6f2815da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:42.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.368+0000 7f6f2cdc1700 1 -- 172.21.15.8:0/2514828999 >> v1:172.21.15.8:6789/0 conn(0x7f6f280c7630 legacy=0x7f6f280c7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:42.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.368+0000 7f6f2cdc1700 1 -- 172.21.15.8:0/2514828999 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f280ca310 con 0x7f6f280c99a0 2023-10-06T04:36:42.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.368+0000 7f6f27fff700 1 -- 172.21.15.8:0/2514828999 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2932924963 0 0) 0x7f6f28157540 con 0x7f6f280c7630 2023-10-06T04:36:42.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.368+0000 7f6f2cdc1700 1 --2- 172.21.15.8:0/2514828999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f280c99a0 0x7f6f2815a4b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c0098e0 tx=0x7f6f1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eebfa3d0143c9128 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:42.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.368+0000 7f6f27fff700 1 -- 172.21.15.8:0/2514828999 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c009e80 con 0x7f6f280c99a0 2023-10-06T04:36:42.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.368+0000 7f6f27fff700 1 -- 172.21.15.8:0/2514828999 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1c00b860 con 0x7f6f280c99a0 2023-10-06T04:36:42.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.368+0000 7f6f27fff700 1 -- 172.21.15.8:0/2514828999 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c00bbe0 con 0x7f6f280c99a0 2023-10-06T04:36:42.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.369+0000 7f6f2f826700 1 -- 172.21.15.8:0/2514828999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f280c99a0 msgr2=0x7f6f2815a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:42.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.369+0000 7f6f2f826700 1 --2- 172.21.15.8:0/2514828999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f280c99a0 0x7f6f2815a4b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c0098e0 tx=0x7f6f1c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:42.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.369+0000 7f6f2f826700 1 -- 172.21.15.8:0/2514828999 shutdown_connections 2023-10-06T04:36:42.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.369+0000 7f6f2f826700 1 --2- 172.21.15.8:0/2514828999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f280c99a0 0x7f6f2815a4b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:42.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.369+0000 7f6f2f826700 1 -- 172.21.15.8:0/2514828999 >> 172.21.15.8:0/2514828999 conn(0x7f6f280686e0 msgr2=0x7f6f28068ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:42.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.369+0000 7f6f2f826700 1 -- 172.21.15.8:0/2514828999 shutdown_connections 2023-10-06T04:36:42.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.369+0000 7f6f2f826700 1 -- 172.21.15.8:0/2514828999 wait complete. 2023-10-06T04:36:42.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.370+0000 7f6f2f826700 1 Processor -- start 2023-10-06T04:36:42.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.370+0000 7f6f2f826700 1 -- start start 2023-10-06T04:36:42.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.371+0000 7f6f2f826700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f280c7630 0x7f6f28154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:42.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.371+0000 7f6f2f826700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f280c99a0 0x7f6f280b2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:42.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.371+0000 7f6f2f826700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f28157170 0x7f6f280b2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:42.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.371+0000 7f6f2f826700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f28155150 con 0x7f6f28157170 2023-10-06T04:36:42.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.371+0000 7f6f2f826700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2816b1a0 con 0x7f6f280c99a0 2023-10-06T04:36:42.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.371+0000 7f6f2f826700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f280c0af0 con 0x7f6f280c7630 2023-10-06T04:36:42.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.371+0000 7f6f2ddc3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f28157170 0x7f6f280b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:42.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.371+0000 7f6f2ddc3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f28157170 0x7f6f280b2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36518/0 (socket says 172.21.15.8:36518) 2023-10-06T04:36:42.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.371+0000 7f6f2ddc3700 1 -- 172.21.15.8:0/3266700507 learned_addr learned my addr 172.21.15.8:0/3266700507 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:42.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.371+0000 7f6f2d5c2700 1 --2- 172.21.15.8:0/3266700507 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f280c7630 0x7f6f28154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:42.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.371+0000 7f6f2cdc1700 1 --2- 172.21.15.8:0/3266700507 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f280c99a0 0x7f6f280b2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:42.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.371+0000 7f6f2ddc3700 1 -- 172.21.15.8:0/3266700507 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f280c7630 msgr2=0x7f6f28154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:42.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.371+0000 7f6f2ddc3700 1 --2- 172.21.15.8:0/3266700507 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f280c7630 0x7f6f28154c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:42.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.371+0000 7f6f2ddc3700 1 -- 172.21.15.8:0/3266700507 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f280c99a0 msgr2=0x7f6f280b2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:42.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.371+0000 7f6f2ddc3700 1 --2- 172.21.15.8:0/3266700507 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f280c99a0 0x7f6f280b2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:42.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.371+0000 7f6f2ddc3700 1 -- 172.21.15.8:0/3266700507 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f1c009420 con 0x7f6f28157170 2023-10-06T04:36:42.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.371+0000 7f6f2d5c2700 1 --2- 172.21.15.8:0/3266700507 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f280c7630 0x7f6f28154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:42.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.371+0000 7f6f2cdc1700 1 --2- 172.21.15.8:0/3266700507 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f280c99a0 0x7f6f280b2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:42.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.371+0000 7f6f2ddc3700 1 --2- 172.21.15.8:0/3266700507 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f28157170 0x7f6f280b2790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6f1800ccc0 tx=0x7f6f18001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:42.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.372+0000 7f6f257fa700 1 -- 172.21.15.8:0/3266700507 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1800ab10 con 0x7f6f28157170 2023-10-06T04:36:42.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.372+0000 7f6f257fa700 1 -- 172.21.15.8:0/3266700507 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1800ac70 con 0x7f6f28157170 2023-10-06T04:36:42.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.372+0000 7f6f2f826700 1 -- 172.21.15.8:0/3266700507 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f280c0dd0 con 0x7f6f28157170 2023-10-06T04:36:42.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.372+0000 7f6f257fa700 1 -- 172.21.15.8:0/3266700507 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f180070f0 con 0x7f6f28157170 2023-10-06T04:36:42.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.372+0000 7f6f2f826700 1 -- 172.21.15.8:0/3266700507 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f280c1390 con 0x7f6f28157170 2023-10-06T04:36:42.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.373+0000 7f6f2f826700 1 -- 172.21.15.8:0/3266700507 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f28071550 con 0x7f6f28157170 2023-10-06T04:36:42.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.373+0000 7f6f257fa700 1 -- 172.21.15.8:0/3266700507 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6f18007520 con 0x7f6f28157170 2023-10-06T04:36:42.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.373+0000 7f6f257fa700 1 --2- 172.21.15.8:0/3266700507 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6f14066f30 0x7f6f140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:42.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.373+0000 7f6f257fa700 1 -- 172.21.15.8:0/3266700507 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6f18084dd0 con 0x7f6f28157170 2023-10-06T04:36:42.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.374+0000 7f6f2d5c2700 1 --2- 172.21.15.8:0/3266700507 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6f14066f30 0x7f6f140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:42.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.374+0000 7f6f2d5c2700 1 --2- 172.21.15.8:0/3266700507 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6f14066f30 0x7f6f140693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6f20007fd0 tx=0x7f6f20009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:42.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.378+0000 7f6f257fa700 1 -- 172.21.15.8:0/3266700507 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f18051c70 con 0x7f6f28157170 2023-10-06T04:36:42.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.576+0000 7f6f2f826700 1 -- 172.21.15.8:0/3266700507 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f2815d290 con 0x7f6f28157170 2023-10-06T04:36:42.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.577+0000 7f6f257fa700 1 -- 172.21.15.8:0/3266700507 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f6f18086090 con 0x7f6f28157170 2023-10-06T04:36:42.580 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:36:42.580 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":25,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:36:21.690266+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:36:10.148177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:36:10.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:36:14.390671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:36:15.601089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:36:19.291300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.555871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.490505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.504578+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.517217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:05.991135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.537329+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.543232+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.443715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:36:42.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.579+0000 7f6f2f826700 1 -- 172.21.15.8:0/3266700507 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6f14066f30 msgr2=0x7f6f140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:42.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.579+0000 7f6f2f826700 1 --2- 172.21.15.8:0/3266700507 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6f14066f30 0x7f6f140693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6f20007fd0 tx=0x7f6f20009040 comp rx=0 tx=0).stop 2023-10-06T04:36:42.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.579+0000 7f6f2f826700 1 -- 172.21.15.8:0/3266700507 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f28157170 msgr2=0x7f6f280b2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:42.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.579+0000 7f6f2f826700 1 --2- 172.21.15.8:0/3266700507 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f28157170 0x7f6f280b2790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6f1800ccc0 tx=0x7f6f18001a20 comp rx=0 tx=0).stop 2023-10-06T04:36:42.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.579+0000 7f6f2f826700 1 -- 172.21.15.8:0/3266700507 shutdown_connections 2023-10-06T04:36:42.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.579+0000 7f6f2f826700 1 --2- 172.21.15.8:0/3266700507 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6f14066f30 0x7f6f140693e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:42.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.579+0000 7f6f2f826700 1 --2- 172.21.15.8:0/3266700507 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f28157170 0x7f6f280b2790 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:42.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.579+0000 7f6f2f826700 1 --2- 172.21.15.8:0/3266700507 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f280c7630 0x7f6f28154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:42.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.579+0000 7f6f2f826700 1 --2- 172.21.15.8:0/3266700507 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f280c99a0 0x7f6f280b2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:42.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.579+0000 7f6f2f826700 1 -- 172.21.15.8:0/3266700507 >> 172.21.15.8:0/3266700507 conn(0x7f6f280686e0 msgr2=0x7f6f281559c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:42.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.579+0000 7f6f2f826700 1 -- 172.21.15.8:0/3266700507 shutdown_connections 2023-10-06T04:36:42.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.579+0000 7f6f2f826700 1 -- 172.21.15.8:0/3266700507 wait complete. 2023-10-06T04:36:42.594 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:36:42.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.711+0000 7f8439425700 1 Processor -- start 2023-10-06T04:36:42.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.711+0000 7f8439425700 1 -- start start 2023-10-06T04:36:42.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.711+0000 7f8439425700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f84340d0aa0 0x7f84341649b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:42.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.711+0000 7f8439425700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84340cc4c0 con 0x7f84340af680 2023-10-06T04:36:42.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.711+0000 7f8439425700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84340cb8b0 con 0x7f84340cb360 2023-10-06T04:36:42.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.711+0000 7f8439425700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f843415d460 con 0x7f84340d0aa0 2023-10-06T04:36:42.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.712+0000 7f84337fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f84340d0aa0 0x7f84341649b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:42.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.712+0000 7f8432ffd700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f84340af680 0x7f843415e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:52606/0 (socket says 172.21.15.8:52606) 2023-10-06T04:36:42.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.712+0000 7f84337fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f84340d0aa0 0x7f84341649b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36524/0 (socket says 172.21.15.8:36524) 2023-10-06T04:36:42.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.712+0000 7f8432ffd700 1 -- 172.21.15.8:0/2094760709 learned_addr learned my addr 172.21.15.8:0/2094760709 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:42.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.712+0000 7f84337fe700 1 -- 172.21.15.8:0/2094760709 >> v1:172.21.15.184:6789/0 conn(0x7f84340cb360 legacy=0x7f84340d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:42.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.712+0000 7f84337fe700 1 -- 172.21.15.8:0/2094760709 >> v1:172.21.15.8:6789/0 conn(0x7f84340af680 legacy=0x7f843415e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:42.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.712+0000 7f8431ffb700 1 -- 172.21.15.8:0/2094760709 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3155681322 0 0) 0x7f84340cb8b0 con 0x7f84340cb360 2023-10-06T04:36:42.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.712+0000 7f84337fe700 1 -- 172.21.15.8:0/2094760709 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84340cbb90 con 0x7f84340d0aa0 2023-10-06T04:36:42.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.712+0000 7f84337fe700 1 --2- 172.21.15.8:0/2094760709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84340d0aa0 0x7f84341649b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f842c009e60 tx=0x7f842c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a2760ea95fc5c8a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:42.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.712+0000 7f8431ffb700 1 -- 172.21.15.8:0/2094760709 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c00e070 con 0x7f84340d0aa0 2023-10-06T04:36:42.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.712+0000 7f8431ffb700 1 -- 172.21.15.8:0/2094760709 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842c00bb30 con 0x7f84340d0aa0 2023-10-06T04:36:42.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.712+0000 7f8431ffb700 1 -- 172.21.15.8:0/2094760709 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c012430 con 0x7f84340d0aa0 2023-10-06T04:36:42.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.713+0000 7f8439425700 1 -- 172.21.15.8:0/2094760709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84340d0aa0 msgr2=0x7f84341649b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:42.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.713+0000 7f8439425700 1 --2- 172.21.15.8:0/2094760709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84340d0aa0 0x7f84341649b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f842c009e60 tx=0x7f842c009780 comp rx=0 tx=0).stop 2023-10-06T04:36:42.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.713+0000 7f8439425700 1 -- 172.21.15.8:0/2094760709 shutdown_connections 2023-10-06T04:36:42.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.713+0000 7f8439425700 1 --2- 172.21.15.8:0/2094760709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84340d0aa0 0x7f84341649b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:42.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.713+0000 7f8439425700 1 -- 172.21.15.8:0/2094760709 >> 172.21.15.8:0/2094760709 conn(0x7f84340633d0 msgr2=0x7f84340637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:42.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.713+0000 7f8439425700 1 -- 172.21.15.8:0/2094760709 shutdown_connections 2023-10-06T04:36:42.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.713+0000 7f8439425700 1 -- 172.21.15.8:0/2094760709 wait complete. 2023-10-06T04:36:42.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.714+0000 7f8439425700 1 Processor -- start 2023-10-06T04:36:42.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.714+0000 7f8439425700 1 -- start start 2023-10-06T04:36:42.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.715+0000 7f8439425700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84340af680 0x7f84340c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:42.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.715+0000 7f8439425700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84340cb360 0x7f843414b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:42.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.715+0000 7f8439425700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84340d0aa0 0x7f84340cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:42.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.715+0000 7f8439425700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84340c92a0 con 0x7f84340cb360 2023-10-06T04:36:42.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.715+0000 7f8439425700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84340c8690 con 0x7f84340d0aa0 2023-10-06T04:36:42.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.715+0000 7f8439425700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84340c8970 con 0x7f84340af680 2023-10-06T04:36:42.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.715+0000 7f84327fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84340cb360 0x7f843414b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:42.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.715+0000 7f84327fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84340cb360 0x7f843414b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36538/0 (socket says 172.21.15.8:36538) 2023-10-06T04:36:42.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.715+0000 7f84327fc700 1 -- 172.21.15.8:0/2482929151 learned_addr learned my addr 172.21.15.8:0/2482929151 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:42.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.715+0000 7f8432ffd700 1 --2- 172.21.15.8:0/2482929151 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84340af680 0x7f84340c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:42.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.715+0000 7f84337fe700 1 --2- 172.21.15.8:0/2482929151 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84340d0aa0 0x7f84340cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:42.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.715+0000 7f84327fc700 1 -- 172.21.15.8:0/2482929151 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84340af680 msgr2=0x7f84340c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:42.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.715+0000 7f84327fc700 1 --2- 172.21.15.8:0/2482929151 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84340af680 0x7f84340c7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:42.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.715+0000 7f84327fc700 1 -- 172.21.15.8:0/2482929151 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84340d0aa0 msgr2=0x7f84340cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:42.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.715+0000 7f84327fc700 1 --2- 172.21.15.8:0/2482929151 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84340d0aa0 0x7f84340cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:42.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.715+0000 7f84327fc700 1 -- 172.21.15.8:0/2482929151 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f842c009a20 con 0x7f84340cb360 2023-10-06T04:36:42.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.715+0000 7f84337fe700 1 --2- 172.21.15.8:0/2482929151 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84340d0aa0 0x7f84340cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:42.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.715+0000 7f84327fc700 1 --2- 172.21.15.8:0/2482929151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84340cb360 0x7f843414b830 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f841c00c7e0 tx=0x7f841c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:42.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.716+0000 7f842affd700 1 -- 172.21.15.8:0/2482929151 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c011590 con 0x7f84340cb360 2023-10-06T04:36:42.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.716+0000 7f842affd700 1 -- 172.21.15.8:0/2482929151 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841c011710 con 0x7f84340cb360 2023-10-06T04:36:42.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.716+0000 7f8439425700 1 -- 172.21.15.8:0/2482929151 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84340c8c50 con 0x7f84340cb360 2023-10-06T04:36:42.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.716+0000 7f842affd700 1 -- 172.21.15.8:0/2482929151 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c011ad0 con 0x7f84340cb360 2023-10-06T04:36:42.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.716+0000 7f8439425700 1 -- 172.21.15.8:0/2482929151 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84340c8400 con 0x7f84340cb360 2023-10-06T04:36:42.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.717+0000 7f8439425700 1 -- 172.21.15.8:0/2482929151 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84340c9410 con 0x7f84340cb360 2023-10-06T04:36:42.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.717+0000 7f842affd700 1 -- 172.21.15.8:0/2482929151 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f841c01b3b0 con 0x7f84340cb360 2023-10-06T04:36:42.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.717+0000 7f842affd700 1 --2- 172.21.15.8:0/2482929151 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8414066f30 0x7f84140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:42.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.718+0000 7f842affd700 1 -- 172.21.15.8:0/2482929151 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f841c083fe0 con 0x7f84340cb360 2023-10-06T04:36:42.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.718+0000 7f8432ffd700 1 --2- 172.21.15.8:0/2482929151 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8414066f30 0x7f84140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:42.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.718+0000 7f8432ffd700 1 --2- 172.21.15.8:0/2482929151 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8414066f30 0x7f84140693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f84240058d0 tx=0x7f8424009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:42.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.722+0000 7f842affd700 1 -- 172.21.15.8:0/2482929151 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f841c050da0 con 0x7f84340cb360 2023-10-06T04:36:42.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.960+0000 7f8439425700 1 -- 172.21.15.8:0/2482929151 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8434071550 con 0x7f84340cb360 2023-10-06T04:36:42.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.961+0000 7f842affd700 1 -- 172.21.15.8:0/2482929151 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4587 (secure 0 0 0) 0x7f841c017070 con 0x7f84340cb360 2023-10-06T04:36:42.964 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:36:42.964 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/516627422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":516627422},{"type":"v1","addr":"172.21.15.8:6835","nonce":516627422}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/1078182353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1078182353},{"type":"v1","addr":"172.21.15.8:6834","nonce":1078182353}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/181555783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":181555783},{"type":"v1","addr":"172.21.15.184:6836","nonce":181555783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:36:16.632579+0000","modified":"2023-10-06T04:36:29.752096+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/2590100121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":2590100121},{"type":"v1","addr":"172.21.15.184:6837","nonce":2590100121}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:36:42.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.963+0000 7f8439425700 1 -- 172.21.15.8:0/2482929151 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8414066f30 msgr2=0x7f84140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:42.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.963+0000 7f8439425700 1 --2- 172.21.15.8:0/2482929151 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8414066f30 0x7f84140693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f84240058d0 tx=0x7f8424009040 comp rx=0 tx=0).stop 2023-10-06T04:36:42.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.963+0000 7f8439425700 1 -- 172.21.15.8:0/2482929151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84340cb360 msgr2=0x7f843414b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:42.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.963+0000 7f8439425700 1 --2- 172.21.15.8:0/2482929151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84340cb360 0x7f843414b830 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f841c00c7e0 tx=0x7f841c007df0 comp rx=0 tx=0).stop 2023-10-06T04:36:42.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.963+0000 7f8439425700 1 -- 172.21.15.8:0/2482929151 shutdown_connections 2023-10-06T04:36:42.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.963+0000 7f8439425700 1 --2- 172.21.15.8:0/2482929151 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8414066f30 0x7f84140693e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:42.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.963+0000 7f8439425700 1 --2- 172.21.15.8:0/2482929151 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84340d0aa0 0x7f84340cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:42.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.963+0000 7f8439425700 1 --2- 172.21.15.8:0/2482929151 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84340af680 0x7f84340c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:42.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.963+0000 7f8439425700 1 --2- 172.21.15.8:0/2482929151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84340cb360 0x7f843414b830 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:42.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.963+0000 7f8439425700 1 -- 172.21.15.8:0/2482929151 >> 172.21.15.8:0/2482929151 conn(0x7f84340633d0 msgr2=0x7f84340cd310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:42.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.963+0000 7f8439425700 1 -- 172.21.15.8:0/2482929151 shutdown_connections 2023-10-06T04:36:42.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:42.963+0000 7f8439425700 1 -- 172.21.15.8:0/2482929151 wait complete. 2023-10-06T04:36:42.967 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 9 2023-10-06T04:36:43.379 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T04:36:16.632579+0000', 'modified': '2023-10-06T04:36:29.752096+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4284}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4284': {'gid': 4284, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.184:6837/2590100121', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6835', 'nonce': 2590100121}, {'type': 'v1', 'addr': '172.21.15.184:6837', 'nonce': 2590100121}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T04:36:43.380 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T04:36:43.380 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-06T04:36:43.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.502+0000 7f7c5d947700 1 Processor -- start 2023-10-06T04:36:43.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.502+0000 7f7c5d947700 1 -- start start 2023-10-06T04:36:43.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.503+0000 7f7c5d947700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c580b1c70 0x7f7c580b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:43.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.503+0000 7f7c5d947700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7c5815ad80 0x7f7c5815b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:43.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.503+0000 7f7c5d947700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c580b2620 con 0x7f7c58156e30 2023-10-06T04:36:43.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.503+0000 7f7c5d947700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c580cf370 con 0x7f7c5815ad80 2023-10-06T04:36:43.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.503+0000 7f7c5d947700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c580ce800 con 0x7f7c580b1c70 2023-10-06T04:36:43.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.503+0000 7f7c57fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c580b1c70 0x7f7c580b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:43.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.503+0000 7f7c57fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c580b1c70 0x7f7c580b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.8:60848/0 (socket says 172.21.15.8:60848) 2023-10-06T04:36:43.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.503+0000 7f7c57fff700 1 -- 172.21.15.8:0/1135096597 learned_addr learned my addr 172.21.15.8:0/1135096597 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:43.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.503+0000 7f7c5d146700 1 --2- 172.21.15.8:0/1135096597 >> v2:172.21.15.184:3300/0 conn(0x7f7c5815ad80 0x7f7c5815b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:43.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.504+0000 7f7c57fff700 1 -- 172.21.15.8:0/1135096597 >> v2:172.21.15.184:3300/0 conn(0x7f7c5815ad80 msgr2=0x7f7c5815b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:43.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.504+0000 7f7c57fff700 1 --2- 172.21.15.8:0/1135096597 >> v2:172.21.15.184:3300/0 conn(0x7f7c5815ad80 0x7f7c5815b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:43.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.504+0000 7f7c57fff700 1 -- 172.21.15.8:0/1135096597 >> v1:172.21.15.184:6789/0 conn(0x7f7c58156e30 legacy=0x7f7c580cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:43.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.504+0000 7f7c57fff700 1 -- 172.21.15.8:0/1135096597 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c580cea60 con 0x7f7c580b1c70 2023-10-06T04:36:43.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.504+0000 7f7c5d146700 1 --2- 172.21.15.8:0/1135096597 >> v2:172.21.15.184:3300/0 conn(0x7f7c5815ad80 0x7f7c5815b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:36:43.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.504+0000 7f7c57fff700 1 --2- 172.21.15.8:0/1135096597 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c580b1c70 0x7f7c580b20e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7c580cec50 tx=0x7f7c48009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17fa32bf764b041a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:43.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.504+0000 7f7c577fe700 1 -- 172.21.15.8:0/1135096597 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c48009e70 con 0x7f7c580b1c70 2023-10-06T04:36:43.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.504+0000 7f7c577fe700 1 -- 172.21.15.8:0/1135096597 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4800b860 con 0x7f7c580b1c70 2023-10-06T04:36:43.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.504+0000 7f7c577fe700 1 -- 172.21.15.8:0/1135096597 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4800bc20 con 0x7f7c580b1c70 2023-10-06T04:36:43.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.504+0000 7f7c5d947700 1 -- 172.21.15.8:0/1135096597 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c580b1c70 msgr2=0x7f7c580b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:43.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.504+0000 7f7c5d947700 1 --2- 172.21.15.8:0/1135096597 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c580b1c70 0x7f7c580b20e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7c580cec50 tx=0x7f7c48009250 comp rx=0 tx=0).stop 2023-10-06T04:36:43.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.505+0000 7f7c5d947700 1 -- 172.21.15.8:0/1135096597 shutdown_connections 2023-10-06T04:36:43.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.505+0000 7f7c5d947700 1 --2- 172.21.15.8:0/1135096597 >> v2:172.21.15.184:3300/0 conn(0x7f7c5815ad80 0x7f7c5815b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:43.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.505+0000 7f7c5d947700 1 --2- 172.21.15.8:0/1135096597 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c580b1c70 0x7f7c580b20e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:43.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.505+0000 7f7c5d947700 1 -- 172.21.15.8:0/1135096597 >> 172.21.15.8:0/1135096597 conn(0x7f7c5806ed00 msgr2=0x7f7c5806f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:43.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.505+0000 7f7c5d947700 1 -- 172.21.15.8:0/1135096597 shutdown_connections 2023-10-06T04:36:43.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.505+0000 7f7c5d947700 1 -- 172.21.15.8:0/1135096597 wait complete. 2023-10-06T04:36:43.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.506+0000 7f7c5d947700 1 Processor -- start 2023-10-06T04:36:43.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.506+0000 7f7c5d947700 1 -- start start 2023-10-06T04:36:43.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.506+0000 7f7c5d947700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c580b1c70 0x7f7c5814aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:43.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.506+0000 7f7c5d947700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c58156e30 0x7f7c5814e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:43.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.506+0000 7f7c5d947700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c5815ad80 0x7f7c58154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:43.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.506+0000 7f7c5d947700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c58157510 con 0x7f7c5815ad80 2023-10-06T04:36:43.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.507+0000 7f7c5d947700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c58157760 con 0x7f7c58156e30 2023-10-06T04:36:43.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.507+0000 7f7c5d947700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c58157a40 con 0x7f7c580b1c70 2023-10-06T04:36:43.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.507+0000 7f7c5d146700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c5815ad80 0x7f7c58154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:43.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.507+0000 7f7c5d146700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c5815ad80 0x7f7c58154a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36554/0 (socket says 172.21.15.8:36554) 2023-10-06T04:36:43.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.507+0000 7f7c5d146700 1 -- 172.21.15.8:0/783914981 learned_addr learned my addr 172.21.15.8:0/783914981 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:43.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.507+0000 7f7c5c945700 1 --2- 172.21.15.8:0/783914981 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c580b1c70 0x7f7c5814aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:43.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.507+0000 7f7c57fff700 1 --2- 172.21.15.8:0/783914981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c58156e30 0x7f7c5814e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:43.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.507+0000 7f7c5d146700 1 -- 172.21.15.8:0/783914981 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c580b1c70 msgr2=0x7f7c5814aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:43.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.507+0000 7f7c5d146700 1 --2- 172.21.15.8:0/783914981 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c580b1c70 0x7f7c5814aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:43.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.507+0000 7f7c5d146700 1 -- 172.21.15.8:0/783914981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c58156e30 msgr2=0x7f7c5814e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:43.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.507+0000 7f7c5d146700 1 --2- 172.21.15.8:0/783914981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c58156e30 0x7f7c5814e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:43.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.507+0000 7f7c5d146700 1 -- 172.21.15.8:0/783914981 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c40009420 con 0x7f7c5815ad80 2023-10-06T04:36:43.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.507+0000 7f7c57fff700 1 --2- 172.21.15.8:0/783914981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c58156e30 0x7f7c5814e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:43.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.507+0000 7f7c5d146700 1 --2- 172.21.15.8:0/783914981 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c5815ad80 0x7f7c58154a20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7c4000ea20 tx=0x7f7c400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:43.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.507+0000 7f7c54ff9700 1 -- 172.21.15.8:0/783914981 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c40009680 con 0x7f7c5815ad80 2023-10-06T04:36:43.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.507+0000 7f7c54ff9700 1 -- 172.21.15.8:0/783914981 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4000c850 con 0x7f7c5815ad80 2023-10-06T04:36:43.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.507+0000 7f7c5d947700 1 -- 172.21.15.8:0/783914981 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c480094f0 con 0x7f7c5815ad80 2023-10-06T04:36:43.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.507+0000 7f7c54ff9700 1 -- 172.21.15.8:0/783914981 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4000cc10 con 0x7f7c5815ad80 2023-10-06T04:36:43.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.507+0000 7f7c5d947700 1 -- 172.21.15.8:0/783914981 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c58158000 con 0x7f7c5815ad80 2023-10-06T04:36:43.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.509+0000 7f7c54ff9700 1 -- 172.21.15.8:0/783914981 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c40013470 con 0x7f7c5815ad80 2023-10-06T04:36:43.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.509+0000 7f7c54ff9700 1 --2- 172.21.15.8:0/783914981 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7c38066f30 0x7f7c380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:43.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.509+0000 7f7c54ff9700 1 -- 172.21.15.8:0/783914981 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7c40084920 con 0x7f7c5815ad80 2023-10-06T04:36:43.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.509+0000 7f7c5c945700 1 --2- 172.21.15.8:0/783914981 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7c38066f30 0x7f7c380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:43.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.510+0000 7f7c5c945700 1 --2- 172.21.15.8:0/783914981 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7c38066f30 0x7f7c380693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7c50007fd0 tx=0x7f7c500016f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:43.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.511+0000 7f7c67ea1b80 1 Processor -- start 2023-10-06T04:36:43.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.511+0000 7f7c67ea1b80 1 -- start start 2023-10-06T04:36:43.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.512+0000 7f7c67ea1b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aa09f61950 0x55aa09f61d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:43.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.512+0000 7f7c67ea1b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55aa09fabbc0 0x55aa09f8a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:43.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.512+0000 7f7c67ea1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa09f8ae60 0x55aa09f5d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:43.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.512+0000 7f7c67ea1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa09ee1c80 con 0x55aa09f8ae60 2023-10-06T04:36:43.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.512+0000 7f7c67ea1b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa09eb8a70 con 0x55aa09f61950 2023-10-06T04:36:43.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.512+0000 7f7c67ea1b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aa09eb6270 con 0x55aa09fabbc0 2023-10-06T04:36:43.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.512+0000 7f7c5d146700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa09f8ae60 0x55aa09f5d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:43.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.512+0000 7f7c5d146700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa09f8ae60 0x55aa09f5d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36566/0 (socket says 172.21.15.8:36566) 2023-10-06T04:36:43.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.512+0000 7f7c5d146700 1 -- 172.21.15.8:0/1659502987 learned_addr learned my addr 172.21.15.8:0/1659502987 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:43.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.512+0000 7f7c57fff700 1 --2- 172.21.15.8:0/1659502987 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55aa09fabbc0 0x55aa09f8a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:43.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.512+0000 7f7c5c945700 1 --2- 172.21.15.8:0/1659502987 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aa09f61950 0x55aa09f61d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:43.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.512+0000 7f7c5d146700 1 -- 172.21.15.8:0/1659502987 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55aa09fabbc0 msgr2=0x55aa09f8a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:43.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.512+0000 7f7c5d146700 1 --2- 172.21.15.8:0/1659502987 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55aa09fabbc0 0x55aa09f8a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:43.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.512+0000 7f7c5d146700 1 -- 172.21.15.8:0/1659502987 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aa09f61950 msgr2=0x55aa09f61d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:43.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.512+0000 7f7c5d146700 1 --2- 172.21.15.8:0/1659502987 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aa09f61950 0x55aa09f61d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:43.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.512+0000 7f7c5d146700 1 -- 172.21.15.8:0/1659502987 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa09d4c270 con 0x55aa09f8ae60 2023-10-06T04:36:43.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.512+0000 7f7c5d146700 1 --2- 172.21.15.8:0/1659502987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa09f8ae60 0x55aa09f5d990 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7c40009840 tx=0x7f7c40082950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ab277700ab74099 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:43.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.513+0000 7f7c4dffb700 1 -- 172.21.15.8:0/1659502987 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c40058650 con 0x55aa09f8ae60 2023-10-06T04:36:43.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.513+0000 7f7c4dffb700 1 -- 172.21.15.8:0/1659502987 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4005c3a0 con 0x55aa09f8ae60 2023-10-06T04:36:43.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.513+0000 7f7c4dffb700 1 -- 172.21.15.8:0/1659502987 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c400537a0 con 0x55aa09f8ae60 2023-10-06T04:36:43.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.513+0000 7f7c67ea1b80 1 -- 172.21.15.8:0/1659502987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa09f8ae60 msgr2=0x55aa09f5d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:43.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.513+0000 7f7c67ea1b80 1 --2- 172.21.15.8:0/1659502987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa09f8ae60 0x55aa09f5d990 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7c40009840 tx=0x7f7c40082950 comp rx=0 tx=0).stop 2023-10-06T04:36:43.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.513+0000 7f7c67ea1b80 1 -- 172.21.15.8:0/1659502987 shutdown_connections 2023-10-06T04:36:43.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.513+0000 7f7c67ea1b80 1 --2- 172.21.15.8:0/1659502987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa09f8ae60 0x55aa09f5d990 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:43.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.513+0000 7f7c67ea1b80 1 --2- 172.21.15.8:0/1659502987 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aa09f61950 0x55aa09f61d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:43.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.513+0000 7f7c67ea1b80 1 --2- 172.21.15.8:0/1659502987 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55aa09fabbc0 0x55aa09f8a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:43.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.513+0000 7f7c67ea1b80 1 -- 172.21.15.8:0/1659502987 >> 172.21.15.8:0/1659502987 conn(0x55aa09f63270 msgr2=0x55aa09f63640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:43.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.513+0000 7f7c67ea1b80 1 -- 172.21.15.8:0/1659502987 shutdown_connections 2023-10-06T04:36:43.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.513+0000 7f7c67ea1b80 1 -- 172.21.15.8:0/1659502987 wait complete. 2023-10-06T04:36:43.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.514+0000 7f7c67ea1b80 1 -- start start 2023-10-06T04:36:43.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.514+0000 7f7c67ea1b80 1 Processor -- start 2023-10-06T04:36:43.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.515+0000 7f7c67ea1b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55aa09f61950 0x55aa09f86e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:43.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.515+0000 7f7c67ea1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa09f8ae60 0x55aa09fa5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:43.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.515+0000 7f7c67ea1b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aa09fabbc0 0x55aa09f581e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:43.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.515+0000 7f7c67ea1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa09eb2060 con 0x55aa09f8ae60 2023-10-06T04:36:43.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.515+0000 7f7c67ea1b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa09e5d890 con 0x55aa09fabbc0 2023-10-06T04:36:43.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.515+0000 7f7c67ea1b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aa09e78ea0 con 0x55aa09f61950 2023-10-06T04:36:43.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.515+0000 7f7c57fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa09f8ae60 0x55aa09fa5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:43.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.515+0000 7f7c67ea1b80 10 client.0 _ll_register_callbacks cb 0x55aa09d4ef30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:36:43.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.515+0000 7f7c57fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa09f8ae60 0x55aa09fa5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36568/0 (socket says 172.21.15.8:36568) 2023-10-06T04:36:43.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.515+0000 7f7c57fff700 1 -- 172.21.15.8:0/3049748304 learned_addr learned my addr 172.21.15.8:0/3049748304 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:43.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.515+0000 7f7c5c945700 1 --2- 172.21.15.8:0/3049748304 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55aa09f61950 0x55aa09f86e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:43.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.515+0000 7f7c5d146700 1 --2- 172.21.15.8:0/3049748304 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aa09fabbc0 0x55aa09f581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:43.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.515+0000 7f7c57fff700 1 -- 172.21.15.8:0/3049748304 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55aa09f61950 msgr2=0x55aa09f86e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:43.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.515+0000 7f7c57fff700 1 --2- 172.21.15.8:0/3049748304 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55aa09f61950 0x55aa09f86e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:43.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.515+0000 7f7c57fff700 1 -- 172.21.15.8:0/3049748304 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aa09fabbc0 msgr2=0x55aa09f581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:43.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.515+0000 7f7c57fff700 1 --2- 172.21.15.8:0/3049748304 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aa09fabbc0 0x55aa09f581e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:43.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.515+0000 7f7c57fff700 1 -- 172.21.15.8:0/3049748304 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c58158000 con 0x55aa09f8ae60 2023-10-06T04:36:43.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.515+0000 7f7c57fff700 1 --2- 172.21.15.8:0/3049748304 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa09f8ae60 0x55aa09fa5a60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7c4800c010 tx=0x7f7c48016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3256302ea7926fdf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:43.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.515+0000 7f7c36ffd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T04:36:43.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.516+0000 7f7c36ffd700 1 -- 172.21.15.8:0/3049748304 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c48023070 con 0x55aa09f8ae60 2023-10-06T04:36:43.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.516+0000 7f7c36ffd700 1 -- 172.21.15.8:0/3049748304 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7c4801b660 con 0x55aa09f8ae60 2023-10-06T04:36:43.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.516+0000 7f7c67ea1b80 1 -- 172.21.15.8:0/3049748304 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aa09f56690 con 0x55aa09f8ae60 2023-10-06T04:36:43.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.516+0000 7f7c36ffd700 1 -- 172.21.15.8:0/3049748304 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c4801ba30 con 0x55aa09f8ae60 2023-10-06T04:36:43.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.516+0000 7f7c67ea1b80 10 client.4761 fetch_fsmap learned FSMap version 9 2023-10-06T04:36:43.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.516+0000 7f7c67ea1b80 1 -- 172.21.15.8:0/3049748304 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55aa09ceefe0 con 0x55aa09f8ae60 2023-10-06T04:36:43.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.516+0000 7f7c36ffd700 1 -- 172.21.15.8:0/3049748304 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55aa09f56690 con 0x55aa09f8ae60 2023-10-06T04:36:43.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.516+0000 7f7c36ffd700 1 -- 172.21.15.8:0/3049748304 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 9) v1 ==== 3108+0+0 (secure 0 0 0) 0x7f7c48018070 con 0x55aa09f8ae60 2023-10-06T04:36:43.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.516+0000 7f7c67ea1b80 10 client.4761 fetch_fsmap finished waiting for FSMap version 9 2023-10-06T04:36:43.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.516+0000 7f7c67ea1b80 10 client.4761 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T04:36:43.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.516+0000 7f7c67ea1b80 20 client.4761 populate_metadata read hostname 'smithi008' 2023-10-06T04:36:43.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.516+0000 7f7c67ea1b80 1 --2- 172.21.15.8:0/3049748304 >> [v2:172.21.15.184:6835/2590100121,v1:172.21.15.184:6837/2590100121] conn(0x55aa09fb81f0 0x55aa09fb85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:43.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.516+0000 7f7c67ea1b80 4 client.4761 mds_command: new command op to 4284 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T04:36:43.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.516+0000 7f7c67ea1b80 1 -- 172.21.15.8:0/3049748304 --> [v2:172.21.15.184:6835/2590100121,v1:172.21.15.184:6837/2590100121] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aa09f335c0 con 0x55aa09fb81f0 2023-10-06T04:36:43.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.516+0000 7f7c5c945700 1 --2- 172.21.15.8:0/3049748304 >> [v2:172.21.15.184:6835/2590100121,v1:172.21.15.184:6837/2590100121] conn(0x55aa09fb81f0 0x55aa09fb85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:43.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.517+0000 7f7c5c945700 1 --2- 172.21.15.8:0/3049748304 >> [v2:172.21.15.184:6835/2590100121,v1:172.21.15.184:6837/2590100121] conn(0x55aa09fb81f0 0x55aa09fb85c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=374fe7c9e0b61a6d server_cookie=d12d9180c8a47958 in_seq=0 out_seq=0 2023-10-06T04:36:43.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.517+0000 7f7c36ffd700 10 client.4761 ms_handle_connect on v2:172.21.15.184:6835/2590100121 2023-10-06T04:36:43.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.517+0000 7f7c36ffd700 1 -- 172.21.15.8:0/3049748304 <== mds.0 v2:172.21.15.184:6835/2590100121 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55aa09f335c0 con 0x55aa09fb81f0 2023-10-06T04:36:43.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.517+0000 7f7c36ffd700 10 client.4761 handle_command_reply: tid=0 2023-10-06T04:36:43.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.517+0000 7f7c67ea1b80 1 client.4761 shutdown 2023-10-06T04:36:43.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.518+0000 7f7c67ea1b80 1 -- 172.21.15.8:0/3049748304 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa09f8ae60 msgr2=0x55aa09fa5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:43.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.518+0000 7f7c67ea1b80 1 --2- 172.21.15.8:0/3049748304 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa09f8ae60 0x55aa09fa5a60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7c4800c010 tx=0x7f7c48016000 comp rx=0 tx=0).stop 2023-10-06T04:36:43.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.518+0000 7f7c67ea1b80 1 -- 172.21.15.8:0/3049748304 shutdown_connections 2023-10-06T04:36:43.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.518+0000 7f7c67ea1b80 1 --2- 172.21.15.8:0/3049748304 >> [v2:172.21.15.184:6835/2590100121,v1:172.21.15.184:6837/2590100121] conn(0x55aa09fb81f0 0x55aa09fb85c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:43.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.518+0000 7f7c67ea1b80 1 --2- 172.21.15.8:0/3049748304 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aa09fabbc0 0x55aa09f581e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:43.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.518+0000 7f7c67ea1b80 1 --2- 172.21.15.8:0/3049748304 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55aa09f61950 0x55aa09f86e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:43.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.518+0000 7f7c36ffd700 0 client.4761 ms_handle_reset on v2:172.21.15.184:6835/2590100121 2023-10-06T04:36:43.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.518+0000 7f7c67ea1b80 1 --2- 172.21.15.8:0/3049748304 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa09f8ae60 0x55aa09fa5a60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:43.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.518+0000 7f7c67ea1b80 1 -- 172.21.15.8:0/3049748304 >> 172.21.15.8:0/3049748304 conn(0x55aa09f63270 msgr2=0x55aa09f5d840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:43.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.518+0000 7f7c67ea1b80 1 -- 172.21.15.8:0/3049748304 shutdown_connections 2023-10-06T04:36:43.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.518+0000 7f7c67ea1b80 1 -- 172.21.15.8:0/3049748304 wait complete. 2023-10-06T04:36:43.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.518+0000 7f7c67ea1b80 20 client.4761 trim_cache size 0 max 16384 2023-10-06T04:36:43.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.535+0000 7f7c67ea1b80 1 Processor -- start 2023-10-06T04:36:43.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.535+0000 7f7c67ea1b80 1 -- start start 2023-10-06T04:36:43.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.535+0000 7f7c67ea1b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aa09f61950 0x55aa09f62470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:43.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.535+0000 7f7c67ea1b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55aa09f8ae60 0x55aa09fa51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:43.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.535+0000 7f7c67ea1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa09fabbc0 0x55aa09fa5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:43.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.535+0000 7f7c67ea1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa09d34e30 con 0x55aa09fabbc0 2023-10-06T04:36:43.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.535+0000 7f7c67ea1b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa09f5a550 con 0x55aa09f61950 2023-10-06T04:36:43.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.535+0000 7f7c67ea1b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aa09fa1980 con 0x55aa09f8ae60 2023-10-06T04:36:43.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.535+0000 7f7c5d146700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa09fabbc0 0x55aa09fa5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:43.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.535+0000 7f7c5d146700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa09fabbc0 0x55aa09fa5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36570/0 (socket says 172.21.15.8:36570) 2023-10-06T04:36:43.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.535+0000 7f7c5d146700 1 -- 172.21.15.8:0/1124414521 learned_addr learned my addr 172.21.15.8:0/1124414521 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:43.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.536+0000 7f7c57fff700 1 --2- 172.21.15.8:0/1124414521 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55aa09f8ae60 0x55aa09fa51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:43.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.536+0000 7f7c5c945700 1 --2- 172.21.15.8:0/1124414521 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aa09f61950 0x55aa09f62470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:43.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.536+0000 7f7c5d146700 1 -- 172.21.15.8:0/1124414521 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55aa09f8ae60 msgr2=0x55aa09fa51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:43.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.536+0000 7f7c5d146700 1 --2- 172.21.15.8:0/1124414521 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55aa09f8ae60 0x55aa09fa51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:43.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.536+0000 7f7c5d146700 1 -- 172.21.15.8:0/1124414521 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aa09f61950 msgr2=0x55aa09f62470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:43.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.536+0000 7f7c5d146700 1 --2- 172.21.15.8:0/1124414521 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aa09f61950 0x55aa09f62470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:43.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.536+0000 7f7c5d146700 1 -- 172.21.15.8:0/1124414521 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa09e80780 con 0x55aa09fabbc0 2023-10-06T04:36:43.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.536+0000 7f7c57fff700 1 --2- 172.21.15.8:0/1124414521 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55aa09f8ae60 0x55aa09fa51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:43.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.536+0000 7f7c5d146700 1 --2- 172.21.15.8:0/1124414521 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa09fabbc0 0x55aa09fa5720 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7c40051900 tx=0x7f7c4006b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba421639a8947eb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:43.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.536+0000 7f7c4e7fc700 1 -- 172.21.15.8:0/1124414521 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4007e040 con 0x55aa09fabbc0 2023-10-06T04:36:43.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.536+0000 7f7c4e7fc700 1 -- 172.21.15.8:0/1124414521 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c40054f40 con 0x55aa09fabbc0 2023-10-06T04:36:43.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.536+0000 7f7c4e7fc700 1 -- 172.21.15.8:0/1124414521 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c40058650 con 0x55aa09fabbc0 2023-10-06T04:36:43.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.536+0000 7f7c67ea1b80 1 -- 172.21.15.8:0/1124414521 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa09fabbc0 msgr2=0x55aa09fa5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:43.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.536+0000 7f7c67ea1b80 1 --2- 172.21.15.8:0/1124414521 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa09fabbc0 0x55aa09fa5720 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7c40051900 tx=0x7f7c4006b000 comp rx=0 tx=0).stop 2023-10-06T04:36:43.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.536+0000 7f7c67ea1b80 1 -- 172.21.15.8:0/1124414521 shutdown_connections 2023-10-06T04:36:43.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.537+0000 7f7c67ea1b80 1 --2- 172.21.15.8:0/1124414521 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa09fabbc0 0x55aa09fa5720 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:43.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.537+0000 7f7c67ea1b80 1 --2- 172.21.15.8:0/1124414521 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aa09f61950 0x55aa09f62470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:43.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.537+0000 7f7c67ea1b80 1 --2- 172.21.15.8:0/1124414521 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55aa09f8ae60 0x55aa09fa51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:43.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.537+0000 7f7c67ea1b80 1 -- 172.21.15.8:0/1124414521 >> 172.21.15.8:0/1124414521 conn(0x55aa09f63270 msgr2=0x55aa09f63640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:43.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.537+0000 7f7c67ea1b80 1 -- 172.21.15.8:0/1124414521 shutdown_connections 2023-10-06T04:36:43.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.537+0000 7f7c67ea1b80 1 -- 172.21.15.8:0/1124414521 wait complete. 2023-10-06T04:36:43.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.537+0000 7f7c67ea1b80 1 -- start start 2023-10-06T04:36:43.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.537+0000 7f7c67ea1b80 1 Processor -- start 2023-10-06T04:36:43.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.538+0000 7f7c67ea1b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55aa09f61950 0x55aa09fa0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:43.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.538+0000 7f7c67ea1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa09f8ae60 0x55aa09f9ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:43.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.538+0000 7f7c67ea1b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aa09fabbc0 0x55aa09f9fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:43.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.538+0000 7f7c67ea1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa09fa4750 con 0x55aa09f8ae60 2023-10-06T04:36:43.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.538+0000 7f7c67ea1b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa09fa43e0 con 0x55aa09fabbc0 2023-10-06T04:36:43.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.538+0000 7f7c67ea1b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aa09f85ef0 con 0x55aa09f61950 2023-10-06T04:36:43.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.538+0000 7f7c67ea1b80 10 client.0 _ll_register_callbacks cb 0x55aa09d4ef30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:36:43.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.538+0000 7f7c57fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa09f8ae60 0x55aa09f9ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:43.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.538+0000 7f7c57fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa09f8ae60 0x55aa09f9ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36580/0 (socket says 172.21.15.8:36580) 2023-10-06T04:36:43.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.538+0000 7f7c57fff700 1 -- 172.21.15.8:0/1857413881 learned_addr learned my addr 172.21.15.8:0/1857413881 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:43.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.538+0000 7f7c5d146700 1 --2- 172.21.15.8:0/1857413881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aa09fabbc0 0x55aa09f9fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:43.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.538+0000 7f7c5c945700 1 --2- 172.21.15.8:0/1857413881 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55aa09f61950 0x55aa09fa0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:43.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.539+0000 7f7c57fff700 1 -- 172.21.15.8:0/1857413881 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55aa09f61950 msgr2=0x55aa09fa0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:43.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.539+0000 7f7c57fff700 1 --2- 172.21.15.8:0/1857413881 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55aa09f61950 0x55aa09fa0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:43.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.539+0000 7f7c57fff700 1 -- 172.21.15.8:0/1857413881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aa09fabbc0 msgr2=0x55aa09f9fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:43.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.539+0000 7f7c57fff700 1 --2- 172.21.15.8:0/1857413881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aa09fabbc0 0x55aa09f9fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:43.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.539+0000 7f7c57fff700 1 -- 172.21.15.8:0/1857413881 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55aa09d4c270 con 0x55aa09f8ae60 2023-10-06T04:36:43.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.539+0000 7f7c57fff700 1 --2- 172.21.15.8:0/1857413881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa09f8ae60 0x55aa09f9ed50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7c48009240 tx=0x7f7c48023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9680a4b5557ae2e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:43.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.539+0000 7f7c36ffd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T04:36:43.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.539+0000 7f7c36ffd700 1 -- 172.21.15.8:0/1857413881 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c48009350 con 0x55aa09f8ae60 2023-10-06T04:36:43.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.539+0000 7f7c36ffd700 1 -- 172.21.15.8:0/1857413881 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7c4801b660 con 0x55aa09f8ae60 2023-10-06T04:36:43.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.539+0000 7f7c67ea1b80 1 -- 172.21.15.8:0/1857413881 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7c4005c3a0 con 0x55aa09f8ae60 2023-10-06T04:36:43.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.539+0000 7f7c36ffd700 1 -- 172.21.15.8:0/1857413881 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c4800bbe0 con 0x55aa09f8ae60 2023-10-06T04:36:43.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.539+0000 7f7c67ea1b80 10 client.4767 fetch_fsmap learned FSMap version 9 2023-10-06T04:36:43.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.539+0000 7f7c67ea1b80 1 -- 172.21.15.8:0/1857413881 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55aa09e67470 con 0x55aa09f8ae60 2023-10-06T04:36:43.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.539+0000 7f7c36ffd700 1 -- 172.21.15.8:0/1857413881 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4005c3a0 con 0x55aa09f8ae60 2023-10-06T04:36:43.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.539+0000 7f7c36ffd700 1 -- 172.21.15.8:0/1857413881 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 9) v1 ==== 3108+0+0 (secure 0 0 0) 0x7f7c48018050 con 0x55aa09f8ae60 2023-10-06T04:36:43.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.539+0000 7f7c67ea1b80 10 client.4767 fetch_fsmap finished waiting for FSMap version 9 2023-10-06T04:36:43.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.539+0000 7f7c67ea1b80 10 client.4767 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T04:36:43.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.539+0000 7f7c67ea1b80 20 client.4767 populate_metadata read hostname 'smithi008' 2023-10-06T04:36:43.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.539+0000 7f7c67ea1b80 1 --2- 172.21.15.8:0/1857413881 >> [v2:172.21.15.184:6835/2590100121,v1:172.21.15.184:6837/2590100121] conn(0x55aa09f5df50 0x55aa09f5e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:43.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.539+0000 7f7c67ea1b80 4 client.4767 mds_command: new command op to 4284 tid=0[{"prefix": "status"}] 2023-10-06T04:36:43.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.539+0000 7f7c67ea1b80 1 -- 172.21.15.8:0/1857413881 --> [v2:172.21.15.184:6835/2590100121,v1:172.21.15.184:6837/2590100121] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55aa09e54e00 con 0x55aa09f5df50 2023-10-06T04:36:43.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.540+0000 7f7c5c945700 1 --2- 172.21.15.8:0/1857413881 >> [v2:172.21.15.184:6835/2590100121,v1:172.21.15.184:6837/2590100121] conn(0x55aa09f5df50 0x55aa09f5e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:43.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.540+0000 7f7c36ffd700 10 client.4767 ms_handle_connect on v2:172.21.15.184:6835/2590100121 2023-10-06T04:36:43.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.540+0000 7f7c5c945700 1 --2- 172.21.15.8:0/1857413881 >> [v2:172.21.15.184:6835/2590100121,v1:172.21.15.184:6837/2590100121] conn(0x55aa09f5df50 0x55aa09f5e320 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0ae659050650fb1 server_cookie=923eb954defa7320 in_seq=0 out_seq=0 2023-10-06T04:36:43.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.540+0000 7f7c36ffd700 1 -- 172.21.15.8:0/1857413881 <== mds.0 v2:172.21.15.184:6835/2590100121 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55aa09e54e00 con 0x55aa09f5df50 2023-10-06T04:36:43.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.540+0000 7f7c36ffd700 10 client.4767 handle_command_reply: tid=0 2023-10-06T04:36:43.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.540+0000 7f7c67ea1b80 1 client.4767 shutdown 2023-10-06T04:36:43.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.540+0000 7f7c67ea1b80 1 -- 172.21.15.8:0/1857413881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa09f8ae60 msgr2=0x55aa09f9ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:43.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.540+0000 7f7c67ea1b80 1 --2- 172.21.15.8:0/1857413881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa09f8ae60 0x55aa09f9ed50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7c48009240 tx=0x7f7c48023000 comp rx=0 tx=0).stop 2023-10-06T04:36:43.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.540+0000 7f7c67ea1b80 1 -- 172.21.15.8:0/1857413881 shutdown_connections 2023-10-06T04:36:43.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.540+0000 7f7c67ea1b80 1 --2- 172.21.15.8:0/1857413881 >> [v2:172.21.15.184:6835/2590100121,v1:172.21.15.184:6837/2590100121] conn(0x55aa09f5df50 0x55aa09f5e320 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:43.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.540+0000 7f7c67ea1b80 1 --2- 172.21.15.8:0/1857413881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aa09fabbc0 0x55aa09f9fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:43.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.540+0000 7f7c36ffd700 0 client.4767 ms_handle_reset on v2:172.21.15.184:6835/2590100121 2023-10-06T04:36:43.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.540+0000 7f7c67ea1b80 1 --2- 172.21.15.8:0/1857413881 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55aa09f61950 0x55aa09fa0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:43.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.540+0000 7f7c67ea1b80 1 --2- 172.21.15.8:0/1857413881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa09f8ae60 0x55aa09f9ed50 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:43.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.540+0000 7f7c67ea1b80 1 -- 172.21.15.8:0/1857413881 >> 172.21.15.8:0/1857413881 conn(0x55aa09f63270 msgr2=0x55aa09fa0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:43.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.540+0000 7f7c67ea1b80 1 -- 172.21.15.8:0/1857413881 shutdown_connections 2023-10-06T04:36:43.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.540+0000 7f7c67ea1b80 1 -- 172.21.15.8:0/1857413881 wait complete. 2023-10-06T04:36:43.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.541+0000 7f7c67ea1b80 20 client.4767 trim_cache size 0 max 16384 2023-10-06T04:36:43.553 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T04:36:43.554 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "c030d94d-df8f-49bb-8df7-07e9e557d96b", 2023-10-06T04:36:43.554 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 0, 2023-10-06T04:36:43.554 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 4284, 2023-10-06T04:36:43.554 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-10-06T04:36:43.554 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-10-06T04:36:43.554 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-10-06T04:36:43.554 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 26.296252713000001, 2023-10-06T04:36:43.554 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 9, 2023-10-06T04:36:43.554 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 25, 2023-10-06T04:36:43.555 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 25, 2023-10-06T04:36:43.555 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 32.257850570999999 2023-10-06T04:36:43.555 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T04:36:43.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.541+0000 7f7c5d947700 1 -- 172.21.15.8:0/783914981 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7c38066f30 msgr2=0x7f7c380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:43.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.541+0000 7f7c5d947700 1 --2- 172.21.15.8:0/783914981 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7c38066f30 0x7f7c380693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7c50007fd0 tx=0x7f7c500016f0 comp rx=0 tx=0).stop 2023-10-06T04:36:43.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.541+0000 7f7c5d947700 1 -- 172.21.15.8:0/783914981 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c5815ad80 msgr2=0x7f7c58154a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:43.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.541+0000 7f7c5d947700 1 --2- 172.21.15.8:0/783914981 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c5815ad80 0x7f7c58154a20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7c4000ea20 tx=0x7f7c400091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:43.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.541+0000 7f7c5d947700 1 -- 172.21.15.8:0/783914981 shutdown_connections 2023-10-06T04:36:43.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.541+0000 7f7c5d947700 1 --2- 172.21.15.8:0/783914981 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7c38066f30 0x7f7c380693e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:43.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.541+0000 7f7c5d947700 1 --2- 172.21.15.8:0/783914981 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c5815ad80 0x7f7c58154a20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:43.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.541+0000 7f7c5d947700 1 --2- 172.21.15.8:0/783914981 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c580b1c70 0x7f7c5814aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:43.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.541+0000 7f7c5d947700 1 --2- 172.21.15.8:0/783914981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c58156e30 0x7f7c5814e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:43.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.541+0000 7f7c5d947700 1 -- 172.21.15.8:0/783914981 >> 172.21.15.8:0/783914981 conn(0x7f7c5806ed00 msgr2=0x7f7c580afd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:43.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.541+0000 7f7c5d947700 1 -- 172.21.15.8:0/783914981 shutdown_connections 2023-10-06T04:36:43.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:43.541+0000 7f7c5d947700 1 -- 172.21.15.8:0/783914981 wait complete. 2023-10-06T04:36:43.557 INFO:teuthology.run_tasks:Running task kclient... 2023-10-06T04:36:43.570 INFO:tasks.kclient:Mounting kernel clients... 2023-10-06T04:36:43.571 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-06T04:36:43.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:43.571 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2023-10-06T04:36:43.586 INFO:teuthology.orchestra.run.smithi008.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-10-06T04:36:43.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:43.587 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-06T04:36:43.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:43.661 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link delete ceph-brx 2023-10-06T04:36:43.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:43.756 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2023-10-06T04:36:43.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:43.772 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link delete ceph-brx 2023-10-06T04:36:43.840 INFO:teuthology.orchestra.run.smithi008.stderr:Cannot find device "ceph-brx" 2023-10-06T04:36:43.841 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:36:43.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:43.842 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-10-06T04:36:43.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:43.860 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link delete ceph-brx 2023-10-06T04:36:43.931 INFO:teuthology.orchestra.run.smithi184.stderr:Cannot find device "ceph-brx" 2023-10-06T04:36:43.933 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:36:43.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:43.934 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-10-06T04:36:43.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:43.990 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link delete ceph-brx 2023-10-06T04:36:44.056 INFO:teuthology.orchestra.run.smithi184.stderr:Cannot find device "ceph-brx" 2023-10-06T04:36:44.057 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:36:44.057 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-10-06T04:36:44.058 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:36:44.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.176+0000 7f5c445db700 1 Processor -- start 2023-10-06T04:36:44.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.176+0000 7f5c445db700 1 -- start start 2023-10-06T04:36:44.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.177+0000 7f5c445db700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5c3c0afde0 0x7f5c3c0b0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:44.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.177+0000 7f5c445db700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c3c0acca0 con 0x7f5c3c155c50 2023-10-06T04:36:44.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.177+0000 7f5c445db700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c3c0abe30 con 0x7f5c3c0ada10 2023-10-06T04:36:44.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.177+0000 7f5c445db700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c3c0b07a0 con 0x7f5c3c0afde0 2023-10-06T04:36:44.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.177+0000 7f5c42377700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f5c3c155c50 0x7f5c3c0ad130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:52622/0 (socket says 172.21.15.8:52622) 2023-10-06T04:36:44.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.177+0000 7f5c42377700 1 -- 172.21.15.8:0/2611358000 learned_addr learned my addr 172.21.15.8:0/2611358000 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:44.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.178+0000 7f5c42b78700 1 --2- 172.21.15.8:0/2611358000 >> v2:172.21.15.184:3300/0 conn(0x7f5c3c0afde0 0x7f5c3c0b0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:44.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.178+0000 7f5c41375700 1 -- 172.21.15.8:0/2611358000 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2954970167 0 0) 0x7f5c3c0acca0 con 0x7f5c3c155c50 2023-10-06T04:36:44.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.178+0000 7f5c41375700 1 -- 172.21.15.8:0/2611358000 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c24003570 con 0x7f5c3c155c50 2023-10-06T04:36:44.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.178+0000 7f5c41375700 1 -- 172.21.15.8:0/2611358000 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2069886896 0 0) 0x7f5c3c0abe30 con 0x7f5c3c0ada10 2023-10-06T04:36:44.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.178+0000 7f5c41375700 1 -- 172.21.15.8:0/2611358000 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c3c0acca0 con 0x7f5c3c0ada10 2023-10-06T04:36:44.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.178+0000 7f5c42b78700 1 -- 172.21.15.8:0/2611358000 >> v1:172.21.15.184:6789/0 conn(0x7f5c3c0ada10 legacy=0x7f5c3c0ab720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:44.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.178+0000 7f5c42b78700 1 -- 172.21.15.8:0/2611358000 >> v1:172.21.15.8:6789/0 conn(0x7f5c3c155c50 legacy=0x7f5c3c0ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:44.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.178+0000 7f5c41375700 1 -- 172.21.15.8:0/2611358000 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3815210076 0 0) 0x7f5c24003570 con 0x7f5c3c155c50 2023-10-06T04:36:44.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.178+0000 7f5c42b78700 1 -- 172.21.15.8:0/2611358000 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c3c0ac090 con 0x7f5c3c0afde0 2023-10-06T04:36:44.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.178+0000 7f5c42b78700 1 --2- 172.21.15.8:0/2611358000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c3c0afde0 0x7f5c3c0b0260 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c009e90 tx=0x7f5c2c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f3fa5f43a538ee3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:44.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.178+0000 7f5c41375700 1 -- 172.21.15.8:0/2611358000 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c00e070 con 0x7f5c3c0afde0 2023-10-06T04:36:44.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.178+0000 7f5c41375700 1 -- 172.21.15.8:0/2611358000 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2c00bb90 con 0x7f5c3c0afde0 2023-10-06T04:36:44.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.178+0000 7f5c41375700 1 -- 172.21.15.8:0/2611358000 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c012430 con 0x7f5c3c0afde0 2023-10-06T04:36:44.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.179+0000 7f5c445db700 1 -- 172.21.15.8:0/2611358000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c3c0afde0 msgr2=0x7f5c3c0b0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:44.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.179+0000 7f5c445db700 1 --2- 172.21.15.8:0/2611358000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c3c0afde0 0x7f5c3c0b0260 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c009e90 tx=0x7f5c2c009780 comp rx=0 tx=0).stop 2023-10-06T04:36:44.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.179+0000 7f5c445db700 1 -- 172.21.15.8:0/2611358000 shutdown_connections 2023-10-06T04:36:44.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.179+0000 7f5c445db700 1 --2- 172.21.15.8:0/2611358000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c3c0afde0 0x7f5c3c0b0260 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:44.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.179+0000 7f5c445db700 1 -- 172.21.15.8:0/2611358000 >> 172.21.15.8:0/2611358000 conn(0x7f5c3c068070 msgr2=0x7f5c3c0cc000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:44.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.179+0000 7f5c445db700 1 -- 172.21.15.8:0/2611358000 shutdown_connections 2023-10-06T04:36:44.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.179+0000 7f5c445db700 1 -- 172.21.15.8:0/2611358000 wait complete. 2023-10-06T04:36:44.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.180+0000 7f5c445db700 1 Processor -- start 2023-10-06T04:36:44.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.180+0000 7f5c445db700 1 -- start start 2023-10-06T04:36:44.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.181+0000 7f5c445db700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c3c0ada10 0x7f5c3c159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:44.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.181+0000 7f5c445db700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c3c0afde0 0x7f5c3c0a8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:44.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.181+0000 7f5c445db700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5c3c155c50 0x7f5c3c0a88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:44.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.181+0000 7f5c445db700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c15a480 con 0x7f5c3c0afde0 2023-10-06T04:36:44.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.181+0000 7f5c445db700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c159870 con 0x7f5c3c0ada10 2023-10-06T04:36:44.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.181+0000 7f5c445db700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c159b50 con 0x7f5c3c155c50 2023-10-06T04:36:44.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.181+0000 7f5c41b76700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c3c0afde0 0x7f5c3c0a8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:44.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.181+0000 7f5c41b76700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c3c0afde0 0x7f5c3c0a8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36586/0 (socket says 172.21.15.8:36586) 2023-10-06T04:36:44.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.181+0000 7f5c41b76700 1 -- 172.21.15.8:0/811970164 learned_addr learned my addr 172.21.15.8:0/811970164 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:44.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.181+0000 7f5c42b78700 1 --2- 172.21.15.8:0/811970164 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5c3c155c50 0x7f5c3c0a88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:44.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.181+0000 7f5c42377700 1 --2- 172.21.15.8:0/811970164 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c3c0ada10 0x7f5c3c159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:44.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.181+0000 7f5c41b76700 1 -- 172.21.15.8:0/811970164 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5c3c155c50 msgr2=0x7f5c3c0a88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:44.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.181+0000 7f5c41b76700 1 --2- 172.21.15.8:0/811970164 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5c3c155c50 0x7f5c3c0a88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:44.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.181+0000 7f5c41b76700 1 -- 172.21.15.8:0/811970164 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c3c0ada10 msgr2=0x7f5c3c159200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:44.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.181+0000 7f5c41b76700 1 --2- 172.21.15.8:0/811970164 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c3c0ada10 0x7f5c3c159200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:44.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.181+0000 7f5c41b76700 1 -- 172.21.15.8:0/811970164 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c2c009a20 con 0x7f5c3c0afde0 2023-10-06T04:36:44.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.181+0000 7f5c41b76700 1 --2- 172.21.15.8:0/811970164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c3c0afde0 0x7f5c3c0a8370 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000c7c0 tx=0x7f5c30007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:44.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.181+0000 7f5c3a7fc700 1 -- 172.21.15.8:0/811970164 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c30010510 con 0x7f5c3c0afde0 2023-10-06T04:36:44.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.181+0000 7f5c3a7fc700 1 -- 172.21.15.8:0/811970164 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c300106b0 con 0x7f5c3c0afde0 2023-10-06T04:36:44.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.181+0000 7f5c3a7fc700 1 -- 172.21.15.8:0/811970164 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c30010a70 con 0x7f5c3c0afde0 2023-10-06T04:36:44.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.181+0000 7f5c445db700 1 -- 172.21.15.8:0/811970164 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c3c159e30 con 0x7f5c3c0afde0 2023-10-06T04:36:44.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.182+0000 7f5c445db700 1 -- 172.21.15.8:0/811970164 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c3c15a910 con 0x7f5c3c0afde0 2023-10-06T04:36:44.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.182+0000 7f5c445db700 1 -- 172.21.15.8:0/811970164 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c3c06b340 con 0x7f5c3c0afde0 2023-10-06T04:36:44.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.183+0000 7f5c3a7fc700 1 -- 172.21.15.8:0/811970164 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5c30012440 con 0x7f5c3c0afde0 2023-10-06T04:36:44.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.183+0000 7f5c3a7fc700 1 --2- 172.21.15.8:0/811970164 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5c28066f30 0x7f5c280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:44.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.183+0000 7f5c3a7fc700 1 -- 172.21.15.8:0/811970164 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f5c300840d0 con 0x7f5c3c0afde0 2023-10-06T04:36:44.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.184+0000 7f5c42377700 1 --2- 172.21.15.8:0/811970164 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5c28066f30 0x7f5c280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:44.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.184+0000 7f5c42377700 1 --2- 172.21.15.8:0/811970164 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5c28066f30 0x7f5c280693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5c34007fd0 tx=0x7f5c34007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:44.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.188+0000 7f5c3a7fc700 1 -- 172.21.15.8:0/811970164 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5c30050fa0 con 0x7f5c3c0afde0 2023-10-06T04:36:44.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.429+0000 7f5c445db700 1 -- 172.21.15.8:0/811970164 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5c3c0648a0 con 0x7f5c3c0afde0 2023-10-06T04:36:44.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.430+0000 7f5c3a7fc700 1 -- 172.21.15.8:0/811970164 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f5c300545c0 con 0x7f5c3c0afde0 2023-10-06T04:36:44.432 INFO:teuthology.orchestra.run.smithi008.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T04:36:44.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.432+0000 7f5c445db700 1 -- 172.21.15.8:0/811970164 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5c28066f30 msgr2=0x7f5c280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:44.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.432+0000 7f5c445db700 1 --2- 172.21.15.8:0/811970164 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5c28066f30 0x7f5c280693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5c34007fd0 tx=0x7f5c34007d30 comp rx=0 tx=0).stop 2023-10-06T04:36:44.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.432+0000 7f5c445db700 1 -- 172.21.15.8:0/811970164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c3c0afde0 msgr2=0x7f5c3c0a8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:44.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.432+0000 7f5c445db700 1 --2- 172.21.15.8:0/811970164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c3c0afde0 0x7f5c3c0a8370 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000c7c0 tx=0x7f5c30007de0 comp rx=0 tx=0).stop 2023-10-06T04:36:44.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.432+0000 7f5c445db700 1 -- 172.21.15.8:0/811970164 shutdown_connections 2023-10-06T04:36:44.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.432+0000 7f5c445db700 1 --2- 172.21.15.8:0/811970164 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5c28066f30 0x7f5c280693e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:44.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.432+0000 7f5c445db700 1 --2- 172.21.15.8:0/811970164 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5c3c155c50 0x7f5c3c0a88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:44.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.432+0000 7f5c445db700 1 --2- 172.21.15.8:0/811970164 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c3c0ada10 0x7f5c3c159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:44.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.432+0000 7f5c445db700 1 --2- 172.21.15.8:0/811970164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c3c0afde0 0x7f5c3c0a8370 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:44.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.432+0000 7f5c445db700 1 -- 172.21.15.8:0/811970164 >> 172.21.15.8:0/811970164 conn(0x7f5c3c068070 msgr2=0x7f5c3c0cc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:44.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.432+0000 7f5c445db700 1 -- 172.21.15.8:0/811970164 shutdown_connections 2023-10-06T04:36:44.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:44.432+0000 7f5c445db700 1 -- 172.21.15.8:0/811970164 wait complete. 2023-10-06T04:36:44.446 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T04:36:44.446 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:36:44.446 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi008.front.sepia.ceph.com 2023-10-06T04:36:44.446 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T04:36:44.446 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T04:36:44.447 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T04:36:44.447 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T04:36:44.447 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:36:44.447 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:36:44.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:44.447 DEBUG:teuthology.orchestra.run.smithi008:> ip addr 2023-10-06T04:36:44.464 INFO:teuthology.orchestra.run.smithi008.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:36:44.464 INFO:teuthology.orchestra.run.smithi008.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:36:44.464 INFO:teuthology.orchestra.run.smithi008.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:36:44.464 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:44.464 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 ::1/128 scope host 2023-10-06T04:36:44.465 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:44.465 INFO:teuthology.orchestra.run.smithi008.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:36:44.465 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2e brd ff:ff:ff:ff:ff:ff 2023-10-06T04:36:44.465 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f0 2023-10-06T04:36:44.465 INFO:teuthology.orchestra.run.smithi008.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:36:44.465 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2f brd ff:ff:ff:ff:ff:ff 2023-10-06T04:36:44.466 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f1 2023-10-06T04:36:44.466 INFO:teuthology.orchestra.run.smithi008.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:36:44.466 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:fe brd ff:ff:ff:ff:ff:ff 2023-10-06T04:36:44.466 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f0 2023-10-06T04:36:44.466 INFO:teuthology.orchestra.run.smithi008.stdout: inet 172.21.15.8/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T04:36:44.466 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft 42476sec preferred_lft 42476sec 2023-10-06T04:36:44.467 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::ae1f:6bff:fef8:25fe/64 scope link 2023-10-06T04:36:44.467 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:44.467 INFO:teuthology.orchestra.run.smithi008.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:36:44.467 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:ff brd ff:ff:ff:ff:ff:ff 2023-10-06T04:36:44.467 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f1 2023-10-06T04:36:44.468 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T04:36:44.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:44.468 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-10-06T04:36:44.468 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-10-06T04:36:44.468 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link add name ceph-brx type bridge 2023-10-06T04:36:44.469 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip addr flush dev ceph-brx 2023-10-06T04:36:44.469 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set ceph-brx up 2023-10-06T04:36:44.469 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T04:36:44.469 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-10-06T04:36:44.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:44.578 DEBUG:teuthology.orchestra.run.smithi008:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:36:44.602 INFO:teuthology.orchestra.run.smithi008.stdout:1 2023-10-06T04:36:44.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:44.604 DEBUG:teuthology.orchestra.run.smithi008:> route 2023-10-06T04:36:44.661 INFO:teuthology.orchestra.run.smithi008.stdout:Kernel IP routing table 2023-10-06T04:36:44.661 INFO:teuthology.orchestra.run.smithi008.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:36:44.661 INFO:teuthology.orchestra.run.smithi008.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T04:36:44.661 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T04:36:44.662 INFO:teuthology.orchestra.run.smithi008.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:36:44.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:44.662 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-10-06T04:36:44.662 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-10-06T04:36:44.663 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T04:36:44.663 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T04:36:44.663 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T04:36:44.663 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-10-06T04:36:44.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:44.765 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2023-10-06T04:36:44.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:44.780 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list-id 2023-10-06T04:36:44.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:44.836 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-10-06T04:36:44.836 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-10-06T04:36:44.836 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T04:36:44.836 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-06T04:36:44.837 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-10-06T04:36:44.927 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-06T04:36:44.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:44.928 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-10-06T04:36:44.928 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-10-06T04:36:44.928 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-06T04:36:44.928 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T04:36:44.928 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-06T04:36:44.928 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-06T04:36:44.928 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-06T04:36:44.928 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-10-06T04:36:45.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:45.097 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-10-06T04:36:45.097 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-10-06T04:36:45.097 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set brx.0 up 2023-10-06T04:36:45.097 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T04:36:45.097 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-10-06T04:36:45.190 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:36:45.191 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T04:36:45.206 INFO:teuthology.orchestra.run.smithi008.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:36:45.206 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:36:45.206 DEBUG:teuthology.orchestra.run.smithi008:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T04:36:45.261 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T04:36:45.261 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:36:45.261 DEBUG:teuthology.orchestra.run.smithi008:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:36:45.342 INFO:teuthology.orchestra.run.smithi008.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:36:45.343 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T04:36:45.443 INFO:teuthology.orchestra.run.smithi008.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:36:45.443 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T04:36:45.443 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: resolved to: "172.21.15.8:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-10-06T04:36:45.443 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: trying mount with new device syntax: 0@c030d94d-df8f-49bb-8df7-07e9e557d96b.cephfs=/ 2023-10-06T04:36:45.443 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.8:3300/172.21.15.184:3300/172.21.15.184:3301" will pass to kernel 2023-10-06T04:36:45.443 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T04:36:45.444 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T04:36:45.444 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:36:45.465 INFO:teuthology.orchestra.run.smithi008.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:36:45.465 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T04:36:45.465 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: resolved to: "172.21.15.8:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-10-06T04:36:45.466 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: trying mount with new device syntax: 0@c030d94d-df8f-49bb-8df7-07e9e557d96b.cephfs=/ 2023-10-06T04:36:45.466 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.8:3300/172.21.15.184:3300/172.21.15.184:3301" will pass to kernel 2023-10-06T04:36:45.466 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T04:36:45.466 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T04:36:45.466 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:36:45.466 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: resolved to: "172.21.15.8:6789,172.21.15.184:6789,172.21.15.184:6790" 2023-10-06T04:36:45.466 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.8:6789,172.21.15.184:6789,172.21.15.184:6790:/ 2023-10-06T04:36:45.466 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=c030d94d-df8f-49bb-8df7-07e9e557d96b" will pass to kernel 2023-10-06T04:36:45.468 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T04:36:45.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:45.469 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T04:36:45.534 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-10-06T04:36:45.534 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:36:45.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.690+0000 7fcd6ec5b700 1 Processor -- start 2023-10-06T04:36:45.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.691+0000 7fcd6ec5b700 1 -- start start 2023-10-06T04:36:45.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.691+0000 7fcd6ec5b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fcd68159690 0x7fcd680afe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:45.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.691+0000 7fcd6ec5b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd680b0390 0x7fcd680ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:45.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.691+0000 7fcd6ec5b700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd680cf330 con 0x7fcd681592c0 2023-10-06T04:36:45.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.691+0000 7fcd6ec5b700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd680ce720 con 0x7fcd68159690 2023-10-06T04:36:45.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.691+0000 7fcd6ec5b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd680cea00 con 0x7fcd680b0390 2023-10-06T04:36:45.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.692+0000 7fcd6c9f7700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fcd681592c0 0x7fcd680caa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:59816/0 (socket says 172.21.15.8:59816) 2023-10-06T04:36:45.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.692+0000 7fcd6c9f7700 1 -- 172.21.15.8:0/2466195668 learned_addr learned my addr 172.21.15.8:0/2466195668 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:45.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.692+0000 7fcd67fff700 1 --2- 172.21.15.8:0/2466195668 >> v2:172.21.15.184:3300/0 conn(0x7fcd68159690 0x7fcd680afe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:45.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.692+0000 7fcd6d1f8700 1 --2- 172.21.15.8:0/2466195668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd680b0390 0x7fcd680ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:45.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.692+0000 7fcd677fe700 1 -- 172.21.15.8:0/2466195668 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1629030193 0 0) 0x7fcd680cf330 con 0x7fcd681592c0 2023-10-06T04:36:45.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.692+0000 7fcd677fe700 1 -- 172.21.15.8:0/2466195668 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd54003570 con 0x7fcd681592c0 2023-10-06T04:36:45.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.692+0000 7fcd677fe700 1 -- 172.21.15.8:0/2466195668 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 92352778 0 0) 0x7fcd54003570 con 0x7fcd681592c0 2023-10-06T04:36:45.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.692+0000 7fcd677fe700 1 -- 172.21.15.8:0/2466195668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd680b0390 msgr2=0x7fcd680ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:45.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.692+0000 7fcd677fe700 1 --2- 172.21.15.8:0/2466195668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd680b0390 0x7fcd680ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:45.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.692+0000 7fcd677fe700 1 -- 172.21.15.8:0/2466195668 >> v2:172.21.15.184:3300/0 conn(0x7fcd68159690 msgr2=0x7fcd680afe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:45.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.692+0000 7fcd677fe700 1 --2- 172.21.15.8:0/2466195668 >> v2:172.21.15.184:3300/0 conn(0x7fcd68159690 0x7fcd680afe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:45.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.692+0000 7fcd677fe700 1 -- 172.21.15.8:0/2466195668 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd680cece0 con 0x7fcd681592c0 2023-10-06T04:36:45.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.692+0000 7fcd677fe700 1 -- 172.21.15.8:0/2466195668 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7fcd60001970 con 0x7fcd681592c0 2023-10-06T04:36:45.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.692+0000 7fcd67fff700 1 --2- 172.21.15.8:0/2466195668 >> v2:172.21.15.184:3300/0 conn(0x7fcd68159690 0x7fcd680afe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:36:45.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.692+0000 7fcd677fe700 1 -- 172.21.15.8:0/2466195668 >> v1:172.21.15.8:6789/0 conn(0x7fcd681592c0 legacy=0x7fcd680caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:45.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.692+0000 7fcd677fe700 1 --2- 172.21.15.8:0/2466195668 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd54003a60 0x7fcd54003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:45.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.692+0000 7fcd677fe700 1 --2- 172.21.15.8:0/2466195668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd680b0390 0x7fcd54004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:45.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.692+0000 7fcd677fe700 1 --2- 172.21.15.8:0/2466195668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd54004d50 0x7fcd540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:45.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.692+0000 7fcd677fe700 1 -- 172.21.15.8:0/2466195668 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd680ce720 con 0x7fcd54003a60 2023-10-06T04:36:45.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.692+0000 7fcd677fe700 1 -- 172.21.15.8:0/2466195668 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd680cea00 con 0x7fcd54004d50 2023-10-06T04:36:45.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.692+0000 7fcd677fe700 1 -- 172.21.15.8:0/2466195668 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5400ba60 con 0x7fcd680b0390 2023-10-06T04:36:45.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.692+0000 7fcd6c9f7700 1 --2- 172.21.15.8:0/2466195668 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd54003a60 0x7fcd54003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:45.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.692+0000 7fcd67fff700 1 --2- 172.21.15.8:0/2466195668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd680b0390 0x7fcd54004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:45.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.692+0000 7fcd6d1f8700 1 --2- 172.21.15.8:0/2466195668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd54004d50 0x7fcd540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:45.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.693+0000 7fcd6c9f7700 1 -- 172.21.15.8:0/2466195668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd680b0390 msgr2=0x7fcd54004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:45.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.693+0000 7fcd6c9f7700 1 --2- 172.21.15.8:0/2466195668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd680b0390 0x7fcd54004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:45.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.693+0000 7fcd6c9f7700 1 -- 172.21.15.8:0/2466195668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd54004d50 msgr2=0x7fcd540051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:45.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.693+0000 7fcd6c9f7700 1 --2- 172.21.15.8:0/2466195668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd54004d50 0x7fcd540051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:45.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.693+0000 7fcd6c9f7700 1 -- 172.21.15.8:0/2466195668 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd54003570 con 0x7fcd54003a60 2023-10-06T04:36:45.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.693+0000 7fcd6c9f7700 1 --2- 172.21.15.8:0/2466195668 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd54003a60 0x7fcd54003e70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcd6000c6b0 tx=0x7fcd60007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b5f98f8350560b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:45.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.693+0000 7fcd677fe700 1 -- 172.21.15.8:0/2466195668 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd60005b70 con 0x7fcd54003a60 2023-10-06T04:36:45.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.693+0000 7fcd677fe700 1 -- 172.21.15.8:0/2466195668 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd60005cf0 con 0x7fcd54003a60 2023-10-06T04:36:45.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.693+0000 7fcd677fe700 1 -- 172.21.15.8:0/2466195668 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd60007360 con 0x7fcd54003a60 2023-10-06T04:36:45.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.694+0000 7fcd6ec5b700 1 -- 172.21.15.8:0/2466195668 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd54003a60 msgr2=0x7fcd54003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:45.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.694+0000 7fcd6ec5b700 1 --2- 172.21.15.8:0/2466195668 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd54003a60 0x7fcd54003e70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcd6000c6b0 tx=0x7fcd60007ca0 comp rx=0 tx=0).stop 2023-10-06T04:36:45.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.694+0000 7fcd6d1f8700 1 -- 172.21.15.8:0/2466195668 reap_dead start 2023-10-06T04:36:45.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.694+0000 7fcd6ec5b700 1 -- 172.21.15.8:0/2466195668 shutdown_connections 2023-10-06T04:36:45.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.694+0000 7fcd6ec5b700 1 -- 172.21.15.8:0/2466195668 >> 172.21.15.8:0/2466195668 conn(0x7fcd6806ed00 msgr2=0x7fcd6806f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:45.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.694+0000 7fcd6ec5b700 1 -- 172.21.15.8:0/2466195668 shutdown_connections 2023-10-06T04:36:45.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.694+0000 7fcd6ec5b700 1 -- 172.21.15.8:0/2466195668 wait complete. 2023-10-06T04:36:45.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.695+0000 7fcd6ec5b700 1 Processor -- start 2023-10-06T04:36:45.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.695+0000 7fcd6ec5b700 1 -- start start 2023-10-06T04:36:45.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.696+0000 7fcd6ec5b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd54003a60 0x7fcd680c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:45.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.696+0000 7fcd6ec5b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd68159bf0 0x7fcd6815a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:45.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.696+0000 7fcd6ec5b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd6814faf0 0x7fcd6814ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:45.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.696+0000 7fcd6ec5b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd68155650 con 0x7fcd68159bf0 2023-10-06T04:36:45.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.696+0000 7fcd6ec5b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd680b31f0 con 0x7fcd6814faf0 2023-10-06T04:36:45.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.696+0000 7fcd6ec5b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd681504a0 con 0x7fcd54003a60 2023-10-06T04:36:45.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.696+0000 7fcd67fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd68159bf0 0x7fcd6815a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:45.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.696+0000 7fcd67fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd68159bf0 0x7fcd6815a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47914/0 (socket says 172.21.15.8:47914) 2023-10-06T04:36:45.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.696+0000 7fcd67fff700 1 -- 172.21.15.8:0/1678265482 learned_addr learned my addr 172.21.15.8:0/1678265482 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:45.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.696+0000 7fcd6d1f8700 1 --2- 172.21.15.8:0/1678265482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd6814faf0 0x7fcd6814ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:45.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.696+0000 7fcd67fff700 1 -- 172.21.15.8:0/1678265482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd54003a60 msgr2=0x7fcd680c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:45.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.696+0000 7fcd6c9f7700 1 --2- 172.21.15.8:0/1678265482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd54003a60 0x7fcd680c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:45.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.696+0000 7fcd67fff700 1 --2- 172.21.15.8:0/1678265482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd54003a60 0x7fcd680c5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:45.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.696+0000 7fcd67fff700 1 -- 172.21.15.8:0/1678265482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd6814faf0 msgr2=0x7fcd6814ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:45.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.696+0000 7fcd67fff700 1 --2- 172.21.15.8:0/1678265482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd6814faf0 0x7fcd6814ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:45.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.696+0000 7fcd67fff700 1 -- 172.21.15.8:0/1678265482 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6815a6d0 con 0x7fcd68159bf0 2023-10-06T04:36:45.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.696+0000 7fcd6d1f8700 1 --2- 172.21.15.8:0/1678265482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd6814faf0 0x7fcd6814ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:36:45.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.696+0000 7fcd67fff700 1 --2- 172.21.15.8:0/1678265482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd68159bf0 0x7fcd6815a060 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcd58011da0 tx=0x7fcd580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:45.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.696+0000 7fcd64ff9700 1 -- 172.21.15.8:0/1678265482 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5800fcd0 con 0x7fcd68159bf0 2023-10-06T04:36:45.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.696+0000 7fcd64ff9700 1 -- 172.21.15.8:0/1678265482 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5800fe30 con 0x7fcd68159bf0 2023-10-06T04:36:45.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.696+0000 7fcd6ec5b700 1 -- 172.21.15.8:0/1678265482 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd6815a9b0 con 0x7fcd68159bf0 2023-10-06T04:36:45.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.696+0000 7fcd64ff9700 1 -- 172.21.15.8:0/1678265482 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd58014690 con 0x7fcd68159bf0 2023-10-06T04:36:45.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.696+0000 7fcd6ec5b700 1 -- 172.21.15.8:0/1678265482 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd68155b10 con 0x7fcd68159bf0 2023-10-06T04:36:45.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.697+0000 7fcd6ec5b700 1 -- 172.21.15.8:0/1678265482 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd6815abf0 con 0x7fcd68159bf0 2023-10-06T04:36:45.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.698+0000 7fcd64ff9700 1 -- 172.21.15.8:0/1678265482 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcd58014a80 con 0x7fcd68159bf0 2023-10-06T04:36:45.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.698+0000 7fcd64ff9700 1 --2- 172.21.15.8:0/1678265482 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fcd48066f30 0x7fcd480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:45.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.698+0000 7fcd64ff9700 1 -- 172.21.15.8:0/1678265482 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fcd58018030 con 0x7fcd68159bf0 2023-10-06T04:36:45.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.698+0000 7fcd6c9f7700 1 --2- 172.21.15.8:0/1678265482 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fcd48066f30 0x7fcd480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:45.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.699+0000 7fcd6c9f7700 1 --2- 172.21.15.8:0/1678265482 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fcd48066f30 0x7fcd480693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcd6000c6b0 tx=0x7fcd60015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:45.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.702+0000 7fcd64ff9700 1 -- 172.21.15.8:0/1678265482 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd6815abf0 con 0x7fcd68159bf0 2023-10-06T04:36:45.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.941+0000 7fcd6ec5b700 1 -- 172.21.15.8:0/1678265482 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcd6815abf0 con 0x7fcd68159bf0 2023-10-06T04:36:45.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.941+0000 7fcd64ff9700 1 -- 172.21.15.8:0/1678265482 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fcd58022070 con 0x7fcd68159bf0 2023-10-06T04:36:45.944 INFO:teuthology.orchestra.run.smithi008.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T04:36:45.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.943+0000 7fcd6ec5b700 1 -- 172.21.15.8:0/1678265482 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fcd48066f30 msgr2=0x7fcd480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:45.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.943+0000 7fcd6ec5b700 1 --2- 172.21.15.8:0/1678265482 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fcd48066f30 0x7fcd480693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcd6000c6b0 tx=0x7fcd60015000 comp rx=0 tx=0).stop 2023-10-06T04:36:45.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.943+0000 7fcd6ec5b700 1 -- 172.21.15.8:0/1678265482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd68159bf0 msgr2=0x7fcd6815a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:45.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.943+0000 7fcd6ec5b700 1 --2- 172.21.15.8:0/1678265482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd68159bf0 0x7fcd6815a060 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcd58011da0 tx=0x7fcd580091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:45.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.943+0000 7fcd6ec5b700 1 -- 172.21.15.8:0/1678265482 shutdown_connections 2023-10-06T04:36:45.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.943+0000 7fcd6ec5b700 1 --2- 172.21.15.8:0/1678265482 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fcd48066f30 0x7fcd480693e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:45.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.943+0000 7fcd6ec5b700 1 --2- 172.21.15.8:0/1678265482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd6814faf0 0x7fcd6814ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:45.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.943+0000 7fcd6ec5b700 1 --2- 172.21.15.8:0/1678265482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd54003a60 0x7fcd680c5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:45.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.943+0000 7fcd6ec5b700 1 --2- 172.21.15.8:0/1678265482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd68159bf0 0x7fcd6815a060 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:45.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.943+0000 7fcd6ec5b700 1 -- 172.21.15.8:0/1678265482 >> 172.21.15.8:0/1678265482 conn(0x7fcd6806ed00 msgr2=0x7fcd680ca990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:45.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.944+0000 7fcd6ec5b700 1 -- 172.21.15.8:0/1678265482 shutdown_connections 2023-10-06T04:36:45.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:45.944+0000 7fcd6ec5b700 1 -- 172.21.15.8:0/1678265482 wait complete. 2023-10-06T04:36:45.958 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T04:36:45.958 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:36:45.959 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi008.front.sepia.ceph.com 2023-10-06T04:36:45.959 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-06T04:36:45.959 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-06T04:36:45.959 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T04:36:45.959 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T04:36:45.959 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:36:45.959 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-06T04:36:45.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:45.960 DEBUG:teuthology.orchestra.run.smithi008:> ip addr 2023-10-06T04:36:45.975 INFO:teuthology.orchestra.run.smithi008.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:36:45.975 INFO:teuthology.orchestra.run.smithi008.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:36:45.975 INFO:teuthology.orchestra.run.smithi008.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:36:45.975 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:45.975 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 ::1/128 scope host 2023-10-06T04:36:45.975 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:45.975 INFO:teuthology.orchestra.run.smithi008.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:36:45.976 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2e brd ff:ff:ff:ff:ff:ff 2023-10-06T04:36:45.976 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f0 2023-10-06T04:36:45.976 INFO:teuthology.orchestra.run.smithi008.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:36:45.976 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2f brd ff:ff:ff:ff:ff:ff 2023-10-06T04:36:45.976 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f1 2023-10-06T04:36:45.976 INFO:teuthology.orchestra.run.smithi008.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:36:45.976 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:fe brd ff:ff:ff:ff:ff:ff 2023-10-06T04:36:45.976 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f0 2023-10-06T04:36:45.976 INFO:teuthology.orchestra.run.smithi008.stdout: inet 172.21.15.8/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T04:36:45.976 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft 42474sec preferred_lft 42474sec 2023-10-06T04:36:45.976 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::ae1f:6bff:fef8:25fe/64 scope link 2023-10-06T04:36:45.977 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:45.977 INFO:teuthology.orchestra.run.smithi008.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:36:45.977 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:ff brd ff:ff:ff:ff:ff:ff 2023-10-06T04:36:45.977 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f1 2023-10-06T04:36:45.977 INFO:teuthology.orchestra.run.smithi008.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:36:45.977 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 3e:b3:ce:23:96:5e brd ff:ff:ff:ff:ff:ff 2023-10-06T04:36:45.977 INFO:teuthology.orchestra.run.smithi008.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T04:36:45.977 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:45.977 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::2096:16ff:fef6:bb26/64 scope link tentative 2023-10-06T04:36:45.977 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:45.977 INFO:teuthology.orchestra.run.smithi008.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:36:45.977 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 3e:b3:ce:23:96:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T04:36:45.978 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::3cb3:ceff:fe23:965e/64 scope link tentative 2023-10-06T04:36:45.978 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:45.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:45.978 DEBUG:teuthology.orchestra.run.smithi008:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:36:46.040 INFO:teuthology.orchestra.run.smithi008.stdout:1 2023-10-06T04:36:46.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:46.041 DEBUG:teuthology.orchestra.run.smithi008:> route 2023-10-06T04:36:46.098 INFO:teuthology.orchestra.run.smithi008.stdout:Kernel IP routing table 2023-10-06T04:36:46.098 INFO:teuthology.orchestra.run.smithi008.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:36:46.098 INFO:teuthology.orchestra.run.smithi008.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T04:36:46.098 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T04:36:46.098 INFO:teuthology.orchestra.run.smithi008.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:36:46.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:46.099 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-10-06T04:36:46.099 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-10-06T04:36:46.099 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T04:36:46.099 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T04:36:46.099 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T04:36:46.099 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-10-06T04:36:46.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:46.201 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2023-10-06T04:36:46.216 INFO:teuthology.orchestra.run.smithi008.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T04:36:46.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:46.217 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list-id 2023-10-06T04:36:46.271 INFO:teuthology.orchestra.run.smithi008.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-06T04:36:46.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:46.272 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-10-06T04:36:46.272 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-10-06T04:36:46.272 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T04:36:46.272 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-06T04:36:46.272 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-10-06T04:36:46.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:46.361 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T04:36:46.400 INFO:teuthology.orchestra.run.smithi008.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:36:46.400 INFO:teuthology.orchestra.run.smithi008.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:36:46.400 INFO:teuthology.orchestra.run.smithi008.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:36:46.400 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:46.400 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 ::1/128 scope host 2023-10-06T04:36:46.400 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:46.401 INFO:teuthology.orchestra.run.smithi008.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:36:46.401 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 96:fc:80:94:4b:07 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T04:36:46.401 INFO:teuthology.orchestra.run.smithi008.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T04:36:46.401 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:46.401 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::94fc:80ff:fe94:4b07/64 scope link tentative 2023-10-06T04:36:46.401 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:46.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:46.418 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T04:36:46.491 INFO:teuthology.orchestra.run.smithi008.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:36:46.491 INFO:teuthology.orchestra.run.smithi008.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:36:46.491 INFO:teuthology.orchestra.run.smithi008.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:36:46.491 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:46.491 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 ::1/128 scope host 2023-10-06T04:36:46.491 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:46.491 INFO:teuthology.orchestra.run.smithi008.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:36:46.492 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 96:fc:80:94:4b:07 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T04:36:46.492 INFO:teuthology.orchestra.run.smithi008.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T04:36:46.492 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:46.492 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::94fc:80ff:fe94:4b07/64 scope link tentative 2023-10-06T04:36:46.492 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:46.504 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-06T04:36:46.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:46.505 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-10-06T04:36:46.505 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-10-06T04:36:46.505 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-06T04:36:46.505 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T04:36:46.506 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-06T04:36:46.506 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-06T04:36:46.506 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-06T04:36:46.506 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-10-06T04:36:46.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:46.743 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-10-06T04:36:46.743 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-10-06T04:36:46.743 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set brx.1 up 2023-10-06T04:36:46.743 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T04:36:46.744 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-10-06T04:36:46.826 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:36:46.826 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-06T04:36:46.841 INFO:teuthology.orchestra.run.smithi008.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-06T04:36:46.842 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:36:46.842 DEBUG:teuthology.orchestra.run.smithi008:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-06T04:36:46.896 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-10-06T04:36:46.896 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:36:46.896 DEBUG:teuthology.orchestra.run.smithi008:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:36:46.978 INFO:teuthology.orchestra.run.smithi008.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:36:46.978 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T04:36:46.997 INFO:teuthology.orchestra.run.smithi008.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:36:46.997 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T04:36:46.997 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: resolved to: "172.21.15.8:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-10-06T04:36:46.997 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: trying mount with new device syntax: 2@c030d94d-df8f-49bb-8df7-07e9e557d96b.cephfs=/ 2023-10-06T04:36:46.997 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.8:3300/172.21.15.184:3300/172.21.15.184:3301" will pass to kernel 2023-10-06T04:36:46.998 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T04:36:46.998 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T04:36:46.998 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:36:47.019 INFO:teuthology.orchestra.run.smithi008.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:36:47.019 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T04:36:47.020 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: resolved to: "172.21.15.8:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-10-06T04:36:47.020 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: trying mount with new device syntax: 2@c030d94d-df8f-49bb-8df7-07e9e557d96b.cephfs=/ 2023-10-06T04:36:47.020 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.8:3300/172.21.15.184:3300/172.21.15.184:3301" will pass to kernel 2023-10-06T04:36:47.020 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T04:36:47.020 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T04:36:47.021 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:36:47.021 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: resolved to: "172.21.15.8:6789,172.21.15.184:6789,172.21.15.184:6790" 2023-10-06T04:36:47.021 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.8:6789,172.21.15.184:6789,172.21.15.184:6790:/ 2023-10-06T04:36:47.021 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,key=2,mds_namespace=cephfs,fsid=c030d94d-df8f-49bb-8df7-07e9e557d96b" will pass to kernel 2023-10-06T04:36:47.022 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T04:36:47.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:47.022 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-06T04:36:47.087 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-10-06T04:36:47.087 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:36:47.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.244+0000 7f1cdc71e700 1 Processor -- start 2023-10-06T04:36:47.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.244+0000 7f1cdc71e700 1 -- start start 2023-10-06T04:36:47.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.244+0000 7f1cdc71e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1cd40af680 0x7f1cd415e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:47.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.244+0000 7f1cdc71e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1cd40cb360 0x7f1cd40d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:47.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.244+0000 7f1cdc71e700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1cd40d08d0 0x7f1cd40b0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:47.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.244+0000 7f1cdc71e700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd415d460 con 0x7f1cd40d08d0 2023-10-06T04:36:47.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.244+0000 7f1cdc71e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd40d0d50 con 0x7f1cd40af680 2023-10-06T04:36:47.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.244+0000 7f1cdc71e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd40cc4c0 con 0x7f1cd40cb360 2023-10-06T04:36:47.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.245+0000 7f1cdacbb700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1cd40d08d0 0x7f1cd40b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:47.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.245+0000 7f1cdacbb700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1cd40d08d0 0x7f1cd40b0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47918/0 (socket says 172.21.15.8:47918) 2023-10-06T04:36:47.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.245+0000 7f1cdacbb700 1 -- 172.21.15.8:0/1220706814 learned_addr learned my addr 172.21.15.8:0/1220706814 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:47.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.245+0000 7f1cda4ba700 1 --2- 172.21.15.8:0/1220706814 >> v2:172.21.15.184:3300/0 conn(0x7f1cd40af680 0x7f1cd415e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:47.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.245+0000 7f1cd9cb9700 1 --2- 172.21.15.8:0/1220706814 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1cd40cb360 0x7f1cd40d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:47.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.245+0000 7f1cdacbb700 1 -- 172.21.15.8:0/1220706814 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1cd40cb360 msgr2=0x7f1cd40d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:47.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.245+0000 7f1cdacbb700 1 --2- 172.21.15.8:0/1220706814 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1cd40cb360 0x7f1cd40d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:47.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.245+0000 7f1cdacbb700 1 -- 172.21.15.8:0/1220706814 >> v2:172.21.15.184:3300/0 conn(0x7f1cd40af680 msgr2=0x7f1cd415e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:47.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.245+0000 7f1cdacbb700 1 --2- 172.21.15.8:0/1220706814 >> v2:172.21.15.184:3300/0 conn(0x7f1cd40af680 0x7f1cd415e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:47.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.245+0000 7f1cdacbb700 1 -- 172.21.15.8:0/1220706814 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd415e580 con 0x7f1cd40d08d0 2023-10-06T04:36:47.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.245+0000 7f1cdacbb700 1 --2- 172.21.15.8:0/1220706814 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cd40d08d0 0x7f1cd40b0000 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1cd40d1020 tx=0x7f1cc4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e1b3ccae3fc36af server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:47.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.245+0000 7f1cd94b8700 1 -- 172.21.15.8:0/1220706814 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc400e070 con 0x7f1cd40d08d0 2023-10-06T04:36:47.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.245+0000 7f1cd94b8700 1 -- 172.21.15.8:0/1220706814 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc400ba40 con 0x7f1cd40d08d0 2023-10-06T04:36:47.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.245+0000 7f1cd94b8700 1 -- 172.21.15.8:0/1220706814 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc40092e0 con 0x7f1cd40d08d0 2023-10-06T04:36:47.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.246+0000 7f1cdc71e700 1 -- 172.21.15.8:0/1220706814 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cd40d08d0 msgr2=0x7f1cd40b0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:47.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.246+0000 7f1cdc71e700 1 --2- 172.21.15.8:0/1220706814 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cd40d08d0 0x7f1cd40b0000 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1cd40d1020 tx=0x7f1cc4009840 comp rx=0 tx=0).stop 2023-10-06T04:36:47.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.246+0000 7f1cdc71e700 1 -- 172.21.15.8:0/1220706814 shutdown_connections 2023-10-06T04:36:47.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.246+0000 7f1cdc71e700 1 --2- 172.21.15.8:0/1220706814 >> v2:172.21.15.184:3300/0 conn(0x7f1cd40af680 0x7f1cd415e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:47.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.246+0000 7f1cdc71e700 1 --2- 172.21.15.8:0/1220706814 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cd40d08d0 0x7f1cd40b0000 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:47.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.246+0000 7f1cdc71e700 1 --2- 172.21.15.8:0/1220706814 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1cd40cb360 0x7f1cd40d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:47.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.246+0000 7f1cdc71e700 1 -- 172.21.15.8:0/1220706814 >> 172.21.15.8:0/1220706814 conn(0x7f1cd40633d0 msgr2=0x7f1cd40637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:47.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.246+0000 7f1cdc71e700 1 -- 172.21.15.8:0/1220706814 shutdown_connections 2023-10-06T04:36:47.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.246+0000 7f1cdc71e700 1 -- 172.21.15.8:0/1220706814 wait complete. 2023-10-06T04:36:47.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.247+0000 7f1cdc71e700 1 Processor -- start 2023-10-06T04:36:47.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.247+0000 7f1cdc71e700 1 -- start start 2023-10-06T04:36:47.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.248+0000 7f1cdc71e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1cd40af680 0x7f1cd40c7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:47.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.248+0000 7f1cdc71e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cd40cb360 0x7f1cd4157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:47.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.248+0000 7f1cdc71e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1cd40d08d0 0x7f1cd40c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:47.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.248+0000 7f1cdc71e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd41585a0 con 0x7f1cd40cb360 2023-10-06T04:36:47.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.248+0000 7f1cdc71e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd4159400 con 0x7f1cd40af680 2023-10-06T04:36:47.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.248+0000 7f1cdc71e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd40c7970 con 0x7f1cd40d08d0 2023-10-06T04:36:47.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.248+0000 7f1cd9cb9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cd40cb360 0x7f1cd4157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:47.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.248+0000 7f1cd9cb9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cd40cb360 0x7f1cd4157ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47920/0 (socket says 172.21.15.8:47920) 2023-10-06T04:36:47.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.248+0000 7f1cd9cb9700 1 -- 172.21.15.8:0/2071270670 learned_addr learned my addr 172.21.15.8:0/2071270670 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:47.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.248+0000 7f1cda4ba700 1 --2- 172.21.15.8:0/2071270670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1cd40af680 0x7f1cd40c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:47.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.248+0000 7f1cdacbb700 1 --2- 172.21.15.8:0/2071270670 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1cd40d08d0 0x7f1cd40c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:47.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.248+0000 7f1cd9cb9700 1 -- 172.21.15.8:0/2071270670 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1cd40d08d0 msgr2=0x7f1cd40c9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:47.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.248+0000 7f1cd9cb9700 1 --2- 172.21.15.8:0/2071270670 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1cd40d08d0 0x7f1cd40c9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:47.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.248+0000 7f1cd9cb9700 1 -- 172.21.15.8:0/2071270670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1cd40af680 msgr2=0x7f1cd40c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:47.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.248+0000 7f1cd9cb9700 1 --2- 172.21.15.8:0/2071270670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1cd40af680 0x7f1cd40c7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:47.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.248+0000 7f1cd9cb9700 1 -- 172.21.15.8:0/2071270670 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc4009ae0 con 0x7f1cd40cb360 2023-10-06T04:36:47.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.248+0000 7f1cd9cb9700 1 --2- 172.21.15.8:0/2071270670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cd40cb360 0x7f1cd4157ae0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1cc800d890 tx=0x7f1cc8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:47.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.248+0000 7f1cd27fc700 1 -- 172.21.15.8:0/2071270670 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc80125f0 con 0x7f1cd40cb360 2023-10-06T04:36:47.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.248+0000 7f1cd27fc700 1 -- 172.21.15.8:0/2071270670 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc8012750 con 0x7f1cd40cb360 2023-10-06T04:36:47.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.248+0000 7f1cd27fc700 1 -- 172.21.15.8:0/2071270670 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc8012af0 con 0x7f1cd40cb360 2023-10-06T04:36:47.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.248+0000 7f1cdc71e700 1 -- 172.21.15.8:0/2071270670 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cd41587f0 con 0x7f1cd40cb360 2023-10-06T04:36:47.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.249+0000 7f1cdc71e700 1 -- 172.21.15.8:0/2071270670 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd4158db0 con 0x7f1cd40cb360 2023-10-06T04:36:47.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.249+0000 7f1cdc71e700 1 -- 172.21.15.8:0/2071270670 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cd4071550 con 0x7f1cd40cb360 2023-10-06T04:36:47.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.250+0000 7f1cd27fc700 1 -- 172.21.15.8:0/2071270670 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1cc801e460 con 0x7f1cd40cb360 2023-10-06T04:36:47.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.250+0000 7f1cd27fc700 1 --2- 172.21.15.8:0/2071270670 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1cc0066f30 0x7f1cc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:47.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.250+0000 7f1cd27fc700 1 -- 172.21.15.8:0/2071270670 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1cc8084eb0 con 0x7f1cd40cb360 2023-10-06T04:36:47.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.250+0000 7f1cda4ba700 1 --2- 172.21.15.8:0/2071270670 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1cc0066f30 0x7f1cc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:47.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.251+0000 7f1cda4ba700 1 --2- 172.21.15.8:0/2071270670 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1cc0066f30 0x7f1cc00693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc006fd0 tx=0x7f1ccc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:47.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.254+0000 7f1cd27fc700 1 -- 172.21.15.8:0/2071270670 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1cc8051cd0 con 0x7f1cd40cb360 2023-10-06T04:36:47.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.491+0000 7f1cdc71e700 1 -- 172.21.15.8:0/2071270670 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1cd415d0a0 con 0x7f1cd40cb360 2023-10-06T04:36:47.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.491+0000 7f1cd27fc700 1 -- 172.21.15.8:0/2071270670 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f1cc80552f0 con 0x7f1cd40cb360 2023-10-06T04:36:47.494 INFO:teuthology.orchestra.run.smithi008.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T04:36:47.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.493+0000 7f1cdc71e700 1 -- 172.21.15.8:0/2071270670 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1cc0066f30 msgr2=0x7f1cc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:47.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.493+0000 7f1cdc71e700 1 --2- 172.21.15.8:0/2071270670 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1cc0066f30 0x7f1cc00693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc006fd0 tx=0x7f1ccc008040 comp rx=0 tx=0).stop 2023-10-06T04:36:47.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.493+0000 7f1cdc71e700 1 -- 172.21.15.8:0/2071270670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cd40cb360 msgr2=0x7f1cd4157ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:47.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.493+0000 7f1cdc71e700 1 --2- 172.21.15.8:0/2071270670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cd40cb360 0x7f1cd4157ae0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1cc800d890 tx=0x7f1cc8008040 comp rx=0 tx=0).stop 2023-10-06T04:36:47.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.493+0000 7f1cdc71e700 1 -- 172.21.15.8:0/2071270670 shutdown_connections 2023-10-06T04:36:47.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.493+0000 7f1cdc71e700 1 --2- 172.21.15.8:0/2071270670 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1cc0066f30 0x7f1cc00693e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:47.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.493+0000 7f1cdc71e700 1 --2- 172.21.15.8:0/2071270670 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1cd40d08d0 0x7f1cd40c9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:47.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.493+0000 7f1cdc71e700 1 --2- 172.21.15.8:0/2071270670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1cd40af680 0x7f1cd40c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:47.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.493+0000 7f1cdc71e700 1 --2- 172.21.15.8:0/2071270670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cd40cb360 0x7f1cd4157ae0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:47.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.493+0000 7f1cdc71e700 1 -- 172.21.15.8:0/2071270670 >> 172.21.15.8:0/2071270670 conn(0x7f1cd40633d0 msgr2=0x7f1cd40b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:47.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.494+0000 7f1cdc71e700 1 -- 172.21.15.8:0/2071270670 shutdown_connections 2023-10-06T04:36:47.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:47.494+0000 7f1cdc71e700 1 -- 172.21.15.8:0/2071270670 wait complete. 2023-10-06T04:36:47.508 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T04:36:47.508 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:36:47.508 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi184.front.sepia.ceph.com 2023-10-06T04:36:47.508 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T04:36:47.509 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T04:36:47.509 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T04:36:47.509 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T04:36:47.509 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:36:47.509 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T04:36:47.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:47.510 DEBUG:teuthology.orchestra.run.smithi184:> ip addr 2023-10-06T04:36:47.529 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:36:47.530 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:36:47.530 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:36:47.530 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:47.530 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-10-06T04:36:47.530 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:47.530 INFO:teuthology.orchestra.run.smithi184.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:36:47.530 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:16 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:36:47.530 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f0 2023-10-06T04:36:47.530 INFO:teuthology.orchestra.run.smithi184.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:36:47.530 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:17 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:36:47.530 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f1 2023-10-06T04:36:47.531 INFO:teuthology.orchestra.run.smithi184.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:36:47.531 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8e brd ff:ff:ff:ff:ff:ff 2023-10-06T04:36:47.531 INFO:teuthology.orchestra.run.smithi184.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:36:47.531 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8f brd ff:ff:ff:ff:ff:ff 2023-10-06T04:36:47.531 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.21.15.184/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T04:36:47.531 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft 42471sec preferred_lft 42471sec 2023-10-06T04:36:47.531 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::ec4:7aff:fe88:7b8f/64 scope link 2023-10-06T04:36:47.531 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:47.531 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T04:36:47.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:47.532 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-06T04:36:47.532 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-06T04:36:47.532 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link add name ceph-brx type bridge 2023-10-06T04:36:47.532 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip addr flush dev ceph-brx 2023-10-06T04:36:47.532 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set ceph-brx up 2023-10-06T04:36:47.532 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T04:36:47.532 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-06T04:36:47.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:47.704 DEBUG:teuthology.orchestra.run.smithi184:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:36:47.747 INFO:teuthology.orchestra.run.smithi184.stdout:1 2023-10-06T04:36:47.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:47.749 DEBUG:teuthology.orchestra.run.smithi184:> route 2023-10-06T04:36:47.781 INFO:teuthology.orchestra.run.smithi184.stdout:Kernel IP routing table 2023-10-06T04:36:47.782 INFO:teuthology.orchestra.run.smithi184.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:36:47.782 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T04:36:47.782 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T04:36:47.782 INFO:teuthology.orchestra.run.smithi184.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:36:47.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:47.783 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-06T04:36:47.783 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-06T04:36:47.783 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T04:36:47.784 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T04:36:47.784 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T04:36:47.784 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-06T04:36:48.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:48.081 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-10-06T04:36:48.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:48.096 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list-id 2023-10-06T04:36:48.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:48.150 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-06T04:36:48.150 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-06T04:36:48.151 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T04:36:48.151 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-06T04:36:48.151 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-06T04:36:48.241 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-06T04:36:48.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:48.242 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-06T04:36:48.242 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-06T04:36:48.242 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-06T04:36:48.242 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T04:36:48.242 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-06T04:36:48.242 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-06T04:36:48.242 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-06T04:36:48.242 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-06T04:36:48.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:48.447 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-06T04:36:48.447 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-06T04:36:48.448 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set brx.0 up 2023-10-06T04:36:48.448 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T04:36:48.448 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-06T04:36:48.539 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:36:48.539 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T04:36:48.554 INFO:teuthology.orchestra.run.smithi184.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T04:36:48.554 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:36:48.554 DEBUG:teuthology.orchestra.run.smithi184:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T04:36:48.608 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-06T04:36:48.609 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:36:48.609 DEBUG:teuthology.orchestra.run.smithi184:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:36:48.696 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:36:48.696 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T04:36:48.784 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:36:48.784 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T04:36:48.784 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.8:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-10-06T04:36:48.785 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: trying mount with new device syntax: 1@c030d94d-df8f-49bb-8df7-07e9e557d96b.cephfs=/ 2023-10-06T04:36:48.785 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.8:3300/172.21.15.184:3300/172.21.15.184:3301" will pass to kernel 2023-10-06T04:36:48.785 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T04:36:48.785 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T04:36:48.785 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:36:48.806 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:36:48.806 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T04:36:48.806 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.8:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-10-06T04:36:48.806 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: trying mount with new device syntax: 1@c030d94d-df8f-49bb-8df7-07e9e557d96b.cephfs=/ 2023-10-06T04:36:48.806 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.8:3300/172.21.15.184:3300/172.21.15.184:3301" will pass to kernel 2023-10-06T04:36:48.806 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T04:36:48.806 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T04:36:48.807 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:36:48.807 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.8:6789,172.21.15.184:6789,172.21.15.184:6790" 2023-10-06T04:36:48.807 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.8:6789,172.21.15.184:6789,172.21.15.184:6790:/ 2023-10-06T04:36:48.807 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=c030d94d-df8f-49bb-8df7-07e9e557d96b" will pass to kernel 2023-10-06T04:36:48.808 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T04:36:48.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:48.808 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T04:36:48.832 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-10-06T04:36:48.832 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:36:48.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.964+0000 7f76a9c69700 1 Processor -- start 2023-10-06T04:36:48.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.964+0000 7f76a9c69700 1 -- start start 2023-10-06T04:36:48.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.965+0000 7f76a9c69700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f76a40cb360 0x7f76a40d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:48.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.965+0000 7f76a9c69700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76a40d08d0 0x7f76a40cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:48.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.965+0000 7f76a9c69700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76a40cc4c0 con 0x7f76a40af680 2023-10-06T04:36:48.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.965+0000 7f76a9c69700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a415d460 con 0x7f76a40cb360 2023-10-06T04:36:48.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.965+0000 7f76a9c69700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a40d0d20 con 0x7f76a40d08d0 2023-10-06T04:36:48.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.965+0000 7f76a2ffd700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f76a40cb360 0x7f76a40d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:48.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.965+0000 7f76a37fe700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f76a40af680 0x7f76a415e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:59820/0 (socket says 172.21.15.8:59820) 2023-10-06T04:36:48.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.965+0000 7f76a37fe700 1 -- 172.21.15.8:0/1722401113 learned_addr learned my addr 172.21.15.8:0/1722401113 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:48.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.965+0000 7f76a3fff700 1 --2- 172.21.15.8:0/1722401113 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76a40d08d0 0x7f76a40cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:48.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.965+0000 7f76a2ffd700 1 -- 172.21.15.8:0/1722401113 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76a40d08d0 msgr2=0x7f76a40cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:48.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.965+0000 7f76a2ffd700 1 --2- 172.21.15.8:0/1722401113 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76a40d08d0 0x7f76a40cc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:48.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.965+0000 7f76a2ffd700 1 -- 172.21.15.8:0/1722401113 >> v1:172.21.15.8:6789/0 conn(0x7f76a40af680 legacy=0x7f76a415e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:48.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.965+0000 7f76a2ffd700 1 -- 172.21.15.8:0/1722401113 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a40cb8b0 con 0x7f76a40cb360 2023-10-06T04:36:48.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.965+0000 7f76a27fc700 1 -- 172.21.15.8:0/1722401113 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1287405733 0 0) 0x7f76a40cc4c0 con 0x7f76a40af680 2023-10-06T04:36:48.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.965+0000 7f76a2ffd700 1 --2- 172.21.15.8:0/1722401113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76a40cb360 0x7f76a40d0390 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f76980098e0 tx=0x7f76980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30150881a96f6e8d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:48.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.966+0000 7f76a27fc700 1 -- 172.21.15.8:0/1722401113 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769800b640 con 0x7f76a40cb360 2023-10-06T04:36:48.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.966+0000 7f76a27fc700 1 -- 172.21.15.8:0/1722401113 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769800b7a0 con 0x7f76a40cb360 2023-10-06T04:36:48.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.966+0000 7f76a27fc700 1 -- 172.21.15.8:0/1722401113 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769800bb40 con 0x7f76a40cb360 2023-10-06T04:36:48.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.966+0000 7f76a9c69700 1 -- 172.21.15.8:0/1722401113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76a40cb360 msgr2=0x7f76a40d0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:48.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.966+0000 7f76a9c69700 1 --2- 172.21.15.8:0/1722401113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76a40cb360 0x7f76a40d0390 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f76980098e0 tx=0x7f76980091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:48.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.966+0000 7f76a9c69700 1 -- 172.21.15.8:0/1722401113 shutdown_connections 2023-10-06T04:36:48.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.966+0000 7f76a9c69700 1 --2- 172.21.15.8:0/1722401113 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76a40d08d0 0x7f76a40cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:48.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.966+0000 7f76a9c69700 1 --2- 172.21.15.8:0/1722401113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76a40cb360 0x7f76a40d0390 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:48.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.966+0000 7f76a9c69700 1 -- 172.21.15.8:0/1722401113 >> 172.21.15.8:0/1722401113 conn(0x7f76a40633d0 msgr2=0x7f76a40637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:48.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.966+0000 7f76a9c69700 1 -- 172.21.15.8:0/1722401113 shutdown_connections 2023-10-06T04:36:48.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.966+0000 7f76a9c69700 1 -- 172.21.15.8:0/1722401113 wait complete. 2023-10-06T04:36:48.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.967+0000 7f76a9c69700 1 Processor -- start 2023-10-06T04:36:48.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.968+0000 7f76a9c69700 1 -- start start 2023-10-06T04:36:48.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.968+0000 7f76a9c69700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76a40af680 0x7f76a4156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:48.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.968+0000 7f76a9c69700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76a40cb360 0x7f76a40b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:48.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.968+0000 7f76a9c69700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76a40d08d0 0x7f76a40b3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:48.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.968+0000 7f76a9c69700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a4159340 con 0x7f76a40cb360 2023-10-06T04:36:48.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.968+0000 7f76a9c69700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a40b5050 con 0x7f76a40af680 2023-10-06T04:36:48.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.968+0000 7f76a9c69700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a4158fd0 con 0x7f76a40d08d0 2023-10-06T04:36:48.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.968+0000 7f76a2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76a40cb360 0x7f76a40b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:48.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.968+0000 7f76a2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76a40cb360 0x7f76a40b31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47936/0 (socket says 172.21.15.8:47936) 2023-10-06T04:36:48.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.968+0000 7f76a2ffd700 1 -- 172.21.15.8:0/1343874427 learned_addr learned my addr 172.21.15.8:0/1343874427 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:48.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.968+0000 7f76a3fff700 1 --2- 172.21.15.8:0/1343874427 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76a40d08d0 0x7f76a40b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:48.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.969+0000 7f76a37fe700 1 --2- 172.21.15.8:0/1343874427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76a40af680 0x7f76a4156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:48.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.969+0000 7f76a2ffd700 1 -- 172.21.15.8:0/1343874427 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76a40d08d0 msgr2=0x7f76a40b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:48.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.969+0000 7f76a2ffd700 1 --2- 172.21.15.8:0/1343874427 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76a40d08d0 0x7f76a40b3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:48.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.969+0000 7f76a2ffd700 1 -- 172.21.15.8:0/1343874427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76a40af680 msgr2=0x7f76a4156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:48.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.969+0000 7f76a2ffd700 1 --2- 172.21.15.8:0/1343874427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76a40af680 0x7f76a4156bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:48.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.969+0000 7f76a2ffd700 1 -- 172.21.15.8:0/1343874427 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7698009420 con 0x7f76a40cb360 2023-10-06T04:36:48.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.969+0000 7f76a2ffd700 1 --2- 172.21.15.8:0/1343874427 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76a40cb360 0x7f76a40b31d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f76a4063f80 tx=0x7f7698017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:48.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.969+0000 7f768b7fe700 1 -- 172.21.15.8:0/1343874427 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769800bb20 con 0x7f76a40cb360 2023-10-06T04:36:48.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.969+0000 7f768b7fe700 1 -- 172.21.15.8:0/1343874427 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7698011420 con 0x7f76a40cb360 2023-10-06T04:36:48.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.969+0000 7f76a9c69700 1 -- 172.21.15.8:0/1343874427 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a40b3f40 con 0x7f76a40cb360 2023-10-06T04:36:48.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.969+0000 7f768b7fe700 1 -- 172.21.15.8:0/1343874427 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76980117a0 con 0x7f76a40cb360 2023-10-06T04:36:48.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.969+0000 7f76a9c69700 1 -- 172.21.15.8:0/1343874427 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a40c7430 con 0x7f76a40cb360 2023-10-06T04:36:48.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.970+0000 7f76a9c69700 1 -- 172.21.15.8:0/1343874427 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a4159190 con 0x7f76a40cb360 2023-10-06T04:36:48.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.970+0000 7f768b7fe700 1 -- 172.21.15.8:0/1343874427 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7698011b50 con 0x7f76a40cb360 2023-10-06T04:36:48.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.971+0000 7f768b7fe700 1 --2- 172.21.15.8:0/1343874427 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7690066f30 0x7f76900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:48.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.971+0000 7f768b7fe700 1 -- 172.21.15.8:0/1343874427 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7698086120 con 0x7f76a40cb360 2023-10-06T04:36:48.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.971+0000 7f76a37fe700 1 --2- 172.21.15.8:0/1343874427 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7690066f30 0x7f76900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:48.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.972+0000 7f76a37fe700 1 --2- 172.21.15.8:0/1343874427 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7690066f30 0x7f76900693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f76940011e0 tx=0x7f7694009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:48.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:48.976+0000 7f768b7fe700 1 -- 172.21.15.8:0/1343874427 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7698052ea0 con 0x7f76a40cb360 2023-10-06T04:36:49.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:49.213+0000 7f76a9c69700 1 -- 172.21.15.8:0/1343874427 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f76a4071550 con 0x7f76a40cb360 2023-10-06T04:36:49.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:49.213+0000 7f768b7fe700 1 -- 172.21.15.8:0/1343874427 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f76980564c0 con 0x7f76a40cb360 2023-10-06T04:36:49.216 INFO:teuthology.orchestra.run.smithi008.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T04:36:49.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:49.215+0000 7f76a9c69700 1 -- 172.21.15.8:0/1343874427 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7690066f30 msgr2=0x7f76900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:49.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:49.215+0000 7f76a9c69700 1 --2- 172.21.15.8:0/1343874427 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7690066f30 0x7f76900693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f76940011e0 tx=0x7f7694009040 comp rx=0 tx=0).stop 2023-10-06T04:36:49.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:49.215+0000 7f76a9c69700 1 -- 172.21.15.8:0/1343874427 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76a40cb360 msgr2=0x7f76a40b31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:49.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:49.215+0000 7f76a9c69700 1 --2- 172.21.15.8:0/1343874427 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76a40cb360 0x7f76a40b31d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f76a4063f80 tx=0x7f7698017000 comp rx=0 tx=0).stop 2023-10-06T04:36:49.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:49.215+0000 7f76a9c69700 1 -- 172.21.15.8:0/1343874427 shutdown_connections 2023-10-06T04:36:49.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:49.215+0000 7f76a9c69700 1 --2- 172.21.15.8:0/1343874427 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7690066f30 0x7f76900693e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:49.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:49.215+0000 7f76a9c69700 1 --2- 172.21.15.8:0/1343874427 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76a40d08d0 0x7f76a40b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:49.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:49.215+0000 7f76a9c69700 1 --2- 172.21.15.8:0/1343874427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76a40af680 0x7f76a4156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:49.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:49.215+0000 7f76a9c69700 1 --2- 172.21.15.8:0/1343874427 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76a40cb360 0x7f76a40b31d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:49.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:49.215+0000 7f76a9c69700 1 -- 172.21.15.8:0/1343874427 >> 172.21.15.8:0/1343874427 conn(0x7f76a40633d0 msgr2=0x7f76a40b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:49.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:49.215+0000 7f76a9c69700 1 -- 172.21.15.8:0/1343874427 shutdown_connections 2023-10-06T04:36:49.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:49.215+0000 7f76a9c69700 1 -- 172.21.15.8:0/1343874427 wait complete. 2023-10-06T04:36:49.230 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T04:36:49.230 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:36:49.230 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi184.front.sepia.ceph.com 2023-10-06T04:36:49.230 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-06T04:36:49.231 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-06T04:36:49.231 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T04:36:49.231 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T04:36:49.231 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:36:49.231 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-06T04:36:49.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:49.231 DEBUG:teuthology.orchestra.run.smithi184:> ip addr 2023-10-06T04:36:49.247 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:36:49.248 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:36:49.248 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:36:49.248 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:49.248 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-10-06T04:36:49.248 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:49.249 INFO:teuthology.orchestra.run.smithi184.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:36:49.249 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:16 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:36:49.249 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f0 2023-10-06T04:36:49.249 INFO:teuthology.orchestra.run.smithi184.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:36:49.249 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:17 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:36:49.250 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f1 2023-10-06T04:36:49.250 INFO:teuthology.orchestra.run.smithi184.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:36:49.250 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8e brd ff:ff:ff:ff:ff:ff 2023-10-06T04:36:49.250 INFO:teuthology.orchestra.run.smithi184.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:36:49.250 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8f brd ff:ff:ff:ff:ff:ff 2023-10-06T04:36:49.251 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.21.15.184/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T04:36:49.251 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft 42469sec preferred_lft 42469sec 2023-10-06T04:36:49.251 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::ec4:7aff:fe88:7b8f/64 scope link 2023-10-06T04:36:49.251 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:49.251 INFO:teuthology.orchestra.run.smithi184.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:36:49.251 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 06:4b:33:80:54:59 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:36:49.252 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T04:36:49.252 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:49.252 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::bcfa:92ff:fe64:101c/64 scope link 2023-10-06T04:36:49.252 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:49.252 INFO:teuthology.orchestra.run.smithi184.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:36:49.252 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 06:4b:33:80:54:59 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T04:36:49.252 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::44b:33ff:fe80:5459/64 scope link tentative 2023-10-06T04:36:49.253 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:49.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:49.253 DEBUG:teuthology.orchestra.run.smithi184:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:36:49.311 INFO:teuthology.orchestra.run.smithi184.stdout:1 2023-10-06T04:36:49.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:49.313 DEBUG:teuthology.orchestra.run.smithi184:> route 2023-10-06T04:36:49.368 INFO:teuthology.orchestra.run.smithi184.stdout:Kernel IP routing table 2023-10-06T04:36:49.369 INFO:teuthology.orchestra.run.smithi184.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:36:49.369 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T04:36:49.369 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T04:36:49.369 INFO:teuthology.orchestra.run.smithi184.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:36:49.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:49.369 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-06T04:36:49.369 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-06T04:36:49.370 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T04:36:49.370 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T04:36:49.370 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T04:36:49.370 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-06T04:36:49.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:49.469 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-10-06T04:36:49.484 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T04:36:49.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:49.484 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list-id 2023-10-06T04:36:49.538 INFO:teuthology.orchestra.run.smithi184.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-06T04:36:49.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:49.539 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-06T04:36:49.539 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-06T04:36:49.539 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T04:36:49.539 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-06T04:36:49.539 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-06T04:36:49.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:49.626 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T04:36:49.659 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:36:49.660 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:36:49.660 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:36:49.660 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:49.660 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-10-06T04:36:49.660 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:49.660 INFO:teuthology.orchestra.run.smithi184.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:36:49.660 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 4e:62:90:a3:86:70 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T04:36:49.660 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T04:36:49.661 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:49.661 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::4c62:90ff:fea3:8670/64 scope link 2023-10-06T04:36:49.661 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:49.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:49.669 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T04:36:49.746 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:36:49.746 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:36:49.746 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:36:49.746 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:49.747 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-10-06T04:36:49.747 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:49.747 INFO:teuthology.orchestra.run.smithi184.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:36:49.747 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 4e:62:90:a3:86:70 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T04:36:49.747 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T04:36:49.747 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:49.748 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::4c62:90ff:fea3:8670/64 scope link 2023-10-06T04:36:49.748 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:36:49.757 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-06T04:36:49.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:49.758 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-06T04:36:49.759 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-06T04:36:49.759 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-06T04:36:49.759 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T04:36:49.760 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-06T04:36:49.760 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-06T04:36:49.760 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-06T04:36:49.760 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-06T04:36:49.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:49.977 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-06T04:36:49.977 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-06T04:36:49.977 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set brx.1 up 2023-10-06T04:36:49.977 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T04:36:49.977 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-06T04:36:50.056 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:36:50.056 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-06T04:36:50.070 INFO:teuthology.orchestra.run.smithi184.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-06T04:36:50.071 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:36:50.071 DEBUG:teuthology.orchestra.run.smithi184:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-06T04:36:50.125 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-10-06T04:36:50.125 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:36:50.125 DEBUG:teuthology.orchestra.run.smithi184:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:36:50.205 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:36:50.205 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T04:36:50.223 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:36:50.223 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T04:36:50.223 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.8:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-10-06T04:36:50.223 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: trying mount with new device syntax: 3@c030d94d-df8f-49bb-8df7-07e9e557d96b.cephfs=/ 2023-10-06T04:36:50.223 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.8:3300/172.21.15.184:3300/172.21.15.184:3301" will pass to kernel 2023-10-06T04:36:50.224 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T04:36:50.224 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T04:36:50.224 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:36:50.244 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:36:50.245 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T04:36:50.245 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.8:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-10-06T04:36:50.245 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: trying mount with new device syntax: 3@c030d94d-df8f-49bb-8df7-07e9e557d96b.cephfs=/ 2023-10-06T04:36:50.245 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.8:3300/172.21.15.184:3300/172.21.15.184:3301" will pass to kernel 2023-10-06T04:36:50.245 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T04:36:50.245 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T04:36:50.245 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:36:50.245 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.8:6789,172.21.15.184:6789,172.21.15.184:6790" 2023-10-06T04:36:50.246 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.8:6789,172.21.15.184:6789,172.21.15.184:6790:/ 2023-10-06T04:36:50.246 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,key=3,mds_namespace=cephfs,fsid=c030d94d-df8f-49bb-8df7-07e9e557d96b" will pass to kernel 2023-10-06T04:36:50.247 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T04:36:50.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:36:50.247 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-06T04:36:50.312 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-06T04:36:50.331 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:36:50.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.461+0000 7f00f0fdc700 1 Processor -- start 2023-10-06T04:36:50.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.461+0000 7f00f0fdc700 1 -- start start 2023-10-06T04:36:50.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.462+0000 7f00f0fdc700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f00ec0cb360 0x7f00ec0d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:50.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.462+0000 7f00f0fdc700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00ec0cc4c0 con 0x7f00ec0af680 2023-10-06T04:36:50.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.462+0000 7f00f0fdc700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00ec0d0d20 con 0x7f00ec0d08d0 2023-10-06T04:36:50.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.462+0000 7f00f0fdc700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00ec15d460 con 0x7f00ec0cb360 2023-10-06T04:36:50.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.462+0000 7f00ea59c700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f00ec0af680 0x7f00ec15e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:59830/0 (socket says 172.21.15.8:59830) 2023-10-06T04:36:50.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.462+0000 7f00ea59c700 1 -- 172.21.15.8:0/1154855255 learned_addr learned my addr 172.21.15.8:0/1154855255 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:50.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.462+0000 7f00e9d9b700 1 --2- 172.21.15.8:0/1154855255 >> v2:172.21.15.184:3300/0 conn(0x7f00ec0cb360 0x7f00ec0d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:50.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.462+0000 7f00e959a700 1 -- 172.21.15.8:0/1154855255 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2327133189 0 0) 0x7f00ec0cc4c0 con 0x7f00ec0af680 2023-10-06T04:36:50.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.462+0000 7f00e959a700 1 -- 172.21.15.8:0/1154855255 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00d8003570 con 0x7f00ec0af680 2023-10-06T04:36:50.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.462+0000 7f00e959a700 1 -- 172.21.15.8:0/1154855255 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1515745748 0 0) 0x7f00ec0d0d20 con 0x7f00ec0d08d0 2023-10-06T04:36:50.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.462+0000 7f00e959a700 1 -- 172.21.15.8:0/1154855255 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00ec0cc4c0 con 0x7f00ec0d08d0 2023-10-06T04:36:50.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.462+0000 7f00e9d9b700 1 -- 172.21.15.8:0/1154855255 >> v1:172.21.15.184:6789/0 conn(0x7f00ec0d08d0 legacy=0x7f00ec0cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:50.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.462+0000 7f00e9d9b700 1 -- 172.21.15.8:0/1154855255 >> v1:172.21.15.8:6789/0 conn(0x7f00ec0af680 legacy=0x7f00ec15e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:50.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.462+0000 7f00e9d9b700 1 -- 172.21.15.8:0/1154855255 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ec0cb8b0 con 0x7f00ec0cb360 2023-10-06T04:36:50.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.463+0000 7f00e9d9b700 1 --2- 172.21.15.8:0/1154855255 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00ec0cb360 0x7f00ec0d0390 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f00d40098e0 tx=0x7f00d40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5426617776f9aff5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:50.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.463+0000 7f00e959a700 1 -- 172.21.15.8:0/1154855255 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d4011630 con 0x7f00ec0cb360 2023-10-06T04:36:50.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.463+0000 7f00e959a700 1 -- 172.21.15.8:0/1154855255 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d4011790 con 0x7f00ec0cb360 2023-10-06T04:36:50.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.463+0000 7f00e959a700 1 -- 172.21.15.8:0/1154855255 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d4011b30 con 0x7f00ec0cb360 2023-10-06T04:36:50.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.463+0000 7f00f0fdc700 1 -- 172.21.15.8:0/1154855255 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00ec0cb360 msgr2=0x7f00ec0d0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:50.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.463+0000 7f00f0fdc700 1 --2- 172.21.15.8:0/1154855255 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00ec0cb360 0x7f00ec0d0390 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f00d40098e0 tx=0x7f00d40091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:50.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.463+0000 7f00f0fdc700 1 -- 172.21.15.8:0/1154855255 shutdown_connections 2023-10-06T04:36:50.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.463+0000 7f00f0fdc700 1 --2- 172.21.15.8:0/1154855255 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00ec0cb360 0x7f00ec0d0390 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:50.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.463+0000 7f00f0fdc700 1 -- 172.21.15.8:0/1154855255 >> 172.21.15.8:0/1154855255 conn(0x7f00ec0633d0 msgr2=0x7f00ec0637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:50.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.463+0000 7f00f0fdc700 1 -- 172.21.15.8:0/1154855255 shutdown_connections 2023-10-06T04:36:50.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.464+0000 7f00f0fdc700 1 -- 172.21.15.8:0/1154855255 wait complete. 2023-10-06T04:36:50.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.465+0000 7f00f0fdc700 1 Processor -- start 2023-10-06T04:36:50.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.465+0000 7f00f0fdc700 1 -- start start 2023-10-06T04:36:50.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.465+0000 7f00f0fdc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00ec0af680 0x7f00ec15b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:50.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.465+0000 7f00f0fdc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00ec0cb360 0x7f00ec0c7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:50.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.465+0000 7f00f0fdc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00ec0d08d0 0x7f00ec169a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:50.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.465+0000 7f00f0fdc700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec0c51d0 con 0x7f00ec0af680 2023-10-06T04:36:50.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.465+0000 7f00f0fdc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec0c54b0 con 0x7f00ec0cb360 2023-10-06T04:36:50.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.465+0000 7f00f0fdc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec0c5790 con 0x7f00ec0d08d0 2023-10-06T04:36:50.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.465+0000 7f00ea59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00ec0af680 0x7f00ec15b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:50.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.465+0000 7f00ea59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00ec0af680 0x7f00ec15b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47946/0 (socket says 172.21.15.8:47946) 2023-10-06T04:36:50.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.465+0000 7f00ea59c700 1 -- 172.21.15.8:0/1093649702 learned_addr learned my addr 172.21.15.8:0/1093649702 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:50.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.466+0000 7f00e9d9b700 1 --2- 172.21.15.8:0/1093649702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00ec0cb360 0x7f00ec0c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:50.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.466+0000 7f00ea59c700 1 -- 172.21.15.8:0/1093649702 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00ec0d08d0 msgr2=0x7f00ec169a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:50.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.466+0000 7f00ea59c700 1 --2- 172.21.15.8:0/1093649702 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00ec0d08d0 0x7f00ec169a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:50.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.466+0000 7f00ea59c700 1 -- 172.21.15.8:0/1093649702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00ec0cb360 msgr2=0x7f00ec0c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:50.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.466+0000 7f00ea59c700 1 --2- 172.21.15.8:0/1093649702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00ec0cb360 0x7f00ec0c7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:50.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.466+0000 7f00ea59c700 1 -- 172.21.15.8:0/1093649702 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d4009420 con 0x7f00ec0af680 2023-10-06T04:36:50.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.466+0000 7f00ea59c700 1 --2- 172.21.15.8:0/1093649702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00ec0af680 0x7f00ec15b850 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f00e400cd00 tx=0x7f00e4001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:50.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.466+0000 7f00e27fc700 1 -- 172.21.15.8:0/1093649702 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e400ab30 con 0x7f00ec0af680 2023-10-06T04:36:50.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.466+0000 7f00e27fc700 1 -- 172.21.15.8:0/1093649702 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e400ac90 con 0x7f00ec0af680 2023-10-06T04:36:50.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.466+0000 7f00f0fdc700 1 -- 172.21.15.8:0/1093649702 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00ec0c5a70 con 0x7f00ec0af680 2023-10-06T04:36:50.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.466+0000 7f00e27fc700 1 -- 172.21.15.8:0/1093649702 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e4007300 con 0x7f00ec0af680 2023-10-06T04:36:50.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.466+0000 7f00f0fdc700 1 -- 172.21.15.8:0/1093649702 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00ec0ae9c0 con 0x7f00ec0af680 2023-10-06T04:36:50.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.467+0000 7f00f0fdc700 1 -- 172.21.15.8:0/1093649702 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00ec071550 con 0x7f00ec0af680 2023-10-06T04:36:50.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.468+0000 7f00e27fc700 1 -- 172.21.15.8:0/1093649702 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f00e40076f0 con 0x7f00ec0af680 2023-10-06T04:36:50.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.468+0000 7f00e27fc700 1 --2- 172.21.15.8:0/1093649702 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f00cc066f30 0x7f00cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:50.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.468+0000 7f00e27fc700 1 -- 172.21.15.8:0/1093649702 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f00e4084e30 con 0x7f00ec0af680 2023-10-06T04:36:50.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.468+0000 7f00e9d9b700 1 --2- 172.21.15.8:0/1093649702 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f00cc066f30 0x7f00cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:50.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.469+0000 7f00e9d9b700 1 --2- 172.21.15.8:0/1093649702 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f00cc066f30 0x7f00cc0693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f00ec0c5030 tx=0x7f00d4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:50.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.472+0000 7f00e27fc700 1 -- 172.21.15.8:0/1093649702 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00e4051cd0 con 0x7f00ec0af680 2023-10-06T04:36:50.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.668+0000 7f00f0fdc700 1 -- 172.21.15.8:0/1093649702 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00ec0cacd0 con 0x7f00ec0af680 2023-10-06T04:36:50.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.669+0000 7f00e27fc700 1 -- 172.21.15.8:0/1093649702 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f00e40552f0 con 0x7f00ec0af680 2023-10-06T04:36:50.671 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:36:50.672 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":25,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:36:21.690266+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:36:10.148177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:36:10.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:36:14.390671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:36:15.601089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:36:19.291300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.555871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.490505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.504578+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.517217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:05.991135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.537329+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.543232+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.443715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:36:50.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.671+0000 7f00f0fdc700 1 -- 172.21.15.8:0/1093649702 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f00cc066f30 msgr2=0x7f00cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:50.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.671+0000 7f00f0fdc700 1 --2- 172.21.15.8:0/1093649702 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f00cc066f30 0x7f00cc0693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f00ec0c5030 tx=0x7f00d4017000 comp rx=0 tx=0).stop 2023-10-06T04:36:50.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.671+0000 7f00f0fdc700 1 -- 172.21.15.8:0/1093649702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00ec0af680 msgr2=0x7f00ec15b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:50.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.671+0000 7f00f0fdc700 1 --2- 172.21.15.8:0/1093649702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00ec0af680 0x7f00ec15b850 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f00e400cd00 tx=0x7f00e4001b10 comp rx=0 tx=0).stop 2023-10-06T04:36:50.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.671+0000 7f00f0fdc700 1 -- 172.21.15.8:0/1093649702 shutdown_connections 2023-10-06T04:36:50.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.671+0000 7f00f0fdc700 1 --2- 172.21.15.8:0/1093649702 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f00cc066f30 0x7f00cc0693e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:50.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.671+0000 7f00f0fdc700 1 --2- 172.21.15.8:0/1093649702 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00ec0d08d0 0x7f00ec169a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:50.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.671+0000 7f00f0fdc700 1 --2- 172.21.15.8:0/1093649702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00ec0af680 0x7f00ec15b850 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:50.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.671+0000 7f00f0fdc700 1 --2- 172.21.15.8:0/1093649702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00ec0cb360 0x7f00ec0c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:50.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.671+0000 7f00f0fdc700 1 -- 172.21.15.8:0/1093649702 >> 172.21.15.8:0/1093649702 conn(0x7f00ec0633d0 msgr2=0x7f00ec0cc950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:50.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.671+0000 7f00f0fdc700 1 -- 172.21.15.8:0/1093649702 shutdown_connections 2023-10-06T04:36:50.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.671+0000 7f00f0fdc700 1 -- 172.21.15.8:0/1093649702 wait complete. 2023-10-06T04:36:50.686 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:36:10.148177+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:36:10.684157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:36:14.390671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:36:15.601089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T04:36:19.291300+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:36:50.687 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:36:50.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.805+0000 7fe4d7e83700 1 Processor -- start 2023-10-06T04:36:50.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.806+0000 7fe4d7e83700 1 -- start start 2023-10-06T04:36:50.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.806+0000 7fe4d7e83700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe4d01430c0 0x7fe4d00cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:50.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.806+0000 7fe4d7e83700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4d00cf510 con 0x7fe4d0142cf0 2023-10-06T04:36:50.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.807+0000 7fe4d7e83700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4d00ce6a0 con 0x7fe4d00cfee0 2023-10-06T04:36:50.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.807+0000 7fe4d7e83700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4d00ce900 con 0x7fe4d01430c0 2023-10-06T04:36:50.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.807+0000 7fe4d5c1f700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe4d0142cf0 0x7fe4d00b5cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:59834/0 (socket says 172.21.15.8:59834) 2023-10-06T04:36:50.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.807+0000 7fe4d5c1f700 1 -- 172.21.15.8:0/4267933979 learned_addr learned my addr 172.21.15.8:0/4267933979 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:50.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.807+0000 7fe4d4c1d700 1 -- 172.21.15.8:0/4267933979 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3311832770 0 0) 0x7fe4d00cf510 con 0x7fe4d0142cf0 2023-10-06T04:36:50.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.807+0000 7fe4d541e700 1 --2- 172.21.15.8:0/4267933979 >> v2:172.21.15.184:3300/0 conn(0x7fe4d01430c0 0x7fe4d00cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:50.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.807+0000 7fe4d4c1d700 1 -- 172.21.15.8:0/4267933979 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4b8003570 con 0x7fe4d0142cf0 2023-10-06T04:36:50.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.807+0000 7fe4d4c1d700 1 -- 172.21.15.8:0/4267933979 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1268548203 0 0) 0x7fe4b8003570 con 0x7fe4d0142cf0 2023-10-06T04:36:50.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.807+0000 7fe4d4c1d700 1 -- 172.21.15.8:0/4267933979 >> v2:172.21.15.184:3300/0 conn(0x7fe4d01430c0 msgr2=0x7fe4d00cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:50.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.807+0000 7fe4d4c1d700 1 --2- 172.21.15.8:0/4267933979 >> v2:172.21.15.184:3300/0 conn(0x7fe4d01430c0 0x7fe4d00cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:50.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.807+0000 7fe4d4c1d700 1 -- 172.21.15.8:0/4267933979 >> v1:172.21.15.184:6789/0 conn(0x7fe4d00cfee0 legacy=0x7fe4d00b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:50.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.807+0000 7fe4d4c1d700 1 -- 172.21.15.8:0/4267933979 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d00cebe0 con 0x7fe4d0142cf0 2023-10-06T04:36:50.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.807+0000 7fe4d4c1d700 1 -- 172.21.15.8:0/4267933979 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7fe4c8001470 con 0x7fe4d0142cf0 2023-10-06T04:36:50.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.807+0000 7fe4d4c1d700 1 -- 172.21.15.8:0/4267933979 >> v1:172.21.15.8:6789/0 conn(0x7fe4d0142cf0 legacy=0x7fe4d00b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:50.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.807+0000 7fe4d4c1d700 1 --2- 172.21.15.8:0/4267933979 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4b8003a60 0x7fe4b8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:50.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.807+0000 7fe4d4c1d700 1 --2- 172.21.15.8:0/4267933979 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4b8004810 0x7fe4b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:50.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.807+0000 7fe4d4c1d700 1 --2- 172.21.15.8:0/4267933979 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4b80051c0 0x7fe4b800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:50.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.807+0000 7fe4d4c1d700 1 -- 172.21.15.8:0/4267933979 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d00ce900 con 0x7fe4b8004810 2023-10-06T04:36:50.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.807+0000 7fe4d4c1d700 1 -- 172.21.15.8:0/4267933979 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b800c160 con 0x7fe4b80051c0 2023-10-06T04:36:50.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.807+0000 7fe4d4c1d700 1 -- 172.21.15.8:0/4267933979 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b800c320 con 0x7fe4b8003a60 2023-10-06T04:36:50.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.807+0000 7fe4d5c1f700 1 --2- 172.21.15.8:0/4267933979 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4b8003a60 0x7fe4b8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:50.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.807+0000 7fe4d541e700 1 --2- 172.21.15.8:0/4267933979 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4b8004810 0x7fe4b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:50.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.807+0000 7fe4d6420700 1 --2- 172.21.15.8:0/4267933979 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4b80051c0 0x7fe4b800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:50.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.808+0000 7fe4d541e700 1 -- 172.21.15.8:0/4267933979 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4b8003a60 msgr2=0x7fe4b8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:50.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.808+0000 7fe4d541e700 1 --2- 172.21.15.8:0/4267933979 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4b8003a60 0x7fe4b8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:50.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.808+0000 7fe4d541e700 1 -- 172.21.15.8:0/4267933979 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4b80051c0 msgr2=0x7fe4b800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:50.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.808+0000 7fe4d541e700 1 --2- 172.21.15.8:0/4267933979 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4b80051c0 0x7fe4b800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:50.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.808+0000 7fe4d6420700 1 -- 172.21.15.8:0/4267933979 reap_dead start 2023-10-06T04:36:50.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.808+0000 7fe4d541e700 1 -- 172.21.15.8:0/4267933979 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b8003570 con 0x7fe4b8004810 2023-10-06T04:36:50.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.808+0000 7fe4d541e700 1 --2- 172.21.15.8:0/4267933979 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4b8004810 0x7fe4b8004c80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4009c00 tx=0x7fe4c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=979862ecccae468d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:50.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.808+0000 7fe4d4c1d700 1 -- 172.21.15.8:0/4267933979 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c400e710 con 0x7fe4b8004810 2023-10-06T04:36:50.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.808+0000 7fe4d4c1d700 1 -- 172.21.15.8:0/4267933979 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c400e870 con 0x7fe4b8004810 2023-10-06T04:36:50.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.808+0000 7fe4d4c1d700 1 -- 172.21.15.8:0/4267933979 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c400ec30 con 0x7fe4b8004810 2023-10-06T04:36:50.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.809+0000 7fe4d7e83700 1 -- 172.21.15.8:0/4267933979 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4b8004810 msgr2=0x7fe4b8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:50.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.809+0000 7fe4d7e83700 1 --2- 172.21.15.8:0/4267933979 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4b8004810 0x7fe4b8004c80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4009c00 tx=0x7fe4c40091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:50.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.809+0000 7fe4d7e83700 1 -- 172.21.15.8:0/4267933979 shutdown_connections 2023-10-06T04:36:50.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.809+0000 7fe4d7e83700 1 --2- 172.21.15.8:0/4267933979 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4b8004810 0x7fe4b8004c80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:50.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.809+0000 7fe4d7e83700 1 -- 172.21.15.8:0/4267933979 >> 172.21.15.8:0/4267933979 conn(0x7fe4d006ed00 msgr2=0x7fe4d006f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:50.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.809+0000 7fe4d7e83700 1 -- 172.21.15.8:0/4267933979 shutdown_connections 2023-10-06T04:36:50.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.809+0000 7fe4d7e83700 1 -- 172.21.15.8:0/4267933979 wait complete. 2023-10-06T04:36:50.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.810+0000 7fe4d7e83700 1 Processor -- start 2023-10-06T04:36:50.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.810+0000 7fe4d7e83700 1 -- start start 2023-10-06T04:36:50.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.810+0000 7fe4d7e83700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4b8004810 0x7fe4d0158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:50.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.811+0000 7fe4d7e83700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4d015c360 0x7fe4d0169eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:50.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.811+0000 7fe4d7e83700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4d015c7d0 0x7fe4d00b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:50.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.811+0000 7fe4d7e83700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d00aa320 con 0x7fe4d015c360 2023-10-06T04:36:50.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.811+0000 7fe4d7e83700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d016a9c0 con 0x7fe4d015c7d0 2023-10-06T04:36:50.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.811+0000 7fe4d7e83700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d016aca0 con 0x7fe4b8004810 2023-10-06T04:36:50.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.811+0000 7fe4d541e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4d015c360 0x7fe4d0169eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:50.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.811+0000 7fe4d541e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4d015c360 0x7fe4d0169eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47952/0 (socket says 172.21.15.8:47952) 2023-10-06T04:36:50.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.811+0000 7fe4d541e700 1 -- 172.21.15.8:0/983222137 learned_addr learned my addr 172.21.15.8:0/983222137 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:50.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.811+0000 7fe4d5c1f700 1 --2- 172.21.15.8:0/983222137 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4b8004810 0x7fe4d0158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:50.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.811+0000 7fe4d6420700 1 --2- 172.21.15.8:0/983222137 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4d015c7d0 0x7fe4d00b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:50.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.811+0000 7fe4d541e700 1 -- 172.21.15.8:0/983222137 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4b8004810 msgr2=0x7fe4d0158220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:50.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.811+0000 7fe4d541e700 1 --2- 172.21.15.8:0/983222137 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4b8004810 0x7fe4d0158220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:50.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.811+0000 7fe4d541e700 1 -- 172.21.15.8:0/983222137 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4d015c7d0 msgr2=0x7fe4d00b4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:50.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.811+0000 7fe4d541e700 1 --2- 172.21.15.8:0/983222137 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4d015c7d0 0x7fe4d00b4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:50.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.811+0000 7fe4d541e700 1 -- 172.21.15.8:0/983222137 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d00a9fb0 con 0x7fe4d015c360 2023-10-06T04:36:50.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.811+0000 7fe4d541e700 1 --2- 172.21.15.8:0/983222137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4d015c360 0x7fe4d0169eb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe4b800c130 tx=0x7fe4c401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:50.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.811+0000 7fe4cdffb700 1 -- 172.21.15.8:0/983222137 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c4022070 con 0x7fe4d015c360 2023-10-06T04:36:50.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.811+0000 7fe4cdffb700 1 -- 172.21.15.8:0/983222137 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c400e9e0 con 0x7fe4d015c360 2023-10-06T04:36:50.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.811+0000 7fe4d7e83700 1 -- 172.21.15.8:0/983222137 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4d00a7480 con 0x7fe4d015c360 2023-10-06T04:36:50.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.811+0000 7fe4cdffb700 1 -- 172.21.15.8:0/983222137 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c400e710 con 0x7fe4d015c360 2023-10-06T04:36:50.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.812+0000 7fe4d7e83700 1 -- 172.21.15.8:0/983222137 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d016a3f0 con 0x7fe4d015c360 2023-10-06T04:36:50.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.812+0000 7fe4d7e83700 1 -- 172.21.15.8:0/983222137 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4d00a9e20 con 0x7fe4d015c360 2023-10-06T04:36:50.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.813+0000 7fe4cdffb700 1 -- 172.21.15.8:0/983222137 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe4c401c660 con 0x7fe4d015c360 2023-10-06T04:36:50.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.813+0000 7fe4cdffb700 1 --2- 172.21.15.8:0/983222137 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe4bc066f30 0x7fe4bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:50.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.813+0000 7fe4cdffb700 1 -- 172.21.15.8:0/983222137 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe4c4085f50 con 0x7fe4d015c360 2023-10-06T04:36:50.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.813+0000 7fe4d5c1f700 1 --2- 172.21.15.8:0/983222137 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe4bc066f30 0x7fe4bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:50.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.814+0000 7fe4d5c1f700 1 --2- 172.21.15.8:0/983222137 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe4bc066f30 0x7fe4bc0693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8000e50 tx=0x7fe4d0143560 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:50.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:50.818+0000 7fe4cdffb700 1 -- 172.21.15.8:0/983222137 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe4c4052e20 con 0x7fe4d015c360 2023-10-06T04:36:51.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.011+0000 7fe4d7e83700 1 -- 172.21.15.8:0/983222137 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe4d00aa140 con 0x7fe4d015c360 2023-10-06T04:36:51.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.011+0000 7fe4cdffb700 1 -- 172.21.15.8:0/983222137 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe4c402b0a0 con 0x7fe4d015c360 2023-10-06T04:36:51.014 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 8 2023-10-06T04:36:51.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.013+0000 7fe4d7e83700 1 -- 172.21.15.8:0/983222137 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe4bc066f30 msgr2=0x7fe4bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:51.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.013+0000 7fe4d7e83700 1 --2- 172.21.15.8:0/983222137 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe4bc066f30 0x7fe4bc0693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8000e50 tx=0x7fe4d0143560 comp rx=0 tx=0).stop 2023-10-06T04:36:51.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.013+0000 7fe4d7e83700 1 -- 172.21.15.8:0/983222137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4d015c360 msgr2=0x7fe4d0169eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:51.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.013+0000 7fe4d7e83700 1 --2- 172.21.15.8:0/983222137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4d015c360 0x7fe4d0169eb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe4b800c130 tx=0x7fe4c401a000 comp rx=0 tx=0).stop 2023-10-06T04:36:51.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.013+0000 7fe4d7e83700 1 -- 172.21.15.8:0/983222137 shutdown_connections 2023-10-06T04:36:51.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.013+0000 7fe4d7e83700 1 --2- 172.21.15.8:0/983222137 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe4bc066f30 0x7fe4bc0693e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:51.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.013+0000 7fe4d7e83700 1 --2- 172.21.15.8:0/983222137 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4d015c7d0 0x7fe4d00b4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:51.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.013+0000 7fe4d7e83700 1 --2- 172.21.15.8:0/983222137 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4b8004810 0x7fe4d0158220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:51.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.013+0000 7fe4d7e83700 1 --2- 172.21.15.8:0/983222137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4d015c360 0x7fe4d0169eb0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:51.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.013+0000 7fe4d7e83700 1 -- 172.21.15.8:0/983222137 >> 172.21.15.8:0/983222137 conn(0x7fe4d006ed00 msgr2=0x7fe4d0158bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:51.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.013+0000 7fe4d7e83700 1 -- 172.21.15.8:0/983222137 shutdown_connections 2023-10-06T04:36:51.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.013+0000 7fe4d7e83700 1 -- 172.21.15.8:0/983222137 wait complete. 2023-10-06T04:36:51.028 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:36:51.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.148+0000 7f73a1509700 1 Processor -- start 2023-10-06T04:36:51.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.148+0000 7f73a1509700 1 -- start start 2023-10-06T04:36:51.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.149+0000 7f73a1509700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f739c069940 0x7f739c0cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:51.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.149+0000 7f73a1509700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f739c069d10 0x7f739c15dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:51.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.149+0000 7f73a1509700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f739c0caaa0 con 0x7f739c0ce8e0 2023-10-06T04:36:51.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.149+0000 7f73a1509700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f739c0cb960 con 0x7f739c069d10 2023-10-06T04:36:51.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.149+0000 7f73a1509700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f739c0ce3e0 con 0x7f739c069940 2023-10-06T04:36:51.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.149+0000 7f739a7fc700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f739c069d10 0x7f739c15dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:51.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.149+0000 7f739b7fe700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f739c0ce8e0 0x7f739c0afdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:59836/0 (socket says 172.21.15.8:59836) 2023-10-06T04:36:51.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.149+0000 7f739b7fe700 1 -- 172.21.15.8:0/1773107900 learned_addr learned my addr 172.21.15.8:0/1773107900 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:51.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.149+0000 7f739affd700 1 --2- 172.21.15.8:0/1773107900 >> v2:172.21.15.184:3300/0 conn(0x7f739c069940 0x7f739c0cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:51.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.150+0000 7f739a7fc700 1 -- 172.21.15.8:0/1773107900 >> v2:172.21.15.184:3300/0 conn(0x7f739c069940 msgr2=0x7f739c0cb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:51.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.150+0000 7f7399ffb700 1 -- 172.21.15.8:0/1773107900 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2211314487 0 0) 0x7f739c0caaa0 con 0x7f739c0ce8e0 2023-10-06T04:36:51.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.150+0000 7f739a7fc700 1 --2- 172.21.15.8:0/1773107900 >> v2:172.21.15.184:3300/0 conn(0x7f739c069940 0x7f739c0cb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:51.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.150+0000 7f739a7fc700 1 -- 172.21.15.8:0/1773107900 >> v1:172.21.15.8:6789/0 conn(0x7f739c0ce8e0 legacy=0x7f739c0afdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:51.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.150+0000 7f739a7fc700 1 -- 172.21.15.8:0/1773107900 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f739c0cad40 con 0x7f739c069d10 2023-10-06T04:36:51.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.150+0000 7f739affd700 1 --2- 172.21.15.8:0/1773107900 >> v2:172.21.15.184:3300/0 conn(0x7f739c069940 0x7f739c0cb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:51.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.150+0000 7f739a7fc700 1 --2- 172.21.15.8:0/1773107900 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f739c069d10 0x7f739c15dbd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f739c089560 tx=0x7f73840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c99dc0d08147cd11 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:51.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.150+0000 7f7399ffb700 1 -- 172.21.15.8:0/1773107900 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738400b6b0 con 0x7f739c069d10 2023-10-06T04:36:51.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.150+0000 7f7399ffb700 1 -- 172.21.15.8:0/1773107900 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738400b810 con 0x7f739c069d10 2023-10-06T04:36:51.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.150+0000 7f7399ffb700 1 -- 172.21.15.8:0/1773107900 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738400bbb0 con 0x7f739c069d10 2023-10-06T04:36:51.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.150+0000 7f73a1509700 1 -- 172.21.15.8:0/1773107900 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f739c069d10 msgr2=0x7f739c15dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:51.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.150+0000 7f73a1509700 1 --2- 172.21.15.8:0/1773107900 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f739c069d10 0x7f739c15dbd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f739c089560 tx=0x7f73840091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:51.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.150+0000 7f73a1509700 1 -- 172.21.15.8:0/1773107900 shutdown_connections 2023-10-06T04:36:51.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.150+0000 7f73a1509700 1 --2- 172.21.15.8:0/1773107900 >> v2:172.21.15.184:3300/0 conn(0x7f739c069940 0x7f739c0cb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:51.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.150+0000 7f73a1509700 1 --2- 172.21.15.8:0/1773107900 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f739c069d10 0x7f739c15dbd0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:51.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.150+0000 7f73a1509700 1 -- 172.21.15.8:0/1773107900 >> 172.21.15.8:0/1773107900 conn(0x7f739c0d02c0 msgr2=0x7f739c0d06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:51.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.150+0000 7f73a1509700 1 -- 172.21.15.8:0/1773107900 shutdown_connections 2023-10-06T04:36:51.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.150+0000 7f73a1509700 1 -- 172.21.15.8:0/1773107900 wait complete. 2023-10-06T04:36:51.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.152+0000 7f73a1509700 1 Processor -- start 2023-10-06T04:36:51.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.152+0000 7f73a1509700 1 -- start start 2023-10-06T04:36:51.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.152+0000 7f73a1509700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f739c069940 0x7f739c0c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:51.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.152+0000 7f73a1509700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f739c069d10 0x7f739c153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:51.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.152+0000 7f73a1509700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f739c0ce8e0 0x7f739c0b4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:51.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.152+0000 7f73a1509700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739c0b4980 con 0x7f739c0ce8e0 2023-10-06T04:36:51.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.152+0000 7f73a1509700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739c0c9a80 con 0x7f739c069d10 2023-10-06T04:36:51.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.152+0000 7f73a1509700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f739c0c8e70 con 0x7f739c069940 2023-10-06T04:36:51.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.153+0000 7f739b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f739c0ce8e0 0x7f739c0b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:51.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.153+0000 7f739b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f739c0ce8e0 0x7f739c0b4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47964/0 (socket says 172.21.15.8:47964) 2023-10-06T04:36:51.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.153+0000 7f739b7fe700 1 -- 172.21.15.8:0/412160714 learned_addr learned my addr 172.21.15.8:0/412160714 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:51.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.153+0000 7f739a7fc700 1 --2- 172.21.15.8:0/412160714 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f739c069d10 0x7f739c153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:51.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.153+0000 7f739affd700 1 --2- 172.21.15.8:0/412160714 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f739c069940 0x7f739c0c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:51.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.153+0000 7f739b7fe700 1 -- 172.21.15.8:0/412160714 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f739c069940 msgr2=0x7f739c0c8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:51.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.153+0000 7f739b7fe700 1 --2- 172.21.15.8:0/412160714 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f739c069940 0x7f739c0c8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:51.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.153+0000 7f739b7fe700 1 -- 172.21.15.8:0/412160714 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f739c069d10 msgr2=0x7f739c153250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:51.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.153+0000 7f739b7fe700 1 --2- 172.21.15.8:0/412160714 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f739c069d10 0x7f739c153250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:51.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.153+0000 7f739b7fe700 1 -- 172.21.15.8:0/412160714 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7384009420 con 0x7f739c0ce8e0 2023-10-06T04:36:51.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.153+0000 7f739b7fe700 1 --2- 172.21.15.8:0/412160714 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f739c0ce8e0 0x7f739c0b4440 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f738c00cbf0 tx=0x7f738c0019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:51.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.153+0000 7f7392ffd700 1 -- 172.21.15.8:0/412160714 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c00a8b0 con 0x7f739c0ce8e0 2023-10-06T04:36:51.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.153+0000 7f7392ffd700 1 -- 172.21.15.8:0/412160714 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738c00aa10 con 0x7f739c0ce8e0 2023-10-06T04:36:51.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.153+0000 7f7392ffd700 1 -- 172.21.15.8:0/412160714 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c00add0 con 0x7f739c0ce8e0 2023-10-06T04:36:51.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.153+0000 7f73a1509700 1 -- 172.21.15.8:0/412160714 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f739c0c9150 con 0x7f739c0ce8e0 2023-10-06T04:36:51.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.153+0000 7f73a1509700 1 -- 172.21.15.8:0/412160714 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f739c0c9710 con 0x7f739c0ce8e0 2023-10-06T04:36:51.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.154+0000 7f73a1509700 1 -- 172.21.15.8:0/412160714 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f739c0c9c10 con 0x7f739c0ce8e0 2023-10-06T04:36:51.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.155+0000 7f7392ffd700 1 -- 172.21.15.8:0/412160714 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f738c007300 con 0x7f739c0ce8e0 2023-10-06T04:36:51.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.155+0000 7f7392ffd700 1 --2- 172.21.15.8:0/412160714 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f737c066f30 0x7f737c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:51.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.155+0000 7f7392ffd700 1 -- 172.21.15.8:0/412160714 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f738c084bf0 con 0x7f739c0ce8e0 2023-10-06T04:36:51.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.155+0000 7f739affd700 1 --2- 172.21.15.8:0/412160714 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f737c066f30 0x7f737c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:51.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.156+0000 7f739affd700 1 --2- 172.21.15.8:0/412160714 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f737c066f30 0x7f737c0693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7394006f00 tx=0x7f7394008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:51.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.159+0000 7f7392ffd700 1 -- 172.21.15.8:0/412160714 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f738c051a90 con 0x7f739c0ce8e0 2023-10-06T04:36:51.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.353+0000 7f73a1509700 1 -- 172.21.15.8:0/412160714 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f739c04c380 con 0x7f739c0ce8e0 2023-10-06T04:36:51.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.354+0000 7f7392ffd700 1 -- 172.21.15.8:0/412160714 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f738c0550b0 con 0x7f739c0ce8e0 2023-10-06T04:36:51.356 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-06T04:36:51.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.356+0000 7f73a1509700 1 -- 172.21.15.8:0/412160714 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f737c066f30 msgr2=0x7f737c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:51.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.356+0000 7f73a1509700 1 --2- 172.21.15.8:0/412160714 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f737c066f30 0x7f737c0693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7394006f00 tx=0x7f7394008040 comp rx=0 tx=0).stop 2023-10-06T04:36:51.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.356+0000 7f73a1509700 1 -- 172.21.15.8:0/412160714 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f739c0ce8e0 msgr2=0x7f739c0b4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:51.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.356+0000 7f73a1509700 1 --2- 172.21.15.8:0/412160714 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f739c0ce8e0 0x7f739c0b4440 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f738c00cbf0 tx=0x7f738c0019b0 comp rx=0 tx=0).stop 2023-10-06T04:36:51.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.356+0000 7f73a1509700 1 -- 172.21.15.8:0/412160714 shutdown_connections 2023-10-06T04:36:51.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.356+0000 7f73a1509700 1 --2- 172.21.15.8:0/412160714 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f737c066f30 0x7f737c0693e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:51.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.356+0000 7f73a1509700 1 --2- 172.21.15.8:0/412160714 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f739c0ce8e0 0x7f739c0b4440 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:51.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.356+0000 7f73a1509700 1 --2- 172.21.15.8:0/412160714 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f739c069940 0x7f739c0c8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:51.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.356+0000 7f73a1509700 1 --2- 172.21.15.8:0/412160714 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f739c069d10 0x7f739c153250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:51.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.356+0000 7f73a1509700 1 -- 172.21.15.8:0/412160714 >> 172.21.15.8:0/412160714 conn(0x7f739c0d02c0 msgr2=0x7f739c0afdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:51.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.356+0000 7f73a1509700 1 -- 172.21.15.8:0/412160714 shutdown_connections 2023-10-06T04:36:51.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.356+0000 7f73a1509700 1 -- 172.21.15.8:0/412160714 wait complete. 2023-10-06T04:36:51.370 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:36:51.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.490+0000 7f6d5ea10700 1 Processor -- start 2023-10-06T04:36:51.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.490+0000 7f6d5ea10700 1 -- start start 2023-10-06T04:36:51.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.491+0000 7f6d5ea10700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6d58142cf0 0x7f6d580b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:51.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.491+0000 7f6d5ea10700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d580cf510 con 0x7f6d581430c0 2023-10-06T04:36:51.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.491+0000 7f6d5ea10700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d580ce6a0 con 0x7f6d580b3790 2023-10-06T04:36:51.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.491+0000 7f6d5ea10700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d580ce900 con 0x7f6d58142cf0 2023-10-06T04:36:51.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.491+0000 7f6d577fe700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f6d581430c0 0x7f6d580cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:59844/0 (socket says 172.21.15.8:59844) 2023-10-06T04:36:51.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.491+0000 7f6d577fe700 1 -- 172.21.15.8:0/1473990538 learned_addr learned my addr 172.21.15.8:0/1473990538 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:51.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.491+0000 7f6d57fff700 1 --2- 172.21.15.8:0/1473990538 >> v2:172.21.15.184:3300/0 conn(0x7f6d58142cf0 0x7f6d580b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:51.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.491+0000 7f6d56ffd700 1 -- 172.21.15.8:0/1473990538 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3045278792 0 0) 0x7f6d580cf510 con 0x7f6d581430c0 2023-10-06T04:36:51.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.491+0000 7f6d56ffd700 1 -- 172.21.15.8:0/1473990538 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d40003570 con 0x7f6d581430c0 2023-10-06T04:36:51.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.491+0000 7f6d57fff700 1 -- 172.21.15.8:0/1473990538 >> v1:172.21.15.184:6789/0 conn(0x7f6d580b3790 legacy=0x7f6d580d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:51.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.491+0000 7f6d56ffd700 1 -- 172.21.15.8:0/1473990538 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1377619412 0 0) 0x7f6d40003570 con 0x7f6d581430c0 2023-10-06T04:36:51.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.491+0000 7f6d57fff700 1 -- 172.21.15.8:0/1473990538 >> v1:172.21.15.8:6789/0 conn(0x7f6d581430c0 legacy=0x7f6d580cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:51.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.491+0000 7f6d57fff700 1 -- 172.21.15.8:0/1473990538 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d580cebe0 con 0x7f6d58142cf0 2023-10-06T04:36:51.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.492+0000 7f6d57fff700 1 --2- 172.21.15.8:0/1473990538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d58142cf0 0x7f6d580b5cd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6d480098e0 tx=0x7f6d480091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ecd051510de3c6f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:51.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.492+0000 7f6d56ffd700 1 -- 172.21.15.8:0/1473990538 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c001470 con 0x7f6d58142cf0 2023-10-06T04:36:51.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.492+0000 7f6d56ffd700 1 -- 172.21.15.8:0/1473990538 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d48011420 con 0x7f6d58142cf0 2023-10-06T04:36:51.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.492+0000 7f6d56ffd700 1 -- 172.21.15.8:0/1473990538 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d480117c0 con 0x7f6d58142cf0 2023-10-06T04:36:51.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.492+0000 7f6d5ea10700 1 -- 172.21.15.8:0/1473990538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d58142cf0 msgr2=0x7f6d580b5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:51.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.492+0000 7f6d5ea10700 1 --2- 172.21.15.8:0/1473990538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d58142cf0 0x7f6d580b5cd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6d480098e0 tx=0x7f6d480091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:51.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.492+0000 7f6d5ea10700 1 -- 172.21.15.8:0/1473990538 shutdown_connections 2023-10-06T04:36:51.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.492+0000 7f6d5ea10700 1 --2- 172.21.15.8:0/1473990538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d58142cf0 0x7f6d580b5cd0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:51.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.492+0000 7f6d5ea10700 1 -- 172.21.15.8:0/1473990538 >> 172.21.15.8:0/1473990538 conn(0x7f6d5806ed00 msgr2=0x7f6d5806f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:51.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.492+0000 7f6d5ea10700 1 -- 172.21.15.8:0/1473990538 shutdown_connections 2023-10-06T04:36:51.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.492+0000 7f6d5ea10700 1 -- 172.21.15.8:0/1473990538 wait complete. 2023-10-06T04:36:51.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.493+0000 7f6d5ea10700 1 Processor -- start 2023-10-06T04:36:51.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.494+0000 7f6d5ea10700 1 -- start start 2023-10-06T04:36:51.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.494+0000 7f6d5ea10700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d580b3790 0x7f6d5815d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:51.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.494+0000 7f6d5ea10700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d58142cf0 0x7f6d580a81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:51.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.494+0000 7f6d5ea10700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d581430c0 0x7f6d580d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:51.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.494+0000 7f6d5ea10700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5815dac0 con 0x7f6d581430c0 2023-10-06T04:36:51.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.494+0000 7f6d5ea10700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5815dda0 con 0x7f6d580b3790 2023-10-06T04:36:51.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.494+0000 7f6d5ea10700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5815e080 con 0x7f6d58142cf0 2023-10-06T04:36:51.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.494+0000 7f6d5cfad700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d581430c0 0x7f6d580d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:51.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.494+0000 7f6d5cfad700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d581430c0 0x7f6d580d0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47976/0 (socket says 172.21.15.8:47976) 2023-10-06T04:36:51.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.494+0000 7f6d5cfad700 1 -- 172.21.15.8:0/1716796914 learned_addr learned my addr 172.21.15.8:0/1716796914 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:51.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.495+0000 7f6d577fe700 1 --2- 172.21.15.8:0/1716796914 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d58142cf0 0x7f6d580a81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:51.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.495+0000 7f6d57fff700 1 --2- 172.21.15.8:0/1716796914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d580b3790 0x7f6d5815d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:51.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.495+0000 7f6d5cfad700 1 -- 172.21.15.8:0/1716796914 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d58142cf0 msgr2=0x7f6d580a81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:51.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.495+0000 7f6d5cfad700 1 --2- 172.21.15.8:0/1716796914 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d58142cf0 0x7f6d580a81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:51.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.495+0000 7f6d5cfad700 1 -- 172.21.15.8:0/1716796914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d580b3790 msgr2=0x7f6d5815d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:51.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.495+0000 7f6d5cfad700 1 --2- 172.21.15.8:0/1716796914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d580b3790 0x7f6d5815d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:51.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.495+0000 7f6d5cfad700 1 -- 172.21.15.8:0/1716796914 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d48009420 con 0x7f6d581430c0 2023-10-06T04:36:51.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.495+0000 7f6d5cfad700 1 --2- 172.21.15.8:0/1716796914 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d581430c0 0x7f6d580d0a50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6d5000c8e0 tx=0x7f6d50001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:51.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.495+0000 7f6d3ffff700 1 -- 172.21.15.8:0/1716796914 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d50012630 con 0x7f6d581430c0 2023-10-06T04:36:51.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.495+0000 7f6d3ffff700 1 -- 172.21.15.8:0/1716796914 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d50012790 con 0x7f6d581430c0 2023-10-06T04:36:51.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.495+0000 7f6d5ea10700 1 -- 172.21.15.8:0/1716796914 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d58140f60 con 0x7f6d581430c0 2023-10-06T04:36:51.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.495+0000 7f6d3ffff700 1 -- 172.21.15.8:0/1716796914 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d50012b50 con 0x7f6d581430c0 2023-10-06T04:36:51.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.495+0000 7f6d5ea10700 1 -- 172.21.15.8:0/1716796914 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d5815d690 con 0x7f6d581430c0 2023-10-06T04:36:51.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.496+0000 7f6d5ea10700 1 -- 172.21.15.8:0/1716796914 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d58141480 con 0x7f6d581430c0 2023-10-06T04:36:51.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.497+0000 7f6d3ffff700 1 -- 172.21.15.8:0/1716796914 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6d5001a3a0 con 0x7f6d581430c0 2023-10-06T04:36:51.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.497+0000 7f6d3ffff700 1 --2- 172.21.15.8:0/1716796914 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6d44066f30 0x7f6d440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:51.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.497+0000 7f6d3ffff700 1 -- 172.21.15.8:0/1716796914 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6d50084bb0 con 0x7f6d581430c0 2023-10-06T04:36:51.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.497+0000 7f6d57fff700 1 --2- 172.21.15.8:0/1716796914 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6d44066f30 0x7f6d440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:51.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.498+0000 7f6d57fff700 1 --2- 172.21.15.8:0/1716796914 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6d44066f30 0x7f6d440693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6d480091e0 tx=0x7f6d48016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:51.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.501+0000 7f6d3ffff700 1 -- 172.21.15.8:0/1716796914 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d58141480 con 0x7f6d581430c0 2023-10-06T04:36:51.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.693+0000 7f6d5ea10700 1 -- 172.21.15.8:0/1716796914 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6d58141480 con 0x7f6d581430c0 2023-10-06T04:36:51.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.694+0000 7f6d3ffff700 1 -- 172.21.15.8:0/1716796914 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6d58141480 con 0x7f6d581430c0 2023-10-06T04:36:51.696 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-06T04:36:51.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.696+0000 7f6d5ea10700 1 -- 172.21.15.8:0/1716796914 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6d44066f30 msgr2=0x7f6d440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:51.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.696+0000 7f6d5ea10700 1 --2- 172.21.15.8:0/1716796914 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6d44066f30 0x7f6d440693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6d480091e0 tx=0x7f6d48016000 comp rx=0 tx=0).stop 2023-10-06T04:36:51.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.696+0000 7f6d5ea10700 1 -- 172.21.15.8:0/1716796914 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d581430c0 msgr2=0x7f6d580d0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:51.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.696+0000 7f6d5ea10700 1 --2- 172.21.15.8:0/1716796914 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d581430c0 0x7f6d580d0a50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6d5000c8e0 tx=0x7f6d50001710 comp rx=0 tx=0).stop 2023-10-06T04:36:51.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.696+0000 7f6d5ea10700 1 -- 172.21.15.8:0/1716796914 shutdown_connections 2023-10-06T04:36:51.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.696+0000 7f6d5ea10700 1 --2- 172.21.15.8:0/1716796914 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6d44066f30 0x7f6d440693e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:51.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.696+0000 7f6d5ea10700 1 --2- 172.21.15.8:0/1716796914 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d581430c0 0x7f6d580d0a50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:51.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.696+0000 7f6d5ea10700 1 --2- 172.21.15.8:0/1716796914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d580b3790 0x7f6d5815d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:51.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.696+0000 7f6d5ea10700 1 --2- 172.21.15.8:0/1716796914 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d58142cf0 0x7f6d580a81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:51.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.696+0000 7f6d5ea10700 1 -- 172.21.15.8:0/1716796914 >> 172.21.15.8:0/1716796914 conn(0x7f6d5806ed00 msgr2=0x7f6d580b0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:51.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.696+0000 7f6d5ea10700 1 -- 172.21.15.8:0/1716796914 shutdown_connections 2023-10-06T04:36:51.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.696+0000 7f6d5ea10700 1 -- 172.21.15.8:0/1716796914 wait complete. 2023-10-06T04:36:51.710 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:36:51.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.829+0000 7f085812b700 1 Processor -- start 2023-10-06T04:36:51.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.829+0000 7f085812b700 1 -- start start 2023-10-06T04:36:51.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.830+0000 7f085812b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f08500c6a50 0x7f085015e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:51.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.830+0000 7f085812b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f08500b00c0 0x7f08501592a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:51.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.830+0000 7f085812b700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08500c3ec0 con 0x7f08500ccea0 2023-10-06T04:36:51.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.830+0000 7f085812b700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08500cb080 con 0x7f08500b00c0 2023-10-06T04:36:51.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.830+0000 7f085812b700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f085015e680 con 0x7f08500c6a50 2023-10-06T04:36:51.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.830+0000 7f08566c8700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f08500b00c0 0x7f08501592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:51.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.830+0000 7f08566c8700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f08500b00c0 0x7f08501592a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47988/0 (socket says 172.21.15.8:47988) 2023-10-06T04:36:51.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.830+0000 7f08566c8700 1 -- 172.21.15.8:0/2949286583 learned_addr learned my addr 172.21.15.8:0/2949286583 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:51.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.831+0000 7f08556c6700 1 --2- 172.21.15.8:0/2949286583 >> v2:172.21.15.184:3300/0 conn(0x7f08500c6a50 0x7f085015e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:51.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.831+0000 7f08566c8700 1 -- 172.21.15.8:0/2949286583 >> v2:172.21.15.184:3300/0 conn(0x7f08500c6a50 msgr2=0x7f085015e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:51.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.831+0000 7f08566c8700 1 --2- 172.21.15.8:0/2949286583 >> v2:172.21.15.184:3300/0 conn(0x7f08500c6a50 0x7f085015e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:51.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.831+0000 7f08566c8700 1 -- 172.21.15.8:0/2949286583 >> v1:172.21.15.184:6789/0 conn(0x7f08500ccea0 legacy=0x7f08500c6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:51.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.831+0000 7f08566c8700 1 -- 172.21.15.8:0/2949286583 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08500b0660 con 0x7f08500b00c0 2023-10-06T04:36:51.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.831+0000 7f08566c8700 1 --2- 172.21.15.8:0/2949286583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08500b00c0 0x7f08501592a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f08500896e0 tx=0x7f0840009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f5d959334987b6f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:51.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.831+0000 7f0854ec5700 1 -- 172.21.15.8:0/2949286583 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084000e070 con 0x7f08500b00c0 2023-10-06T04:36:51.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.831+0000 7f0854ec5700 1 -- 172.21.15.8:0/2949286583 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084000ba10 con 0x7f08500b00c0 2023-10-06T04:36:51.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.831+0000 7f0854ec5700 1 -- 172.21.15.8:0/2949286583 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08400092e0 con 0x7f08500b00c0 2023-10-06T04:36:51.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.832+0000 7f085812b700 1 -- 172.21.15.8:0/2949286583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08500b00c0 msgr2=0x7f08501592a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:51.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.832+0000 7f085812b700 1 --2- 172.21.15.8:0/2949286583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08500b00c0 0x7f08501592a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f08500896e0 tx=0x7f0840009840 comp rx=0 tx=0).stop 2023-10-06T04:36:51.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.832+0000 7f085812b700 1 -- 172.21.15.8:0/2949286583 shutdown_connections 2023-10-06T04:36:51.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.832+0000 7f085812b700 1 --2- 172.21.15.8:0/2949286583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08500b00c0 0x7f08501592a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:51.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.832+0000 7f085812b700 1 --2- 172.21.15.8:0/2949286583 >> v2:172.21.15.184:3300/0 conn(0x7f08500c6a50 0x7f085015e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:51.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.832+0000 7f085812b700 1 -- 172.21.15.8:0/2949286583 >> 172.21.15.8:0/2949286583 conn(0x7f085006f780 msgr2=0x7f08500698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:51.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.832+0000 7f085812b700 1 -- 172.21.15.8:0/2949286583 shutdown_connections 2023-10-06T04:36:51.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.832+0000 7f085812b700 1 -- 172.21.15.8:0/2949286583 wait complete. 2023-10-06T04:36:51.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.833+0000 7f085812b700 1 Processor -- start 2023-10-06T04:36:51.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.833+0000 7f085812b700 1 -- start start 2023-10-06T04:36:51.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.833+0000 7f085812b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08500b00c0 0x7f085015aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:51.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.834+0000 7f085812b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08500c6a50 0x7f08500af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:51.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.834+0000 7f085812b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08500ccea0 0x7f08500b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:51.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.834+0000 7f085812b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085015b400 con 0x7f08500c6a50 2023-10-06T04:36:51.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.834+0000 7f085812b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08500b41c0 con 0x7f08500b00c0 2023-10-06T04:36:51.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.834+0000 7f085812b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08500b44a0 con 0x7f08500ccea0 2023-10-06T04:36:51.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.834+0000 7f08556c6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08500c6a50 0x7f08500af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:51.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.834+0000 7f08556c6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08500c6a50 0x7f08500af0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47992/0 (socket says 172.21.15.8:47992) 2023-10-06T04:36:51.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.834+0000 7f08556c6700 1 -- 172.21.15.8:0/3277892498 learned_addr learned my addr 172.21.15.8:0/3277892498 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:51.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.834+0000 7f08566c8700 1 --2- 172.21.15.8:0/3277892498 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08500ccea0 0x7f08500b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:51.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.834+0000 7f0855ec7700 1 --2- 172.21.15.8:0/3277892498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08500b00c0 0x7f085015aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:51.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.834+0000 7f08556c6700 1 -- 172.21.15.8:0/3277892498 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08500ccea0 msgr2=0x7f08500b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:51.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.834+0000 7f08556c6700 1 --2- 172.21.15.8:0/3277892498 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08500ccea0 0x7f08500b52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:51.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.834+0000 7f08556c6700 1 -- 172.21.15.8:0/3277892498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08500b00c0 msgr2=0x7f085015aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:51.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.834+0000 7f08556c6700 1 --2- 172.21.15.8:0/3277892498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08500b00c0 0x7f085015aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:51.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.834+0000 7f08556c6700 1 -- 172.21.15.8:0/3277892498 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0840009ae0 con 0x7f08500c6a50 2023-10-06T04:36:51.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.834+0000 7f08566c8700 1 --2- 172.21.15.8:0/3277892498 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08500ccea0 0x7f08500b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:36:51.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.834+0000 7f0855ec7700 1 --2- 172.21.15.8:0/3277892498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08500b00c0 0x7f085015aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:36:51.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.834+0000 7f08556c6700 1 --2- 172.21.15.8:0/3277892498 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08500c6a50 0x7f08500af0c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f084400d7e0 tx=0x7f0844008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:51.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.834+0000 7f084dffb700 1 -- 172.21.15.8:0/3277892498 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08440125f0 con 0x7f08500c6a50 2023-10-06T04:36:51.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.834+0000 7f084dffb700 1 -- 172.21.15.8:0/3277892498 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0844012750 con 0x7f08500c6a50 2023-10-06T04:36:51.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.834+0000 7f084dffb700 1 -- 172.21.15.8:0/3277892498 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0844012b10 con 0x7f08500c6a50 2023-10-06T04:36:51.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.834+0000 7f085812b700 1 -- 172.21.15.8:0/3277892498 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08500b4780 con 0x7f08500c6a50 2023-10-06T04:36:51.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.835+0000 7f085812b700 1 -- 172.21.15.8:0/3277892498 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08500af600 con 0x7f08500c6a50 2023-10-06T04:36:51.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.835+0000 7f085812b700 1 -- 172.21.15.8:0/3277892498 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08500c74e0 con 0x7f08500c6a50 2023-10-06T04:36:51.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.836+0000 7f084dffb700 1 -- 172.21.15.8:0/3277892498 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f084401e460 con 0x7f08500c6a50 2023-10-06T04:36:51.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.836+0000 7f084dffb700 1 --2- 172.21.15.8:0/3277892498 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f083c066f30 0x7f083c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:51.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.836+0000 7f084dffb700 1 -- 172.21.15.8:0/3277892498 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0844085080 con 0x7f08500c6a50 2023-10-06T04:36:51.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.836+0000 7f0855ec7700 1 --2- 172.21.15.8:0/3277892498 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f083c066f30 0x7f083c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:51.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.837+0000 7f0855ec7700 1 --2- 172.21.15.8:0/3277892498 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f083c066f30 0x7f083c0693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f08500c5c60 tx=0x7f0848009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:51.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:51.840+0000 7f084dffb700 1 -- 172.21.15.8:0/3277892498 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f08500c74e0 con 0x7f08500c6a50 2023-10-06T04:36:52.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.033+0000 7f085812b700 1 -- 172.21.15.8:0/3277892498 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f08500c74e0 con 0x7f08500c6a50 2023-10-06T04:36:52.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.033+0000 7f084dffb700 1 -- 172.21.15.8:0/3277892498 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f08500c74e0 con 0x7f08500c6a50 2023-10-06T04:36:52.036 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-06T04:36:52.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.035+0000 7f085812b700 1 -- 172.21.15.8:0/3277892498 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f083c066f30 msgr2=0x7f083c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:52.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.035+0000 7f085812b700 1 --2- 172.21.15.8:0/3277892498 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f083c066f30 0x7f083c0693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f08500c5c60 tx=0x7f0848009040 comp rx=0 tx=0).stop 2023-10-06T04:36:52.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.035+0000 7f085812b700 1 -- 172.21.15.8:0/3277892498 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08500c6a50 msgr2=0x7f08500af0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:52.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.035+0000 7f085812b700 1 --2- 172.21.15.8:0/3277892498 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08500c6a50 0x7f08500af0c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f084400d7e0 tx=0x7f0844008040 comp rx=0 tx=0).stop 2023-10-06T04:36:52.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.035+0000 7f085812b700 1 -- 172.21.15.8:0/3277892498 shutdown_connections 2023-10-06T04:36:52.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.035+0000 7f085812b700 1 --2- 172.21.15.8:0/3277892498 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f083c066f30 0x7f083c0693e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:52.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.035+0000 7f085812b700 1 --2- 172.21.15.8:0/3277892498 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08500ccea0 0x7f08500b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:52.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.035+0000 7f085812b700 1 --2- 172.21.15.8:0/3277892498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08500b00c0 0x7f085015aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:52.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.035+0000 7f085812b700 1 --2- 172.21.15.8:0/3277892498 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08500c6a50 0x7f08500af0c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:52.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.035+0000 7f085812b700 1 -- 172.21.15.8:0/3277892498 >> 172.21.15.8:0/3277892498 conn(0x7f085006f780 msgr2=0x7f08500cbed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:52.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.035+0000 7f085812b700 1 -- 172.21.15.8:0/3277892498 shutdown_connections 2023-10-06T04:36:52.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.035+0000 7f085812b700 1 -- 172.21.15.8:0/3277892498 wait complete. 2023-10-06T04:36:52.049 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T04:36:52.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.169+0000 7f204f8bd700 1 Processor -- start 2023-10-06T04:36:52.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.169+0000 7f204f8bd700 1 -- start start 2023-10-06T04:36:52.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.170+0000 7f204f8bd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f20481430c0 0x7f20480cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:52.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.170+0000 7f204f8bd700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20480cf510 con 0x7f2048142cf0 2023-10-06T04:36:52.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.170+0000 7f204f8bd700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20480ce6a0 con 0x7f20480cfee0 2023-10-06T04:36:52.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.170+0000 7f204f8bd700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20480ce900 con 0x7f20481430c0 2023-10-06T04:36:52.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.170+0000 7f204d659700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f2048142cf0 0x7f20480b5cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:59856/0 (socket says 172.21.15.8:59856) 2023-10-06T04:36:52.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.170+0000 7f204d659700 1 -- 172.21.15.8:0/1761466832 learned_addr learned my addr 172.21.15.8:0/1761466832 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:52.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.170+0000 7f204ce58700 1 --2- 172.21.15.8:0/1761466832 >> v2:172.21.15.184:3300/0 conn(0x7f20481430c0 0x7f20480cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:52.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.170+0000 7f2047fff700 1 -- 172.21.15.8:0/1761466832 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 348517667 0 0) 0x7f20480cf510 con 0x7f2048142cf0 2023-10-06T04:36:52.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.170+0000 7f2047fff700 1 -- 172.21.15.8:0/1761466832 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2030003570 con 0x7f2048142cf0 2023-10-06T04:36:52.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.170+0000 7f2047fff700 1 -- 172.21.15.8:0/1761466832 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1944347801 0 0) 0x7f20480ce6a0 con 0x7f20480cfee0 2023-10-06T04:36:52.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.170+0000 7f2047fff700 1 -- 172.21.15.8:0/1761466832 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20480cf510 con 0x7f20480cfee0 2023-10-06T04:36:52.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.170+0000 7f2047fff700 1 -- 172.21.15.8:0/1761466832 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3358779471 0 0) 0x7f2030003570 con 0x7f2048142cf0 2023-10-06T04:36:52.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.170+0000 7f2047fff700 1 -- 172.21.15.8:0/1761466832 >> v2:172.21.15.184:3300/0 conn(0x7f20481430c0 msgr2=0x7f20480cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:52.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.170+0000 7f2047fff700 1 --2- 172.21.15.8:0/1761466832 >> v2:172.21.15.184:3300/0 conn(0x7f20481430c0 0x7f20480cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:52.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.170+0000 7f2047fff700 1 -- 172.21.15.8:0/1761466832 >> v1:172.21.15.184:6789/0 conn(0x7f20480cfee0 legacy=0x7f20480b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:52.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.170+0000 7f2047fff700 1 -- 172.21.15.8:0/1761466832 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20480cebe0 con 0x7f2048142cf0 2023-10-06T04:36:52.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.170+0000 7f2047fff700 1 -- 172.21.15.8:0/1761466832 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7f20400017f0 con 0x7f2048142cf0 2023-10-06T04:36:52.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.170+0000 7f204ce58700 1 --2- 172.21.15.8:0/1761466832 >> v2:172.21.15.184:3300/0 conn(0x7f20481430c0 0x7f20480cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:36:52.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.170+0000 7f2047fff700 1 -- 172.21.15.8:0/1761466832 >> v1:172.21.15.8:6789/0 conn(0x7f2048142cf0 legacy=0x7f20480b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:52.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.170+0000 7f2047fff700 1 --2- 172.21.15.8:0/1761466832 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2030003bf0 0x7f2030003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:52.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.170+0000 7f2047fff700 1 --2- 172.21.15.8:0/1761466832 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2030004810 0x7f2030004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:52.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.170+0000 7f2047fff700 1 --2- 172.21.15.8:0/1761466832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20300051c0 0x7f203000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:52.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.171+0000 7f2047fff700 1 -- 172.21.15.8:0/1761466832 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20480ce900 con 0x7f20300051c0 2023-10-06T04:36:52.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.171+0000 7f2047fff700 1 -- 172.21.15.8:0/1761466832 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203000c160 con 0x7f2030003bf0 2023-10-06T04:36:52.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.171+0000 7f2047fff700 1 -- 172.21.15.8:0/1761466832 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203000c320 con 0x7f2030004810 2023-10-06T04:36:52.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.171+0000 7f204de5a700 1 --2- 172.21.15.8:0/1761466832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20300051c0 0x7f203000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:52.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.171+0000 7f204d659700 1 --2- 172.21.15.8:0/1761466832 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2030003bf0 0x7f2030003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:52.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.171+0000 7f204ce58700 1 --2- 172.21.15.8:0/1761466832 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2030004810 0x7f2030004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:52.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.171+0000 7f204de5a700 1 -- 172.21.15.8:0/1761466832 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2030004810 msgr2=0x7f2030004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:52.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.171+0000 7f204de5a700 1 --2- 172.21.15.8:0/1761466832 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2030004810 0x7f2030004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:52.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.171+0000 7f204de5a700 1 -- 172.21.15.8:0/1761466832 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2030003bf0 msgr2=0x7f2030003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:52.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.171+0000 7f204de5a700 1 --2- 172.21.15.8:0/1761466832 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2030003bf0 0x7f2030003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:52.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.171+0000 7f204de5a700 1 -- 172.21.15.8:0/1761466832 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2030003570 con 0x7f20300051c0 2023-10-06T04:36:52.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.171+0000 7f204de5a700 1 -- 172.21.15.8:0/1761466832 reap_dead start 2023-10-06T04:36:52.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.171+0000 7f204de5a700 1 --2- 172.21.15.8:0/1761466832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20300051c0 0x7f203000ba60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f20380019e0 tx=0x7f2038007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7415dbe53dd9c029 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:52.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.171+0000 7f2047fff700 1 -- 172.21.15.8:0/1761466832 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203800c5d0 con 0x7f20300051c0 2023-10-06T04:36:52.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.171+0000 7f2047fff700 1 -- 172.21.15.8:0/1761466832 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203800c730 con 0x7f20300051c0 2023-10-06T04:36:52.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.171+0000 7f2047fff700 1 -- 172.21.15.8:0/1761466832 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203800cad0 con 0x7f20300051c0 2023-10-06T04:36:52.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.172+0000 7f204f8bd700 1 -- 172.21.15.8:0/1761466832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20300051c0 msgr2=0x7f203000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:52.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.172+0000 7f204f8bd700 1 --2- 172.21.15.8:0/1761466832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20300051c0 0x7f203000ba60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f20380019e0 tx=0x7f2038007d30 comp rx=0 tx=0).stop 2023-10-06T04:36:52.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.172+0000 7f204f8bd700 1 -- 172.21.15.8:0/1761466832 shutdown_connections 2023-10-06T04:36:52.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.172+0000 7f204f8bd700 1 --2- 172.21.15.8:0/1761466832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20300051c0 0x7f203000ba60 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:52.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.172+0000 7f204f8bd700 1 -- 172.21.15.8:0/1761466832 >> 172.21.15.8:0/1761466832 conn(0x7f204806ed00 msgr2=0x7f204806f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:52.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.172+0000 7f204f8bd700 1 -- 172.21.15.8:0/1761466832 shutdown_connections 2023-10-06T04:36:52.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.172+0000 7f204f8bd700 1 -- 172.21.15.8:0/1761466832 wait complete. 2023-10-06T04:36:52.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.173+0000 7f204f8bd700 1 Processor -- start 2023-10-06T04:36:52.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.173+0000 7f204f8bd700 1 -- start start 2023-10-06T04:36:52.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.174+0000 7f204f8bd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20300051c0 0x7f204813e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:52.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.174+0000 7f204f8bd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2048169c70 0x7f20480a87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:52.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.174+0000 7f204f8bd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20480a8d00 0x7f20480a78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:52.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.174+0000 7f204f8bd700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20480aae30 con 0x7f20300051c0 2023-10-06T04:36:52.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.174+0000 7f204f8bd700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20480a9170 con 0x7f2048169c70 2023-10-06T04:36:52.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.174+0000 7f204f8bd700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204813f9e0 con 0x7f20480a8d00 2023-10-06T04:36:52.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.174+0000 7f204d659700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20300051c0 0x7f204813e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:52.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.174+0000 7f204d659700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20300051c0 0x7f204813e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48012/0 (socket says 172.21.15.8:48012) 2023-10-06T04:36:52.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.174+0000 7f204d659700 1 -- 172.21.15.8:0/1279025231 learned_addr learned my addr 172.21.15.8:0/1279025231 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:52.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.174+0000 7f204de5a700 1 --2- 172.21.15.8:0/1279025231 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20480a8d00 0x7f20480a78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:52.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.174+0000 7f204ce58700 1 --2- 172.21.15.8:0/1279025231 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2048169c70 0x7f20480a87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:52.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.174+0000 7f204d659700 1 -- 172.21.15.8:0/1279025231 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20480a8d00 msgr2=0x7f20480a78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:52.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.174+0000 7f204d659700 1 --2- 172.21.15.8:0/1279025231 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20480a8d00 0x7f20480a78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:52.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.174+0000 7f204d659700 1 -- 172.21.15.8:0/1279025231 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2048169c70 msgr2=0x7f20480a87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:52.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.174+0000 7f204d659700 1 --2- 172.21.15.8:0/1279025231 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2048169c70 0x7f20480a87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:52.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.174+0000 7f204d659700 1 -- 172.21.15.8:0/1279025231 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f204813ecf0 con 0x7f20300051c0 2023-10-06T04:36:52.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.174+0000 7f204d659700 1 --2- 172.21.15.8:0/1279025231 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20300051c0 0x7f204813e7b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2040007a90 tx=0x7f2048143560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:52.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.174+0000 7f20457fa700 1 -- 172.21.15.8:0/1279025231 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204000ad00 con 0x7f20300051c0 2023-10-06T04:36:52.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.175+0000 7f20457fa700 1 -- 172.21.15.8:0/1279025231 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20400133f0 con 0x7f20300051c0 2023-10-06T04:36:52.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.175+0000 7f204f8bd700 1 -- 172.21.15.8:0/1279025231 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f204813f0b0 con 0x7f20300051c0 2023-10-06T04:36:52.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.175+0000 7f20457fa700 1 -- 172.21.15.8:0/1279025231 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204000aea0 con 0x7f20300051c0 2023-10-06T04:36:52.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.175+0000 7f204f8bd700 1 -- 172.21.15.8:0/1279025231 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f204813f670 con 0x7f20300051c0 2023-10-06T04:36:52.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.175+0000 7f204f8bd700 1 -- 172.21.15.8:0/1279025231 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2048071550 con 0x7f20300051c0 2023-10-06T04:36:52.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.176+0000 7f20457fa700 1 -- 172.21.15.8:0/1279025231 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f20400139c0 con 0x7f20300051c0 2023-10-06T04:36:52.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.176+0000 7f20457fa700 1 --2- 172.21.15.8:0/1279025231 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2034066f60 0x7f2034069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:52.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.176+0000 7f20457fa700 1 -- 172.21.15.8:0/1279025231 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f20400855f0 con 0x7f20300051c0 2023-10-06T04:36:52.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.177+0000 7f204ce58700 1 --2- 172.21.15.8:0/1279025231 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2034066f60 0x7f2034069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:52.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.177+0000 7f204ce58700 1 --2- 172.21.15.8:0/1279025231 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2034066f60 0x7f2034069410 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f20480b58f0 tx=0x7f203c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:52.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.181+0000 7f20457fa700 1 -- 172.21.15.8:0/1279025231 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2040052370 con 0x7f20300051c0 2023-10-06T04:36:52.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.370+0000 7f204f8bd700 1 -- 172.21.15.8:0/1279025231 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f20480ceec0 con 0x7f20300051c0 2023-10-06T04:36:52.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.371+0000 7f20457fa700 1 -- 172.21.15.8:0/1279025231 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2040055990 con 0x7f20300051c0 2023-10-06T04:36:52.373 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-06T04:36:52.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.373+0000 7f204f8bd700 1 -- 172.21.15.8:0/1279025231 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2034066f60 msgr2=0x7f2034069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:52.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.373+0000 7f204f8bd700 1 --2- 172.21.15.8:0/1279025231 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2034066f60 0x7f2034069410 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f20480b58f0 tx=0x7f203c008040 comp rx=0 tx=0).stop 2023-10-06T04:36:52.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.373+0000 7f204f8bd700 1 -- 172.21.15.8:0/1279025231 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20300051c0 msgr2=0x7f204813e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:52.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.373+0000 7f204f8bd700 1 --2- 172.21.15.8:0/1279025231 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20300051c0 0x7f204813e7b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2040007a90 tx=0x7f2048143560 comp rx=0 tx=0).stop 2023-10-06T04:36:52.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.373+0000 7f204f8bd700 1 -- 172.21.15.8:0/1279025231 shutdown_connections 2023-10-06T04:36:52.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.373+0000 7f204f8bd700 1 --2- 172.21.15.8:0/1279025231 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2034066f60 0x7f2034069410 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:52.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.373+0000 7f204f8bd700 1 --2- 172.21.15.8:0/1279025231 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20480a8d00 0x7f20480a78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:52.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.373+0000 7f204f8bd700 1 --2- 172.21.15.8:0/1279025231 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20300051c0 0x7f204813e7b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:52.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.373+0000 7f204f8bd700 1 --2- 172.21.15.8:0/1279025231 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2048169c70 0x7f20480a87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:52.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.373+0000 7f204f8bd700 1 -- 172.21.15.8:0/1279025231 >> 172.21.15.8:0/1279025231 conn(0x7f204806ed00 msgr2=0x7f2048158af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:52.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.373+0000 7f204f8bd700 1 -- 172.21.15.8:0/1279025231 shutdown_connections 2023-10-06T04:36:52.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.373+0000 7f204f8bd700 1 -- 172.21.15.8:0/1279025231 wait complete. 2023-10-06T04:36:52.388 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:36:52.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.503+0000 7f365aeaf700 1 Processor -- start 2023-10-06T04:36:52.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.503+0000 7f365aeaf700 1 -- start start 2023-10-06T04:36:52.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.504+0000 7f365aeaf700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36540cb360 0x7f36540d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:52.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.504+0000 7f365aeaf700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f36540d08d0 0x7f36540cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:52.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.504+0000 7f365aeaf700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36540cc4c0 con 0x7f36540af680 2023-10-06T04:36:52.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.504+0000 7f365aeaf700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f365415d460 con 0x7f36540d08d0 2023-10-06T04:36:52.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.504+0000 7f365aeaf700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36540d0d50 con 0x7f36540cb360 2023-10-06T04:36:52.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.504+0000 7f365944c700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f36540d08d0 0x7f36540cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:52.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.504+0000 7f365944c700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f36540d08d0 0x7f36540cc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48018/0 (socket says 172.21.15.8:48018) 2023-10-06T04:36:52.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.504+0000 7f3658c4b700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f36540af680 0x7f365415e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:59862/0 (socket says 172.21.15.8:59862) 2023-10-06T04:36:52.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.504+0000 7f365944c700 1 -- 172.21.15.8:0/35115023 learned_addr learned my addr 172.21.15.8:0/35115023 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:52.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.504+0000 7f3653fff700 1 --2- 172.21.15.8:0/35115023 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36540cb360 0x7f36540d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:52.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.505+0000 7f365944c700 1 -- 172.21.15.8:0/35115023 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36540cb360 msgr2=0x7f36540d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:52.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.505+0000 7f365944c700 1 --2- 172.21.15.8:0/35115023 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36540cb360 0x7f36540d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:52.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.505+0000 7f365944c700 1 -- 172.21.15.8:0/35115023 >> v1:172.21.15.8:6789/0 conn(0x7f36540af680 legacy=0x7f365415e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:52.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.505+0000 7f365944c700 1 -- 172.21.15.8:0/35115023 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36540cb8b0 con 0x7f36540d08d0 2023-10-06T04:36:52.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.505+0000 7f36537fe700 1 -- 172.21.15.8:0/35115023 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2056449242 0 0) 0x7f36540cc4c0 con 0x7f36540af680 2023-10-06T04:36:52.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.505+0000 7f365944c700 1 --2- 172.21.15.8:0/35115023 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36540d08d0 0x7f36540cc950 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f363c0099b0 tx=0x7f363c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af185a8c1383645 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:52.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.505+0000 7f36537fe700 1 -- 172.21.15.8:0/35115023 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c009ea0 con 0x7f36540d08d0 2023-10-06T04:36:52.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.505+0000 7f36537fe700 1 -- 172.21.15.8:0/35115023 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363c00b860 con 0x7f36540d08d0 2023-10-06T04:36:52.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.505+0000 7f36537fe700 1 -- 172.21.15.8:0/35115023 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c00bc00 con 0x7f36540d08d0 2023-10-06T04:36:52.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.505+0000 7f365aeaf700 1 -- 172.21.15.8:0/35115023 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36540d08d0 msgr2=0x7f36540cc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:52.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.505+0000 7f365aeaf700 1 --2- 172.21.15.8:0/35115023 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36540d08d0 0x7f36540cc950 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f363c0099b0 tx=0x7f363c009250 comp rx=0 tx=0).stop 2023-10-06T04:36:52.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.505+0000 7f365aeaf700 1 -- 172.21.15.8:0/35115023 shutdown_connections 2023-10-06T04:36:52.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.505+0000 7f365aeaf700 1 --2- 172.21.15.8:0/35115023 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36540d08d0 0x7f36540cc950 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:52.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.505+0000 7f365aeaf700 1 --2- 172.21.15.8:0/35115023 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36540cb360 0x7f36540d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:52.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.506+0000 7f365aeaf700 1 -- 172.21.15.8:0/35115023 >> 172.21.15.8:0/35115023 conn(0x7f36540633d0 msgr2=0x7f36540637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:52.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.506+0000 7f365aeaf700 1 -- 172.21.15.8:0/35115023 shutdown_connections 2023-10-06T04:36:52.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.506+0000 7f365aeaf700 1 -- 172.21.15.8:0/35115023 wait complete. 2023-10-06T04:36:52.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.507+0000 7f365aeaf700 1 Processor -- start 2023-10-06T04:36:52.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.507+0000 7f365aeaf700 1 -- start start 2023-10-06T04:36:52.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.507+0000 7f365aeaf700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36540af680 0x7f36540c9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:52.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.507+0000 7f365aeaf700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36540cb360 0x7f3654158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:52.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.507+0000 7f365aeaf700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36540d08d0 0x7f36540b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:52.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.507+0000 7f365aeaf700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3654169a20 con 0x7f36540d08d0 2023-10-06T04:36:52.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.507+0000 7f365aeaf700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36540c9aa0 con 0x7f36540cb360 2023-10-06T04:36:52.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.507+0000 7f365aeaf700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3654159100 con 0x7f36540af680 2023-10-06T04:36:52.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.508+0000 7f365944c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36540d08d0 0x7f36540b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:52.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.508+0000 7f365944c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36540d08d0 0x7f36540b4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48028/0 (socket says 172.21.15.8:48028) 2023-10-06T04:36:52.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.508+0000 7f365944c700 1 -- 172.21.15.8:0/1624765428 learned_addr learned my addr 172.21.15.8:0/1624765428 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:52.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.508+0000 7f3658c4b700 1 --2- 172.21.15.8:0/1624765428 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36540af680 0x7f36540c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:52.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.508+0000 7f3653fff700 1 --2- 172.21.15.8:0/1624765428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36540cb360 0x7f3654158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:52.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.508+0000 7f365944c700 1 -- 172.21.15.8:0/1624765428 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36540af680 msgr2=0x7f36540c9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:52.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.508+0000 7f365944c700 1 --2- 172.21.15.8:0/1624765428 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36540af680 0x7f36540c9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:52.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.508+0000 7f365944c700 1 -- 172.21.15.8:0/1624765428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36540cb360 msgr2=0x7f3654158bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:52.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.508+0000 7f365944c700 1 --2- 172.21.15.8:0/1624765428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36540cb360 0x7f3654158bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:52.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.508+0000 7f365944c700 1 -- 172.21.15.8:0/1624765428 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f363c0094f0 con 0x7f36540d08d0 2023-10-06T04:36:52.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.508+0000 7f3653fff700 1 --2- 172.21.15.8:0/1624765428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36540cb360 0x7f3654158bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:36:52.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.508+0000 7f365944c700 1 --2- 172.21.15.8:0/1624765428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36540d08d0 0x7f36540b4f20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3654063f80 tx=0x7f363c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:52.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.508+0000 7f3650ff9700 1 -- 172.21.15.8:0/1624765428 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c011630 con 0x7f36540d08d0 2023-10-06T04:36:52.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.508+0000 7f3650ff9700 1 -- 172.21.15.8:0/1624765428 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363c0117b0 con 0x7f36540d08d0 2023-10-06T04:36:52.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.508+0000 7f365aeaf700 1 -- 172.21.15.8:0/1624765428 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36540c7430 con 0x7f36540d08d0 2023-10-06T04:36:52.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.508+0000 7f3650ff9700 1 -- 172.21.15.8:0/1624765428 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c011b70 con 0x7f36540d08d0 2023-10-06T04:36:52.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.508+0000 7f365aeaf700 1 -- 172.21.15.8:0/1624765428 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36540c79f0 con 0x7f36540d08d0 2023-10-06T04:36:52.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.509+0000 7f365aeaf700 1 -- 172.21.15.8:0/1624765428 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3654169b60 con 0x7f36540d08d0 2023-10-06T04:36:52.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.510+0000 7f3650ff9700 1 -- 172.21.15.8:0/1624765428 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f363c0253f0 con 0x7f36540d08d0 2023-10-06T04:36:52.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.510+0000 7f3650ff9700 1 --2- 172.21.15.8:0/1624765428 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3634066f30 0x7f36340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:52.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.510+0000 7f3650ff9700 1 -- 172.21.15.8:0/1624765428 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f363c0864f0 con 0x7f36540d08d0 2023-10-06T04:36:52.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.510+0000 7f3658c4b700 1 --2- 172.21.15.8:0/1624765428 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3634066f30 0x7f36340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:52.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.511+0000 7f3658c4b700 1 --2- 172.21.15.8:0/1624765428 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3634066f30 0x7f36340693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f364c007fd0 tx=0x7f364c007e10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:52.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.514+0000 7f3650ff9700 1 -- 172.21.15.8:0/1624765428 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3654169b60 con 0x7f36540d08d0 2023-10-06T04:36:52.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.709+0000 7f365aeaf700 1 -- 172.21.15.8:0/1624765428 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3654169b60 con 0x7f36540d08d0 2023-10-06T04:36:52.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.709+0000 7f3650ff9700 1 -- 172.21.15.8:0/1624765428 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f3654169b60 con 0x7f36540d08d0 2023-10-06T04:36:52.712 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:36:52.712 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":25,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:36:21.690266+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:36:10.148177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:36:10.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:36:14.390671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:36:15.601089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:36:19.291300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.555871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.490505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.504578+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.517217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:05.991135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.537329+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.543232+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.443715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:36:52.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.712+0000 7f365aeaf700 1 -- 172.21.15.8:0/1624765428 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3634066f30 msgr2=0x7f36340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:52.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.712+0000 7f365aeaf700 1 --2- 172.21.15.8:0/1624765428 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3634066f30 0x7f36340693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f364c007fd0 tx=0x7f364c007e10 comp rx=0 tx=0).stop 2023-10-06T04:36:52.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.712+0000 7f365aeaf700 1 -- 172.21.15.8:0/1624765428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36540d08d0 msgr2=0x7f36540b4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:52.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.712+0000 7f365aeaf700 1 --2- 172.21.15.8:0/1624765428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36540d08d0 0x7f36540b4f20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3654063f80 tx=0x7f363c017000 comp rx=0 tx=0).stop 2023-10-06T04:36:52.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.712+0000 7f365aeaf700 1 -- 172.21.15.8:0/1624765428 shutdown_connections 2023-10-06T04:36:52.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.712+0000 7f365aeaf700 1 --2- 172.21.15.8:0/1624765428 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3634066f30 0x7f36340693e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:52.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.712+0000 7f365aeaf700 1 --2- 172.21.15.8:0/1624765428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36540d08d0 0x7f36540b4f20 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:52.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.712+0000 7f365aeaf700 1 --2- 172.21.15.8:0/1624765428 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36540af680 0x7f36540c9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:52.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.712+0000 7f365aeaf700 1 --2- 172.21.15.8:0/1624765428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36540cb360 0x7f3654158bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:52.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.712+0000 7f365aeaf700 1 -- 172.21.15.8:0/1624765428 >> 172.21.15.8:0/1624765428 conn(0x7f36540633d0 msgr2=0x7f365415c350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:52.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.712+0000 7f365aeaf700 1 -- 172.21.15.8:0/1624765428 shutdown_connections 2023-10-06T04:36:52.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.712+0000 7f365aeaf700 1 -- 172.21.15.8:0/1624765428 wait complete. 2023-10-06T04:36:52.727 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:36:10.148177+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:36:10.684157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:36:14.390671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:36:15.601089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T04:36:19.291300+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:36:52.727 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:36:52.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.847+0000 7fe9d4672700 1 Processor -- start 2023-10-06T04:36:52.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.847+0000 7fe9d4672700 1 -- start start 2023-10-06T04:36:52.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.848+0000 7fe9d4672700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe9cc1430c0 0x7fe9cc0cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:52.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.848+0000 7fe9d4672700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9cc0cf510 con 0x7fe9cc0cfee0 2023-10-06T04:36:52.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.848+0000 7fe9d4672700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9cc0ce6a0 con 0x7fe9cc142cf0 2023-10-06T04:36:52.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.848+0000 7fe9d4672700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9cc0ce900 con 0x7fe9cc1430c0 2023-10-06T04:36:52.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.848+0000 7fe9d2c0f700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe9cc0cfee0 0x7fe9cc0b3790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:59868/0 (socket says 172.21.15.8:59868) 2023-10-06T04:36:52.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.848+0000 7fe9d2c0f700 1 -- 172.21.15.8:0/1975977931 learned_addr learned my addr 172.21.15.8:0/1975977931 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:52.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.848+0000 7fe9d1c0d700 1 --2- 172.21.15.8:0/1975977931 >> v2:172.21.15.184:3300/0 conn(0x7fe9cc1430c0 0x7fe9cc0cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:52.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.848+0000 7fe9d140c700 1 -- 172.21.15.8:0/1975977931 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4227235379 0 0) 0x7fe9cc0cf510 con 0x7fe9cc0cfee0 2023-10-06T04:36:52.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.848+0000 7fe9d140c700 1 -- 172.21.15.8:0/1975977931 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9b4003570 con 0x7fe9cc0cfee0 2023-10-06T04:36:52.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.848+0000 7fe9d140c700 1 -- 172.21.15.8:0/1975977931 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1856514960 0 0) 0x7fe9cc0ce6a0 con 0x7fe9cc142cf0 2023-10-06T04:36:52.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.848+0000 7fe9d140c700 1 -- 172.21.15.8:0/1975977931 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9cc0cf510 con 0x7fe9cc142cf0 2023-10-06T04:36:52.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.848+0000 7fe9d1c0d700 1 -- 172.21.15.8:0/1975977931 >> v1:172.21.15.184:6789/0 conn(0x7fe9cc142cf0 legacy=0x7fe9cc0b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:52.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.848+0000 7fe9d1c0d700 1 -- 172.21.15.8:0/1975977931 >> v1:172.21.15.8:6789/0 conn(0x7fe9cc0cfee0 legacy=0x7fe9cc0b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:52.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.848+0000 7fe9d140c700 1 -- 172.21.15.8:0/1975977931 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2271924635 0 0) 0x7fe9b4003570 con 0x7fe9cc0cfee0 2023-10-06T04:36:52.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.848+0000 7fe9d1c0d700 1 -- 172.21.15.8:0/1975977931 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9cc0cebe0 con 0x7fe9cc1430c0 2023-10-06T04:36:52.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.849+0000 7fe9d1c0d700 1 --2- 172.21.15.8:0/1975977931 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9cc1430c0 0x7fe9cc0cf9a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe9c00098e0 tx=0x7fe9c00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdf03b1955b2f87c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:52.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.849+0000 7fe9d140c700 1 -- 172.21.15.8:0/1975977931 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc0017f0 con 0x7fe9cc1430c0 2023-10-06T04:36:52.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.849+0000 7fe9d140c700 1 -- 172.21.15.8:0/1975977931 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c0011420 con 0x7fe9cc1430c0 2023-10-06T04:36:52.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.849+0000 7fe9d140c700 1 -- 172.21.15.8:0/1975977931 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c00117c0 con 0x7fe9cc1430c0 2023-10-06T04:36:52.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.849+0000 7fe9d4672700 1 -- 172.21.15.8:0/1975977931 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9cc1430c0 msgr2=0x7fe9cc0cf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:52.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.849+0000 7fe9d4672700 1 --2- 172.21.15.8:0/1975977931 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9cc1430c0 0x7fe9cc0cf9a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe9c00098e0 tx=0x7fe9c00091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:52.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.849+0000 7fe9d4672700 1 -- 172.21.15.8:0/1975977931 shutdown_connections 2023-10-06T04:36:52.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.849+0000 7fe9d4672700 1 --2- 172.21.15.8:0/1975977931 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9cc1430c0 0x7fe9cc0cf9a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:52.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.849+0000 7fe9d4672700 1 -- 172.21.15.8:0/1975977931 >> 172.21.15.8:0/1975977931 conn(0x7fe9cc06ed00 msgr2=0x7fe9cc06f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:52.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.850+0000 7fe9d4672700 1 -- 172.21.15.8:0/1975977931 shutdown_connections 2023-10-06T04:36:52.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.850+0000 7fe9d4672700 1 -- 172.21.15.8:0/1975977931 wait complete. 2023-10-06T04:36:52.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.851+0000 7fe9d4672700 1 Processor -- start 2023-10-06T04:36:52.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.851+0000 7fe9d4672700 1 -- start start 2023-10-06T04:36:52.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.851+0000 7fe9d4672700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9cc0cfee0 0x7fe9cc0c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:52.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.851+0000 7fe9d4672700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9cc142cf0 0x7fe9cc169ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:52.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.851+0000 7fe9d4672700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9cc1430c0 0x7fe9cc16a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:52.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.851+0000 7fe9d4672700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc159fb0 con 0x7fe9cc142cf0 2023-10-06T04:36:52.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.851+0000 7fe9d4672700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc159cb0 con 0x7fe9cc1430c0 2023-10-06T04:36:52.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.851+0000 7fe9d4672700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc16a600 con 0x7fe9cc0cfee0 2023-10-06T04:36:52.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.851+0000 7fe9d1c0d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9cc142cf0 0x7fe9cc169ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:52.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.852+0000 7fe9d1c0d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9cc142cf0 0x7fe9cc169ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48040/0 (socket says 172.21.15.8:48040) 2023-10-06T04:36:52.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.852+0000 7fe9d1c0d700 1 -- 172.21.15.8:0/1625458874 learned_addr learned my addr 172.21.15.8:0/1625458874 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:52.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.852+0000 7fe9d240e700 1 --2- 172.21.15.8:0/1625458874 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9cc0cfee0 0x7fe9cc0c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:52.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.852+0000 7fe9d2c0f700 1 --2- 172.21.15.8:0/1625458874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9cc1430c0 0x7fe9cc16a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:52.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.852+0000 7fe9d1c0d700 1 -- 172.21.15.8:0/1625458874 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9cc0cfee0 msgr2=0x7fe9cc0c72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:52.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.852+0000 7fe9d1c0d700 1 --2- 172.21.15.8:0/1625458874 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9cc0cfee0 0x7fe9cc0c72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:52.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.852+0000 7fe9d1c0d700 1 -- 172.21.15.8:0/1625458874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9cc1430c0 msgr2=0x7fe9cc16a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:52.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.852+0000 7fe9d1c0d700 1 --2- 172.21.15.8:0/1625458874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9cc1430c0 0x7fe9cc16a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:52.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.852+0000 7fe9d1c0d700 1 -- 172.21.15.8:0/1625458874 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c0009420 con 0x7fe9cc142cf0 2023-10-06T04:36:52.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.852+0000 7fe9d1c0d700 1 --2- 172.21.15.8:0/1625458874 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9cc142cf0 0x7fe9cc169ad0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc0ce830 tx=0x7fe9c0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:52.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.852+0000 7fe9ca7fc700 1 -- 172.21.15.8:0/1625458874 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c001cc90 con 0x7fe9cc142cf0 2023-10-06T04:36:52.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.852+0000 7fe9ca7fc700 1 -- 172.21.15.8:0/1625458874 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c001cdf0 con 0x7fe9cc142cf0 2023-10-06T04:36:52.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.852+0000 7fe9ca7fc700 1 -- 172.21.15.8:0/1625458874 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c001a6a0 con 0x7fe9cc142cf0 2023-10-06T04:36:52.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.852+0000 7fe9d4672700 1 -- 172.21.15.8:0/1625458874 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9cc16a8e0 con 0x7fe9cc142cf0 2023-10-06T04:36:52.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.852+0000 7fe9d4672700 1 -- 172.21.15.8:0/1625458874 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9cc16abc0 con 0x7fe9cc142cf0 2023-10-06T04:36:52.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.853+0000 7fe9d4672700 1 -- 172.21.15.8:0/1625458874 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9cc071550 con 0x7fe9cc142cf0 2023-10-06T04:36:52.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.854+0000 7fe9ca7fc700 1 -- 172.21.15.8:0/1625458874 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe9c001aa90 con 0x7fe9cc142cf0 2023-10-06T04:36:52.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.854+0000 7fe9ca7fc700 1 --2- 172.21.15.8:0/1625458874 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe9b8066f30 0x7fe9b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:52.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.854+0000 7fe9ca7fc700 1 -- 172.21.15.8:0/1625458874 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe9c0086020 con 0x7fe9cc142cf0 2023-10-06T04:36:52.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.854+0000 7fe9d240e700 1 --2- 172.21.15.8:0/1625458874 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe9b8066f30 0x7fe9b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:52.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.855+0000 7fe9d240e700 1 --2- 172.21.15.8:0/1625458874 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe9b8066f30 0x7fe9b80693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4003870 tx=0x7fe9c4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:52.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:52.858+0000 7fe9ca7fc700 1 -- 172.21.15.8:0/1625458874 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9c0052e40 con 0x7fe9cc142cf0 2023-10-06T04:36:53.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.053+0000 7fe9d4672700 1 -- 172.21.15.8:0/1625458874 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe9cc0ceec0 con 0x7fe9cc142cf0 2023-10-06T04:36:53.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.054+0000 7fe9ca7fc700 1 -- 172.21.15.8:0/1625458874 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe9c00290a0 con 0x7fe9cc142cf0 2023-10-06T04:36:53.057 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 8 2023-10-06T04:36:53.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.056+0000 7fe9d4672700 1 -- 172.21.15.8:0/1625458874 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe9b8066f30 msgr2=0x7fe9b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:53.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.056+0000 7fe9d4672700 1 --2- 172.21.15.8:0/1625458874 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe9b8066f30 0x7fe9b80693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4003870 tx=0x7fe9c4009040 comp rx=0 tx=0).stop 2023-10-06T04:36:53.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.056+0000 7fe9d4672700 1 -- 172.21.15.8:0/1625458874 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9cc142cf0 msgr2=0x7fe9cc169ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:53.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.056+0000 7fe9d4672700 1 --2- 172.21.15.8:0/1625458874 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9cc142cf0 0x7fe9cc169ad0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc0ce830 tx=0x7fe9c0016000 comp rx=0 tx=0).stop 2023-10-06T04:36:53.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.056+0000 7fe9d4672700 1 -- 172.21.15.8:0/1625458874 shutdown_connections 2023-10-06T04:36:53.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.056+0000 7fe9d4672700 1 --2- 172.21.15.8:0/1625458874 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe9b8066f30 0x7fe9b80693e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:53.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.056+0000 7fe9d4672700 1 --2- 172.21.15.8:0/1625458874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9cc1430c0 0x7fe9cc16a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:53.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.056+0000 7fe9d4672700 1 --2- 172.21.15.8:0/1625458874 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9cc0cfee0 0x7fe9cc0c72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:53.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.056+0000 7fe9d4672700 1 --2- 172.21.15.8:0/1625458874 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9cc142cf0 0x7fe9cc169ad0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:53.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.056+0000 7fe9d4672700 1 -- 172.21.15.8:0/1625458874 >> 172.21.15.8:0/1625458874 conn(0x7fe9cc06ed00 msgr2=0x7fe9cc0b0730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:53.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.056+0000 7fe9d4672700 1 -- 172.21.15.8:0/1625458874 shutdown_connections 2023-10-06T04:36:53.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.056+0000 7fe9d4672700 1 -- 172.21.15.8:0/1625458874 wait complete. 2023-10-06T04:36:53.071 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:36:53.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.191+0000 7fa8daba3700 1 Processor -- start 2023-10-06T04:36:53.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.191+0000 7fa8daba3700 1 -- start start 2023-10-06T04:36:53.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.192+0000 7fa8daba3700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8d40b3790 0x7fa8d40b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:53.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.192+0000 7fa8daba3700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d40cf510 con 0x7fa8d41430c0 2023-10-06T04:36:53.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.192+0000 7fa8daba3700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d40ce6a0 con 0x7fa8d4142cf0 2023-10-06T04:36:53.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.192+0000 7fa8daba3700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d40b4110 con 0x7fa8d40b3790 2023-10-06T04:36:53.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.192+0000 7fa8d3fff700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fa8d41430c0 0x7fa8d40cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:59878/0 (socket says 172.21.15.8:59878) 2023-10-06T04:36:53.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.192+0000 7fa8d3fff700 1 -- 172.21.15.8:0/2494858552 learned_addr learned my addr 172.21.15.8:0/2494858552 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:53.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.192+0000 7fa8d37fe700 1 -- 172.21.15.8:0/2494858552 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2991688052 0 0) 0x7fa8d40cf510 con 0x7fa8d41430c0 2023-10-06T04:36:53.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.192+0000 7fa8d37fe700 1 -- 172.21.15.8:0/2494858552 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8c0003570 con 0x7fa8d41430c0 2023-10-06T04:36:53.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.192+0000 7fa8d9140700 1 --2- 172.21.15.8:0/2494858552 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8d40b3790 0x7fa8d40b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:53.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.193+0000 7fa8d37fe700 1 -- 172.21.15.8:0/2494858552 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 512412437 0 0) 0x7fa8c0003570 con 0x7fa8d41430c0 2023-10-06T04:36:53.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.193+0000 7fa8d37fe700 1 -- 172.21.15.8:0/2494858552 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8d40b3790 msgr2=0x7fa8d40b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:53.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.193+0000 7fa8d37fe700 1 --2- 172.21.15.8:0/2494858552 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8d40b3790 0x7fa8d40b3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:53.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.193+0000 7fa8d37fe700 1 -- 172.21.15.8:0/2494858552 >> v1:172.21.15.184:6789/0 conn(0x7fa8d4142cf0 legacy=0x7fa8d40b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:53.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.193+0000 7fa8d37fe700 1 -- 172.21.15.8:0/2494858552 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d40ce900 con 0x7fa8d41430c0 2023-10-06T04:36:53.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.193+0000 7fa8d37fe700 1 -- 172.21.15.8:0/2494858552 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7fa8c40017f0 con 0x7fa8d41430c0 2023-10-06T04:36:53.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.193+0000 7fa8d37fe700 1 -- 172.21.15.8:0/2494858552 >> v1:172.21.15.8:6789/0 conn(0x7fa8d41430c0 legacy=0x7fa8d40cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:53.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.193+0000 7fa8d37fe700 1 --2- 172.21.15.8:0/2494858552 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8d40b3790 0x7fa8c0003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:53.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.193+0000 7fa8d37fe700 1 --2- 172.21.15.8:0/2494858552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8c0004060 0x7fa8c0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:53.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.193+0000 7fa8d37fe700 1 --2- 172.21.15.8:0/2494858552 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8c0004d50 0x7fa8c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:53.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.193+0000 7fa8d37fe700 1 -- 172.21.15.8:0/2494858552 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d40b4110 con 0x7fa8c0004d50 2023-10-06T04:36:53.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.193+0000 7fa8d37fe700 1 -- 172.21.15.8:0/2494858552 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c000bc20 con 0x7fa8c0004060 2023-10-06T04:36:53.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.193+0000 7fa8d37fe700 1 -- 172.21.15.8:0/2494858552 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c000bde0 con 0x7fa8d40b3790 2023-10-06T04:36:53.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.193+0000 7fa8d9140700 1 --2- 172.21.15.8:0/2494858552 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8c0004d50 0x7fa8c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:53.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.193+0000 7fa8d3fff700 1 --2- 172.21.15.8:0/2494858552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8c0004060 0x7fa8c0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:53.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.193+0000 7fa8d893f700 1 --2- 172.21.15.8:0/2494858552 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8d40b3790 0x7fa8c0003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:53.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.193+0000 7fa8d9140700 1 -- 172.21.15.8:0/2494858552 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8d40b3790 msgr2=0x7fa8c0003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:53.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.193+0000 7fa8d9140700 1 --2- 172.21.15.8:0/2494858552 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8d40b3790 0x7fa8c0003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:53.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.193+0000 7fa8d9140700 1 -- 172.21.15.8:0/2494858552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8c0004060 msgr2=0x7fa8c0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:53.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.193+0000 7fa8d9140700 1 --2- 172.21.15.8:0/2494858552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8c0004060 0x7fa8c0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:53.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.193+0000 7fa8d9140700 1 -- 172.21.15.8:0/2494858552 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c0003570 con 0x7fa8c0004d50 2023-10-06T04:36:53.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.193+0000 7fa8d9140700 1 --2- 172.21.15.8:0/2494858552 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8c0004d50 0x7fa8c00051c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc009c00 tx=0x7fa8bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66ba592f8d82c7d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:53.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.193+0000 7fa8d37fe700 1 -- 172.21.15.8:0/2494858552 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc00e710 con 0x7fa8c0004d50 2023-10-06T04:36:53.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.193+0000 7fa8d37fe700 1 -- 172.21.15.8:0/2494858552 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8bc00e870 con 0x7fa8c0004d50 2023-10-06T04:36:53.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.193+0000 7fa8d37fe700 1 -- 172.21.15.8:0/2494858552 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc00ec30 con 0x7fa8c0004d50 2023-10-06T04:36:53.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.194+0000 7fa8daba3700 1 -- 172.21.15.8:0/2494858552 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8c0004d50 msgr2=0x7fa8c00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:53.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.194+0000 7fa8daba3700 1 --2- 172.21.15.8:0/2494858552 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8c0004d50 0x7fa8c00051c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc009c00 tx=0x7fa8bc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:53.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.194+0000 7fa8d9140700 1 -- 172.21.15.8:0/2494858552 reap_dead start 2023-10-06T04:36:53.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.194+0000 7fa8daba3700 1 -- 172.21.15.8:0/2494858552 shutdown_connections 2023-10-06T04:36:53.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.194+0000 7fa8daba3700 1 -- 172.21.15.8:0/2494858552 >> 172.21.15.8:0/2494858552 conn(0x7fa8d406ed00 msgr2=0x7fa8d406f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:53.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.194+0000 7fa8daba3700 1 -- 172.21.15.8:0/2494858552 shutdown_connections 2023-10-06T04:36:53.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.194+0000 7fa8daba3700 1 -- 172.21.15.8:0/2494858552 wait complete. 2023-10-06T04:36:53.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.195+0000 7fa8daba3700 1 Processor -- start 2023-10-06T04:36:53.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.195+0000 7fa8daba3700 1 -- start start 2023-10-06T04:36:53.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.196+0000 7fa8daba3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d41413f0 0x7fa8d4140bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:53.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.196+0000 7fa8daba3700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8d41417c0 0x7fa8d4158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:53.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.196+0000 7fa8daba3700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8d4158ff0 0x7fa8d40c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:53.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.196+0000 7fa8daba3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d415b500 con 0x7fa8d41413f0 2023-10-06T04:36:53.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.196+0000 7fa8daba3700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d415a690 con 0x7fa8d4158ff0 2023-10-06T04:36:53.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.196+0000 7fa8daba3700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d415a8f0 con 0x7fa8d41417c0 2023-10-06T04:36:53.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.196+0000 7fa8d893f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d41413f0 0x7fa8d4140bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:53.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.196+0000 7fa8d893f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d41413f0 0x7fa8d4140bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48058/0 (socket says 172.21.15.8:48058) 2023-10-06T04:36:53.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.196+0000 7fa8d893f700 1 -- 172.21.15.8:0/3706034526 learned_addr learned my addr 172.21.15.8:0/3706034526 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:53.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.196+0000 7fa8d9140700 1 --2- 172.21.15.8:0/3706034526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8d4158ff0 0x7fa8d40c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:53.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.196+0000 7fa8d3fff700 1 --2- 172.21.15.8:0/3706034526 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8d41417c0 0x7fa8d4158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:53.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.196+0000 7fa8d893f700 1 -- 172.21.15.8:0/3706034526 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8d41417c0 msgr2=0x7fa8d4158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:53.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.196+0000 7fa8d893f700 1 --2- 172.21.15.8:0/3706034526 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8d41417c0 0x7fa8d4158ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:53.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.196+0000 7fa8d893f700 1 -- 172.21.15.8:0/3706034526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8d4158ff0 msgr2=0x7fa8d40c5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:53.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.196+0000 7fa8d893f700 1 --2- 172.21.15.8:0/3706034526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8d4158ff0 0x7fa8d40c5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:53.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.196+0000 7fa8d893f700 1 -- 172.21.15.8:0/3706034526 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d415abd0 con 0x7fa8d41413f0 2023-10-06T04:36:53.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.197+0000 7fa8d893f700 1 --2- 172.21.15.8:0/3706034526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d41413f0 0x7fa8d4140bd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc002950 tx=0x7fa8cc007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:53.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.197+0000 7fa8d0ff9700 1 -- 172.21.15.8:0/3706034526 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc002e90 con 0x7fa8d41413f0 2023-10-06T04:36:53.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.197+0000 7fa8d0ff9700 1 -- 172.21.15.8:0/3706034526 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8cc00f8d0 con 0x7fa8d41413f0 2023-10-06T04:36:53.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.197+0000 7fa8daba3700 1 -- 172.21.15.8:0/3706034526 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d415aeb0 con 0x7fa8d41413f0 2023-10-06T04:36:53.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.197+0000 7fa8d0ff9700 1 -- 172.21.15.8:0/3706034526 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc00fc90 con 0x7fa8d41413f0 2023-10-06T04:36:53.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.197+0000 7fa8daba3700 1 -- 172.21.15.8:0/3706034526 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d4159440 con 0x7fa8d41413f0 2023-10-06T04:36:53.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.198+0000 7fa8daba3700 1 -- 172.21.15.8:0/3706034526 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d40c5c70 con 0x7fa8d41413f0 2023-10-06T04:36:53.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.198+0000 7fa8d0ff9700 1 -- 172.21.15.8:0/3706034526 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa8cc006820 con 0x7fa8d41413f0 2023-10-06T04:36:53.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.198+0000 7fa8d0ff9700 1 --2- 172.21.15.8:0/3706034526 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa8b4066f30 0x7fa8b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:53.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.199+0000 7fa8d0ff9700 1 -- 172.21.15.8:0/3706034526 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa8cc084ad0 con 0x7fa8d41413f0 2023-10-06T04:36:53.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.199+0000 7fa8d3fff700 1 --2- 172.21.15.8:0/3706034526 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa8b4066f30 0x7fa8b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:53.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.199+0000 7fa8d3fff700 1 --2- 172.21.15.8:0/3706034526 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa8b4066f30 0x7fa8b40693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4002210 tx=0x7fa8c4006040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:53.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.203+0000 7fa8d0ff9700 1 -- 172.21.15.8:0/3706034526 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa8cc0519a0 con 0x7fa8d41413f0 2023-10-06T04:36:53.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.397+0000 7fa8daba3700 1 -- 172.21.15.8:0/3706034526 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa8d4071550 con 0x7fa8d41413f0 2023-10-06T04:36:53.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.398+0000 7fa8d0ff9700 1 -- 172.21.15.8:0/3706034526 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa8cc054fc0 con 0x7fa8d41413f0 2023-10-06T04:36:53.400 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-06T04:36:53.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.399+0000 7fa8daba3700 1 -- 172.21.15.8:0/3706034526 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa8b4066f30 msgr2=0x7fa8b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:53.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.399+0000 7fa8daba3700 1 --2- 172.21.15.8:0/3706034526 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa8b4066f30 0x7fa8b40693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4002210 tx=0x7fa8c4006040 comp rx=0 tx=0).stop 2023-10-06T04:36:53.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.399+0000 7fa8daba3700 1 -- 172.21.15.8:0/3706034526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d41413f0 msgr2=0x7fa8d4140bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:53.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.399+0000 7fa8daba3700 1 --2- 172.21.15.8:0/3706034526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d41413f0 0x7fa8d4140bd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc002950 tx=0x7fa8cc007d30 comp rx=0 tx=0).stop 2023-10-06T04:36:53.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.400+0000 7fa8daba3700 1 -- 172.21.15.8:0/3706034526 shutdown_connections 2023-10-06T04:36:53.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.400+0000 7fa8daba3700 1 --2- 172.21.15.8:0/3706034526 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa8b4066f30 0x7fa8b40693e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:53.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.400+0000 7fa8daba3700 1 --2- 172.21.15.8:0/3706034526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8d4158ff0 0x7fa8d40c5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:53.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.400+0000 7fa8daba3700 1 --2- 172.21.15.8:0/3706034526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d41413f0 0x7fa8d4140bd0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:53.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.400+0000 7fa8daba3700 1 --2- 172.21.15.8:0/3706034526 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8d41417c0 0x7fa8d4158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:53.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.400+0000 7fa8daba3700 1 -- 172.21.15.8:0/3706034526 >> 172.21.15.8:0/3706034526 conn(0x7fa8d406ed00 msgr2=0x7fa8d40b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:53.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.400+0000 7fa8daba3700 1 -- 172.21.15.8:0/3706034526 shutdown_connections 2023-10-06T04:36:53.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.400+0000 7fa8daba3700 1 -- 172.21.15.8:0/3706034526 wait complete. 2023-10-06T04:36:53.414 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:36:53.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.534+0000 7f8aced72700 1 Processor -- start 2023-10-06T04:36:53.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.534+0000 7f8aced72700 1 -- start start 2023-10-06T04:36:53.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.534+0000 7f8aced72700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ac80b3790 0x7f8ac80b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:53.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.534+0000 7f8aced72700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ac80cf510 con 0x7f8ac81430c0 2023-10-06T04:36:53.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.534+0000 7f8aced72700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ac80ce6a0 con 0x7f8ac8142cf0 2023-10-06T04:36:53.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.534+0000 7f8aced72700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac80b4110 con 0x7f8ac80b3790 2023-10-06T04:36:53.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.535+0000 7f8ac7fff700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f8ac81430c0 0x7f8ac80cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:59890/0 (socket says 172.21.15.8:59890) 2023-10-06T04:36:53.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.535+0000 7f8ac7fff700 1 -- 172.21.15.8:0/2475115252 learned_addr learned my addr 172.21.15.8:0/2475115252 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:53.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.535+0000 7f8acd30f700 1 --2- 172.21.15.8:0/2475115252 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ac80b3790 0x7f8ac80b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:53.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.535+0000 7f8ac77fe700 1 -- 172.21.15.8:0/2475115252 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2026113038 0 0) 0x7f8ac80cf510 con 0x7f8ac81430c0 2023-10-06T04:36:53.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.535+0000 7f8ac77fe700 1 -- 172.21.15.8:0/2475115252 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ab0003570 con 0x7f8ac81430c0 2023-10-06T04:36:53.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.535+0000 7f8ac77fe700 1 -- 172.21.15.8:0/2475115252 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1501388812 0 0) 0x7f8ac80ce6a0 con 0x7f8ac8142cf0 2023-10-06T04:36:53.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.535+0000 7f8ac77fe700 1 -- 172.21.15.8:0/2475115252 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ac80cf510 con 0x7f8ac8142cf0 2023-10-06T04:36:53.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.535+0000 7f8acd30f700 1 -- 172.21.15.8:0/2475115252 >> v1:172.21.15.184:6789/0 conn(0x7f8ac8142cf0 legacy=0x7f8ac80b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:53.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.535+0000 7f8acd30f700 1 -- 172.21.15.8:0/2475115252 >> v1:172.21.15.8:6789/0 conn(0x7f8ac81430c0 legacy=0x7f8ac80cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:53.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.535+0000 7f8acd30f700 1 -- 172.21.15.8:0/2475115252 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac80ce900 con 0x7f8ac80b3790 2023-10-06T04:36:53.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.535+0000 7f8acd30f700 1 --2- 172.21.15.8:0/2475115252 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ac80b3790 0x7f8ac80b3bd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0009e90 tx=0x7f8ac0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cd87328f9809a46 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:53.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.536+0000 7f8ac77fe700 1 -- 172.21.15.8:0/2475115252 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac000e070 con 0x7f8ac80b3790 2023-10-06T04:36:53.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.536+0000 7f8ac77fe700 1 -- 172.21.15.8:0/2475115252 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac000bb80 con 0x7f8ac80b3790 2023-10-06T04:36:53.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.536+0000 7f8ac77fe700 1 -- 172.21.15.8:0/2475115252 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac0012430 con 0x7f8ac80b3790 2023-10-06T04:36:53.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.536+0000 7f8aced72700 1 -- 172.21.15.8:0/2475115252 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ac80b3790 msgr2=0x7f8ac80b3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:53.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.536+0000 7f8aced72700 1 --2- 172.21.15.8:0/2475115252 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ac80b3790 0x7f8ac80b3bd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0009e90 tx=0x7f8ac0009780 comp rx=0 tx=0).stop 2023-10-06T04:36:53.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.536+0000 7f8aced72700 1 -- 172.21.15.8:0/2475115252 shutdown_connections 2023-10-06T04:36:53.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.536+0000 7f8aced72700 1 --2- 172.21.15.8:0/2475115252 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ac80b3790 0x7f8ac80b3bd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:53.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.536+0000 7f8aced72700 1 -- 172.21.15.8:0/2475115252 >> 172.21.15.8:0/2475115252 conn(0x7f8ac806ed00 msgr2=0x7f8ac806f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:53.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.536+0000 7f8aced72700 1 -- 172.21.15.8:0/2475115252 shutdown_connections 2023-10-06T04:36:53.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.536+0000 7f8aced72700 1 -- 172.21.15.8:0/2475115252 wait complete. 2023-10-06T04:36:53.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.537+0000 7f8aced72700 1 Processor -- start 2023-10-06T04:36:53.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.537+0000 7f8aced72700 1 -- start start 2023-10-06T04:36:53.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.538+0000 7f8aced72700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ac80b3790 0x7f8ac81593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:53.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.538+0000 7f8aced72700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ac8142cf0 0x7f8ac80ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:53.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.538+0000 7f8aced72700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ac81430c0 0x7f8ac80adc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:53.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.538+0000 7f8aced72700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac80ac300 con 0x7f8ac81430c0 2023-10-06T04:36:53.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.538+0000 7f8aced72700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac80aeea0 con 0x7f8ac8142cf0 2023-10-06T04:36:53.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.538+0000 7f8aced72700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac80ae290 con 0x7f8ac80b3790 2023-10-06T04:36:53.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.538+0000 7f8acd30f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ac81430c0 0x7f8ac80adc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:53.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.538+0000 7f8acd30f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ac81430c0 0x7f8ac80adc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48070/0 (socket says 172.21.15.8:48070) 2023-10-06T04:36:53.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.538+0000 7f8acd30f700 1 -- 172.21.15.8:0/3192155709 learned_addr learned my addr 172.21.15.8:0/3192155709 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:53.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.538+0000 7f8ac7fff700 1 --2- 172.21.15.8:0/3192155709 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ac8142cf0 0x7f8ac80ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:53.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.538+0000 7f8accb0e700 1 --2- 172.21.15.8:0/3192155709 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ac80b3790 0x7f8ac81593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:53.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.538+0000 7f8acd30f700 1 -- 172.21.15.8:0/3192155709 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ac80b3790 msgr2=0x7f8ac81593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:53.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.538+0000 7f8acd30f700 1 --2- 172.21.15.8:0/3192155709 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ac80b3790 0x7f8ac81593c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:53.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.538+0000 7f8acd30f700 1 -- 172.21.15.8:0/3192155709 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ac8142cf0 msgr2=0x7f8ac80ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:53.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.538+0000 7f8acd30f700 1 --2- 172.21.15.8:0/3192155709 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ac8142cf0 0x7f8ac80ad6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:53.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.538+0000 7f8acd30f700 1 -- 172.21.15.8:0/3192155709 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac0009a20 con 0x7f8ac81430c0 2023-10-06T04:36:53.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.539+0000 7f8acd30f700 1 --2- 172.21.15.8:0/3192155709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ac81430c0 0x7f8ac80adc10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8067f40 tx=0x7f8ac0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:53.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.539+0000 7f8ac4ff9700 1 -- 172.21.15.8:0/3192155709 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac001b420 con 0x7f8ac81430c0 2023-10-06T04:36:53.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.539+0000 7f8ac4ff9700 1 -- 172.21.15.8:0/3192155709 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac001b5a0 con 0x7f8ac81430c0 2023-10-06T04:36:53.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.539+0000 7f8aced72700 1 -- 172.21.15.8:0/3192155709 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac80ae570 con 0x7f8ac81430c0 2023-10-06T04:36:53.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.539+0000 7f8ac4ff9700 1 -- 172.21.15.8:0/3192155709 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac001b960 con 0x7f8ac81430c0 2023-10-06T04:36:53.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.539+0000 7f8aced72700 1 -- 172.21.15.8:0/3192155709 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac80aeb30 con 0x7f8ac81430c0 2023-10-06T04:36:53.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.540+0000 7f8aced72700 1 -- 172.21.15.8:0/3192155709 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ac8071550 con 0x7f8ac81430c0 2023-10-06T04:36:53.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.540+0000 7f8ac4ff9700 1 -- 172.21.15.8:0/3192155709 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ac001bd50 con 0x7f8ac81430c0 2023-10-06T04:36:53.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.541+0000 7f8ac4ff9700 1 --2- 172.21.15.8:0/3192155709 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8ab4066f30 0x7f8ab40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:53.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.541+0000 7f8ac4ff9700 1 -- 172.21.15.8:0/3192155709 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f8ac00866e0 con 0x7f8ac81430c0 2023-10-06T04:36:53.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.541+0000 7f8accb0e700 1 --2- 172.21.15.8:0/3192155709 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8ab4066f30 0x7f8ab40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:53.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.541+0000 7f8accb0e700 1 --2- 172.21.15.8:0/3192155709 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8ab4066f30 0x7f8ab40693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8007fd0 tx=0x7f8ab8007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:53.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.545+0000 7f8ac4ff9700 1 -- 172.21.15.8:0/3192155709 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ac0053540 con 0x7f8ac81430c0 2023-10-06T04:36:53.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.736+0000 7f8aced72700 1 -- 172.21.15.8:0/3192155709 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8ac80cebe0 con 0x7f8ac81430c0 2023-10-06T04:36:53.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.737+0000 7f8ac4ff9700 1 -- 172.21.15.8:0/3192155709 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8ac0056b20 con 0x7f8ac81430c0 2023-10-06T04:36:53.740 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-06T04:36:53.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.739+0000 7f8aced72700 1 -- 172.21.15.8:0/3192155709 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8ab4066f30 msgr2=0x7f8ab40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:53.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.739+0000 7f8aced72700 1 --2- 172.21.15.8:0/3192155709 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8ab4066f30 0x7f8ab40693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8007fd0 tx=0x7f8ab8007d50 comp rx=0 tx=0).stop 2023-10-06T04:36:53.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.739+0000 7f8aced72700 1 -- 172.21.15.8:0/3192155709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ac81430c0 msgr2=0x7f8ac80adc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:53.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.739+0000 7f8aced72700 1 --2- 172.21.15.8:0/3192155709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ac81430c0 0x7f8ac80adc10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8067f40 tx=0x7f8ac0019000 comp rx=0 tx=0).stop 2023-10-06T04:36:53.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.739+0000 7f8aced72700 1 -- 172.21.15.8:0/3192155709 shutdown_connections 2023-10-06T04:36:53.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.739+0000 7f8aced72700 1 --2- 172.21.15.8:0/3192155709 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8ab4066f30 0x7f8ab40693e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:53.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.739+0000 7f8aced72700 1 --2- 172.21.15.8:0/3192155709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ac81430c0 0x7f8ac80adc10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:53.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.739+0000 7f8aced72700 1 --2- 172.21.15.8:0/3192155709 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ac80b3790 0x7f8ac81593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:53.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.739+0000 7f8aced72700 1 --2- 172.21.15.8:0/3192155709 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ac8142cf0 0x7f8ac80ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:53.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.739+0000 7f8aced72700 1 -- 172.21.15.8:0/3192155709 >> 172.21.15.8:0/3192155709 conn(0x7f8ac806ed00 msgr2=0x7f8ac80b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:53.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.739+0000 7f8aced72700 1 -- 172.21.15.8:0/3192155709 shutdown_connections 2023-10-06T04:36:53.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.739+0000 7f8aced72700 1 -- 172.21.15.8:0/3192155709 wait complete. 2023-10-06T04:36:53.754 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:36:53.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.874+0000 7f3713aa2700 1 Processor -- start 2023-10-06T04:36:53.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.874+0000 7f3713aa2700 1 -- start start 2023-10-06T04:36:53.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.875+0000 7f3713aa2700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f370c142cf0 0x7f370c0b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:53.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.875+0000 7f3713aa2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f370c1430c0 0x7f370c0cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:53.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.875+0000 7f3713aa2700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f370c0cfee0 0x7f370c0b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:53.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.875+0000 7f3713aa2700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f370c0cf510 con 0x7f370c142cf0 2023-10-06T04:36:53.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.875+0000 7f3713aa2700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f370c0ce6a0 con 0x7f370c0cfee0 2023-10-06T04:36:53.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.875+0000 7f3713aa2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370c0ce900 con 0x7f370c1430c0 2023-10-06T04:36:53.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.875+0000 7f371183e700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f370c142cf0 0x7f370c0b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:53.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.875+0000 7f371183e700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f370c142cf0 0x7f370c0b5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48076/0 (socket says 172.21.15.8:48076) 2023-10-06T04:36:53.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.875+0000 7f371183e700 1 -- 172.21.15.8:0/3770640704 learned_addr learned my addr 172.21.15.8:0/3770640704 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:53.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.875+0000 7f371103d700 1 --2- 172.21.15.8:0/3770640704 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f370c1430c0 0x7f370c0cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:53.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.875+0000 7f371203f700 1 --2- 172.21.15.8:0/3770640704 >> v2:172.21.15.184:3300/0 conn(0x7f370c0cfee0 0x7f370c0b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:53.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.875+0000 7f371183e700 1 -- 172.21.15.8:0/3770640704 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f370c1430c0 msgr2=0x7f370c0cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:53.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.875+0000 7f371183e700 1 --2- 172.21.15.8:0/3770640704 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f370c1430c0 0x7f370c0cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:53.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.875+0000 7f371183e700 1 -- 172.21.15.8:0/3770640704 >> v2:172.21.15.184:3300/0 conn(0x7f370c0cfee0 msgr2=0x7f370c0b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:53.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.875+0000 7f371183e700 1 --2- 172.21.15.8:0/3770640704 >> v2:172.21.15.184:3300/0 conn(0x7f370c0cfee0 0x7f370c0b3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:53.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.875+0000 7f371183e700 1 -- 172.21.15.8:0/3770640704 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370c0cebe0 con 0x7f370c142cf0 2023-10-06T04:36:53.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.875+0000 7f371183e700 1 --2- 172.21.15.8:0/3770640704 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f370c142cf0 0x7f370c0b5cd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f370c06fc80 tx=0x7f3704009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b57ee218646a9f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:53.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.876+0000 7f371083c700 1 -- 172.21.15.8:0/3770640704 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370400e070 con 0x7f370c142cf0 2023-10-06T04:36:53.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.876+0000 7f371083c700 1 -- 172.21.15.8:0/3770640704 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370400ba50 con 0x7f370c142cf0 2023-10-06T04:36:53.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.876+0000 7f371083c700 1 -- 172.21.15.8:0/3770640704 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37040092e0 con 0x7f370c142cf0 2023-10-06T04:36:53.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.876+0000 7f3713aa2700 1 -- 172.21.15.8:0/3770640704 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f370c142cf0 msgr2=0x7f370c0b5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:53.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.876+0000 7f3713aa2700 1 --2- 172.21.15.8:0/3770640704 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f370c142cf0 0x7f370c0b5cd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f370c06fc80 tx=0x7f3704009840 comp rx=0 tx=0).stop 2023-10-06T04:36:53.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.876+0000 7f3713aa2700 1 -- 172.21.15.8:0/3770640704 shutdown_connections 2023-10-06T04:36:53.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.876+0000 7f3713aa2700 1 --2- 172.21.15.8:0/3770640704 >> v2:172.21.15.184:3300/0 conn(0x7f370c0cfee0 0x7f370c0b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:53.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.876+0000 7f3713aa2700 1 --2- 172.21.15.8:0/3770640704 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f370c142cf0 0x7f370c0b5cd0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:53.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.876+0000 7f3713aa2700 1 --2- 172.21.15.8:0/3770640704 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f370c1430c0 0x7f370c0cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:53.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.876+0000 7f3713aa2700 1 -- 172.21.15.8:0/3770640704 >> 172.21.15.8:0/3770640704 conn(0x7f370c06ed00 msgr2=0x7f370c06f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:53.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.876+0000 7f3713aa2700 1 -- 172.21.15.8:0/3770640704 shutdown_connections 2023-10-06T04:36:53.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.876+0000 7f3713aa2700 1 -- 172.21.15.8:0/3770640704 wait complete. 2023-10-06T04:36:53.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.877+0000 7f3713aa2700 1 Processor -- start 2023-10-06T04:36:53.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.877+0000 7f3713aa2700 1 -- start start 2023-10-06T04:36:53.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.878+0000 7f3713aa2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f370c0cfee0 0x7f370c16c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:53.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.878+0000 7f3713aa2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f370c142cf0 0x7f370c0c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:53.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.878+0000 7f3713aa2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f370c1430c0 0x7f370c0c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:53.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.878+0000 7f3713aa2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370c15c470 con 0x7f370c0cfee0 2023-10-06T04:36:53.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.878+0000 7f3713aa2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370c0cbd10 con 0x7f370c142cf0 2023-10-06T04:36:53.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.878+0000 7f3713aa2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370c0cbff0 con 0x7f370c1430c0 2023-10-06T04:36:53.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.878+0000 7f371183e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f370c0cfee0 0x7f370c16c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:53.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.878+0000 7f371183e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f370c0cfee0 0x7f370c16c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48090/0 (socket says 172.21.15.8:48090) 2023-10-06T04:36:53.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.878+0000 7f371183e700 1 -- 172.21.15.8:0/2110513299 learned_addr learned my addr 172.21.15.8:0/2110513299 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:53.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.878+0000 7f371103d700 1 --2- 172.21.15.8:0/2110513299 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f370c142cf0 0x7f370c0c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:53.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.878+0000 7f371203f700 1 --2- 172.21.15.8:0/2110513299 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f370c1430c0 0x7f370c0c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:53.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.879+0000 7f371183e700 1 -- 172.21.15.8:0/2110513299 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f370c1430c0 msgr2=0x7f370c0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:53.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.879+0000 7f371183e700 1 --2- 172.21.15.8:0/2110513299 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f370c1430c0 0x7f370c0c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:53.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.879+0000 7f371183e700 1 -- 172.21.15.8:0/2110513299 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f370c142cf0 msgr2=0x7f370c0c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:53.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.879+0000 7f371183e700 1 --2- 172.21.15.8:0/2110513299 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f370c142cf0 0x7f370c0c8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:53.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.879+0000 7f371183e700 1 -- 172.21.15.8:0/2110513299 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3704009ae0 con 0x7f370c0cfee0 2023-10-06T04:36:53.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.879+0000 7f371183e700 1 --2- 172.21.15.8:0/2110513299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f370c0cfee0 0x7f370c16c2f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3704009430 tx=0x7f3704018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:53.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.879+0000 7f3709ffb700 1 -- 172.21.15.8:0/2110513299 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3704008930 con 0x7f370c0cfee0 2023-10-06T04:36:53.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.879+0000 7f3709ffb700 1 -- 172.21.15.8:0/2110513299 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3704008ab0 con 0x7f370c0cfee0 2023-10-06T04:36:53.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.879+0000 7f3713aa2700 1 -- 172.21.15.8:0/2110513299 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f370c15be20 con 0x7f370c0cfee0 2023-10-06T04:36:53.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.879+0000 7f3709ffb700 1 -- 172.21.15.8:0/2110513299 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3704008e70 con 0x7f370c0cfee0 2023-10-06T04:36:53.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.880+0000 7f3713aa2700 1 -- 172.21.15.8:0/2110513299 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f370c16c830 con 0x7f370c0cfee0 2023-10-06T04:36:53.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.880+0000 7f3713aa2700 1 -- 172.21.15.8:0/2110513299 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f370c071550 con 0x7f370c0cfee0 2023-10-06T04:36:53.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.881+0000 7f3709ffb700 1 -- 172.21.15.8:0/2110513299 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3704003040 con 0x7f370c0cfee0 2023-10-06T04:36:53.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.881+0000 7f3709ffb700 1 --2- 172.21.15.8:0/2110513299 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f36f8066f30 0x7f36f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:53.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.881+0000 7f3709ffb700 1 -- 172.21.15.8:0/2110513299 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f3704086120 con 0x7f370c0cfee0 2023-10-06T04:36:53.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.881+0000 7f371103d700 1 --2- 172.21.15.8:0/2110513299 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f36f8066f30 0x7f36f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:53.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.882+0000 7f371103d700 1 --2- 172.21.15.8:0/2110513299 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f36f8066f30 0x7f36f80693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f370c16a6f0 tx=0x7f3700008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:53.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:53.886+0000 7f3709ffb700 1 -- 172.21.15.8:0/2110513299 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3704052f40 con 0x7f370c0cfee0 2023-10-06T04:36:54.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.078+0000 7f3713aa2700 1 -- 172.21.15.8:0/2110513299 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f370c0b3570 con 0x7f370c0cfee0 2023-10-06T04:36:54.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.078+0000 7f3709ffb700 1 -- 172.21.15.8:0/2110513299 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3704056560 con 0x7f370c0cfee0 2023-10-06T04:36:54.081 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-06T04:36:54.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.080+0000 7f3713aa2700 1 -- 172.21.15.8:0/2110513299 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f36f8066f30 msgr2=0x7f36f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:54.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.081+0000 7f3713aa2700 1 --2- 172.21.15.8:0/2110513299 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f36f8066f30 0x7f36f80693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f370c16a6f0 tx=0x7f3700008040 comp rx=0 tx=0).stop 2023-10-06T04:36:54.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.081+0000 7f3713aa2700 1 -- 172.21.15.8:0/2110513299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f370c0cfee0 msgr2=0x7f370c16c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:54.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.081+0000 7f3713aa2700 1 --2- 172.21.15.8:0/2110513299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f370c0cfee0 0x7f370c16c2f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3704009430 tx=0x7f3704018000 comp rx=0 tx=0).stop 2023-10-06T04:36:54.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.081+0000 7f3713aa2700 1 -- 172.21.15.8:0/2110513299 shutdown_connections 2023-10-06T04:36:54.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.081+0000 7f3713aa2700 1 --2- 172.21.15.8:0/2110513299 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f36f8066f30 0x7f36f80693e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:54.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.081+0000 7f3713aa2700 1 --2- 172.21.15.8:0/2110513299 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f370c1430c0 0x7f370c0c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:54.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.081+0000 7f3713aa2700 1 --2- 172.21.15.8:0/2110513299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f370c0cfee0 0x7f370c16c2f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:54.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.081+0000 7f3713aa2700 1 --2- 172.21.15.8:0/2110513299 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f370c142cf0 0x7f370c0c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:54.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.081+0000 7f3713aa2700 1 -- 172.21.15.8:0/2110513299 >> 172.21.15.8:0/2110513299 conn(0x7f370c06ed00 msgr2=0x7f370c0afee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:54.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.081+0000 7f3713aa2700 1 -- 172.21.15.8:0/2110513299 shutdown_connections 2023-10-06T04:36:54.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.081+0000 7f3713aa2700 1 -- 172.21.15.8:0/2110513299 wait complete. 2023-10-06T04:36:54.096 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T04:36:54.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.216+0000 7f0e5e747700 1 Processor -- start 2023-10-06T04:36:54.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.216+0000 7f0e5e747700 1 -- start start 2023-10-06T04:36:54.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.217+0000 7f0e5e747700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0e58157410 0x7f0e5806eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:54.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.217+0000 7f0e5e747700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f0e580b24b0 0x7f0e580af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:54.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.217+0000 7f0e5e747700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e580681e0 con 0x7f0e580afd10 2023-10-06T04:36:54.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.217+0000 7f0e5e747700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e580675d0 con 0x7f0e58157410 2023-10-06T04:36:54.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.217+0000 7f0e5e747700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e580678b0 con 0x7f0e580b24b0 2023-10-06T04:36:54.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.217+0000 7f0e57fff700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0e58157410 0x7f0e5806eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:54.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.217+0000 7f0e57fff700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0e58157410 0x7f0e5806eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49842/0 (socket says 172.21.15.8:49842) 2023-10-06T04:36:54.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.217+0000 7f0e57fff700 1 -- 172.21.15.8:0/4191443081 learned_addr learned my addr 172.21.15.8:0/4191443081 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:54.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.217+0000 7f0e577fe700 1 --2- 172.21.15.8:0/4191443081 >> v2:172.21.15.184:3300/0 conn(0x7f0e580b24b0 0x7f0e580af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:54.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.217+0000 7f0e57fff700 1 -- 172.21.15.8:0/4191443081 >> v2:172.21.15.184:3300/0 conn(0x7f0e580b24b0 msgr2=0x7f0e580af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:54.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.217+0000 7f0e57fff700 1 --2- 172.21.15.8:0/4191443081 >> v2:172.21.15.184:3300/0 conn(0x7f0e580b24b0 0x7f0e580af7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:54.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.217+0000 7f0e57fff700 1 -- 172.21.15.8:0/4191443081 >> v1:172.21.15.184:6789/0 conn(0x7f0e580afd10 legacy=0x7f0e58068670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:54.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.217+0000 7f0e57fff700 1 -- 172.21.15.8:0/4191443081 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e58067b90 con 0x7f0e58157410 2023-10-06T04:36:54.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.217+0000 7f0e57fff700 1 --2- 172.21.15.8:0/4191443081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e58157410 0x7f0e5806eae0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0e480099b0 tx=0x7f0e48009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=405def862cba175b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:54.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.217+0000 7f0e56ffd700 1 -- 172.21.15.8:0/4191443081 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4800b820 con 0x7f0e58157410 2023-10-06T04:36:54.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.218+0000 7f0e56ffd700 1 -- 172.21.15.8:0/4191443081 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4800b980 con 0x7f0e58157410 2023-10-06T04:36:54.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.218+0000 7f0e56ffd700 1 -- 172.21.15.8:0/4191443081 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4800bd20 con 0x7f0e58157410 2023-10-06T04:36:54.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.218+0000 7f0e5e747700 1 -- 172.21.15.8:0/4191443081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e58157410 msgr2=0x7f0e5806eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:54.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.218+0000 7f0e5e747700 1 --2- 172.21.15.8:0/4191443081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e58157410 0x7f0e5806eae0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0e480099b0 tx=0x7f0e48009250 comp rx=0 tx=0).stop 2023-10-06T04:36:54.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.218+0000 7f0e5e747700 1 -- 172.21.15.8:0/4191443081 shutdown_connections 2023-10-06T04:36:54.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.218+0000 7f0e5e747700 1 --2- 172.21.15.8:0/4191443081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e58157410 0x7f0e5806eae0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:54.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.218+0000 7f0e5e747700 1 --2- 172.21.15.8:0/4191443081 >> v2:172.21.15.184:3300/0 conn(0x7f0e580b24b0 0x7f0e580af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:54.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.218+0000 7f0e5e747700 1 -- 172.21.15.8:0/4191443081 >> 172.21.15.8:0/4191443081 conn(0x7f0e580cc8e0 msgr2=0x7f0e580ccce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:54.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.218+0000 7f0e5e747700 1 -- 172.21.15.8:0/4191443081 shutdown_connections 2023-10-06T04:36:54.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.218+0000 7f0e5e747700 1 -- 172.21.15.8:0/4191443081 wait complete. 2023-10-06T04:36:54.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.219+0000 7f0e5e747700 1 Processor -- start 2023-10-06T04:36:54.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.219+0000 7f0e5e747700 1 -- start start 2023-10-06T04:36:54.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.220+0000 7f0e5e747700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e580afd10 0x7f0e5815b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:54.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.220+0000 7f0e5e747700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0e580b24b0 0x7f0e5814c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:54.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.220+0000 7f0e5e747700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e58157410 0x7f0e580c4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:54.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.220+0000 7f0e5e747700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e580c3df0 con 0x7f0e58157410 2023-10-06T04:36:54.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.220+0000 7f0e5e747700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e580c40d0 con 0x7f0e580afd10 2023-10-06T04:36:54.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.220+0000 7f0e5e747700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e580c43b0 con 0x7f0e580b24b0 2023-10-06T04:36:54.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.220+0000 7f0e5cce4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e58157410 0x7f0e580c4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:54.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.220+0000 7f0e5cce4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e58157410 0x7f0e580c4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49858/0 (socket says 172.21.15.8:49858) 2023-10-06T04:36:54.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.220+0000 7f0e5cce4700 1 -- 172.21.15.8:0/793472035 learned_addr learned my addr 172.21.15.8:0/793472035 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:54.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.220+0000 7f0e577fe700 1 --2- 172.21.15.8:0/793472035 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0e580b24b0 0x7f0e5814c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:54.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.220+0000 7f0e57fff700 1 --2- 172.21.15.8:0/793472035 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e580afd10 0x7f0e5815b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:54.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.220+0000 7f0e5cce4700 1 -- 172.21.15.8:0/793472035 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0e580b24b0 msgr2=0x7f0e5814c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:54.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.221+0000 7f0e5cce4700 1 --2- 172.21.15.8:0/793472035 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0e580b24b0 0x7f0e5814c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:54.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.221+0000 7f0e5cce4700 1 -- 172.21.15.8:0/793472035 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e580afd10 msgr2=0x7f0e5815b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:54.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.221+0000 7f0e5cce4700 1 --2- 172.21.15.8:0/793472035 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e580afd10 0x7f0e5815b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:54.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.221+0000 7f0e5cce4700 1 -- 172.21.15.8:0/793472035 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e480094f0 con 0x7f0e58157410 2023-10-06T04:36:54.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.221+0000 7f0e5cce4700 1 --2- 172.21.15.8:0/793472035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e58157410 0x7f0e580c4e90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000c8e0 tx=0x7f0e50001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:54.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.221+0000 7f0e3ffff700 1 -- 172.21.15.8:0/793472035 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e50012630 con 0x7f0e58157410 2023-10-06T04:36:54.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.221+0000 7f0e3ffff700 1 -- 172.21.15.8:0/793472035 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e50012790 con 0x7f0e58157410 2023-10-06T04:36:54.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.221+0000 7f0e5e747700 1 -- 172.21.15.8:0/793472035 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e580c4690 con 0x7f0e58157410 2023-10-06T04:36:54.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.221+0000 7f0e3ffff700 1 -- 172.21.15.8:0/793472035 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e50012b50 con 0x7f0e58157410 2023-10-06T04:36:54.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.221+0000 7f0e5e747700 1 -- 172.21.15.8:0/793472035 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e5815b8e0 con 0x7f0e58157410 2023-10-06T04:36:54.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.222+0000 7f0e5e747700 1 -- 172.21.15.8:0/793472035 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e580c4bb0 con 0x7f0e58157410 2023-10-06T04:36:54.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.222+0000 7f0e3ffff700 1 -- 172.21.15.8:0/793472035 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e5001a3a0 con 0x7f0e58157410 2023-10-06T04:36:54.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.223+0000 7f0e3ffff700 1 --2- 172.21.15.8:0/793472035 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f0e44066f30 0x7f0e440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:54.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.223+0000 7f0e3ffff700 1 -- 172.21.15.8:0/793472035 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0e50084ac0 con 0x7f0e58157410 2023-10-06T04:36:54.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.223+0000 7f0e57fff700 1 --2- 172.21.15.8:0/793472035 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f0e44066f30 0x7f0e440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:54.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.224+0000 7f0e57fff700 1 --2- 172.21.15.8:0/793472035 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f0e44066f30 0x7f0e440693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0e480099b0 tx=0x7f0e48017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:54.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.227+0000 7f0e3ffff700 1 -- 172.21.15.8:0/793472035 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e580c4bb0 con 0x7f0e58157410 2023-10-06T04:36:54.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.419+0000 7f0e5e747700 1 -- 172.21.15.8:0/793472035 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0e580c4b80 con 0x7f0e58157410 2023-10-06T04:36:54.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.420+0000 7f0e3ffff700 1 -- 172.21.15.8:0/793472035 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0e50055370 con 0x7f0e58157410 2023-10-06T04:36:54.422 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-06T04:36:54.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.422+0000 7f0e5e747700 1 -- 172.21.15.8:0/793472035 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f0e44066f30 msgr2=0x7f0e440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:54.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.422+0000 7f0e5e747700 1 --2- 172.21.15.8:0/793472035 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f0e44066f30 0x7f0e440693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0e480099b0 tx=0x7f0e48017000 comp rx=0 tx=0).stop 2023-10-06T04:36:54.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.422+0000 7f0e5e747700 1 -- 172.21.15.8:0/793472035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e58157410 msgr2=0x7f0e580c4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:54.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.422+0000 7f0e5e747700 1 --2- 172.21.15.8:0/793472035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e58157410 0x7f0e580c4e90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000c8e0 tx=0x7f0e50001710 comp rx=0 tx=0).stop 2023-10-06T04:36:54.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.422+0000 7f0e5e747700 1 -- 172.21.15.8:0/793472035 shutdown_connections 2023-10-06T04:36:54.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.422+0000 7f0e5e747700 1 --2- 172.21.15.8:0/793472035 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f0e44066f30 0x7f0e440693e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:54.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.422+0000 7f0e5e747700 1 --2- 172.21.15.8:0/793472035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e58157410 0x7f0e580c4e90 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:54.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.422+0000 7f0e5e747700 1 --2- 172.21.15.8:0/793472035 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e580afd10 0x7f0e5815b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:54.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.422+0000 7f0e5e747700 1 --2- 172.21.15.8:0/793472035 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0e580b24b0 0x7f0e5814c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:54.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.422+0000 7f0e5e747700 1 -- 172.21.15.8:0/793472035 >> 172.21.15.8:0/793472035 conn(0x7f0e580cc8e0 msgr2=0x7f0e58069e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:54.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.422+0000 7f0e5e747700 1 -- 172.21.15.8:0/793472035 shutdown_connections 2023-10-06T04:36:54.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.422+0000 7f0e5e747700 1 -- 172.21.15.8:0/793472035 wait complete. 2023-10-06T04:36:54.437 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:36:54.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.554+0000 7f3d20b55700 1 Processor -- start 2023-10-06T04:36:54.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.554+0000 7f3d20b55700 1 -- start start 2023-10-06T04:36:54.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.555+0000 7f3d20b55700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d1c0cb360 0x7f3d1c0d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:54.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.555+0000 7f3d20b55700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d1c0cc4c0 con 0x7f3d1c0af680 2023-10-06T04:36:54.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.555+0000 7f3d20b55700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d1c0cb8b0 con 0x7f3d1c0d08d0 2023-10-06T04:36:54.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.555+0000 7f3d20b55700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1c15d460 con 0x7f3d1c0cb360 2023-10-06T04:36:54.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.555+0000 7f3d1a59c700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f3d1c0af680 0x7f3d1c15e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60848/0 (socket says 172.21.15.8:60848) 2023-10-06T04:36:54.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.555+0000 7f3d1a59c700 1 -- 172.21.15.8:0/2039682975 learned_addr learned my addr 172.21.15.8:0/2039682975 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:54.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.555+0000 7f3d19d9b700 1 --2- 172.21.15.8:0/2039682975 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d1c0cb360 0x7f3d1c0d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:54.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.555+0000 7f3d1959a700 1 -- 172.21.15.8:0/2039682975 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 819667738 0 0) 0x7f3d1c0cc4c0 con 0x7f3d1c0af680 2023-10-06T04:36:54.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.555+0000 7f3d1959a700 1 -- 172.21.15.8:0/2039682975 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d04003570 con 0x7f3d1c0af680 2023-10-06T04:36:54.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.555+0000 7f3d1959a700 1 -- 172.21.15.8:0/2039682975 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3986953371 0 0) 0x7f3d04003570 con 0x7f3d1c0af680 2023-10-06T04:36:54.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.555+0000 7f3d1959a700 1 -- 172.21.15.8:0/2039682975 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d1c0cb360 msgr2=0x7f3d1c0d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:54.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.555+0000 7f3d1959a700 1 --2- 172.21.15.8:0/2039682975 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d1c0cb360 0x7f3d1c0d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:54.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.555+0000 7f3d1959a700 1 -- 172.21.15.8:0/2039682975 >> v1:172.21.15.184:6789/0 conn(0x7f3d1c0d08d0 legacy=0x7f3d1c0cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:54.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.555+0000 7f3d1959a700 1 -- 172.21.15.8:0/2039682975 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d1c0cbb90 con 0x7f3d1c0af680 2023-10-06T04:36:54.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.555+0000 7f3d1959a700 1 -- 172.21.15.8:0/2039682975 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7f3d0c0017f0 con 0x7f3d1c0af680 2023-10-06T04:36:54.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.555+0000 7f3d1959a700 1 -- 172.21.15.8:0/2039682975 >> v1:172.21.15.8:6789/0 conn(0x7f3d1c0af680 legacy=0x7f3d1c15e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:54.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.555+0000 7f3d1959a700 1 --2- 172.21.15.8:0/2039682975 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d04003a90 0x7f3d04003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:54.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.555+0000 7f3d1959a700 1 --2- 172.21.15.8:0/2039682975 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d04004810 0x7f3d04004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:54.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.555+0000 7f3d1959a700 1 --2- 172.21.15.8:0/2039682975 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d1c0cb360 0x7f3d040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:54.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.555+0000 7f3d1959a700 1 -- 172.21.15.8:0/2039682975 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1c15d460 con 0x7f3d04003a90 2023-10-06T04:36:54.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.555+0000 7f3d1959a700 1 -- 172.21.15.8:0/2039682975 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0400bb10 con 0x7f3d04004810 2023-10-06T04:36:54.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.555+0000 7f3d1959a700 1 -- 172.21.15.8:0/2039682975 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0400bcd0 con 0x7f3d1c0cb360 2023-10-06T04:36:54.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.556+0000 7f3d1a59c700 1 --2- 172.21.15.8:0/2039682975 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d04003a90 0x7f3d04003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:54.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.556+0000 7f3d19d9b700 1 --2- 172.21.15.8:0/2039682975 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d04004810 0x7f3d04004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:54.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.556+0000 7f3d1ad9d700 1 --2- 172.21.15.8:0/2039682975 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d1c0cb360 0x7f3d040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:54.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.556+0000 7f3d1a59c700 1 -- 172.21.15.8:0/2039682975 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d1c0cb360 msgr2=0x7f3d040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:54.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.556+0000 7f3d1a59c700 1 --2- 172.21.15.8:0/2039682975 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d1c0cb360 0x7f3d040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:54.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.556+0000 7f3d1a59c700 1 -- 172.21.15.8:0/2039682975 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d04004810 msgr2=0x7f3d04004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:54.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.556+0000 7f3d1a59c700 1 --2- 172.21.15.8:0/2039682975 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d04004810 0x7f3d04004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:54.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.556+0000 7f3d1a59c700 1 -- 172.21.15.8:0/2039682975 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d04003570 con 0x7f3d04003a90 2023-10-06T04:36:54.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.556+0000 7f3d1a59c700 1 --2- 172.21.15.8:0/2039682975 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d04003a90 0x7f3d04003e60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c00a950 tx=0x7f3d0c0021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d50e1255cae77d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:54.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.556+0000 7f3d1959a700 1 -- 172.21.15.8:0/2039682975 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c0070d0 con 0x7f3d04003a90 2023-10-06T04:36:54.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.556+0000 7f3d1959a700 1 -- 172.21.15.8:0/2039682975 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0c007250 con 0x7f3d04003a90 2023-10-06T04:36:54.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.556+0000 7f3d1959a700 1 -- 172.21.15.8:0/2039682975 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c007610 con 0x7f3d04003a90 2023-10-06T04:36:54.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.557+0000 7f3d20b55700 1 -- 172.21.15.8:0/2039682975 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d04003a90 msgr2=0x7f3d04003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:54.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.557+0000 7f3d20b55700 1 --2- 172.21.15.8:0/2039682975 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d04003a90 0x7f3d04003e60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c00a950 tx=0x7f3d0c0021f0 comp rx=0 tx=0).stop 2023-10-06T04:36:54.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.557+0000 7f3d1ad9d700 1 -- 172.21.15.8:0/2039682975 reap_dead start 2023-10-06T04:36:54.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.557+0000 7f3d20b55700 1 -- 172.21.15.8:0/2039682975 shutdown_connections 2023-10-06T04:36:54.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.557+0000 7f3d20b55700 1 -- 172.21.15.8:0/2039682975 >> 172.21.15.8:0/2039682975 conn(0x7f3d1c0633d0 msgr2=0x7f3d1c0637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:54.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.557+0000 7f3d20b55700 1 -- 172.21.15.8:0/2039682975 shutdown_connections 2023-10-06T04:36:54.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.557+0000 7f3d20b55700 1 -- 172.21.15.8:0/2039682975 wait complete. 2023-10-06T04:36:54.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.558+0000 7f3d20b55700 1 Processor -- start 2023-10-06T04:36:54.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.558+0000 7f3d20b55700 1 -- start start 2023-10-06T04:36:54.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.559+0000 7f3d20b55700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d04003a90 0x7f3d1c0ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:54.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.559+0000 7f3d20b55700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d1c15cb80 0x7f3d1c0c3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:54.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.559+0000 7f3d20b55700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d1c0c42c0 0x7f3d1c0c4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:54.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.559+0000 7f3d20b55700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1c0c4c50 con 0x7f3d1c15cb80 2023-10-06T04:36:54.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.559+0000 7f3d20b55700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1c0c4fc0 con 0x7f3d1c0c42c0 2023-10-06T04:36:54.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.559+0000 7f3d20b55700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1c0c7840 con 0x7f3d04003a90 2023-10-06T04:36:54.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.559+0000 7f3d19d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d1c15cb80 0x7f3d1c0c3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:54.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.559+0000 7f3d19d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d1c15cb80 0x7f3d1c0c3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49884/0 (socket says 172.21.15.8:49884) 2023-10-06T04:36:54.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.559+0000 7f3d19d9b700 1 -- 172.21.15.8:0/4127730715 learned_addr learned my addr 172.21.15.8:0/4127730715 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:54.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.559+0000 7f3d1a59c700 1 --2- 172.21.15.8:0/4127730715 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d04003a90 0x7f3d1c0ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:54.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.559+0000 7f3d1ad9d700 1 --2- 172.21.15.8:0/4127730715 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d1c0c42c0 0x7f3d1c0c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:54.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.559+0000 7f3d19d9b700 1 -- 172.21.15.8:0/4127730715 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d04003a90 msgr2=0x7f3d1c0ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:54.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.559+0000 7f3d19d9b700 1 --2- 172.21.15.8:0/4127730715 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d04003a90 0x7f3d1c0ca040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:54.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.559+0000 7f3d19d9b700 1 -- 172.21.15.8:0/4127730715 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d1c0c42c0 msgr2=0x7f3d1c0c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:54.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.559+0000 7f3d19d9b700 1 --2- 172.21.15.8:0/4127730715 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d1c0c42c0 0x7f3d1c0c4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:54.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.559+0000 7f3d19d9b700 1 -- 172.21.15.8:0/4127730715 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d1c0ca580 con 0x7f3d1c15cb80 2023-10-06T04:36:54.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.559+0000 7f3d1a59c700 1 --2- 172.21.15.8:0/4127730715 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d04003a90 0x7f3d1c0ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:54.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.559+0000 7f3d1ad9d700 1 --2- 172.21.15.8:0/4127730715 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d1c0c42c0 0x7f3d1c0c4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:54.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.560+0000 7f3d19d9b700 1 --2- 172.21.15.8:0/4127730715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d1c15cb80 0x7f3d1c0c3d80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3d10011da0 tx=0x7f3d100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:54.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.560+0000 7f3d0a7fc700 1 -- 172.21.15.8:0/4127730715 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d10009e20 con 0x7f3d1c15cb80 2023-10-06T04:36:54.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.560+0000 7f3d0a7fc700 1 -- 172.21.15.8:0/4127730715 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1000fcd0 con 0x7f3d1c15cb80 2023-10-06T04:36:54.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.560+0000 7f3d20b55700 1 -- 172.21.15.8:0/4127730715 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d1c0c9880 con 0x7f3d1c15cb80 2023-10-06T04:36:54.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.560+0000 7f3d0a7fc700 1 -- 172.21.15.8:0/4127730715 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d10014650 con 0x7f3d1c15cb80 2023-10-06T04:36:54.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.560+0000 7f3d20b55700 1 -- 172.21.15.8:0/4127730715 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d1c0c9b20 con 0x7f3d1c15cb80 2023-10-06T04:36:54.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.561+0000 7f3d20b55700 1 -- 172.21.15.8:0/4127730715 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d1c071550 con 0x7f3d1c15cb80 2023-10-06T04:36:54.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.561+0000 7f3d0a7fc700 1 -- 172.21.15.8:0/4127730715 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d10014a80 con 0x7f3d1c15cb80 2023-10-06T04:36:54.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.562+0000 7f3d0a7fc700 1 --2- 172.21.15.8:0/4127730715 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3cfc066f30 0x7f3cfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:54.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.562+0000 7f3d0a7fc700 1 -- 172.21.15.8:0/4127730715 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f3d10018030 con 0x7f3d1c15cb80 2023-10-06T04:36:54.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.562+0000 7f3d1a59c700 1 --2- 172.21.15.8:0/4127730715 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3cfc066f30 0x7f3cfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:54.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.562+0000 7f3d1a59c700 1 --2- 172.21.15.8:0/4127730715 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3cfc066f30 0x7f3cfc0693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c00a410 tx=0x7f3d0c015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:54.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.566+0000 7f3d0a7fc700 1 -- 172.21.15.8:0/4127730715 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d10052210 con 0x7f3d1c15cb80 2023-10-06T04:36:54.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.759+0000 7f3d20b55700 1 -- 172.21.15.8:0/4127730715 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d1c0c7980 con 0x7f3d1c15cb80 2023-10-06T04:36:54.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.760+0000 7f3d0a7fc700 1 -- 172.21.15.8:0/4127730715 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f3d10059e60 con 0x7f3d1c15cb80 2023-10-06T04:36:54.763 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:36:54.763 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":25,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:36:21.690266+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:36:10.148177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:36:10.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:36:14.390671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:36:15.601089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:36:19.291300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.555871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.490505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.504578+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.517217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:05.991135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.537329+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.543232+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.443715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:36:54.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.762+0000 7f3d20b55700 1 -- 172.21.15.8:0/4127730715 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3cfc066f30 msgr2=0x7f3cfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:54.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.762+0000 7f3d20b55700 1 --2- 172.21.15.8:0/4127730715 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3cfc066f30 0x7f3cfc0693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c00a410 tx=0x7f3d0c015000 comp rx=0 tx=0).stop 2023-10-06T04:36:54.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.762+0000 7f3d20b55700 1 -- 172.21.15.8:0/4127730715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d1c15cb80 msgr2=0x7f3d1c0c3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:54.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.762+0000 7f3d20b55700 1 --2- 172.21.15.8:0/4127730715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d1c15cb80 0x7f3d1c0c3d80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3d10011da0 tx=0x7f3d100091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:54.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.762+0000 7f3d20b55700 1 -- 172.21.15.8:0/4127730715 shutdown_connections 2023-10-06T04:36:54.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.762+0000 7f3d20b55700 1 --2- 172.21.15.8:0/4127730715 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3cfc066f30 0x7f3cfc0693e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:54.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.762+0000 7f3d20b55700 1 --2- 172.21.15.8:0/4127730715 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d1c0c42c0 0x7f3d1c0c4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:54.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.762+0000 7f3d20b55700 1 --2- 172.21.15.8:0/4127730715 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d04003a90 0x7f3d1c0ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:54.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.762+0000 7f3d20b55700 1 --2- 172.21.15.8:0/4127730715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d1c15cb80 0x7f3d1c0c3d80 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:54.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.762+0000 7f3d20b55700 1 -- 172.21.15.8:0/4127730715 >> 172.21.15.8:0/4127730715 conn(0x7f3d1c0633d0 msgr2=0x7f3d1c0cc850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:54.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.763+0000 7f3d20b55700 1 -- 172.21.15.8:0/4127730715 shutdown_connections 2023-10-06T04:36:54.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.763+0000 7f3d20b55700 1 -- 172.21.15.8:0/4127730715 wait complete. 2023-10-06T04:36:54.777 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:36:10.148177+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:36:10.684157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:36:14.390671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:36:15.601089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T04:36:19.291300+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:36:54.778 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:36:54.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.898+0000 7fc869b2e700 1 Processor -- start 2023-10-06T04:36:54.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.898+0000 7fc869b2e700 1 -- start start 2023-10-06T04:36:54.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.899+0000 7fc869b2e700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc864142cf0 0x7fc8640b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:54.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.899+0000 7fc869b2e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8641430c0 0x7fc8640cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:54.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.899+0000 7fc869b2e700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8640cf510 con 0x7fc8640cfee0 2023-10-06T04:36:54.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.899+0000 7fc869b2e700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8640ce6a0 con 0x7fc864142cf0 2023-10-06T04:36:54.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.899+0000 7fc869b2e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8640ce900 con 0x7fc8641430c0 2023-10-06T04:36:54.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.899+0000 7fc8637fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc864142cf0 0x7fc8640b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:54.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.899+0000 7fc863fff700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fc8640cfee0 0x7fc8640b3790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60858/0 (socket says 172.21.15.8:60858) 2023-10-06T04:36:54.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.899+0000 7fc863fff700 1 -- 172.21.15.8:0/335053634 learned_addr learned my addr 172.21.15.8:0/335053634 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:54.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.899+0000 7fc862ffd700 1 --2- 172.21.15.8:0/335053634 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8641430c0 0x7fc8640cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:54.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.899+0000 7fc8637fe700 1 -- 172.21.15.8:0/335053634 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8641430c0 msgr2=0x7fc8640cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:54.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.899+0000 7fc8637fe700 1 --2- 172.21.15.8:0/335053634 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8641430c0 0x7fc8640cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:54.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.899+0000 7fc8637fe700 1 -- 172.21.15.8:0/335053634 >> v1:172.21.15.8:6789/0 conn(0x7fc8640cfee0 legacy=0x7fc8640b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:54.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.899+0000 7fc8627fc700 1 -- 172.21.15.8:0/335053634 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3294405113 0 0) 0x7fc8640cf510 con 0x7fc8640cfee0 2023-10-06T04:36:54.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.899+0000 7fc8637fe700 1 -- 172.21.15.8:0/335053634 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8640cebe0 con 0x7fc864142cf0 2023-10-06T04:36:54.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.899+0000 7fc8637fe700 1 --2- 172.21.15.8:0/335053634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc864142cf0 0x7fc8640b5cd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc8540098e0 tx=0x7fc8540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6b360ebfaa19bf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:54.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.900+0000 7fc8627fc700 1 -- 172.21.15.8:0/335053634 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc854009e80 con 0x7fc864142cf0 2023-10-06T04:36:54.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.900+0000 7fc8627fc700 1 -- 172.21.15.8:0/335053634 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85400b860 con 0x7fc864142cf0 2023-10-06T04:36:54.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.900+0000 7fc8627fc700 1 -- 172.21.15.8:0/335053634 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85400bbe0 con 0x7fc864142cf0 2023-10-06T04:36:54.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.900+0000 7fc869b2e700 1 -- 172.21.15.8:0/335053634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc864142cf0 msgr2=0x7fc8640b5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:54.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.900+0000 7fc869b2e700 1 --2- 172.21.15.8:0/335053634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc864142cf0 0x7fc8640b5cd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc8540098e0 tx=0x7fc8540091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:54.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.900+0000 7fc869b2e700 1 -- 172.21.15.8:0/335053634 shutdown_connections 2023-10-06T04:36:54.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.900+0000 7fc869b2e700 1 --2- 172.21.15.8:0/335053634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc864142cf0 0x7fc8640b5cd0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:54.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.900+0000 7fc869b2e700 1 --2- 172.21.15.8:0/335053634 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8641430c0 0x7fc8640cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:54.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.900+0000 7fc869b2e700 1 -- 172.21.15.8:0/335053634 >> 172.21.15.8:0/335053634 conn(0x7fc86406ed00 msgr2=0x7fc86406f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:54.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.900+0000 7fc869b2e700 1 -- 172.21.15.8:0/335053634 shutdown_connections 2023-10-06T04:36:54.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.900+0000 7fc869b2e700 1 -- 172.21.15.8:0/335053634 wait complete. 2023-10-06T04:36:54.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.901+0000 7fc869b2e700 1 Processor -- start 2023-10-06T04:36:54.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.902+0000 7fc869b2e700 1 -- start start 2023-10-06T04:36:54.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.902+0000 7fc869b2e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8640cfee0 0x7fc864169bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:54.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.902+0000 7fc869b2e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc864142cf0 0x7fc86416c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:54.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.902+0000 7fc869b2e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8641430c0 0x7fc86416cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:54.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.902+0000 7fc869b2e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86416a130 con 0x7fc8641430c0 2023-10-06T04:36:54.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.902+0000 7fc869b2e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86416d4f0 con 0x7fc864142cf0 2023-10-06T04:36:54.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.902+0000 7fc869b2e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8640c64d0 con 0x7fc8640cfee0 2023-10-06T04:36:54.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.902+0000 7fc863fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8641430c0 0x7fc86416cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:54.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.902+0000 7fc863fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8641430c0 0x7fc86416cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49896/0 (socket says 172.21.15.8:49896) 2023-10-06T04:36:54.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.902+0000 7fc863fff700 1 -- 172.21.15.8:0/3253724463 learned_addr learned my addr 172.21.15.8:0/3253724463 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:54.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.902+0000 7fc862ffd700 1 --2- 172.21.15.8:0/3253724463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc864142cf0 0x7fc86416c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:54.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.902+0000 7fc8637fe700 1 --2- 172.21.15.8:0/3253724463 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8640cfee0 0x7fc864169bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:54.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.903+0000 7fc863fff700 1 -- 172.21.15.8:0/3253724463 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8640cfee0 msgr2=0x7fc864169bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:54.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.903+0000 7fc863fff700 1 --2- 172.21.15.8:0/3253724463 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8640cfee0 0x7fc864169bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:54.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.903+0000 7fc863fff700 1 -- 172.21.15.8:0/3253724463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc864142cf0 msgr2=0x7fc86416c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:54.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.903+0000 7fc863fff700 1 --2- 172.21.15.8:0/3253724463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc864142cf0 0x7fc86416c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:54.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.903+0000 7fc863fff700 1 -- 172.21.15.8:0/3253724463 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc854009420 con 0x7fc8641430c0 2023-10-06T04:36:54.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.903+0000 7fc862ffd700 1 --2- 172.21.15.8:0/3253724463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc864142cf0 0x7fc86416c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:54.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.903+0000 7fc8637fe700 1 --2- 172.21.15.8:0/3253724463 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8640cfee0 0x7fc864169bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:54.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.903+0000 7fc863fff700 1 --2- 172.21.15.8:0/3253724463 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8641430c0 0x7fc86416cc40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc85c00ccc0 tx=0x7fc85c001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:54.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.903+0000 7fc84b7fe700 1 -- 172.21.15.8:0/3253724463 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85c00ab10 con 0x7fc8641430c0 2023-10-06T04:36:54.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.903+0000 7fc84b7fe700 1 -- 172.21.15.8:0/3253724463 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85c00ac70 con 0x7fc8641430c0 2023-10-06T04:36:54.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.903+0000 7fc869b2e700 1 -- 172.21.15.8:0/3253724463 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8640c6810 con 0x7fc8641430c0 2023-10-06T04:36:54.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.903+0000 7fc84b7fe700 1 -- 172.21.15.8:0/3253724463 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85c0070f0 con 0x7fc8641430c0 2023-10-06T04:36:54.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.903+0000 7fc869b2e700 1 -- 172.21.15.8:0/3253724463 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8640c6a90 con 0x7fc8641430c0 2023-10-06T04:36:54.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.904+0000 7fc869b2e700 1 -- 172.21.15.8:0/3253724463 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc864071550 con 0x7fc8641430c0 2023-10-06T04:36:54.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.904+0000 7fc84b7fe700 1 -- 172.21.15.8:0/3253724463 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc85c007520 con 0x7fc8641430c0 2023-10-06T04:36:54.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.905+0000 7fc84b7fe700 1 --2- 172.21.15.8:0/3253724463 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc850066f30 0x7fc8500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:54.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.905+0000 7fc84b7fe700 1 -- 172.21.15.8:0/3253724463 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fc85c084dd0 con 0x7fc8641430c0 2023-10-06T04:36:54.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.905+0000 7fc8637fe700 1 --2- 172.21.15.8:0/3253724463 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc850066f30 0x7fc8500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:54.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.906+0000 7fc8637fe700 1 --2- 172.21.15.8:0/3253724463 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc850066f30 0x7fc8500693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc8540091e0 tx=0x7fc854017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:54.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:54.909+0000 7fc84b7fe700 1 -- 172.21.15.8:0/3253724463 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc85c051c70 con 0x7fc8641430c0 2023-10-06T04:36:54.991 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:36:54.993 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:36:55.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.107+0000 7fc869b2e700 1 -- 172.21.15.8:0/3253724463 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc8640ceec0 con 0x7fc8641430c0 2023-10-06T04:36:55.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.108+0000 7fc84b7fe700 1 -- 172.21.15.8:0/3253724463 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc85c0860a0 con 0x7fc8641430c0 2023-10-06T04:36:55.110 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 8 2023-10-06T04:36:55.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.109+0000 7fc869b2e700 1 -- 172.21.15.8:0/3253724463 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc850066f30 msgr2=0x7fc8500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:55.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.109+0000 7fc869b2e700 1 --2- 172.21.15.8:0/3253724463 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc850066f30 0x7fc8500693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc8540091e0 tx=0x7fc854017000 comp rx=0 tx=0).stop 2023-10-06T04:36:55.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.109+0000 7fc869b2e700 1 -- 172.21.15.8:0/3253724463 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8641430c0 msgr2=0x7fc86416cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:55.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.109+0000 7fc869b2e700 1 --2- 172.21.15.8:0/3253724463 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8641430c0 0x7fc86416cc40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc85c00ccc0 tx=0x7fc85c001a20 comp rx=0 tx=0).stop 2023-10-06T04:36:55.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.110+0000 7fc869b2e700 1 -- 172.21.15.8:0/3253724463 shutdown_connections 2023-10-06T04:36:55.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.110+0000 7fc869b2e700 1 --2- 172.21.15.8:0/3253724463 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc850066f30 0x7fc8500693e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:55.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.110+0000 7fc869b2e700 1 --2- 172.21.15.8:0/3253724463 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8641430c0 0x7fc86416cc40 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:55.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.110+0000 7fc869b2e700 1 --2- 172.21.15.8:0/3253724463 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8640cfee0 0x7fc864169bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:55.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.110+0000 7fc869b2e700 1 --2- 172.21.15.8:0/3253724463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc864142cf0 0x7fc86416c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:55.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.110+0000 7fc869b2e700 1 -- 172.21.15.8:0/3253724463 >> 172.21.15.8:0/3253724463 conn(0x7fc86406ed00 msgr2=0x7fc8640b26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:55.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.110+0000 7fc869b2e700 1 -- 172.21.15.8:0/3253724463 shutdown_connections 2023-10-06T04:36:55.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.110+0000 7fc869b2e700 1 -- 172.21.15.8:0/3253724463 wait complete. 2023-10-06T04:36:55.124 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:36:55.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.244+0000 7fe726976700 1 Processor -- start 2023-10-06T04:36:55.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.244+0000 7fe726976700 1 -- start start 2023-10-06T04:36:55.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.245+0000 7fe726976700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe720142cf0 0x7fe7200b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:55.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.245+0000 7fe726976700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe7201430c0 0x7fe7200cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:55.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.245+0000 7fe726976700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7200cfee0 0x7fe7200b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:55.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.245+0000 7fe726976700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7200cf510 con 0x7fe7201430c0 2023-10-06T04:36:55.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.245+0000 7fe726976700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7200ce6a0 con 0x7fe720142cf0 2023-10-06T04:36:55.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.245+0000 7fe726976700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7200ce900 con 0x7fe7200cfee0 2023-10-06T04:36:55.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.245+0000 7fe71f7fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe7201430c0 0x7fe7200cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:55.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.245+0000 7fe71f7fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe7201430c0 0x7fe7200cf9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49904/0 (socket says 172.21.15.8:49904) 2023-10-06T04:36:55.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.245+0000 7fe71f7fe700 1 -- 172.21.15.8:0/3590775437 learned_addr learned my addr 172.21.15.8:0/3590775437 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:55.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.245+0000 7fe724f13700 1 --2- 172.21.15.8:0/3590775437 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7200cfee0 0x7fe7200b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:55.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.245+0000 7fe71ffff700 1 --2- 172.21.15.8:0/3590775437 >> v2:172.21.15.184:3300/0 conn(0x7fe720142cf0 0x7fe7200b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:55.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.246+0000 7fe71f7fe700 1 -- 172.21.15.8:0/3590775437 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7200cfee0 msgr2=0x7fe7200b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:55.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.246+0000 7fe71f7fe700 1 --2- 172.21.15.8:0/3590775437 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7200cfee0 0x7fe7200b3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:55.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.246+0000 7fe71f7fe700 1 -- 172.21.15.8:0/3590775437 >> v2:172.21.15.184:3300/0 conn(0x7fe720142cf0 msgr2=0x7fe7200b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:55.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.246+0000 7fe71f7fe700 1 --2- 172.21.15.8:0/3590775437 >> v2:172.21.15.184:3300/0 conn(0x7fe720142cf0 0x7fe7200b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:55.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.246+0000 7fe71f7fe700 1 -- 172.21.15.8:0/3590775437 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7200cebe0 con 0x7fe7201430c0 2023-10-06T04:36:55.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.246+0000 7fe71f7fe700 1 --2- 172.21.15.8:0/3590775437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7201430c0 0x7fe7200cf9a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe720089240 tx=0x7fe710009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52771c6449f6fdbd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:55.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.246+0000 7fe71effd700 1 -- 172.21.15.8:0/3590775437 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71000b640 con 0x7fe7201430c0 2023-10-06T04:36:55.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.246+0000 7fe71effd700 1 -- 172.21.15.8:0/3590775437 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71000b7a0 con 0x7fe7201430c0 2023-10-06T04:36:55.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.246+0000 7fe71effd700 1 -- 172.21.15.8:0/3590775437 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71000bb60 con 0x7fe7201430c0 2023-10-06T04:36:55.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.246+0000 7fe726976700 1 -- 172.21.15.8:0/3590775437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7201430c0 msgr2=0x7fe7200cf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:55.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.246+0000 7fe726976700 1 --2- 172.21.15.8:0/3590775437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7201430c0 0x7fe7200cf9a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe720089240 tx=0x7fe710009250 comp rx=0 tx=0).stop 2023-10-06T04:36:55.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.247+0000 7fe726976700 1 -- 172.21.15.8:0/3590775437 shutdown_connections 2023-10-06T04:36:55.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.247+0000 7fe726976700 1 --2- 172.21.15.8:0/3590775437 >> v2:172.21.15.184:3300/0 conn(0x7fe720142cf0 0x7fe7200b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:55.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.247+0000 7fe726976700 1 --2- 172.21.15.8:0/3590775437 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7200cfee0 0x7fe7200b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:55.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.247+0000 7fe726976700 1 --2- 172.21.15.8:0/3590775437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7201430c0 0x7fe7200cf9a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:55.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.247+0000 7fe726976700 1 -- 172.21.15.8:0/3590775437 >> 172.21.15.8:0/3590775437 conn(0x7fe72006ed00 msgr2=0x7fe72006f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:55.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.247+0000 7fe726976700 1 -- 172.21.15.8:0/3590775437 shutdown_connections 2023-10-06T04:36:55.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.247+0000 7fe726976700 1 -- 172.21.15.8:0/3590775437 wait complete. 2023-10-06T04:36:55.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.248+0000 7fe726976700 1 Processor -- start 2023-10-06T04:36:55.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.248+0000 7fe726976700 1 -- start start 2023-10-06T04:36:55.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.248+0000 7fe726976700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7200cfee0 0x7fe72013e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:55.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.249+0000 7fe726976700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe720142cf0 0x7fe7200a8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:55.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.249+0000 7fe726976700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7201430c0 0x7fe72015c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:55.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.249+0000 7fe726976700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72013ece0 con 0x7fe720142cf0 2023-10-06T04:36:55.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.249+0000 7fe726976700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72015cf00 con 0x7fe7201430c0 2023-10-06T04:36:55.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.249+0000 7fe726976700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe72013f3c0 con 0x7fe7200cfee0 2023-10-06T04:36:55.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.249+0000 7fe71f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe720142cf0 0x7fe7200a8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:55.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.249+0000 7fe71f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe720142cf0 0x7fe7200a8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49906/0 (socket says 172.21.15.8:49906) 2023-10-06T04:36:55.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.249+0000 7fe71f7fe700 1 -- 172.21.15.8:0/3062143598 learned_addr learned my addr 172.21.15.8:0/3062143598 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:55.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.249+0000 7fe71ffff700 1 --2- 172.21.15.8:0/3062143598 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7200cfee0 0x7fe72013e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:55.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.249+0000 7fe724f13700 1 --2- 172.21.15.8:0/3062143598 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7201430c0 0x7fe72015c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:55.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.249+0000 7fe71f7fe700 1 -- 172.21.15.8:0/3062143598 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7200cfee0 msgr2=0x7fe72013e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:55.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.249+0000 7fe71f7fe700 1 --2- 172.21.15.8:0/3062143598 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7200cfee0 0x7fe72013e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:55.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.249+0000 7fe71f7fe700 1 -- 172.21.15.8:0/3062143598 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7201430c0 msgr2=0x7fe72015c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:55.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.249+0000 7fe71f7fe700 1 --2- 172.21.15.8:0/3062143598 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7201430c0 0x7fe72015c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:55.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.249+0000 7fe71f7fe700 1 -- 172.21.15.8:0/3062143598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7100094f0 con 0x7fe720142cf0 2023-10-06T04:36:55.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.249+0000 7fe71f7fe700 1 --2- 172.21.15.8:0/3062143598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe720142cf0 0x7fe7200a8100 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe710006fd0 tx=0x7fe710017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:55.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.249+0000 7fe717fff700 1 -- 172.21.15.8:0/3062143598 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe710000d10 con 0x7fe720142cf0 2023-10-06T04:36:55.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.249+0000 7fe717fff700 1 -- 172.21.15.8:0/3062143598 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71000bb20 con 0x7fe720142cf0 2023-10-06T04:36:55.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.249+0000 7fe726976700 1 -- 172.21.15.8:0/3062143598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe72013fc60 con 0x7fe720142cf0 2023-10-06T04:36:55.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.249+0000 7fe717fff700 1 -- 172.21.15.8:0/3062143598 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71001a6a0 con 0x7fe720142cf0 2023-10-06T04:36:55.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.249+0000 7fe726976700 1 -- 172.21.15.8:0/3062143598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7200a8640 con 0x7fe720142cf0 2023-10-06T04:36:55.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.250+0000 7fe726976700 1 -- 172.21.15.8:0/3062143598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe720071550 con 0x7fe720142cf0 2023-10-06T04:36:55.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.251+0000 7fe717fff700 1 -- 172.21.15.8:0/3062143598 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe71001aa90 con 0x7fe720142cf0 2023-10-06T04:36:55.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.251+0000 7fe717fff700 1 --2- 172.21.15.8:0/3062143598 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe700066f30 0x7fe7000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:55.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.251+0000 7fe717fff700 1 -- 172.21.15.8:0/3062143598 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe7100862c0 con 0x7fe720142cf0 2023-10-06T04:36:55.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.251+0000 7fe71ffff700 1 --2- 172.21.15.8:0/3062143598 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe700066f30 0x7fe7000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:55.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.252+0000 7fe71ffff700 1 --2- 172.21.15.8:0/3062143598 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe700066f30 0x7fe7000693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe708009d40 tx=0x7fe708008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:55.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.255+0000 7fe717fff700 1 -- 172.21.15.8:0/3062143598 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe7100530e0 con 0x7fe720142cf0 2023-10-06T04:36:55.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.449+0000 7fe726976700 1 -- 172.21.15.8:0/3062143598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe7200ceec0 con 0x7fe720142cf0 2023-10-06T04:36:55.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.449+0000 7fe717fff700 1 -- 172.21.15.8:0/3062143598 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe710056700 con 0x7fe720142cf0 2023-10-06T04:36:55.452 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-06T04:36:55.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.451+0000 7fe726976700 1 -- 172.21.15.8:0/3062143598 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe700066f30 msgr2=0x7fe7000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:55.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.451+0000 7fe726976700 1 --2- 172.21.15.8:0/3062143598 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe700066f30 0x7fe7000693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe708009d40 tx=0x7fe708008040 comp rx=0 tx=0).stop 2023-10-06T04:36:55.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.451+0000 7fe726976700 1 -- 172.21.15.8:0/3062143598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe720142cf0 msgr2=0x7fe7200a8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:55.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.451+0000 7fe726976700 1 --2- 172.21.15.8:0/3062143598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe720142cf0 0x7fe7200a8100 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe710006fd0 tx=0x7fe710017000 comp rx=0 tx=0).stop 2023-10-06T04:36:55.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.451+0000 7fe726976700 1 -- 172.21.15.8:0/3062143598 shutdown_connections 2023-10-06T04:36:55.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.451+0000 7fe726976700 1 --2- 172.21.15.8:0/3062143598 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe700066f30 0x7fe7000693e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:55.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.451+0000 7fe726976700 1 --2- 172.21.15.8:0/3062143598 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7201430c0 0x7fe72015c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:55.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.451+0000 7fe726976700 1 --2- 172.21.15.8:0/3062143598 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7200cfee0 0x7fe72013e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:55.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.451+0000 7fe726976700 1 --2- 172.21.15.8:0/3062143598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe720142cf0 0x7fe7200a8100 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:55.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.452+0000 7fe726976700 1 -- 172.21.15.8:0/3062143598 >> 172.21.15.8:0/3062143598 conn(0x7fe72006ed00 msgr2=0x7fe7200affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:55.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.452+0000 7fe726976700 1 -- 172.21.15.8:0/3062143598 shutdown_connections 2023-10-06T04:36:55.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.452+0000 7fe726976700 1 -- 172.21.15.8:0/3062143598 wait complete. 2023-10-06T04:36:55.466 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:36:55.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.585+0000 7f79732bb700 1 Processor -- start 2023-10-06T04:36:55.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.586+0000 7f79732bb700 1 -- start start 2023-10-06T04:36:55.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.586+0000 7f79732bb700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f796c06d1f0 0x7f796c142690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:55.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.586+0000 7f79732bb700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f796c1599c0 con 0x7f796c15da50 2023-10-06T04:36:55.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.586+0000 7f79732bb700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f796c068810 con 0x7f796c06d5c0 2023-10-06T04:36:55.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.586+0000 7f79732bb700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f796c15e0b0 con 0x7f796c06d1f0 2023-10-06T04:36:55.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.586+0000 7f7971057700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f796c06d1f0 0x7f796c142690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:55.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.587+0000 7f7971858700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f796c15da50 0x7f796c0695d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60864/0 (socket says 172.21.15.8:60864) 2023-10-06T04:36:55.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.587+0000 7f7971057700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f796c06d1f0 0x7f796c142690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49918/0 (socket says 172.21.15.8:49918) 2023-10-06T04:36:55.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.587+0000 7f7971858700 1 -- 172.21.15.8:0/3439134139 learned_addr learned my addr 172.21.15.8:0/3439134139 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:55.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.587+0000 7f7971057700 1 -- 172.21.15.8:0/3439134139 >> v1:172.21.15.184:6789/0 conn(0x7f796c06d5c0 legacy=0x7f796c15d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:55.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.587+0000 7f7971057700 1 -- 172.21.15.8:0/3439134139 >> v1:172.21.15.8:6789/0 conn(0x7f796c15da50 legacy=0x7f796c0695d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:55.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.587+0000 7f7971057700 1 -- 172.21.15.8:0/3439134139 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796c068af0 con 0x7f796c06d1f0 2023-10-06T04:36:55.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.587+0000 7f796bfff700 1 -- 172.21.15.8:0/3439134139 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1723041899 0 0) 0x7f796c1599c0 con 0x7f796c15da50 2023-10-06T04:36:55.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.587+0000 7f7971057700 1 --2- 172.21.15.8:0/3439134139 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f796c06d1f0 0x7f796c142690 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f79640098e0 tx=0x7f79640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b61491fb29fa69 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:55.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.587+0000 7f796bfff700 1 -- 172.21.15.8:0/3439134139 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7964009e80 con 0x7f796c06d1f0 2023-10-06T04:36:55.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.587+0000 7f796bfff700 1 -- 172.21.15.8:0/3439134139 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796400b860 con 0x7f796c06d1f0 2023-10-06T04:36:55.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.587+0000 7f796bfff700 1 -- 172.21.15.8:0/3439134139 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796400bbe0 con 0x7f796c06d1f0 2023-10-06T04:36:55.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.588+0000 7f79732bb700 1 -- 172.21.15.8:0/3439134139 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f796c06d1f0 msgr2=0x7f796c142690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:55.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.588+0000 7f79732bb700 1 --2- 172.21.15.8:0/3439134139 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f796c06d1f0 0x7f796c142690 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f79640098e0 tx=0x7f79640091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:55.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.588+0000 7f79732bb700 1 -- 172.21.15.8:0/3439134139 shutdown_connections 2023-10-06T04:36:55.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.588+0000 7f79732bb700 1 --2- 172.21.15.8:0/3439134139 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f796c06d1f0 0x7f796c142690 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:55.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.588+0000 7f79732bb700 1 -- 172.21.15.8:0/3439134139 >> 172.21.15.8:0/3439134139 conn(0x7f796c0680a0 msgr2=0x7f796c0ce210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:55.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.588+0000 7f79732bb700 1 -- 172.21.15.8:0/3439134139 shutdown_connections 2023-10-06T04:36:55.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.588+0000 7f79732bb700 1 -- 172.21.15.8:0/3439134139 wait complete. 2023-10-06T04:36:55.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.589+0000 7f79732bb700 1 Processor -- start 2023-10-06T04:36:55.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.589+0000 7f79732bb700 1 -- start start 2023-10-06T04:36:55.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.590+0000 7f79732bb700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f796c06d1f0 0x7f796c142be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:55.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.590+0000 7f79732bb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f796c06d5c0 0x7f796c0b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:55.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.590+0000 7f79732bb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f796c15da50 0x7f796c0b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:55.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.590+0000 7f79732bb700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c156f50 con 0x7f796c06d5c0 2023-10-06T04:36:55.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.590+0000 7f79732bb700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c0c1a00 con 0x7f796c06d1f0 2023-10-06T04:36:55.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.590+0000 7f79732bb700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796c0c1ce0 con 0x7f796c15da50 2023-10-06T04:36:55.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.590+0000 7f7970856700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f796c06d5c0 0x7f796c0b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:55.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.590+0000 7f7970856700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f796c06d5c0 0x7f796c0b2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49928/0 (socket says 172.21.15.8:49928) 2023-10-06T04:36:55.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.590+0000 7f7970856700 1 -- 172.21.15.8:0/319141628 learned_addr learned my addr 172.21.15.8:0/319141628 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:55.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.590+0000 7f7971858700 1 --2- 172.21.15.8:0/319141628 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f796c15da50 0x7f796c0b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:55.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.590+0000 7f7971057700 1 --2- 172.21.15.8:0/319141628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f796c06d1f0 0x7f796c142be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:55.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.590+0000 7f7970856700 1 -- 172.21.15.8:0/319141628 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f796c15da50 msgr2=0x7f796c0b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:55.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.590+0000 7f7970856700 1 --2- 172.21.15.8:0/319141628 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f796c15da50 0x7f796c0b30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:55.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.590+0000 7f7970856700 1 -- 172.21.15.8:0/319141628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f796c06d1f0 msgr2=0x7f796c142be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:55.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.590+0000 7f7970856700 1 --2- 172.21.15.8:0/319141628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f796c06d1f0 0x7f796c142be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:55.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.590+0000 7f7970856700 1 -- 172.21.15.8:0/319141628 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7964009420 con 0x7f796c06d5c0 2023-10-06T04:36:55.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.590+0000 7f7970856700 1 --2- 172.21.15.8:0/319141628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f796c06d5c0 0x7f796c0b2b80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f796000c5c0 tx=0x7f796000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:55.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.590+0000 7f79697fa700 1 -- 172.21.15.8:0/319141628 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7960011590 con 0x7f796c06d5c0 2023-10-06T04:36:55.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.591+0000 7f79697fa700 1 -- 172.21.15.8:0/319141628 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7960011710 con 0x7f796c06d5c0 2023-10-06T04:36:55.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.591+0000 7f79732bb700 1 -- 172.21.15.8:0/319141628 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f796c0b3760 con 0x7f796c06d5c0 2023-10-06T04:36:55.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.591+0000 7f79697fa700 1 -- 172.21.15.8:0/319141628 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7960011ad0 con 0x7f796c06d5c0 2023-10-06T04:36:55.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.591+0000 7f79732bb700 1 -- 172.21.15.8:0/319141628 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796c0b3d20 con 0x7f796c06d5c0 2023-10-06T04:36:55.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.592+0000 7f79732bb700 1 -- 172.21.15.8:0/319141628 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f796c071550 con 0x7f796c06d5c0 2023-10-06T04:36:55.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.592+0000 7f79697fa700 1 -- 172.21.15.8:0/319141628 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f796001b3b0 con 0x7f796c06d5c0 2023-10-06T04:36:55.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.592+0000 7f79697fa700 1 --2- 172.21.15.8:0/319141628 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7958066f30 0x7f79580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:55.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.592+0000 7f79697fa700 1 -- 172.21.15.8:0/319141628 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7960083ed0 con 0x7f796c06d5c0 2023-10-06T04:36:55.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.593+0000 7f7971057700 1 --2- 172.21.15.8:0/319141628 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7958066f30 0x7f79580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:55.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.593+0000 7f7971057700 1 --2- 172.21.15.8:0/319141628 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7958066f30 0x7f79580693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f79640093f0 tx=0x7f7964017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:55.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.597+0000 7f79697fa700 1 -- 172.21.15.8:0/319141628 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7960050cf0 con 0x7f796c06d5c0 2023-10-06T04:36:55.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.787+0000 7f79732bb700 1 -- 172.21.15.8:0/319141628 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f796c0c1e20 con 0x7f796c06d5c0 2023-10-06T04:36:55.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.787+0000 7f79697fa700 1 -- 172.21.15.8:0/319141628 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7960017020 con 0x7f796c06d5c0 2023-10-06T04:36:55.790 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-06T04:36:55.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.789+0000 7f79732bb700 1 -- 172.21.15.8:0/319141628 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7958066f30 msgr2=0x7f79580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:55.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.789+0000 7f79732bb700 1 --2- 172.21.15.8:0/319141628 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7958066f30 0x7f79580693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f79640093f0 tx=0x7f7964017000 comp rx=0 tx=0).stop 2023-10-06T04:36:55.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.789+0000 7f79732bb700 1 -- 172.21.15.8:0/319141628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f796c06d5c0 msgr2=0x7f796c0b2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:55.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.789+0000 7f79732bb700 1 --2- 172.21.15.8:0/319141628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f796c06d5c0 0x7f796c0b2b80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f796000c5c0 tx=0x7f796000c980 comp rx=0 tx=0).stop 2023-10-06T04:36:55.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.789+0000 7f79732bb700 1 -- 172.21.15.8:0/319141628 shutdown_connections 2023-10-06T04:36:55.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.789+0000 7f79732bb700 1 --2- 172.21.15.8:0/319141628 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7958066f30 0x7f79580693e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:55.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.789+0000 7f79732bb700 1 --2- 172.21.15.8:0/319141628 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f796c15da50 0x7f796c0b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:55.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.789+0000 7f79732bb700 1 --2- 172.21.15.8:0/319141628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f796c06d1f0 0x7f796c142be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:55.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.789+0000 7f79732bb700 1 --2- 172.21.15.8:0/319141628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f796c06d5c0 0x7f796c0b2b80 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:55.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.789+0000 7f79732bb700 1 -- 172.21.15.8:0/319141628 >> 172.21.15.8:0/319141628 conn(0x7f796c0680a0 msgr2=0x7f796c1587e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:55.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.789+0000 7f79732bb700 1 -- 172.21.15.8:0/319141628 shutdown_connections 2023-10-06T04:36:55.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.789+0000 7f79732bb700 1 -- 172.21.15.8:0/319141628 wait complete. 2023-10-06T04:36:55.805 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:36:55.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.926+0000 7ff2c9f9d700 1 Processor -- start 2023-10-06T04:36:55.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.926+0000 7ff2c9f9d700 1 -- start start 2023-10-06T04:36:55.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.927+0000 7ff2c9f9d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff2c41409e0 0x7ff2c4158450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:55.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.927+0000 7ff2c9f9d700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2c4157fc0 con 0x7ff2c4140db0 2023-10-06T04:36:55.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.927+0000 7ff2c9f9d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2c406d580 con 0x7ff2c40c8d50 2023-10-06T04:36:55.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.927+0000 7ff2c9f9d700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2c4158990 con 0x7ff2c41409e0 2023-10-06T04:36:55.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.927+0000 7ff2c8f9b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff2c41409e0 0x7ff2c4158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:55.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.927+0000 7ff2c3fff700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ff2c4140db0 0x7ff2c40c8640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60872/0 (socket says 172.21.15.8:60872) 2023-10-06T04:36:55.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.927+0000 7ff2c3fff700 1 -- 172.21.15.8:0/2981927752 learned_addr learned my addr 172.21.15.8:0/2981927752 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:55.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.927+0000 7ff2c8f9b700 1 -- 172.21.15.8:0/2981927752 >> v1:172.21.15.184:6789/0 conn(0x7ff2c40c8d50 legacy=0x7ff2c40c6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:55.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.927+0000 7ff2c8f9b700 1 -- 172.21.15.8:0/2981927752 >> v1:172.21.15.8:6789/0 conn(0x7ff2c4140db0 legacy=0x7ff2c40c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:55.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.927+0000 7ff2c37fe700 1 -- 172.21.15.8:0/2981927752 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376695224 0 0) 0x7ff2c4157fc0 con 0x7ff2c4140db0 2023-10-06T04:36:55.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.927+0000 7ff2c8f9b700 1 -- 172.21.15.8:0/2981927752 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c406d860 con 0x7ff2c41409e0 2023-10-06T04:36:55.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.927+0000 7ff2c8f9b700 1 --2- 172.21.15.8:0/2981927752 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2c41409e0 0x7ff2c4158450 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff2b80098e0 tx=0x7ff2b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a82aba5079b698a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:55.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.928+0000 7ff2c37fe700 1 -- 172.21.15.8:0/2981927752 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8009e80 con 0x7ff2c41409e0 2023-10-06T04:36:55.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.928+0000 7ff2c37fe700 1 -- 172.21.15.8:0/2981927752 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b800b820 con 0x7ff2c41409e0 2023-10-06T04:36:55.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.928+0000 7ff2c37fe700 1 -- 172.21.15.8:0/2981927752 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b800bba0 con 0x7ff2c41409e0 2023-10-06T04:36:55.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.928+0000 7ff2c9f9d700 1 -- 172.21.15.8:0/2981927752 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2c41409e0 msgr2=0x7ff2c4158450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:55.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.928+0000 7ff2c9f9d700 1 --2- 172.21.15.8:0/2981927752 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2c41409e0 0x7ff2c4158450 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff2b80098e0 tx=0x7ff2b80091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:55.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.928+0000 7ff2c9f9d700 1 -- 172.21.15.8:0/2981927752 shutdown_connections 2023-10-06T04:36:55.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.928+0000 7ff2c9f9d700 1 --2- 172.21.15.8:0/2981927752 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2c41409e0 0x7ff2c4158450 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:55.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.928+0000 7ff2c9f9d700 1 -- 172.21.15.8:0/2981927752 >> 172.21.15.8:0/2981927752 conn(0x7ff2c40675d0 msgr2=0x7ff2c40679d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:55.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.928+0000 7ff2c9f9d700 1 -- 172.21.15.8:0/2981927752 shutdown_connections 2023-10-06T04:36:55.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.928+0000 7ff2c9f9d700 1 -- 172.21.15.8:0/2981927752 wait complete. 2023-10-06T04:36:55.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.929+0000 7ff2c9f9d700 1 Processor -- start 2023-10-06T04:36:55.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.929+0000 7ff2c9f9d700 1 -- start start 2023-10-06T04:36:55.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.930+0000 7ff2c9f9d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2c40c8d50 0x7ff2c40adcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:55.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.930+0000 7ff2c9f9d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2c41409e0 0x7ff2c40c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:55.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.930+0000 7ff2c9f9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2c4140db0 0x7ff2c40c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:55.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.930+0000 7ff2c9f9d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c40ae1f0 con 0x7ff2c4140db0 2023-10-06T04:36:55.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.930+0000 7ff2c9f9d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c41565e0 con 0x7ff2c40c8d50 2023-10-06T04:36:55.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.930+0000 7ff2c9f9d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c40c4a30 con 0x7ff2c41409e0 2023-10-06T04:36:55.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.930+0000 7ff2c979c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2c4140db0 0x7ff2c40c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:55.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.930+0000 7ff2c979c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2c4140db0 0x7ff2c40c9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49934/0 (socket says 172.21.15.8:49934) 2023-10-06T04:36:55.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.930+0000 7ff2c979c700 1 -- 172.21.15.8:0/3222541014 learned_addr learned my addr 172.21.15.8:0/3222541014 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:55.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.930+0000 7ff2c3fff700 1 --2- 172.21.15.8:0/3222541014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2c41409e0 0x7ff2c40c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:55.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.930+0000 7ff2c8f9b700 1 --2- 172.21.15.8:0/3222541014 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2c40c8d50 0x7ff2c40adcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:55.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.931+0000 7ff2c979c700 1 -- 172.21.15.8:0/3222541014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2c41409e0 msgr2=0x7ff2c40c44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:55.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.931+0000 7ff2c979c700 1 --2- 172.21.15.8:0/3222541014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2c41409e0 0x7ff2c40c44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:55.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.931+0000 7ff2c979c700 1 -- 172.21.15.8:0/3222541014 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2c40c8d50 msgr2=0x7ff2c40adcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:55.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.931+0000 7ff2c979c700 1 --2- 172.21.15.8:0/3222541014 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2c40c8d50 0x7ff2c40adcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:55.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.931+0000 7ff2c979c700 1 -- 172.21.15.8:0/3222541014 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b8009420 con 0x7ff2c4140db0 2023-10-06T04:36:55.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.931+0000 7ff2c3fff700 1 --2- 172.21.15.8:0/3222541014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2c41409e0 0x7ff2c40c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:55.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.931+0000 7ff2c8f9b700 1 --2- 172.21.15.8:0/3222541014 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2c40c8d50 0x7ff2c40adcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:36:55.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.931+0000 7ff2c979c700 1 --2- 172.21.15.8:0/3222541014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2c4140db0 0x7ff2c40c9da0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc00bb80 tx=0x7ff2bc009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:55.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.931+0000 7ff2c0ff9700 1 -- 172.21.15.8:0/3222541014 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc00c970 con 0x7ff2c4140db0 2023-10-06T04:36:55.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.931+0000 7ff2c0ff9700 1 -- 172.21.15.8:0/3222541014 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2bc00cad0 con 0x7ff2c4140db0 2023-10-06T04:36:55.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.931+0000 7ff2c0ff9700 1 -- 172.21.15.8:0/3222541014 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc00ce90 con 0x7ff2c4140db0 2023-10-06T04:36:55.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.931+0000 7ff2c9f9d700 1 -- 172.21.15.8:0/3222541014 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2c413d290 con 0x7ff2c4140db0 2023-10-06T04:36:55.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.931+0000 7ff2c9f9d700 1 -- 172.21.15.8:0/3222541014 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2c4156830 con 0x7ff2c4140db0 2023-10-06T04:36:55.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.932+0000 7ff2c9f9d700 1 -- 172.21.15.8:0/3222541014 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2c404c380 con 0x7ff2c4140db0 2023-10-06T04:36:55.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.932+0000 7ff2c0ff9700 1 -- 172.21.15.8:0/3222541014 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff2bc014620 con 0x7ff2c4140db0 2023-10-06T04:36:55.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.933+0000 7ff2c0ff9700 1 --2- 172.21.15.8:0/3222541014 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff2a8066f30 0x7ff2a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:55.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.933+0000 7ff2c0ff9700 1 -- 172.21.15.8:0/3222541014 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff2bc084af0 con 0x7ff2c4140db0 2023-10-06T04:36:55.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.933+0000 7ff2c8f9b700 1 --2- 172.21.15.8:0/3222541014 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff2a8066f30 0x7ff2a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:55.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.934+0000 7ff2c8f9b700 1 --2- 172.21.15.8:0/3222541014 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff2a8066f30 0x7ff2a80693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff2b80030c0 tx=0x7ff2b8016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:55.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:55.937+0000 7ff2c0ff9700 1 -- 172.21.15.8:0/3222541014 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff2bc051910 con 0x7ff2c4140db0 2023-10-06T04:36:56.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.128+0000 7ff2c9f9d700 1 -- 172.21.15.8:0/3222541014 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff2c4157c50 con 0x7ff2c4140db0 2023-10-06T04:36:56.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.129+0000 7ff2c0ff9700 1 -- 172.21.15.8:0/3222541014 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff2bc054f30 con 0x7ff2c4140db0 2023-10-06T04:36:56.131 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-06T04:36:56.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.131+0000 7ff2c9f9d700 1 -- 172.21.15.8:0/3222541014 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff2a8066f30 msgr2=0x7ff2a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:56.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.131+0000 7ff2c9f9d700 1 --2- 172.21.15.8:0/3222541014 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff2a8066f30 0x7ff2a80693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff2b80030c0 tx=0x7ff2b8016000 comp rx=0 tx=0).stop 2023-10-06T04:36:56.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.131+0000 7ff2c9f9d700 1 -- 172.21.15.8:0/3222541014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2c4140db0 msgr2=0x7ff2c40c9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:56.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.131+0000 7ff2c9f9d700 1 --2- 172.21.15.8:0/3222541014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2c4140db0 0x7ff2c40c9da0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc00bb80 tx=0x7ff2bc009810 comp rx=0 tx=0).stop 2023-10-06T04:36:56.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.131+0000 7ff2c9f9d700 1 -- 172.21.15.8:0/3222541014 shutdown_connections 2023-10-06T04:36:56.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.131+0000 7ff2c9f9d700 1 --2- 172.21.15.8:0/3222541014 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff2a8066f30 0x7ff2a80693e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:56.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.131+0000 7ff2c9f9d700 1 --2- 172.21.15.8:0/3222541014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2c4140db0 0x7ff2c40c9da0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:56.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.131+0000 7ff2c9f9d700 1 --2- 172.21.15.8:0/3222541014 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2c40c8d50 0x7ff2c40adcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:56.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.131+0000 7ff2c9f9d700 1 --2- 172.21.15.8:0/3222541014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2c41409e0 0x7ff2c40c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:56.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.131+0000 7ff2c9f9d700 1 -- 172.21.15.8:0/3222541014 >> 172.21.15.8:0/3222541014 conn(0x7ff2c40675d0 msgr2=0x7ff2c413f060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:56.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.131+0000 7ff2c9f9d700 1 -- 172.21.15.8:0/3222541014 shutdown_connections 2023-10-06T04:36:56.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.131+0000 7ff2c9f9d700 1 -- 172.21.15.8:0/3222541014 wait complete. 2023-10-06T04:36:56.145 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T04:36:56.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.266+0000 7f4558b51700 1 Processor -- start 2023-10-06T04:36:56.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.266+0000 7f4558b51700 1 -- start start 2023-10-06T04:36:56.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.267+0000 7f4558b51700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f45540cc440 0x7f455406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:56.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.267+0000 7f4558b51700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f455406c3f0 0x7f45540686e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:56.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.267+0000 7f4558b51700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f455406d8c0 con 0x7f45540cc070 2023-10-06T04:36:56.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.267+0000 7f4558b51700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f455406c830 con 0x7f455406c3f0 2023-10-06T04:36:56.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.267+0000 7f4558b51700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4554143270 con 0x7f45540cc440 2023-10-06T04:36:56.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.267+0000 7f4552d9d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f455406c3f0 0x7f45540686e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:56.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.267+0000 7f4552d9d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f455406c3f0 0x7f45540686e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49944/0 (socket says 172.21.15.8:49944) 2023-10-06T04:36:56.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.267+0000 7f4552d9d700 1 -- 172.21.15.8:0/2625898113 learned_addr learned my addr 172.21.15.8:0/2625898113 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:56.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.268+0000 7f4551d9b700 1 --2- 172.21.15.8:0/2625898113 >> v2:172.21.15.184:3300/0 conn(0x7f45540cc440 0x7f455406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:56.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.268+0000 7f4552d9d700 1 -- 172.21.15.8:0/2625898113 >> v2:172.21.15.184:3300/0 conn(0x7f45540cc440 msgr2=0x7f455406d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:56.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.268+0000 7f4552d9d700 1 --2- 172.21.15.8:0/2625898113 >> v2:172.21.15.184:3300/0 conn(0x7f45540cc440 0x7f455406d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:56.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.268+0000 7f4552d9d700 1 -- 172.21.15.8:0/2625898113 >> v1:172.21.15.184:6789/0 conn(0x7f45540cc070 legacy=0x7f455406cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:56.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.268+0000 7f4552d9d700 1 -- 172.21.15.8:0/2625898113 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f455406b910 con 0x7f455406c3f0 2023-10-06T04:36:56.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.268+0000 7f4552d9d700 1 --2- 172.21.15.8:0/2625898113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f455406c3f0 0x7f45540686e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f455406a020 tx=0x7f4544009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=288617d8d4f75af2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:56.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.268+0000 7f455159a700 1 -- 172.21.15.8:0/2625898113 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454400e070 con 0x7f455406c3f0 2023-10-06T04:36:56.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.268+0000 7f455159a700 1 -- 172.21.15.8:0/2625898113 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f454400ba50 con 0x7f455406c3f0 2023-10-06T04:36:56.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.268+0000 7f455159a700 1 -- 172.21.15.8:0/2625898113 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45440092e0 con 0x7f455406c3f0 2023-10-06T04:36:56.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.268+0000 7f4558b51700 1 -- 172.21.15.8:0/2625898113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f455406c3f0 msgr2=0x7f45540686e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:56.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.268+0000 7f4558b51700 1 --2- 172.21.15.8:0/2625898113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f455406c3f0 0x7f45540686e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f455406a020 tx=0x7f4544009840 comp rx=0 tx=0).stop 2023-10-06T04:36:56.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.269+0000 7f4558b51700 1 -- 172.21.15.8:0/2625898113 shutdown_connections 2023-10-06T04:36:56.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.269+0000 7f4558b51700 1 --2- 172.21.15.8:0/2625898113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f455406c3f0 0x7f45540686e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:56.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.269+0000 7f4558b51700 1 --2- 172.21.15.8:0/2625898113 >> v2:172.21.15.184:3300/0 conn(0x7f45540cc440 0x7f455406d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:56.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.269+0000 7f4558b51700 1 -- 172.21.15.8:0/2625898113 >> 172.21.15.8:0/2625898113 conn(0x7f45540ce250 msgr2=0x7f45540ce650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:56.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.269+0000 7f4558b51700 1 -- 172.21.15.8:0/2625898113 shutdown_connections 2023-10-06T04:36:56.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.269+0000 7f4558b51700 1 -- 172.21.15.8:0/2625898113 wait complete. 2023-10-06T04:36:56.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.270+0000 7f4558b51700 1 Processor -- start 2023-10-06T04:36:56.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.270+0000 7f4558b51700 1 -- start start 2023-10-06T04:36:56.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.270+0000 7f4558b51700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f455406c3f0 0x7f4554156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:56.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.270+0000 7f4558b51700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f45540cc070 0x7f455413acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:56.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.270+0000 7f4558b51700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45540cc440 0x7f455413b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:56.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.270+0000 7f4558b51700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45540c5940 con 0x7f45540cc440 2023-10-06T04:36:56.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.270+0000 7f4558b51700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45540c5cf0 con 0x7f45540cc070 2023-10-06T04:36:56.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.270+0000 7f4558b51700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45540c5fb0 con 0x7f455406c3f0 2023-10-06T04:36:56.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.271+0000 7f4552d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45540cc440 0x7f455413b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:56.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.271+0000 7f4552d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45540cc440 0x7f455413b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49954/0 (socket says 172.21.15.8:49954) 2023-10-06T04:36:56.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.271+0000 7f4552d9d700 1 -- 172.21.15.8:0/3034472201 learned_addr learned my addr 172.21.15.8:0/3034472201 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:56.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.271+0000 7f4552d9d700 1 -- 172.21.15.8:0/3034472201 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f455406c3f0 msgr2=0x7f4554156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:56.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.271+0000 7f4552d9d700 1 --2- 172.21.15.8:0/3034472201 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f455406c3f0 0x7f4554156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:56.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.271+0000 7f4552d9d700 1 -- 172.21.15.8:0/3034472201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f45540cc070 msgr2=0x7f455413acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:56.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.271+0000 7f4552d9d700 1 --2- 172.21.15.8:0/3034472201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f45540cc070 0x7f455413acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:56.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.271+0000 7f4552d9d700 1 -- 172.21.15.8:0/3034472201 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4544009ae0 con 0x7f45540cc440 2023-10-06T04:36:56.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.271+0000 7f4552d9d700 1 --2- 172.21.15.8:0/3034472201 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45540cc440 0x7f455413b200 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f455406f2e0 tx=0x7f4544018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:56.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.271+0000 7f454a7fc700 1 -- 172.21.15.8:0/3034472201 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4544008e40 con 0x7f45540cc440 2023-10-06T04:36:56.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.271+0000 7f454a7fc700 1 -- 172.21.15.8:0/3034472201 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f454401c410 con 0x7f45540cc440 2023-10-06T04:36:56.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.271+0000 7f4558b51700 1 -- 172.21.15.8:0/3034472201 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45540c6290 con 0x7f45540cc440 2023-10-06T04:36:56.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.271+0000 7f454a7fc700 1 -- 172.21.15.8:0/3034472201 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454401c7d0 con 0x7f45540cc440 2023-10-06T04:36:56.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.271+0000 7f4558b51700 1 -- 172.21.15.8:0/3034472201 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45540c6850 con 0x7f45540cc440 2023-10-06T04:36:56.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.272+0000 7f4558b51700 1 -- 172.21.15.8:0/3034472201 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45540c6a70 con 0x7f45540cc440 2023-10-06T04:36:56.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.272+0000 7f454a7fc700 1 -- 172.21.15.8:0/3034472201 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4544003040 con 0x7f45540cc440 2023-10-06T04:36:56.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.273+0000 7f454a7fc700 1 --2- 172.21.15.8:0/3034472201 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4534066f30 0x7f45340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:56.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.273+0000 7f454a7fc700 1 -- 172.21.15.8:0/3034472201 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f45440862f0 con 0x7f45540cc440 2023-10-06T04:36:56.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.273+0000 7f455259c700 1 --2- 172.21.15.8:0/3034472201 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4534066f30 0x7f45340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:56.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.274+0000 7f455259c700 1 --2- 172.21.15.8:0/3034472201 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4534066f30 0x7f45340693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f454c001730 tx=0x7f454c007b40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:56.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.277+0000 7f454a7fc700 1 -- 172.21.15.8:0/3034472201 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4544053110 con 0x7f45540cc440 2023-10-06T04:36:56.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.469+0000 7f4558b51700 1 -- 172.21.15.8:0/3034472201 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4554071550 con 0x7f45540cc440 2023-10-06T04:36:56.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.470+0000 7f454a7fc700 1 -- 172.21.15.8:0/3034472201 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4544056730 con 0x7f45540cc440 2023-10-06T04:36:56.472 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-06T04:36:56.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.472+0000 7f4558b51700 1 -- 172.21.15.8:0/3034472201 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4534066f30 msgr2=0x7f45340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:56.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.472+0000 7f4558b51700 1 --2- 172.21.15.8:0/3034472201 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4534066f30 0x7f45340693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f454c001730 tx=0x7f454c007b40 comp rx=0 tx=0).stop 2023-10-06T04:36:56.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.472+0000 7f4558b51700 1 -- 172.21.15.8:0/3034472201 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45540cc440 msgr2=0x7f455413b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:56.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.472+0000 7f4558b51700 1 --2- 172.21.15.8:0/3034472201 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45540cc440 0x7f455413b200 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f455406f2e0 tx=0x7f4544018000 comp rx=0 tx=0).stop 2023-10-06T04:36:56.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.472+0000 7f4558b51700 1 -- 172.21.15.8:0/3034472201 shutdown_connections 2023-10-06T04:36:56.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.472+0000 7f4558b51700 1 --2- 172.21.15.8:0/3034472201 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4534066f30 0x7f45340693e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:56.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.472+0000 7f4558b51700 1 --2- 172.21.15.8:0/3034472201 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45540cc440 0x7f455413b200 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:56.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.472+0000 7f4558b51700 1 --2- 172.21.15.8:0/3034472201 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f455406c3f0 0x7f4554156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:56.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.472+0000 7f4558b51700 1 --2- 172.21.15.8:0/3034472201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f45540cc070 0x7f455413acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:56.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.472+0000 7f4558b51700 1 -- 172.21.15.8:0/3034472201 >> 172.21.15.8:0/3034472201 conn(0x7f45540ce250 msgr2=0x7f45540c9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:56.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.472+0000 7f4558b51700 1 -- 172.21.15.8:0/3034472201 shutdown_connections 2023-10-06T04:36:56.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.472+0000 7f4558b51700 1 -- 172.21.15.8:0/3034472201 wait complete. 2023-10-06T04:36:56.487 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:36:56.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.603+0000 7f657967a700 1 Processor -- start 2023-10-06T04:36:56.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.603+0000 7f657967a700 1 -- start start 2023-10-06T04:36:56.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.604+0000 7f657967a700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f65740cb360 0x7f65740d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:56.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.604+0000 7f657967a700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65740cc4c0 con 0x7f65740af680 2023-10-06T04:36:56.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.604+0000 7f657967a700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65740d0d20 con 0x7f65740d08d0 2023-10-06T04:36:56.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.604+0000 7f657967a700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f657415d460 con 0x7f65740cb360 2023-10-06T04:36:56.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.604+0000 7f656bfff700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f65740cb360 0x7f65740d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:56.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.604+0000 7f6572ffd700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f65740af680 0x7f657415e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60886/0 (socket says 172.21.15.8:60886) 2023-10-06T04:36:56.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.604+0000 7f6572ffd700 1 -- 172.21.15.8:0/3376502303 learned_addr learned my addr 172.21.15.8:0/3376502303 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:56.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.604+0000 7f656bfff700 1 -- 172.21.15.8:0/3376502303 >> v1:172.21.15.184:6789/0 conn(0x7f65740d08d0 legacy=0x7f65740cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:56.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.604+0000 7f656bfff700 1 -- 172.21.15.8:0/3376502303 >> v1:172.21.15.8:6789/0 conn(0x7f65740af680 legacy=0x7f657415e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:56.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.604+0000 7f656bfff700 1 -- 172.21.15.8:0/3376502303 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65740cb8b0 con 0x7f65740cb360 2023-10-06T04:36:56.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.604+0000 7f65727fc700 1 -- 172.21.15.8:0/3376502303 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3847432320 0 0) 0x7f65740cc4c0 con 0x7f65740af680 2023-10-06T04:36:56.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.605+0000 7f656bfff700 1 --2- 172.21.15.8:0/3376502303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65740cb360 0x7f65740d0390 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f655c0098e0 tx=0x7f655c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef09a43507eec77 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:56.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.605+0000 7f65727fc700 1 -- 172.21.15.8:0/3376502303 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655c009e80 con 0x7f65740cb360 2023-10-06T04:36:56.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.605+0000 7f65727fc700 1 -- 172.21.15.8:0/3376502303 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655c00b820 con 0x7f65740cb360 2023-10-06T04:36:56.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.605+0000 7f65727fc700 1 -- 172.21.15.8:0/3376502303 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655c00bba0 con 0x7f65740cb360 2023-10-06T04:36:56.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.605+0000 7f657967a700 1 -- 172.21.15.8:0/3376502303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65740cb360 msgr2=0x7f65740d0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:56.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.605+0000 7f657967a700 1 --2- 172.21.15.8:0/3376502303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65740cb360 0x7f65740d0390 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f655c0098e0 tx=0x7f655c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:56.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.605+0000 7f657967a700 1 -- 172.21.15.8:0/3376502303 shutdown_connections 2023-10-06T04:36:56.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.605+0000 7f657967a700 1 --2- 172.21.15.8:0/3376502303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65740cb360 0x7f65740d0390 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:56.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.605+0000 7f657967a700 1 -- 172.21.15.8:0/3376502303 >> 172.21.15.8:0/3376502303 conn(0x7f65740633d0 msgr2=0x7f65740637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:56.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.605+0000 7f657967a700 1 -- 172.21.15.8:0/3376502303 shutdown_connections 2023-10-06T04:36:56.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.605+0000 7f657967a700 1 -- 172.21.15.8:0/3376502303 wait complete. 2023-10-06T04:36:56.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.606+0000 7f657967a700 1 Processor -- start 2023-10-06T04:36:56.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.607+0000 7f657967a700 1 -- start start 2023-10-06T04:36:56.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.607+0000 7f657967a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65740af680 0x7f6574169d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:56.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.607+0000 7f657967a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65740cb360 0x7f65741493d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:56.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.607+0000 7f657967a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65740d08d0 0x7f657416dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:56.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.607+0000 7f657967a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657415c150 con 0x7f65740d08d0 2023-10-06T04:36:56.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.607+0000 7f657967a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657416afd0 con 0x7f65740af680 2023-10-06T04:36:56.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.607+0000 7f657967a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6574149910 con 0x7f65740cb360 2023-10-06T04:36:56.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.607+0000 7f65737fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65740d08d0 0x7f657416dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:56.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.607+0000 7f65737fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65740d08d0 0x7f657416dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49968/0 (socket says 172.21.15.8:49968) 2023-10-06T04:36:56.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.607+0000 7f65737fe700 1 -- 172.21.15.8:0/2087595047 learned_addr learned my addr 172.21.15.8:0/2087595047 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:56.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.608+0000 7f6572ffd700 1 --2- 172.21.15.8:0/2087595047 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65740af680 0x7f6574169d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:56.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.608+0000 7f656bfff700 1 --2- 172.21.15.8:0/2087595047 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65740cb360 0x7f65741493d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:56.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.608+0000 7f65737fe700 1 -- 172.21.15.8:0/2087595047 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65740cb360 msgr2=0x7f65741493d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:56.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.608+0000 7f65737fe700 1 --2- 172.21.15.8:0/2087595047 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65740cb360 0x7f65741493d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:56.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.608+0000 7f65737fe700 1 -- 172.21.15.8:0/2087595047 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65740af680 msgr2=0x7f6574169d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:56.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.608+0000 7f65737fe700 1 --2- 172.21.15.8:0/2087595047 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65740af680 0x7f6574169d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:56.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.608+0000 7f65737fe700 1 -- 172.21.15.8:0/2087595047 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f655c009420 con 0x7f65740d08d0 2023-10-06T04:36:56.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.608+0000 7f65737fe700 1 --2- 172.21.15.8:0/2087595047 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65740d08d0 0x7f657416dc30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f656c00bbb0 tx=0x7f656c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:56.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.608+0000 7f656affd700 1 -- 172.21.15.8:0/2087595047 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656c0092e0 con 0x7f65740d08d0 2023-10-06T04:36:56.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.608+0000 7f656affd700 1 -- 172.21.15.8:0/2087595047 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656c00c7a0 con 0x7f65740d08d0 2023-10-06T04:36:56.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.608+0000 7f657967a700 1 -- 172.21.15.8:0/2087595047 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f657416a350 con 0x7f65740d08d0 2023-10-06T04:36:56.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.608+0000 7f656affd700 1 -- 172.21.15.8:0/2087595047 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656c00cb40 con 0x7f65740d08d0 2023-10-06T04:36:56.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.608+0000 7f657967a700 1 -- 172.21.15.8:0/2087595047 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f657416a910 con 0x7f65740d08d0 2023-10-06T04:36:56.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.609+0000 7f657967a700 1 -- 172.21.15.8:0/2087595047 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f657416b140 con 0x7f65740d08d0 2023-10-06T04:36:56.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.609+0000 7f656affd700 1 -- 172.21.15.8:0/2087595047 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f656c012070 con 0x7f65740d08d0 2023-10-06T04:36:56.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.610+0000 7f656affd700 1 --2- 172.21.15.8:0/2087595047 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6554066f30 0x7f65540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:56.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.610+0000 7f656affd700 1 -- 172.21.15.8:0/2087595047 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f656c084610 con 0x7f65740d08d0 2023-10-06T04:36:56.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.610+0000 7f6572ffd700 1 --2- 172.21.15.8:0/2087595047 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6554066f30 0x7f65540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:56.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.611+0000 7f6572ffd700 1 --2- 172.21.15.8:0/2087595047 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6554066f30 0x7f65540693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f65740b0fd0 tx=0x7f6564009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:56.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.614+0000 7f656affd700 1 -- 172.21.15.8:0/2087595047 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f656c051430 con 0x7f65740d08d0 2023-10-06T04:36:56.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.807+0000 7f657967a700 1 -- 172.21.15.8:0/2087595047 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6574071550 con 0x7f65740d08d0 2023-10-06T04:36:56.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.808+0000 7f656affd700 1 -- 172.21.15.8:0/2087595047 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f656c054a50 con 0x7f65740d08d0 2023-10-06T04:36:56.811 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:36:56.811 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":25,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:36:21.690266+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:36:10.148177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:36:10.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:36:14.390671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:36:15.601089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:36:19.291300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.555871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.490505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.504578+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.517217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:05.991135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.537329+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.543232+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.443715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:36:56.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.810+0000 7f657967a700 1 -- 172.21.15.8:0/2087595047 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6554066f30 msgr2=0x7f65540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:56.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.810+0000 7f657967a700 1 --2- 172.21.15.8:0/2087595047 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6554066f30 0x7f65540693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f65740b0fd0 tx=0x7f6564009040 comp rx=0 tx=0).stop 2023-10-06T04:36:56.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.810+0000 7f657967a700 1 -- 172.21.15.8:0/2087595047 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65740d08d0 msgr2=0x7f657416dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:56.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.810+0000 7f657967a700 1 --2- 172.21.15.8:0/2087595047 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65740d08d0 0x7f657416dc30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f656c00bbb0 tx=0x7f656c009840 comp rx=0 tx=0).stop 2023-10-06T04:36:56.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.810+0000 7f657967a700 1 -- 172.21.15.8:0/2087595047 shutdown_connections 2023-10-06T04:36:56.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.810+0000 7f657967a700 1 --2- 172.21.15.8:0/2087595047 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6554066f30 0x7f65540693e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:56.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.810+0000 7f657967a700 1 --2- 172.21.15.8:0/2087595047 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65740d08d0 0x7f657416dc30 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:56.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.810+0000 7f657967a700 1 --2- 172.21.15.8:0/2087595047 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65740af680 0x7f6574169d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:56.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.810+0000 7f657967a700 1 --2- 172.21.15.8:0/2087595047 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65740cb360 0x7f65741493d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:56.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.810+0000 7f657967a700 1 -- 172.21.15.8:0/2087595047 >> 172.21.15.8:0/2087595047 conn(0x7f65740633d0 msgr2=0x7f657415d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:56.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.810+0000 7f657967a700 1 -- 172.21.15.8:0/2087595047 shutdown_connections 2023-10-06T04:36:56.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.810+0000 7f657967a700 1 -- 172.21.15.8:0/2087595047 wait complete. 2023-10-06T04:36:56.826 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:36:10.148177+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:36:10.684157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:36:14.390671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:36:15.601089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T04:36:19.291300+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:36:56.826 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:36:56.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.946+0000 7efe4d0b1700 1 Processor -- start 2023-10-06T04:36:56.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.946+0000 7efe4d0b1700 1 -- start start 2023-10-06T04:36:56.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.947+0000 7efe4d0b1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe4815b170 0x7efe4806b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:56.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.947+0000 7efe4d0b1700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7efe4815bc20 0x7efe48140890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:56.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.947+0000 7efe4d0b1700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7efe480c5300 0x7efe48140dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:56.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.947+0000 7efe4d0b1700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe480cc3b0 con 0x7efe480c5300 2023-10-06T04:36:56.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.947+0000 7efe4d0b1700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe4806c100 con 0x7efe4815bc20 2023-10-06T04:36:56.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.947+0000 7efe4d0b1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe4806c3e0 con 0x7efe4815b170 2023-10-06T04:36:56.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.947+0000 7efe4759e700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7efe480c5300 0x7efe48140dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:56.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.947+0000 7efe4759e700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7efe480c5300 0x7efe48140dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49974/0 (socket says 172.21.15.8:49974) 2023-10-06T04:36:56.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.947+0000 7efe4759e700 1 -- 172.21.15.8:0/2039631081 learned_addr learned my addr 172.21.15.8:0/2039631081 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:56.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.948+0000 7efe4659c700 1 --2- 172.21.15.8:0/2039631081 >> v2:172.21.15.184:3300/0 conn(0x7efe4815bc20 0x7efe48140890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:56.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.948+0000 7efe46d9d700 1 --2- 172.21.15.8:0/2039631081 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe4815b170 0x7efe4806b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:56.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.948+0000 7efe4759e700 1 -- 172.21.15.8:0/2039631081 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe4815b170 msgr2=0x7efe4806b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:56.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.948+0000 7efe4759e700 1 --2- 172.21.15.8:0/2039631081 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe4815b170 0x7efe4806b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:56.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.948+0000 7efe4759e700 1 -- 172.21.15.8:0/2039631081 >> v2:172.21.15.184:3300/0 conn(0x7efe4815bc20 msgr2=0x7efe48140890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:56.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.948+0000 7efe4759e700 1 --2- 172.21.15.8:0/2039631081 >> v2:172.21.15.184:3300/0 conn(0x7efe4815bc20 0x7efe48140890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:56.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.948+0000 7efe4759e700 1 -- 172.21.15.8:0/2039631081 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe4806c6c0 con 0x7efe480c5300 2023-10-06T04:36:56.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.948+0000 7efe46d9d700 1 --2- 172.21.15.8:0/2039631081 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe4815b170 0x7efe4806b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:36:56.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.948+0000 7efe4659c700 1 --2- 172.21.15.8:0/2039631081 >> v2:172.21.15.184:3300/0 conn(0x7efe4815bc20 0x7efe48140890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:36:56.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.948+0000 7efe4759e700 1 --2- 172.21.15.8:0/2039631081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe480c5300 0x7efe48140dd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7efe4806b1c0 tx=0x7efe38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ef5e9a1e9a4224c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:56.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.948+0000 7efe45d9b700 1 -- 172.21.15.8:0/2039631081 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3800b860 con 0x7efe480c5300 2023-10-06T04:36:56.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.948+0000 7efe45d9b700 1 -- 172.21.15.8:0/2039631081 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3800b9c0 con 0x7efe480c5300 2023-10-06T04:36:56.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.948+0000 7efe45d9b700 1 -- 172.21.15.8:0/2039631081 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3800bd60 con 0x7efe480c5300 2023-10-06T04:36:56.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.948+0000 7efe4d0b1700 1 -- 172.21.15.8:0/2039631081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe480c5300 msgr2=0x7efe48140dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:56.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.948+0000 7efe4d0b1700 1 --2- 172.21.15.8:0/2039631081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe480c5300 0x7efe48140dd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7efe4806b1c0 tx=0x7efe38009250 comp rx=0 tx=0).stop 2023-10-06T04:36:56.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.949+0000 7efe4d0b1700 1 -- 172.21.15.8:0/2039631081 shutdown_connections 2023-10-06T04:36:56.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.949+0000 7efe4d0b1700 1 --2- 172.21.15.8:0/2039631081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe480c5300 0x7efe48140dd0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:56.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.949+0000 7efe4d0b1700 1 --2- 172.21.15.8:0/2039631081 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe4815b170 0x7efe4806b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:56.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.949+0000 7efe4d0b1700 1 --2- 172.21.15.8:0/2039631081 >> v2:172.21.15.184:3300/0 conn(0x7efe4815bc20 0x7efe48140890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:56.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.949+0000 7efe4d0b1700 1 -- 172.21.15.8:0/2039631081 >> 172.21.15.8:0/2039631081 conn(0x7efe480ce250 msgr2=0x7efe480ce650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:56.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.949+0000 7efe4d0b1700 1 -- 172.21.15.8:0/2039631081 shutdown_connections 2023-10-06T04:36:56.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.949+0000 7efe4d0b1700 1 -- 172.21.15.8:0/2039631081 wait complete. 2023-10-06T04:36:56.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.950+0000 7efe4d0b1700 1 Processor -- start 2023-10-06T04:36:56.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.950+0000 7efe4d0b1700 1 -- start start 2023-10-06T04:36:56.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.951+0000 7efe4d0b1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe480c5300 0x7efe480c7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:56.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.951+0000 7efe4d0b1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe4815b170 0x7efe48156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:56.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.951+0000 7efe4d0b1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe4815bc20 0x7efe48159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:56.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.951+0000 7efe4d0b1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe480c7d00 con 0x7efe4815b170 2023-10-06T04:36:56.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.951+0000 7efe4d0b1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe480c7780 con 0x7efe480c5300 2023-10-06T04:36:56.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.951+0000 7efe4d0b1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe480c5ee0 con 0x7efe4815bc20 2023-10-06T04:36:56.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.951+0000 7efe4659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe4815b170 0x7efe48156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:56.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.951+0000 7efe4659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe4815b170 0x7efe48156d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49988/0 (socket says 172.21.15.8:49988) 2023-10-06T04:36:56.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.951+0000 7efe4659c700 1 -- 172.21.15.8:0/3450573020 learned_addr learned my addr 172.21.15.8:0/3450573020 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:56.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.951+0000 7efe4759e700 1 --2- 172.21.15.8:0/3450573020 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe4815bc20 0x7efe48159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:56.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.951+0000 7efe46d9d700 1 --2- 172.21.15.8:0/3450573020 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe480c5300 0x7efe480c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:56.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.951+0000 7efe4659c700 1 -- 172.21.15.8:0/3450573020 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe4815bc20 msgr2=0x7efe48159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:56.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.951+0000 7efe4659c700 1 --2- 172.21.15.8:0/3450573020 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe4815bc20 0x7efe48159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:56.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.951+0000 7efe4659c700 1 -- 172.21.15.8:0/3450573020 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe480c5300 msgr2=0x7efe480c7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:56.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.951+0000 7efe4659c700 1 --2- 172.21.15.8:0/3450573020 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe480c5300 0x7efe480c7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:56.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.951+0000 7efe4659c700 1 -- 172.21.15.8:0/3450573020 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe380094f0 con 0x7efe4815b170 2023-10-06T04:36:56.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.951+0000 7efe4659c700 1 --2- 172.21.15.8:0/3450573020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe4815b170 0x7efe48156d00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7efe3000c800 tx=0x7efe30008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:56.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.951+0000 7efe3effd700 1 -- 172.21.15.8:0/3450573020 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe30011600 con 0x7efe4815b170 2023-10-06T04:36:56.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.951+0000 7efe3effd700 1 -- 172.21.15.8:0/3450573020 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe30011760 con 0x7efe4815b170 2023-10-06T04:36:56.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.951+0000 7efe4d0b1700 1 -- 172.21.15.8:0/3450573020 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe480c61a0 con 0x7efe4815b170 2023-10-06T04:36:56.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.951+0000 7efe3effd700 1 -- 172.21.15.8:0/3450573020 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe30011b20 con 0x7efe4815b170 2023-10-06T04:36:56.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.951+0000 7efe4d0b1700 1 -- 172.21.15.8:0/3450573020 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe480c67e0 con 0x7efe4815b170 2023-10-06T04:36:56.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.952+0000 7efe4d0b1700 1 -- 172.21.15.8:0/3450573020 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe48071550 con 0x7efe4815b170 2023-10-06T04:36:56.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.953+0000 7efe3effd700 1 -- 172.21.15.8:0/3450573020 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efe30018350 con 0x7efe4815b170 2023-10-06T04:36:56.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.953+0000 7efe3effd700 1 --2- 172.21.15.8:0/3450573020 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7efe28066f30 0x7efe280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:56.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.953+0000 7efe3effd700 1 -- 172.21.15.8:0/3450573020 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7efe30084780 con 0x7efe4815b170 2023-10-06T04:36:56.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.953+0000 7efe46d9d700 1 --2- 172.21.15.8:0/3450573020 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7efe28066f30 0x7efe280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:56.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.954+0000 7efe46d9d700 1 --2- 172.21.15.8:0/3450573020 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7efe28066f30 0x7efe280693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efe40007fd0 tx=0x7efe400077c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:56.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:56.957+0000 7efe3effd700 1 -- 172.21.15.8:0/3450573020 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efe30055030 con 0x7efe4815b170 2023-10-06T04:36:57.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.148+0000 7efe4d0b1700 1 -- 172.21.15.8:0/3450573020 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efe4813ea10 con 0x7efe4815b170 2023-10-06T04:36:57.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.148+0000 7efe3effd700 1 -- 172.21.15.8:0/3450573020 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7efe30054bc0 con 0x7efe4815b170 2023-10-06T04:36:57.151 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 8 2023-10-06T04:36:57.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.150+0000 7efe4d0b1700 1 -- 172.21.15.8:0/3450573020 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7efe28066f30 msgr2=0x7efe280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:57.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.150+0000 7efe4d0b1700 1 --2- 172.21.15.8:0/3450573020 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7efe28066f30 0x7efe280693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efe40007fd0 tx=0x7efe400077c0 comp rx=0 tx=0).stop 2023-10-06T04:36:57.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.150+0000 7efe4d0b1700 1 -- 172.21.15.8:0/3450573020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe4815b170 msgr2=0x7efe48156d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:57.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.150+0000 7efe4d0b1700 1 --2- 172.21.15.8:0/3450573020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe4815b170 0x7efe48156d00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7efe3000c800 tx=0x7efe30008040 comp rx=0 tx=0).stop 2023-10-06T04:36:57.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.150+0000 7efe4d0b1700 1 -- 172.21.15.8:0/3450573020 shutdown_connections 2023-10-06T04:36:57.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.150+0000 7efe4d0b1700 1 --2- 172.21.15.8:0/3450573020 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7efe28066f30 0x7efe280693e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:57.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.150+0000 7efe4d0b1700 1 --2- 172.21.15.8:0/3450573020 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efe4815bc20 0x7efe48159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:57.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.150+0000 7efe4d0b1700 1 --2- 172.21.15.8:0/3450573020 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe480c5300 0x7efe480c7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:57.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.150+0000 7efe4d0b1700 1 --2- 172.21.15.8:0/3450573020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe4815b170 0x7efe48156d00 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:57.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.150+0000 7efe4d0b1700 1 -- 172.21.15.8:0/3450573020 >> 172.21.15.8:0/3450573020 conn(0x7efe480ce250 msgr2=0x7efe480c8870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:57.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.150+0000 7efe4d0b1700 1 -- 172.21.15.8:0/3450573020 shutdown_connections 2023-10-06T04:36:57.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.150+0000 7efe4d0b1700 1 -- 172.21.15.8:0/3450573020 wait complete. 2023-10-06T04:36:57.165 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:36:57.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.286+0000 7f2685d0d700 1 Processor -- start 2023-10-06T04:36:57.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.286+0000 7f2685d0d700 1 -- start start 2023-10-06T04:36:57.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.287+0000 7f2685d0d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2680142cf0 0x7f26800b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:57.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.287+0000 7f2685d0d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f26801430c0 0x7f26800cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:57.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.287+0000 7f2685d0d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f26800cfee0 0x7f26800b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:57.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.287+0000 7f2685d0d700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26800cf510 con 0x7f2680142cf0 2023-10-06T04:36:57.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.287+0000 7f2685d0d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26800ce6a0 con 0x7f26801430c0 2023-10-06T04:36:57.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.287+0000 7f2685d0d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26800ce900 con 0x7f26800cfee0 2023-10-06T04:36:57.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.287+0000 7f267f7fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2680142cf0 0x7f26800b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:57.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.287+0000 7f267f7fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2680142cf0 0x7f26800b5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49990/0 (socket says 172.21.15.8:49990) 2023-10-06T04:36:57.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.287+0000 7f267f7fe700 1 -- 172.21.15.8:0/975354823 learned_addr learned my addr 172.21.15.8:0/975354823 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:57.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.287+0000 7f267effd700 1 --2- 172.21.15.8:0/975354823 >> v2:172.21.15.184:3300/0 conn(0x7f26801430c0 0x7f26800cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:57.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.287+0000 7f267ffff700 1 --2- 172.21.15.8:0/975354823 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f26800cfee0 0x7f26800b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:57.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.288+0000 7f267f7fe700 1 -- 172.21.15.8:0/975354823 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f26800cfee0 msgr2=0x7f26800b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:57.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.288+0000 7f267f7fe700 1 --2- 172.21.15.8:0/975354823 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f26800cfee0 0x7f26800b3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:57.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.288+0000 7f267f7fe700 1 -- 172.21.15.8:0/975354823 >> v2:172.21.15.184:3300/0 conn(0x7f26801430c0 msgr2=0x7f26800cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:57.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.288+0000 7f267f7fe700 1 --2- 172.21.15.8:0/975354823 >> v2:172.21.15.184:3300/0 conn(0x7f26801430c0 0x7f26800cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:57.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.288+0000 7f267f7fe700 1 -- 172.21.15.8:0/975354823 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26800cebe0 con 0x7f2680142cf0 2023-10-06T04:36:57.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.288+0000 7f267f7fe700 1 --2- 172.21.15.8:0/975354823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2680142cf0 0x7f26800b5cd0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f26800ab440 tx=0x7f2670009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1777a72e832378aa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:57.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.288+0000 7f267e7fc700 1 -- 172.21.15.8:0/975354823 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2670009e70 con 0x7f2680142cf0 2023-10-06T04:36:57.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.288+0000 7f267e7fc700 1 -- 172.21.15.8:0/975354823 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f267000b860 con 0x7f2680142cf0 2023-10-06T04:36:57.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.288+0000 7f267e7fc700 1 -- 172.21.15.8:0/975354823 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267000bc00 con 0x7f2680142cf0 2023-10-06T04:36:57.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.288+0000 7f2685d0d700 1 -- 172.21.15.8:0/975354823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2680142cf0 msgr2=0x7f26800b5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:57.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.288+0000 7f2685d0d700 1 --2- 172.21.15.8:0/975354823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2680142cf0 0x7f26800b5cd0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f26800ab440 tx=0x7f2670009250 comp rx=0 tx=0).stop 2023-10-06T04:36:57.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.288+0000 7f2685d0d700 1 -- 172.21.15.8:0/975354823 shutdown_connections 2023-10-06T04:36:57.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.288+0000 7f2685d0d700 1 --2- 172.21.15.8:0/975354823 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f26800cfee0 0x7f26800b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:57.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.288+0000 7f2685d0d700 1 --2- 172.21.15.8:0/975354823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2680142cf0 0x7f26800b5cd0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:57.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.288+0000 7f2685d0d700 1 --2- 172.21.15.8:0/975354823 >> v2:172.21.15.184:3300/0 conn(0x7f26801430c0 0x7f26800cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:57.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.288+0000 7f2685d0d700 1 -- 172.21.15.8:0/975354823 >> 172.21.15.8:0/975354823 conn(0x7f268006ed00 msgr2=0x7f268006f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:57.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.288+0000 7f2685d0d700 1 -- 172.21.15.8:0/975354823 shutdown_connections 2023-10-06T04:36:57.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.288+0000 7f2685d0d700 1 -- 172.21.15.8:0/975354823 wait complete. 2023-10-06T04:36:57.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.290+0000 7f2685d0d700 1 Processor -- start 2023-10-06T04:36:57.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.290+0000 7f2685d0d700 1 -- start start 2023-10-06T04:36:57.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.290+0000 7f2685d0d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26800cfee0 0x7f268015c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:57.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.290+0000 7f2685d0d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2680142cf0 0x7f26801586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:57.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.291+0000 7f2685d0d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26801430c0 0x7f2680169b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:57.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.291+0000 7f2685d0d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268015cd20 con 0x7f26801430c0 2023-10-06T04:36:57.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.291+0000 7f2685d0d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268015cf10 con 0x7f26800cfee0 2023-10-06T04:36:57.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.291+0000 7f2685d0d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f268015a780 con 0x7f2680142cf0 2023-10-06T04:36:57.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.291+0000 7f267ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26801430c0 0x7f2680169b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:57.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.291+0000 7f267ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26801430c0 0x7f2680169b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49996/0 (socket says 172.21.15.8:49996) 2023-10-06T04:36:57.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.291+0000 7f267ffff700 1 -- 172.21.15.8:0/1032533366 learned_addr learned my addr 172.21.15.8:0/1032533366 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:57.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.291+0000 7f267effd700 1 --2- 172.21.15.8:0/1032533366 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2680142cf0 0x7f26801586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:57.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.291+0000 7f267f7fe700 1 --2- 172.21.15.8:0/1032533366 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26800cfee0 0x7f268015c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:57.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.291+0000 7f267ffff700 1 -- 172.21.15.8:0/1032533366 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2680142cf0 msgr2=0x7f26801586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:57.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.291+0000 7f267ffff700 1 --2- 172.21.15.8:0/1032533366 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2680142cf0 0x7f26801586b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:57.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.291+0000 7f267ffff700 1 -- 172.21.15.8:0/1032533366 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26800cfee0 msgr2=0x7f268015c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:57.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.291+0000 7f267ffff700 1 --2- 172.21.15.8:0/1032533366 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26800cfee0 0x7f268015c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:57.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.291+0000 7f267ffff700 1 -- 172.21.15.8:0/1032533366 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26700094f0 con 0x7f26801430c0 2023-10-06T04:36:57.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.291+0000 7f267ffff700 1 --2- 172.21.15.8:0/1032533366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26801430c0 0x7f2680169b00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2678009fa0 tx=0x7f2678009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:57.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.291+0000 7f26677fe700 1 -- 172.21.15.8:0/1032533366 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267800ebc0 con 0x7f26801430c0 2023-10-06T04:36:57.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.291+0000 7f26677fe700 1 -- 172.21.15.8:0/1032533366 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f267800ed20 con 0x7f26801430c0 2023-10-06T04:36:57.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.291+0000 7f2685d0d700 1 -- 172.21.15.8:0/1032533366 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f268015aa60 con 0x7f26801430c0 2023-10-06T04:36:57.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.291+0000 7f26677fe700 1 -- 172.21.15.8:0/1032533366 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2678014670 con 0x7f26801430c0 2023-10-06T04:36:57.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.291+0000 7f2685d0d700 1 -- 172.21.15.8:0/1032533366 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f268015b020 con 0x7f26801430c0 2023-10-06T04:36:57.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.292+0000 7f2685d0d700 1 -- 172.21.15.8:0/1032533366 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f268015b240 con 0x7f26801430c0 2023-10-06T04:36:57.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.293+0000 7f26677fe700 1 -- 172.21.15.8:0/1032533366 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f26780149e0 con 0x7f26801430c0 2023-10-06T04:36:57.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.293+0000 7f26677fe700 1 --2- 172.21.15.8:0/1032533366 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f266c066f30 0x7f266c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:57.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.293+0000 7f26677fe700 1 -- 172.21.15.8:0/1032533366 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f26780850c0 con 0x7f26801430c0 2023-10-06T04:36:57.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.293+0000 7f267f7fe700 1 --2- 172.21.15.8:0/1032533366 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f266c066f30 0x7f266c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:57.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.294+0000 7f267f7fe700 1 --2- 172.21.15.8:0/1032533366 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f266c066f30 0x7f266c0693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f26800ab440 tx=0x7f2670017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:57.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.297+0000 7f26677fe700 1 -- 172.21.15.8:0/1032533366 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2678051e40 con 0x7f26801430c0 2023-10-06T04:36:57.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.489+0000 7f2685d0d700 1 -- 172.21.15.8:0/1032533366 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2680071550 con 0x7f26801430c0 2023-10-06T04:36:57.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.489+0000 7f26677fe700 1 -- 172.21.15.8:0/1032533366 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2678055460 con 0x7f26801430c0 2023-10-06T04:36:57.492 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-06T04:36:57.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.491+0000 7f2685d0d700 1 -- 172.21.15.8:0/1032533366 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f266c066f30 msgr2=0x7f266c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:57.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.491+0000 7f2685d0d700 1 --2- 172.21.15.8:0/1032533366 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f266c066f30 0x7f266c0693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f26800ab440 tx=0x7f2670017000 comp rx=0 tx=0).stop 2023-10-06T04:36:57.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.491+0000 7f2685d0d700 1 -- 172.21.15.8:0/1032533366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26801430c0 msgr2=0x7f2680169b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:57.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.491+0000 7f2685d0d700 1 --2- 172.21.15.8:0/1032533366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26801430c0 0x7f2680169b00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2678009fa0 tx=0x7f2678009900 comp rx=0 tx=0).stop 2023-10-06T04:36:57.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.491+0000 7f2685d0d700 1 -- 172.21.15.8:0/1032533366 shutdown_connections 2023-10-06T04:36:57.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.491+0000 7f2685d0d700 1 --2- 172.21.15.8:0/1032533366 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f266c066f30 0x7f266c0693e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:57.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.491+0000 7f2685d0d700 1 --2- 172.21.15.8:0/1032533366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26801430c0 0x7f2680169b00 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:57.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.491+0000 7f2685d0d700 1 --2- 172.21.15.8:0/1032533366 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26800cfee0 0x7f268015c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:57.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.491+0000 7f2685d0d700 1 --2- 172.21.15.8:0/1032533366 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2680142cf0 0x7f26801586b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:57.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.491+0000 7f2685d0d700 1 -- 172.21.15.8:0/1032533366 >> 172.21.15.8:0/1032533366 conn(0x7f268006ed00 msgr2=0x7f26800b5290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:57.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.491+0000 7f2685d0d700 1 -- 172.21.15.8:0/1032533366 shutdown_connections 2023-10-06T04:36:57.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.491+0000 7f2685d0d700 1 -- 172.21.15.8:0/1032533366 wait complete. 2023-10-06T04:36:57.506 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:36:57.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.626+0000 7fd0e548d700 1 Processor -- start 2023-10-06T04:36:57.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.626+0000 7fd0e548d700 1 -- start start 2023-10-06T04:36:57.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.626+0000 7fd0e548d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0e00b1c70 0x7fd0e00b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:57.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.626+0000 7fd0e548d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd0e015ad80 0x7fd0e015b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:57.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.626+0000 7fd0e548d700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0e00b2620 con 0x7fd0e0156e30 2023-10-06T04:36:57.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.626+0000 7fd0e548d700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0e00cf370 con 0x7fd0e015ad80 2023-10-06T04:36:57.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.626+0000 7fd0e548d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e00ce800 con 0x7fd0e00b1c70 2023-10-06T04:36:57.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.627+0000 7fd0e4c8c700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd0e015ad80 0x7fd0e015b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:57.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.627+0000 7fd0dffff700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fd0e0156e30 0x7fd0e00cf800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60898/0 (socket says 172.21.15.8:60898) 2023-10-06T04:36:57.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.627+0000 7fd0e4c8c700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd0e015ad80 0x7fd0e015b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50004/0 (socket says 172.21.15.8:50004) 2023-10-06T04:36:57.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.627+0000 7fd0dffff700 1 -- 172.21.15.8:0/4193701843 learned_addr learned my addr 172.21.15.8:0/4193701843 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:57.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.627+0000 7fd0e4c8c700 1 -- 172.21.15.8:0/4193701843 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0e00b1c70 msgr2=0x7fd0e00b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:57.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.627+0000 7fd0df7fe700 1 --2- 172.21.15.8:0/4193701843 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0e00b1c70 0x7fd0e00b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:57.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.627+0000 7fd0e4c8c700 1 --2- 172.21.15.8:0/4193701843 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0e00b1c70 0x7fd0e00b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:57.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.627+0000 7fd0e4c8c700 1 -- 172.21.15.8:0/4193701843 >> v1:172.21.15.8:6789/0 conn(0x7fd0e0156e30 legacy=0x7fd0e00cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:57.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.627+0000 7fd0deffd700 1 -- 172.21.15.8:0/4193701843 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 959825821 0 0) 0x7fd0e00b2620 con 0x7fd0e0156e30 2023-10-06T04:36:57.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.627+0000 7fd0e4c8c700 1 -- 172.21.15.8:0/4193701843 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e00cea60 con 0x7fd0e015ad80 2023-10-06T04:36:57.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.627+0000 7fd0e4c8c700 1 --2- 172.21.15.8:0/4193701843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0e015ad80 0x7fd0e015b1e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd0e00cec50 tx=0x7fd0d8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c328ad47ba7105d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:57.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.627+0000 7fd0deffd700 1 -- 172.21.15.8:0/4193701843 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d8016070 con 0x7fd0e015ad80 2023-10-06T04:36:57.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.627+0000 7fd0deffd700 1 -- 172.21.15.8:0/4193701843 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d800bc30 con 0x7fd0e015ad80 2023-10-06T04:36:57.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.627+0000 7fd0deffd700 1 -- 172.21.15.8:0/4193701843 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d800e070 con 0x7fd0e015ad80 2023-10-06T04:36:57.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.628+0000 7fd0e548d700 1 -- 172.21.15.8:0/4193701843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0e015ad80 msgr2=0x7fd0e015b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:57.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.628+0000 7fd0e548d700 1 --2- 172.21.15.8:0/4193701843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0e015ad80 0x7fd0e015b1e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd0e00cec50 tx=0x7fd0d8009780 comp rx=0 tx=0).stop 2023-10-06T04:36:57.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.628+0000 7fd0e548d700 1 -- 172.21.15.8:0/4193701843 shutdown_connections 2023-10-06T04:36:57.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.628+0000 7fd0e548d700 1 --2- 172.21.15.8:0/4193701843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0e015ad80 0x7fd0e015b1e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:57.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.628+0000 7fd0e548d700 1 --2- 172.21.15.8:0/4193701843 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0e00b1c70 0x7fd0e00b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:57.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.628+0000 7fd0e548d700 1 -- 172.21.15.8:0/4193701843 >> 172.21.15.8:0/4193701843 conn(0x7fd0e006ed00 msgr2=0x7fd0e006f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:57.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.628+0000 7fd0e548d700 1 -- 172.21.15.8:0/4193701843 shutdown_connections 2023-10-06T04:36:57.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.628+0000 7fd0e548d700 1 -- 172.21.15.8:0/4193701843 wait complete. 2023-10-06T04:36:57.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.629+0000 7fd0e548d700 1 Processor -- start 2023-10-06T04:36:57.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.629+0000 7fd0e548d700 1 -- start start 2023-10-06T04:36:57.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.630+0000 7fd0e548d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0e00b1c70 0x7fd0e013eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:57.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.630+0000 7fd0e548d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0e0156e30 0x7fd0e015b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:57.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.630+0000 7fd0e548d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0e015ad80 0x7fd0e015bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:57.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.630+0000 7fd0e548d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e014f720 con 0x7fd0e015ad80 2023-10-06T04:36:57.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.630+0000 7fd0e548d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e016dc50 con 0x7fd0e0156e30 2023-10-06T04:36:57.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.630+0000 7fd0e548d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e016d080 con 0x7fd0e00b1c70 2023-10-06T04:36:57.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.630+0000 7fd0e4c8c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0e015ad80 0x7fd0e015bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:57.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.630+0000 7fd0e4c8c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0e015ad80 0x7fd0e015bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50014/0 (socket says 172.21.15.8:50014) 2023-10-06T04:36:57.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.630+0000 7fd0e4c8c700 1 -- 172.21.15.8:0/4157184358 learned_addr learned my addr 172.21.15.8:0/4157184358 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:57.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.630+0000 7fd0e4c8c700 1 -- 172.21.15.8:0/4157184358 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0e00b1c70 msgr2=0x7fd0e013eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:57.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.630+0000 7fd0e4c8c700 1 --2- 172.21.15.8:0/4157184358 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0e00b1c70 0x7fd0e013eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:57.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.630+0000 7fd0e4c8c700 1 -- 172.21.15.8:0/4157184358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0e0156e30 msgr2=0x7fd0e015b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:57.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.630+0000 7fd0e4c8c700 1 --2- 172.21.15.8:0/4157184358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0e0156e30 0x7fd0e015b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:57.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.630+0000 7fd0e4c8c700 1 -- 172.21.15.8:0/4157184358 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d8009a20 con 0x7fd0e015ad80 2023-10-06T04:36:57.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.630+0000 7fd0e4c8c700 1 --2- 172.21.15.8:0/4157184358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0e015ad80 0x7fd0e015bcb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd0d80097c0 tx=0x7fd0d8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:57.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.630+0000 7fd0c7fff700 1 -- 172.21.15.8:0/4157184358 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d801d650 con 0x7fd0e015ad80 2023-10-06T04:36:57.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.631+0000 7fd0c7fff700 1 -- 172.21.15.8:0/4157184358 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d801d7b0 con 0x7fd0e015ad80 2023-10-06T04:36:57.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.631+0000 7fd0e548d700 1 -- 172.21.15.8:0/4157184358 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0e016d320 con 0x7fd0e015ad80 2023-10-06T04:36:57.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.631+0000 7fd0c7fff700 1 -- 172.21.15.8:0/4157184358 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d801db70 con 0x7fd0e015ad80 2023-10-06T04:36:57.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.631+0000 7fd0e548d700 1 -- 172.21.15.8:0/4157184358 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0e016d8e0 con 0x7fd0e015ad80 2023-10-06T04:36:57.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.632+0000 7fd0e548d700 1 -- 172.21.15.8:0/4157184358 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0e004c380 con 0x7fd0e015ad80 2023-10-06T04:36:57.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.632+0000 7fd0c7fff700 1 -- 172.21.15.8:0/4157184358 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd0d8024070 con 0x7fd0e015ad80 2023-10-06T04:36:57.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.632+0000 7fd0c7fff700 1 --2- 172.21.15.8:0/4157184358 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd0cc066f30 0x7fd0cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:57.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.633+0000 7fd0c7fff700 1 -- 172.21.15.8:0/4157184358 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd0d8087330 con 0x7fd0e015ad80 2023-10-06T04:36:57.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.633+0000 7fd0dffff700 1 --2- 172.21.15.8:0/4157184358 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd0cc066f30 0x7fd0cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:57.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.633+0000 7fd0dffff700 1 --2- 172.21.15.8:0/4157184358 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd0cc066f30 0x7fd0cc0693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd0d0001660 tx=0x7fd0d0007bd0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:57.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.637+0000 7fd0c7fff700 1 -- 172.21.15.8:0/4157184358 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd0d8054150 con 0x7fd0e015ad80 2023-10-06T04:36:57.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.828+0000 7fd0e548d700 1 -- 172.21.15.8:0/4157184358 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd0e016ddc0 con 0x7fd0e015ad80 2023-10-06T04:36:57.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.829+0000 7fd0c7fff700 1 -- 172.21.15.8:0/4157184358 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd0d8057770 con 0x7fd0e015ad80 2023-10-06T04:36:57.831 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-06T04:36:57.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.830+0000 7fd0e548d700 1 -- 172.21.15.8:0/4157184358 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd0cc066f30 msgr2=0x7fd0cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:57.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.830+0000 7fd0e548d700 1 --2- 172.21.15.8:0/4157184358 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd0cc066f30 0x7fd0cc0693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd0d0001660 tx=0x7fd0d0007bd0 comp rx=0 tx=0).stop 2023-10-06T04:36:57.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.830+0000 7fd0e548d700 1 -- 172.21.15.8:0/4157184358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0e015ad80 msgr2=0x7fd0e015bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:57.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.830+0000 7fd0e548d700 1 --2- 172.21.15.8:0/4157184358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0e015ad80 0x7fd0e015bcb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd0d80097c0 tx=0x7fd0d8018000 comp rx=0 tx=0).stop 2023-10-06T04:36:57.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.830+0000 7fd0e548d700 1 -- 172.21.15.8:0/4157184358 shutdown_connections 2023-10-06T04:36:57.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.830+0000 7fd0e548d700 1 --2- 172.21.15.8:0/4157184358 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd0cc066f30 0x7fd0cc0693e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:57.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.830+0000 7fd0e548d700 1 --2- 172.21.15.8:0/4157184358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0e015ad80 0x7fd0e015bcb0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:57.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.830+0000 7fd0e548d700 1 --2- 172.21.15.8:0/4157184358 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0e00b1c70 0x7fd0e013eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:57.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.830+0000 7fd0e548d700 1 --2- 172.21.15.8:0/4157184358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0e0156e30 0x7fd0e015b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:57.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.830+0000 7fd0e548d700 1 -- 172.21.15.8:0/4157184358 >> 172.21.15.8:0/4157184358 conn(0x7fd0e006ed00 msgr2=0x7fd0e0070790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:57.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.831+0000 7fd0e548d700 1 -- 172.21.15.8:0/4157184358 shutdown_connections 2023-10-06T04:36:57.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.831+0000 7fd0e548d700 1 -- 172.21.15.8:0/4157184358 wait complete. 2023-10-06T04:36:57.845 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:36:57.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.964+0000 7f2169b91700 1 Processor -- start 2023-10-06T04:36:57.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.964+0000 7f2169b91700 1 -- start start 2023-10-06T04:36:57.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.965+0000 7f2169b91700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21640cbc10 0x7f2164160910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:57.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.965+0000 7f2169b91700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21640ca770 con 0x7f21641536a0 2023-10-06T04:36:57.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.965+0000 7f2169b91700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f216406d6d0 con 0x7f21641532d0 2023-10-06T04:36:57.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.965+0000 7f2169b91700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216406a930 con 0x7f21640cbc10 2023-10-06T04:36:57.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.965+0000 7f2162ffd700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f21641536a0 0x7f2164159530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60900/0 (socket says 172.21.15.8:60900) 2023-10-06T04:36:57.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.965+0000 7f2162ffd700 1 -- 172.21.15.8:0/975173112 learned_addr learned my addr 172.21.15.8:0/975173112 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:57.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.965+0000 7f2163fff700 1 --2- 172.21.15.8:0/975173112 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21640cbc10 0x7f2164160910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:57.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.966+0000 7f21627fc700 1 -- 172.21.15.8:0/975173112 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989805464 0 0) 0x7f21640ca770 con 0x7f21641536a0 2023-10-06T04:36:57.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.966+0000 7f21627fc700 1 -- 172.21.15.8:0/975173112 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f214c003570 con 0x7f21641536a0 2023-10-06T04:36:57.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.966+0000 7f21627fc700 1 -- 172.21.15.8:0/975173112 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 28040948 0 0) 0x7f214c003570 con 0x7f21641536a0 2023-10-06T04:36:57.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.966+0000 7f21627fc700 1 -- 172.21.15.8:0/975173112 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21640cbc10 msgr2=0x7f2164160910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:57.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.966+0000 7f21627fc700 1 --2- 172.21.15.8:0/975173112 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21640cbc10 0x7f2164160910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:57.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.966+0000 7f21627fc700 1 -- 172.21.15.8:0/975173112 >> v1:172.21.15.184:6789/0 conn(0x7f21641532d0 legacy=0x7f21640698d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:57.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.966+0000 7f21627fc700 1 -- 172.21.15.8:0/975173112 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216406a370 con 0x7f21641536a0 2023-10-06T04:36:57.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.966+0000 7f21627fc700 1 -- 172.21.15.8:0/975173112 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7f2158001470 con 0x7f21641536a0 2023-10-06T04:36:57.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.966+0000 7f21627fc700 1 -- 172.21.15.8:0/975173112 >> v1:172.21.15.8:6789/0 conn(0x7f21641536a0 legacy=0x7f2164159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:57.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.966+0000 7f21627fc700 1 --2- 172.21.15.8:0/975173112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f214c003a90 0x7f214c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:57.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.966+0000 7f21627fc700 1 --2- 172.21.15.8:0/975173112 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f214c004810 0x7f214c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:57.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.966+0000 7f21627fc700 1 --2- 172.21.15.8:0/975173112 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f214c0051c0 0x7f214c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:57.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.966+0000 7f21627fc700 1 -- 172.21.15.8:0/975173112 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216406a930 con 0x7f214c004810 2023-10-06T04:36:57.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.966+0000 7f21627fc700 1 -- 172.21.15.8:0/975173112 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c00d0b0 con 0x7f214c003a90 2023-10-06T04:36:57.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.966+0000 7f21627fc700 1 -- 172.21.15.8:0/975173112 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f214c00d1f0 con 0x7f214c0051c0 2023-10-06T04:36:57.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.966+0000 7f2162ffd700 1 --2- 172.21.15.8:0/975173112 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f214c004810 0x7f214c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:57.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.966+0000 7f21637fe700 1 --2- 172.21.15.8:0/975173112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f214c003a90 0x7f214c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:57.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.966+0000 7f2163fff700 1 --2- 172.21.15.8:0/975173112 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f214c0051c0 0x7f214c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:57.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.966+0000 7f2162ffd700 1 -- 172.21.15.8:0/975173112 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f214c0051c0 msgr2=0x7f214c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:57.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.966+0000 7f2162ffd700 1 --2- 172.21.15.8:0/975173112 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f214c0051c0 0x7f214c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:57.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.966+0000 7f2162ffd700 1 -- 172.21.15.8:0/975173112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f214c003a90 msgr2=0x7f214c003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:57.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.966+0000 7f2162ffd700 1 --2- 172.21.15.8:0/975173112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f214c003a90 0x7f214c003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:57.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.966+0000 7f2162ffd700 1 -- 172.21.15.8:0/975173112 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214c003570 con 0x7f214c004810 2023-10-06T04:36:57.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.967+0000 7f2162ffd700 1 --2- 172.21.15.8:0/975173112 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f214c004810 0x7f214c004c80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f215800c390 tx=0x7f21640ca6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=676176bfc1f20424 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:57.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.967+0000 7f21627fc700 1 -- 172.21.15.8:0/975173112 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215800cc60 con 0x7f214c004810 2023-10-06T04:36:57.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.967+0000 7f21627fc700 1 -- 172.21.15.8:0/975173112 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215800ce00 con 0x7f214c004810 2023-10-06T04:36:57.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.967+0000 7f21627fc700 1 -- 172.21.15.8:0/975173112 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2158005b70 con 0x7f214c004810 2023-10-06T04:36:57.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.967+0000 7f2169b91700 1 -- 172.21.15.8:0/975173112 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f214c004810 msgr2=0x7f214c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:57.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.967+0000 7f2169b91700 1 --2- 172.21.15.8:0/975173112 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f214c004810 0x7f214c004c80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f215800c390 tx=0x7f21640ca6e0 comp rx=0 tx=0).stop 2023-10-06T04:36:57.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.967+0000 7f2163fff700 1 -- 172.21.15.8:0/975173112 reap_dead start 2023-10-06T04:36:57.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.967+0000 7f2169b91700 1 -- 172.21.15.8:0/975173112 shutdown_connections 2023-10-06T04:36:57.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.967+0000 7f2169b91700 1 -- 172.21.15.8:0/975173112 >> 172.21.15.8:0/975173112 conn(0x7f21640680a0 msgr2=0x7f21640cc020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:57.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.967+0000 7f2169b91700 1 -- 172.21.15.8:0/975173112 shutdown_connections 2023-10-06T04:36:57.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.967+0000 7f2169b91700 1 -- 172.21.15.8:0/975173112 wait complete. 2023-10-06T04:36:57.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.969+0000 7f2169b91700 1 Processor -- start 2023-10-06T04:36:57.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.969+0000 7f2169b91700 1 -- start start 2023-10-06T04:36:57.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.969+0000 7f2169b91700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f214c004810 0x7f21640c30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:57.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.969+0000 7f2169b91700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21640cc300 0x7f2164145a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:57.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.969+0000 7f2169b91700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21640c4290 0x7f21640c4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:57.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.969+0000 7f2169b91700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21640c4c70 con 0x7f214c004810 2023-10-06T04:36:57.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.969+0000 7f2169b91700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21640ccbb0 con 0x7f21640cc300 2023-10-06T04:36:57.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.969+0000 7f2169b91700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21640c4050 con 0x7f21640c4290 2023-10-06T04:36:57.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.969+0000 7f21637fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f214c004810 0x7f21640c30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:57.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.969+0000 7f21637fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f214c004810 0x7f21640c30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50036/0 (socket says 172.21.15.8:50036) 2023-10-06T04:36:57.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.969+0000 7f21637fe700 1 -- 172.21.15.8:0/1954679805 learned_addr learned my addr 172.21.15.8:0/1954679805 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:57.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.970+0000 7f2163fff700 1 --2- 172.21.15.8:0/1954679805 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21640c4290 0x7f21640c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:57.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.970+0000 7f2162ffd700 1 --2- 172.21.15.8:0/1954679805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21640cc300 0x7f2164145a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:57.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.970+0000 7f21637fe700 1 -- 172.21.15.8:0/1954679805 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21640c4290 msgr2=0x7f21640c4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:57.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.970+0000 7f21637fe700 1 --2- 172.21.15.8:0/1954679805 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21640c4290 0x7f21640c4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:57.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.970+0000 7f21637fe700 1 -- 172.21.15.8:0/1954679805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21640cc300 msgr2=0x7f2164145a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:57.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.970+0000 7f21637fe700 1 --2- 172.21.15.8:0/1954679805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21640cc300 0x7f2164145a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:57.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.970+0000 7f21637fe700 1 -- 172.21.15.8:0/1954679805 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21640c37b0 con 0x7f214c004810 2023-10-06T04:36:57.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.970+0000 7f2163fff700 1 --2- 172.21.15.8:0/1954679805 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21640c4290 0x7f21640c4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:36:57.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.970+0000 7f2162ffd700 1 --2- 172.21.15.8:0/1954679805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21640cc300 0x7f2164145a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:36:57.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.970+0000 7f21637fe700 1 --2- 172.21.15.8:0/1954679805 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f214c004810 0x7f21640c30d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2154002b80 tx=0x7f2154007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:57.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.970+0000 7f214b7fe700 1 -- 172.21.15.8:0/1954679805 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2154003570 con 0x7f214c004810 2023-10-06T04:36:57.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.970+0000 7f214b7fe700 1 -- 172.21.15.8:0/1954679805 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215400fa00 con 0x7f214c004810 2023-10-06T04:36:57.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.970+0000 7f2169b91700 1 -- 172.21.15.8:0/1954679805 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21640c3a90 con 0x7f214c004810 2023-10-06T04:36:57.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.970+0000 7f214b7fe700 1 -- 172.21.15.8:0/1954679805 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215400fdc0 con 0x7f214c004810 2023-10-06T04:36:57.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.970+0000 7f2169b91700 1 -- 172.21.15.8:0/1954679805 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f216414dc40 con 0x7f214c004810 2023-10-06T04:36:57.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.971+0000 7f2169b91700 1 -- 172.21.15.8:0/1954679805 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f216414de60 con 0x7f214c004810 2023-10-06T04:36:57.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.972+0000 7f214b7fe700 1 -- 172.21.15.8:0/1954679805 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2154013600 con 0x7f214c004810 2023-10-06T04:36:57.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.972+0000 7f214b7fe700 1 --2- 172.21.15.8:0/1954679805 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2150066f30 0x7f21500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:57.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.972+0000 7f214b7fe700 1 -- 172.21.15.8:0/1954679805 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f2154084ff0 con 0x7f214c004810 2023-10-06T04:36:57.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.972+0000 7f2162ffd700 1 --2- 172.21.15.8:0/1954679805 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2150066f30 0x7f21500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:57.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.973+0000 7f2162ffd700 1 --2- 172.21.15.8:0/1954679805 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2150066f30 0x7f21500693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f215800c390 tx=0x7f2158015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:57.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:57.976+0000 7f214b7fe700 1 -- 172.21.15.8:0/1954679805 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2154051e10 con 0x7f214c004810 2023-10-06T04:36:58.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.171+0000 7f2169b91700 1 -- 172.21.15.8:0/1954679805 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2164071550 con 0x7f214c004810 2023-10-06T04:36:58.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.171+0000 7f214b7fe700 1 -- 172.21.15.8:0/1954679805 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2154017020 con 0x7f214c004810 2023-10-06T04:36:58.174 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-06T04:36:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.173+0000 7f2169b91700 1 -- 172.21.15.8:0/1954679805 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2150066f30 msgr2=0x7f21500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.173+0000 7f2169b91700 1 --2- 172.21.15.8:0/1954679805 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2150066f30 0x7f21500693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f215800c390 tx=0x7f2158015000 comp rx=0 tx=0).stop 2023-10-06T04:36:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.173+0000 7f2169b91700 1 -- 172.21.15.8:0/1954679805 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f214c004810 msgr2=0x7f21640c30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.173+0000 7f2169b91700 1 --2- 172.21.15.8:0/1954679805 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f214c004810 0x7f21640c30d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2154002b80 tx=0x7f2154007d10 comp rx=0 tx=0).stop 2023-10-06T04:36:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.173+0000 7f2169b91700 1 -- 172.21.15.8:0/1954679805 shutdown_connections 2023-10-06T04:36:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.173+0000 7f2169b91700 1 --2- 172.21.15.8:0/1954679805 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2150066f30 0x7f21500693e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.173+0000 7f2169b91700 1 --2- 172.21.15.8:0/1954679805 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21640c4290 0x7f21640c4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.173+0000 7f2169b91700 1 --2- 172.21.15.8:0/1954679805 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f214c004810 0x7f21640c30d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.173+0000 7f2169b91700 1 --2- 172.21.15.8:0/1954679805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21640cc300 0x7f2164145a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.173+0000 7f2169b91700 1 -- 172.21.15.8:0/1954679805 >> 172.21.15.8:0/1954679805 conn(0x7f21640680a0 msgr2=0x7f2164151d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.173+0000 7f2169b91700 1 -- 172.21.15.8:0/1954679805 shutdown_connections 2023-10-06T04:36:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.173+0000 7f2169b91700 1 -- 172.21.15.8:0/1954679805 wait complete. 2023-10-06T04:36:58.188 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T04:36:58.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.307+0000 7fe5869dd700 1 Processor -- start 2023-10-06T04:36:58.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.307+0000 7fe5869dd700 1 -- start start 2023-10-06T04:36:58.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.308+0000 7fe5869dd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe58015b170 0x7fe58006b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:58.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.308+0000 7fe5869dd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe580140fa0 0x7fe5800cc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:58.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.308+0000 7fe5869dd700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5800cc3b0 con 0x7fe58015bc20 2023-10-06T04:36:58.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.308+0000 7fe5869dd700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe58006c100 con 0x7fe580140fa0 2023-10-06T04:36:58.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.308+0000 7fe5869dd700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe58006c3e0 con 0x7fe58015b170 2023-10-06T04:36:58.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.308+0000 7fe57f7fe700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe58015bc20 0x7fe580140890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60904/0 (socket says 172.21.15.8:60904) 2023-10-06T04:36:58.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.308+0000 7fe57f7fe700 1 -- 172.21.15.8:0/4275839737 learned_addr learned my addr 172.21.15.8:0/4275839737 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:58.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.309+0000 7fe584f7a700 1 --2- 172.21.15.8:0/4275839737 >> v2:172.21.15.184:3300/0 conn(0x7fe580140fa0 0x7fe5800cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:58.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.309+0000 7fe57ffff700 1 --2- 172.21.15.8:0/4275839737 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe58015b170 0x7fe58006b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:58.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.309+0000 7fe57effd700 1 -- 172.21.15.8:0/4275839737 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2496829631 0 0) 0x7fe5800cc3b0 con 0x7fe58015bc20 2023-10-06T04:36:58.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.309+0000 7fe57effd700 1 -- 172.21.15.8:0/4275839737 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe568003570 con 0x7fe58015bc20 2023-10-06T04:36:58.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.309+0000 7fe57effd700 1 -- 172.21.15.8:0/4275839737 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2499555108 0 0) 0x7fe568003570 con 0x7fe58015bc20 2023-10-06T04:36:58.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.309+0000 7fe57effd700 1 -- 172.21.15.8:0/4275839737 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe58015b170 msgr2=0x7fe58006b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:58.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.309+0000 7fe57effd700 1 --2- 172.21.15.8:0/4275839737 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe58015b170 0x7fe58006b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:58.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.309+0000 7fe57effd700 1 -- 172.21.15.8:0/4275839737 >> v2:172.21.15.184:3300/0 conn(0x7fe580140fa0 msgr2=0x7fe5800cc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:58.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.309+0000 7fe57effd700 1 --2- 172.21.15.8:0/4275839737 >> v2:172.21.15.184:3300/0 conn(0x7fe580140fa0 0x7fe5800cc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:58.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.309+0000 7fe57effd700 1 -- 172.21.15.8:0/4275839737 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe58006c6c0 con 0x7fe58015bc20 2023-10-06T04:36:58.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.309+0000 7fe57effd700 1 -- 172.21.15.8:0/4275839737 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7fe574001470 con 0x7fe58015bc20 2023-10-06T04:36:58.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.309+0000 7fe57effd700 1 -- 172.21.15.8:0/4275839737 >> v1:172.21.15.8:6789/0 conn(0x7fe58015bc20 legacy=0x7fe580140890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:58.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.309+0000 7fe57effd700 1 --2- 172.21.15.8:0/4275839737 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe568003a60 0x7fe568003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:58.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.309+0000 7fe57effd700 1 --2- 172.21.15.8:0/4275839737 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe568004810 0x7fe568004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:58.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.309+0000 7fe57effd700 1 --2- 172.21.15.8:0/4275839737 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe58015b170 0x7fe5680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:58.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.309+0000 7fe57effd700 1 -- 172.21.15.8:0/4275839737 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58006c100 con 0x7fe568003a60 2023-10-06T04:36:58.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.309+0000 7fe57effd700 1 -- 172.21.15.8:0/4275839737 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58006c3e0 con 0x7fe568004810 2023-10-06T04:36:58.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.309+0000 7fe57effd700 1 -- 172.21.15.8:0/4275839737 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe56800ba60 con 0x7fe58015b170 2023-10-06T04:36:58.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.309+0000 7fe57ffff700 1 --2- 172.21.15.8:0/4275839737 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe568003a60 0x7fe568003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:58.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.309+0000 7fe584f7a700 1 --2- 172.21.15.8:0/4275839737 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe58015b170 0x7fe5680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:58.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.309+0000 7fe57f7fe700 1 --2- 172.21.15.8:0/4275839737 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe568004810 0x7fe568004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:58.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.309+0000 7fe57ffff700 1 -- 172.21.15.8:0/4275839737 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe58015b170 msgr2=0x7fe5680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:58.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.309+0000 7fe57ffff700 1 --2- 172.21.15.8:0/4275839737 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe58015b170 0x7fe5680051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:58.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.309+0000 7fe57ffff700 1 -- 172.21.15.8:0/4275839737 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe568004810 msgr2=0x7fe568004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:58.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.309+0000 7fe57ffff700 1 --2- 172.21.15.8:0/4275839737 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe568004810 0x7fe568004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:58.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.309+0000 7fe57ffff700 1 -- 172.21.15.8:0/4275839737 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe568003570 con 0x7fe568003a60 2023-10-06T04:36:58.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.310+0000 7fe57ffff700 1 --2- 172.21.15.8:0/4275839737 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe568003a60 0x7fe568003e70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe570009c30 tx=0x7fe5700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a96c7d41fd77b60e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:58.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.310+0000 7fe57effd700 1 -- 172.21.15.8:0/4275839737 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57000e710 con 0x7fe568003a60 2023-10-06T04:36:58.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.310+0000 7fe57effd700 1 -- 172.21.15.8:0/4275839737 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57000e870 con 0x7fe568003a60 2023-10-06T04:36:58.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.310+0000 7fe57effd700 1 -- 172.21.15.8:0/4275839737 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57000ec30 con 0x7fe568003a60 2023-10-06T04:36:58.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.310+0000 7fe5869dd700 1 -- 172.21.15.8:0/4275839737 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe568003a60 msgr2=0x7fe568003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:58.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.310+0000 7fe5869dd700 1 --2- 172.21.15.8:0/4275839737 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe568003a60 0x7fe568003e70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe570009c30 tx=0x7fe5700091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:58.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.310+0000 7fe584f7a700 1 -- 172.21.15.8:0/4275839737 reap_dead start 2023-10-06T04:36:58.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.310+0000 7fe5869dd700 1 -- 172.21.15.8:0/4275839737 shutdown_connections 2023-10-06T04:36:58.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.310+0000 7fe5869dd700 1 -- 172.21.15.8:0/4275839737 >> 172.21.15.8:0/4275839737 conn(0x7fe5800ce250 msgr2=0x7fe5800ce650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:58.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.310+0000 7fe5869dd700 1 -- 172.21.15.8:0/4275839737 shutdown_connections 2023-10-06T04:36:58.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.310+0000 7fe5869dd700 1 -- 172.21.15.8:0/4275839737 wait complete. 2023-10-06T04:36:58.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.311+0000 7fe5869dd700 1 Processor -- start 2023-10-06T04:36:58.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.312+0000 7fe5869dd700 1 -- start start 2023-10-06T04:36:58.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.312+0000 7fe5869dd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe568003a60 0x7fe580130aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:58.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.312+0000 7fe5869dd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe580167800 0x7fe5800b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:58.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.312+0000 7fe5869dd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe580167c70 0x7fe5800c6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:58.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.312+0000 7fe5869dd700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58013d0f0 con 0x7fe568003a60 2023-10-06T04:36:58.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.312+0000 7fe5869dd700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe580159880 con 0x7fe580167800 2023-10-06T04:36:58.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.312+0000 7fe5869dd700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5800b22a0 con 0x7fe580167c70 2023-10-06T04:36:58.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.312+0000 7fe57ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe568003a60 0x7fe580130aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:58.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.312+0000 7fe57ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe568003a60 0x7fe580130aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50052/0 (socket says 172.21.15.8:50052) 2023-10-06T04:36:58.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.312+0000 7fe57ffff700 1 -- 172.21.15.8:0/4001610659 learned_addr learned my addr 172.21.15.8:0/4001610659 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:58.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.313+0000 7fe57f7fe700 1 --2- 172.21.15.8:0/4001610659 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe580167800 0x7fe5800b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:58.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.313+0000 7fe584f7a700 1 --2- 172.21.15.8:0/4001610659 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe580167c70 0x7fe5800c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:58.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.313+0000 7fe57ffff700 1 -- 172.21.15.8:0/4001610659 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe580167c70 msgr2=0x7fe5800c6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:58.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.313+0000 7fe57ffff700 1 --2- 172.21.15.8:0/4001610659 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe580167c70 0x7fe5800c6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:58.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.313+0000 7fe57ffff700 1 -- 172.21.15.8:0/4001610659 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe580167800 msgr2=0x7fe5800b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:58.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.313+0000 7fe57ffff700 1 --2- 172.21.15.8:0/4001610659 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe580167800 0x7fe5800b36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:58.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.313+0000 7fe57ffff700 1 -- 172.21.15.8:0/4001610659 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe580159530 con 0x7fe568003a60 2023-10-06T04:36:58.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.313+0000 7fe57ffff700 1 --2- 172.21.15.8:0/4001610659 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe568003a60 0x7fe580130aa0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe57000e4b0 tx=0x7fe57001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:58.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.313+0000 7fe567fff700 1 -- 172.21.15.8:0/4001610659 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe570023070 con 0x7fe568003a60 2023-10-06T04:36:58.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.313+0000 7fe567fff700 1 -- 172.21.15.8:0/4001610659 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57000e9e0 con 0x7fe568003a60 2023-10-06T04:36:58.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.313+0000 7fe5869dd700 1 -- 172.21.15.8:0/4001610659 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5800b1a00 con 0x7fe568003a60 2023-10-06T04:36:58.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.313+0000 7fe567fff700 1 -- 172.21.15.8:0/4001610659 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe570006e50 con 0x7fe568003a60 2023-10-06T04:36:58.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.313+0000 7fe5869dd700 1 -- 172.21.15.8:0/4001610659 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5800b1fc0 con 0x7fe568003a60 2023-10-06T04:36:58.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.314+0000 7fe5869dd700 1 -- 172.21.15.8:0/4001610659 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe580159b60 con 0x7fe568003a60 2023-10-06T04:36:58.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.314+0000 7fe567fff700 1 -- 172.21.15.8:0/4001610659 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe570013680 con 0x7fe568003a60 2023-10-06T04:36:58.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.315+0000 7fe567fff700 1 --2- 172.21.15.8:0/4001610659 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe56c066f30 0x7fe56c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:58.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.315+0000 7fe567fff700 1 -- 172.21.15.8:0/4001610659 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe5700860a0 con 0x7fe568003a60 2023-10-06T04:36:58.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.315+0000 7fe57f7fe700 1 --2- 172.21.15.8:0/4001610659 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe56c066f30 0x7fe56c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:58.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.315+0000 7fe57f7fe700 1 --2- 172.21.15.8:0/4001610659 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe56c066f30 0x7fe56c0693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe5740011e0 tx=0x7fe5800c98f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:58.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.319+0000 7fe567fff700 1 -- 172.21.15.8:0/4001610659 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe570052ec0 con 0x7fe568003a60 2023-10-06T04:36:58.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.511+0000 7fe5869dd700 1 -- 172.21.15.8:0/4001610659 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe58013d0f0 con 0x7fe568003a60 2023-10-06T04:36:58.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.512+0000 7fe567fff700 1 -- 172.21.15.8:0/4001610659 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe5700564e0 con 0x7fe568003a60 2023-10-06T04:36:58.514 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-06T04:36:58.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.514+0000 7fe5869dd700 1 -- 172.21.15.8:0/4001610659 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe56c066f30 msgr2=0x7fe56c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:58.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.514+0000 7fe5869dd700 1 --2- 172.21.15.8:0/4001610659 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe56c066f30 0x7fe56c0693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe5740011e0 tx=0x7fe5800c98f0 comp rx=0 tx=0).stop 2023-10-06T04:36:58.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.514+0000 7fe5869dd700 1 -- 172.21.15.8:0/4001610659 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe568003a60 msgr2=0x7fe580130aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:58.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.514+0000 7fe5869dd700 1 --2- 172.21.15.8:0/4001610659 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe568003a60 0x7fe580130aa0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe57000e4b0 tx=0x7fe57001a000 comp rx=0 tx=0).stop 2023-10-06T04:36:58.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.514+0000 7fe5869dd700 1 -- 172.21.15.8:0/4001610659 shutdown_connections 2023-10-06T04:36:58.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.514+0000 7fe5869dd700 1 --2- 172.21.15.8:0/4001610659 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe56c066f30 0x7fe56c0693e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:58.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.514+0000 7fe5869dd700 1 --2- 172.21.15.8:0/4001610659 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe580167c70 0x7fe5800c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:58.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.514+0000 7fe5869dd700 1 --2- 172.21.15.8:0/4001610659 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe568003a60 0x7fe580130aa0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:58.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.514+0000 7fe5869dd700 1 --2- 172.21.15.8:0/4001610659 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe580167800 0x7fe5800b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:58.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.514+0000 7fe5869dd700 1 -- 172.21.15.8:0/4001610659 >> 172.21.15.8:0/4001610659 conn(0x7fe5800ce250 msgr2=0x7fe5800c4630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:58.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.514+0000 7fe5869dd700 1 -- 172.21.15.8:0/4001610659 shutdown_connections 2023-10-06T04:36:58.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.514+0000 7fe5869dd700 1 -- 172.21.15.8:0/4001610659 wait complete. 2023-10-06T04:36:58.555 INFO:tasks.cephfs_test_runner:Starting test: test_rebuild_simple (tasks.cephfs.test_recovery_pool.TestRecoveryPool) 2023-10-06T04:36:58.556 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_recovery_pool.TestRecoveryPool.test_rebuild_simple' 2023-10-06T04:36:58.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.672+0000 7fca878b3700 1 Processor -- start 2023-10-06T04:36:58.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.673+0000 7fca878b3700 1 -- start start 2023-10-06T04:36:58.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.673+0000 7fca878b3700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fca800af680 0x7fca8015e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:58.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.673+0000 7fca878b3700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca800cb360 0x7fca800d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:58.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.673+0000 7fca878b3700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca800cc4c0 con 0x7fca800d08d0 2023-10-06T04:36:58.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.673+0000 7fca878b3700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca8015d460 con 0x7fca800af680 2023-10-06T04:36:58.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.673+0000 7fca878b3700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca800d0d50 con 0x7fca800cb360 2023-10-06T04:36:58.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.674+0000 7fca84e4e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca800cb360 0x7fca800d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:58.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.674+0000 7fca8564f700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fca800af680 0x7fca8015e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:58.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.674+0000 7fca85e50700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fca800d08d0 0x7fca800b0000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.8:45096/0 (socket says 172.21.15.8:45096) 2023-10-06T04:36:58.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.674+0000 7fca84e4e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca800cb360 0x7fca800d0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.8:48106/0 (socket says 172.21.15.8:48106) 2023-10-06T04:36:58.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.674+0000 7fca85e50700 1 -- 172.21.15.8:0/3416102783 learned_addr learned my addr 172.21.15.8:0/3416102783 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:36:58.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.674+0000 7fca8564f700 1 --2- 172.21.15.8:0/3416102783 >> v2:172.21.15.184:3300/0 conn(0x7fca800af680 0x7fca8015e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.8:47264/0 (socket says 172.21.15.8:47264) 2023-10-06T04:36:58.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.674+0000 7fca84e4e700 1 -- 172.21.15.8:0/3416102783 >> v2:172.21.15.184:3300/0 conn(0x7fca800af680 msgr2=0x7fca8015e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:36:58.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.674+0000 7fca84e4e700 1 --2- 172.21.15.8:0/3416102783 >> v2:172.21.15.184:3300/0 conn(0x7fca800af680 0x7fca8015e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:58.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.674+0000 7fca84e4e700 1 -- 172.21.15.8:0/3416102783 >> v1:172.21.15.184:6789/0 conn(0x7fca800d08d0 legacy=0x7fca800b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:58.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.674+0000 7fca7ffff700 1 -- 172.21.15.8:0/3416102783 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3505376252 0 0) 0x7fca800cc4c0 con 0x7fca800d08d0 2023-10-06T04:36:58.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.674+0000 7fca84e4e700 1 -- 172.21.15.8:0/3416102783 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca8015e580 con 0x7fca800cb360 2023-10-06T04:36:58.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.674+0000 7fca8564f700 1 --2- 172.21.15.8:0/3416102783 >> v2:172.21.15.184:3300/0 conn(0x7fca800af680 0x7fca8015e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:36:58.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.674+0000 7fca84e4e700 1 --2- 172.21.15.8:0/3416102783 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca800cb360 0x7fca800d0390 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fca740098e0 tx=0x7fca740091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=862f01ef57963144 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:58.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.675+0000 7fca7ffff700 1 -- 172.21.15.8:0/3416102783 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7400b640 con 0x7fca800cb360 2023-10-06T04:36:58.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.675+0000 7fca7ffff700 1 -- 172.21.15.8:0/3416102783 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7400b7a0 con 0x7fca800cb360 2023-10-06T04:36:58.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.675+0000 7fca7ffff700 1 -- 172.21.15.8:0/3416102783 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7400bb40 con 0x7fca800cb360 2023-10-06T04:36:58.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.675+0000 7fca878b3700 1 -- 172.21.15.8:0/3416102783 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca800cb360 msgr2=0x7fca800d0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:58.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.675+0000 7fca878b3700 1 --2- 172.21.15.8:0/3416102783 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca800cb360 0x7fca800d0390 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fca740098e0 tx=0x7fca740091a0 comp rx=0 tx=0).stop 2023-10-06T04:36:58.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.675+0000 7fca878b3700 1 -- 172.21.15.8:0/3416102783 shutdown_connections 2023-10-06T04:36:58.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.675+0000 7fca878b3700 1 --2- 172.21.15.8:0/3416102783 >> v2:172.21.15.184:3300/0 conn(0x7fca800af680 0x7fca8015e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:58.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.675+0000 7fca878b3700 1 --2- 172.21.15.8:0/3416102783 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca800cb360 0x7fca800d0390 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:58.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.675+0000 7fca878b3700 1 -- 172.21.15.8:0/3416102783 >> 172.21.15.8:0/3416102783 conn(0x7fca800633d0 msgr2=0x7fca800637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:58.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.675+0000 7fca878b3700 1 -- 172.21.15.8:0/3416102783 shutdown_connections 2023-10-06T04:36:58.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.675+0000 7fca878b3700 1 -- 172.21.15.8:0/3416102783 wait complete. 2023-10-06T04:36:58.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.676+0000 7fca878b3700 1 Processor -- start 2023-10-06T04:36:58.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.676+0000 7fca878b3700 1 -- start start 2023-10-06T04:36:58.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.677+0000 7fca878b3700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca800af680 0x7fca80157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:58.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.677+0000 7fca878b3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca800cb360 0x7fca800c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:58.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.677+0000 7fca878b3700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca800d08d0 0x7fca800b4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:58.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.677+0000 7fca878b3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca800c67f0 con 0x7fca800cb360 2023-10-06T04:36:58.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.677+0000 7fca878b3700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca80158100 con 0x7fca800af680 2023-10-06T04:36:58.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.677+0000 7fca878b3700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca800c71c0 con 0x7fca800d08d0 2023-10-06T04:36:58.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.677+0000 7fca84e4e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca800cb360 0x7fca800c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:58.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.677+0000 7fca84e4e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca800cb360 0x7fca800c6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50066/0 (socket says 172.21.15.8:50066) 2023-10-06T04:36:58.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.677+0000 7fca84e4e700 1 -- 172.21.15.8:0/3673973912 learned_addr learned my addr 172.21.15.8:0/3673973912 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:36:58.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.677+0000 7fca85e50700 1 --2- 172.21.15.8:0/3673973912 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca800d08d0 0x7fca800b4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:58.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.677+0000 7fca8564f700 1 --2- 172.21.15.8:0/3673973912 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca800af680 0x7fca80157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:58.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.678+0000 7fca84e4e700 1 -- 172.21.15.8:0/3673973912 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca800d08d0 msgr2=0x7fca800b4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:58.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.678+0000 7fca84e4e700 1 --2- 172.21.15.8:0/3673973912 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca800d08d0 0x7fca800b4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:58.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.678+0000 7fca84e4e700 1 -- 172.21.15.8:0/3673973912 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca800af680 msgr2=0x7fca80157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:58.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.678+0000 7fca84e4e700 1 --2- 172.21.15.8:0/3673973912 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca800af680 0x7fca80157bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:58.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.678+0000 7fca84e4e700 1 -- 172.21.15.8:0/3673973912 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca78009a20 con 0x7fca800cb360 2023-10-06T04:36:58.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.678+0000 7fca84e4e700 1 --2- 172.21.15.8:0/3673973912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca800cb360 0x7fca800c6c80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fca740030b0 tx=0x7fca74017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:58.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.678+0000 7fca7d7fa700 1 -- 172.21.15.8:0/3673973912 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca74000d10 con 0x7fca800cb360 2023-10-06T04:36:58.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.678+0000 7fca7d7fa700 1 -- 172.21.15.8:0/3673973912 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7400bb20 con 0x7fca800cb360 2023-10-06T04:36:58.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.678+0000 7fca878b3700 1 -- 172.21.15.8:0/3673973912 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca74009420 con 0x7fca800cb360 2023-10-06T04:36:58.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.678+0000 7fca7d7fa700 1 -- 172.21.15.8:0/3673973912 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7401a6a0 con 0x7fca800cb360 2023-10-06T04:36:58.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.678+0000 7fca878b3700 1 -- 172.21.15.8:0/3673973912 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca800c5ec0 con 0x7fca800cb360 2023-10-06T04:36:58.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.679+0000 7fca878b3700 1 -- 172.21.15.8:0/3673973912 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca800b11e0 con 0x7fca800cb360 2023-10-06T04:36:58.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.680+0000 7fca7d7fa700 1 -- 172.21.15.8:0/3673973912 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca7401aa50 con 0x7fca800cb360 2023-10-06T04:36:58.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.680+0000 7fca7d7fa700 1 --2- 172.21.15.8:0/3673973912 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fca6c066f30 0x7fca6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:36:58.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.680+0000 7fca7d7fa700 1 -- 172.21.15.8:0/3673973912 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fca74086770 con 0x7fca800cb360 2023-10-06T04:36:58.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.680+0000 7fca8564f700 1 --2- 172.21.15.8:0/3673973912 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fca6c066f30 0x7fca6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:36:58.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.681+0000 7fca8564f700 1 --2- 172.21.15.8:0/3673973912 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fca6c066f30 0x7fca6c0693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fca780099f0 tx=0x7fca7800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:36:58.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.684+0000 7fca7d7fa700 1 -- 172.21.15.8:0/3673973912 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca74053590 con 0x7fca800cb360 2023-10-06T04:36:58.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:58.958+0000 7fca878b3700 1 -- 172.21.15.8:0/3673973912 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_recovery_pool.TestRecoveryPool.test_rebuild_simple"]} v 0) v1 -- 0x7fca80071550 con 0x7fca800cb360 2023-10-06T04:36:59.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:59.895+0000 7fca7d7fa700 1 -- 172.21.15.8:0/3673973912 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_recovery_pool.TestRecoveryPool.test_rebuild_simple"]}]=0 v59) v1 ==== 150+0+0 (secure 0 0 0) 0x7fca74056bb0 con 0x7fca800cb360 2023-10-06T04:36:59.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:59.898+0000 7fca878b3700 1 -- 172.21.15.8:0/3673973912 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fca6c066f30 msgr2=0x7fca6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:59.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:59.898+0000 7fca878b3700 1 --2- 172.21.15.8:0/3673973912 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fca6c066f30 0x7fca6c0693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fca780099f0 tx=0x7fca7800b040 comp rx=0 tx=0).stop 2023-10-06T04:36:59.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:59.898+0000 7fca878b3700 1 -- 172.21.15.8:0/3673973912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca800cb360 msgr2=0x7fca800c6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:36:59.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:59.898+0000 7fca878b3700 1 --2- 172.21.15.8:0/3673973912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca800cb360 0x7fca800c6c80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fca740030b0 tx=0x7fca74017000 comp rx=0 tx=0).stop 2023-10-06T04:36:59.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:59.898+0000 7fca878b3700 1 -- 172.21.15.8:0/3673973912 shutdown_connections 2023-10-06T04:36:59.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:59.898+0000 7fca878b3700 1 --2- 172.21.15.8:0/3673973912 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fca6c066f30 0x7fca6c0693e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:59.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:59.898+0000 7fca878b3700 1 --2- 172.21.15.8:0/3673973912 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca800d08d0 0x7fca800b4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:59.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:59.898+0000 7fca878b3700 1 --2- 172.21.15.8:0/3673973912 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca800af680 0x7fca80157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:59.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:59.898+0000 7fca878b3700 1 --2- 172.21.15.8:0/3673973912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca800cb360 0x7fca800c6c80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:36:59.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:59.898+0000 7fca878b3700 1 -- 172.21.15.8:0/3673973912 >> 172.21.15.8:0/3673973912 conn(0x7fca800633d0 msgr2=0x7fca800cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:36:59.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:59.898+0000 7fca878b3700 1 -- 172.21.15.8:0/3673973912 shutdown_connections 2023-10-06T04:36:59.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:36:59.898+0000 7fca878b3700 1 -- 172.21.15.8:0/3673973912 wait complete. 2023-10-06T04:36:59.915 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T04:37:00.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.042+0000 7f9c6176d700 1 Processor -- start 2023-10-06T04:37:00.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.042+0000 7f9c6176d700 1 -- start start 2023-10-06T04:37:00.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.043+0000 7f9c6176d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9c5c156e30 0x7f9c5c0cf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:00.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.043+0000 7f9c6176d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c5c0b1c70 0x7f9c5c0b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:00.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.043+0000 7f9c6176d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c5c0b2620 con 0x7f9c5c15ad80 2023-10-06T04:37:00.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.043+0000 7f9c6176d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c5c0cf370 con 0x7f9c5c156e30 2023-10-06T04:37:00.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.043+0000 7f9c6176d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c0ce800 con 0x7f9c5c0b1c70 2023-10-06T04:37:00.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.043+0000 7f9c5bfff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9c5c156e30 0x7f9c5c0cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:00.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.043+0000 7f9c5b7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c5c0b1c70 0x7f9c5c0b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:00.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.043+0000 7f9c60f6c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f9c5c15ad80 0x7f9c5c15b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.8:45100/0 (socket says 172.21.15.8:45100) 2023-10-06T04:37:00.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.043+0000 7f9c60f6c700 1 -- 172.21.15.8:0/542579821 learned_addr learned my addr 172.21.15.8:0/542579821 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:00.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.044+0000 7f9c5bfff700 1 -- 172.21.15.8:0/542579821 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c5c0b1c70 msgr2=0x7f9c5c0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:00.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.044+0000 7f9c5bfff700 1 --2- 172.21.15.8:0/542579821 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c5c0b1c70 0x7f9c5c0b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:00.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.044+0000 7f9c5bfff700 1 -- 172.21.15.8:0/542579821 >> v1:172.21.15.184:6789/0 conn(0x7f9c5c15ad80 legacy=0x7f9c5c15b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:00.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.044+0000 7f9c5bfff700 1 -- 172.21.15.8:0/542579821 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5c0cea60 con 0x7f9c5c156e30 2023-10-06T04:37:00.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.044+0000 7f9c5affd700 1 -- 172.21.15.8:0/542579821 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3828733784 0 0) 0x7f9c5c0b2620 con 0x7f9c5c15ad80 2023-10-06T04:37:00.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.044+0000 7f9c5b7fe700 1 --2- 172.21.15.8:0/542579821 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c5c0b1c70 0x7f9c5c0b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:37:00.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.044+0000 7f9c5bfff700 1 --2- 172.21.15.8:0/542579821 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c5c156e30 0x7f9c5c0cf800 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c0cec50 tx=0x7f9c4c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d9939d9f6e6ad9f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:00.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.044+0000 7f9c5affd700 1 -- 172.21.15.8:0/542579821 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c011630 con 0x7f9c5c156e30 2023-10-06T04:37:00.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.044+0000 7f9c5affd700 1 -- 172.21.15.8:0/542579821 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4c011790 con 0x7f9c5c156e30 2023-10-06T04:37:00.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.044+0000 7f9c5affd700 1 -- 172.21.15.8:0/542579821 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c011b50 con 0x7f9c5c156e30 2023-10-06T04:37:00.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.044+0000 7f9c6176d700 1 -- 172.21.15.8:0/542579821 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c5c156e30 msgr2=0x7f9c5c0cf800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:00.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.044+0000 7f9c6176d700 1 --2- 172.21.15.8:0/542579821 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c5c156e30 0x7f9c5c0cf800 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c0cec50 tx=0x7f9c4c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:00.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.044+0000 7f9c6176d700 1 -- 172.21.15.8:0/542579821 shutdown_connections 2023-10-06T04:37:00.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.045+0000 7f9c6176d700 1 --2- 172.21.15.8:0/542579821 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c5c156e30 0x7f9c5c0cf800 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:00.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.045+0000 7f9c6176d700 1 --2- 172.21.15.8:0/542579821 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c5c0b1c70 0x7f9c5c0b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:00.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.045+0000 7f9c6176d700 1 -- 172.21.15.8:0/542579821 >> 172.21.15.8:0/542579821 conn(0x7f9c5c06ed00 msgr2=0x7f9c5c06f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:00.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.045+0000 7f9c6176d700 1 -- 172.21.15.8:0/542579821 shutdown_connections 2023-10-06T04:37:00.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.045+0000 7f9c6176d700 1 -- 172.21.15.8:0/542579821 wait complete. 2023-10-06T04:37:00.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.046+0000 7f9c6176d700 1 Processor -- start 2023-10-06T04:37:00.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.046+0000 7f9c6176d700 1 -- start start 2023-10-06T04:37:00.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.046+0000 7f9c6176d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c5c0b1c70 0x7f9c5c152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:00.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.046+0000 7f9c6176d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c5c156e30 0x7f9c5c0a8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:00.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.046+0000 7f9c6176d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c5c15ad80 0x7f9c5c0a8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:00.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.047+0000 7f9c6176d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c16ac20 con 0x7f9c5c0b1c70 2023-10-06T04:37:00.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.047+0000 7f9c6176d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c0ae8b0 con 0x7f9c5c15ad80 2023-10-06T04:37:00.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.047+0000 7f9c6176d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c169e60 con 0x7f9c5c156e30 2023-10-06T04:37:00.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.047+0000 7f9c5bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c5c0b1c70 0x7f9c5c152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:00.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.047+0000 7f9c5bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c5c0b1c70 0x7f9c5c152c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50074/0 (socket says 172.21.15.8:50074) 2023-10-06T04:37:00.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.047+0000 7f9c5bfff700 1 -- 172.21.15.8:0/4095627642 learned_addr learned my addr 172.21.15.8:0/4095627642 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:00.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.047+0000 7f9c5b7fe700 1 --2- 172.21.15.8:0/4095627642 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c5c156e30 0x7f9c5c0a8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:00.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.047+0000 7f9c60f6c700 1 --2- 172.21.15.8:0/4095627642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c5c15ad80 0x7f9c5c0a8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:00.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.047+0000 7f9c5bfff700 1 -- 172.21.15.8:0/4095627642 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c5c156e30 msgr2=0x7f9c5c0a8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:00.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.047+0000 7f9c5bfff700 1 --2- 172.21.15.8:0/4095627642 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c5c156e30 0x7f9c5c0a8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:00.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.047+0000 7f9c5bfff700 1 -- 172.21.15.8:0/4095627642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c5c15ad80 msgr2=0x7f9c5c0a8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:00.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.047+0000 7f9c5bfff700 1 --2- 172.21.15.8:0/4095627642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c5c15ad80 0x7f9c5c0a8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:00.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.047+0000 7f9c5bfff700 1 -- 172.21.15.8:0/4095627642 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c44009420 con 0x7f9c5c0b1c70 2023-10-06T04:37:00.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.047+0000 7f9c60f6c700 1 --2- 172.21.15.8:0/4095627642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c5c15ad80 0x7f9c5c0a8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:00.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.047+0000 7f9c5bfff700 1 --2- 172.21.15.8:0/4095627642 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c5c0b1c70 0x7f9c5c152c30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c0b35d0 tx=0x7f9c4c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:00.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.047+0000 7f9c53fff700 1 -- 172.21.15.8:0/4095627642 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c01adf0 con 0x7f9c5c0b1c70 2023-10-06T04:37:00.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.047+0000 7f9c53fff700 1 -- 172.21.15.8:0/4095627642 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4c01f070 con 0x7f9c5c0b1c70 2023-10-06T04:37:00.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.047+0000 7f9c6176d700 1 -- 172.21.15.8:0/4095627642 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c4c009420 con 0x7f9c5c0b1c70 2023-10-06T04:37:00.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.047+0000 7f9c53fff700 1 -- 172.21.15.8:0/4095627642 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c0266d0 con 0x7f9c5c0b1c70 2023-10-06T04:37:00.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.047+0000 7f9c6176d700 1 -- 172.21.15.8:0/4095627642 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c5c16a420 con 0x7f9c5c0b1c70 2023-10-06T04:37:00.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.048+0000 7f9c6176d700 1 -- 172.21.15.8:0/4095627642 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c5c04c380 con 0x7f9c5c0b1c70 2023-10-06T04:37:00.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.049+0000 7f9c53fff700 1 -- 172.21.15.8:0/4095627642 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9c4c01b450 con 0x7f9c5c0b1c70 2023-10-06T04:37:00.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.049+0000 7f9c53fff700 1 --2- 172.21.15.8:0/4095627642 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9c3c066f30 0x7f9c3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:00.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.049+0000 7f9c53fff700 1 -- 172.21.15.8:0/4095627642 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9c4c021070 con 0x7f9c5c0b1c70 2023-10-06T04:37:00.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.049+0000 7f9c5b7fe700 1 --2- 172.21.15.8:0/4095627642 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9c3c066f30 0x7f9c3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:00.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.050+0000 7f9c5b7fe700 1 --2- 172.21.15.8:0/4095627642 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9c3c066f30 0x7f9c3c0693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c159e90 tx=0x7f9c440091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:00.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.053+0000 7f9c53fff700 1 -- 172.21.15.8:0/4095627642 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9c4c053220 con 0x7f9c5c0b1c70 2023-10-06T04:37:00.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.247+0000 7f9c6176d700 1 -- 172.21.15.8:0/4095627642 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f9c5c0b3600 con 0x7f9c5c0b1c70 2023-10-06T04:37:00.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.250+0000 7f9c53fff700 1 -- 172.21.15.8:0/4095627642 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9c4c056840 con 0x7f9c5c0b1c70 2023-10-06T04:37:00.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.252+0000 7f9c6176d700 1 -- 172.21.15.8:0/4095627642 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9c3c066f30 msgr2=0x7f9c3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:00.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.252+0000 7f9c6176d700 1 --2- 172.21.15.8:0/4095627642 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9c3c066f30 0x7f9c3c0693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c159e90 tx=0x7f9c440091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:00.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.252+0000 7f9c6176d700 1 -- 172.21.15.8:0/4095627642 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c5c0b1c70 msgr2=0x7f9c5c152c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:00.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.252+0000 7f9c6176d700 1 --2- 172.21.15.8:0/4095627642 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c5c0b1c70 0x7f9c5c152c30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c0b35d0 tx=0x7f9c4c016000 comp rx=0 tx=0).stop 2023-10-06T04:37:00.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.252+0000 7f9c6176d700 1 -- 172.21.15.8:0/4095627642 shutdown_connections 2023-10-06T04:37:00.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.252+0000 7f9c6176d700 1 --2- 172.21.15.8:0/4095627642 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9c3c066f30 0x7f9c3c0693e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:00.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.252+0000 7f9c6176d700 1 --2- 172.21.15.8:0/4095627642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c5c15ad80 0x7f9c5c0a8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:00.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.252+0000 7f9c6176d700 1 --2- 172.21.15.8:0/4095627642 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c5c0b1c70 0x7f9c5c152c30 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:00.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.252+0000 7f9c6176d700 1 --2- 172.21.15.8:0/4095627642 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c5c156e30 0x7f9c5c0a8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:00.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.252+0000 7f9c6176d700 1 -- 172.21.15.8:0/4095627642 >> 172.21.15.8:0/4095627642 conn(0x7f9c5c06ed00 msgr2=0x7f9c5c153db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:00.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.252+0000 7f9c6176d700 1 -- 172.21.15.8:0/4095627642 shutdown_connections 2023-10-06T04:37:00.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.252+0000 7f9c6176d700 1 -- 172.21.15.8:0/4095627642 wait complete. 2023-10-06T04:37:00.267 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T04:37:00.267 DEBUG:teuthology.orchestra.run.smithi008:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T04:37:00.307 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T04:37:00.349 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T04:37:00.349 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T04:37:00.350 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:37:00.350 DEBUG:teuthology.orchestra.run.smithi008:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-06T04:37:00.387 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi008.front.sepia.ceph.com 2023-10-06T04:37:00.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:37:00.387 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T04:37:00.442 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T04:37:00.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:37:00.442 DEBUG:teuthology.orchestra.run.smithi184:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-06T04:37:00.476 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-10-06T04:37:00.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:37:00.477 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T04:37:00.533 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-06T04:37:00.533 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:37:00.533 DEBUG:teuthology.orchestra.run.smithi008:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-06T04:37:00.565 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi008.front.sepia.ceph.com 2023-10-06T04:37:00.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:37:00.565 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T04:37:00.620 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-06T04:37:00.621 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:37:00.621 DEBUG:teuthology.orchestra.run.smithi184:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-06T04:37:00.657 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-10-06T04:37:00.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:37:00.658 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T04:37:00.713 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T04:37:00.713 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:37:00.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.830+0000 7f9899986700 1 Processor -- start 2023-10-06T04:37:00.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.830+0000 7f9899986700 1 -- start start 2023-10-06T04:37:00.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.831+0000 7f9899986700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9894142cc0 0x7f98940686e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:00.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.831+0000 7f9899986700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9894143090 0x7f9894068c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:00.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.831+0000 7f9899986700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9894069f70 con 0x7f98940cbe20 2023-10-06T04:37:00.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.831+0000 7f9899986700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9894069160 con 0x7f9894143090 2023-10-06T04:37:00.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.831+0000 7f9899986700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9894069360 con 0x7f9894142cc0 2023-10-06T04:37:00.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.831+0000 7f98927fc700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9894143090 0x7f9894068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:00.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.831+0000 7f98937fe700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f98940cbe20 0x7f98940cc2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60912/0 (socket says 172.21.15.8:60912) 2023-10-06T04:37:00.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.831+0000 7f98937fe700 1 -- 172.21.15.8:0/257927932 learned_addr learned my addr 172.21.15.8:0/257927932 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:00.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.831+0000 7f9892ffd700 1 --2- 172.21.15.8:0/257927932 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9894142cc0 0x7f98940686e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:00.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.831+0000 7f98927fc700 1 -- 172.21.15.8:0/257927932 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9894142cc0 msgr2=0x7f98940686e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:00.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.831+0000 7f98927fc700 1 --2- 172.21.15.8:0/257927932 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9894142cc0 0x7f98940686e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:00.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.831+0000 7f98927fc700 1 -- 172.21.15.8:0/257927932 >> v1:172.21.15.8:6789/0 conn(0x7f98940cbe20 legacy=0x7f98940cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:00.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.831+0000 7f98927fc700 1 -- 172.21.15.8:0/257927932 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9894069640 con 0x7f9894143090 2023-10-06T04:37:00.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.831+0000 7f9891ffb700 1 -- 172.21.15.8:0/257927932 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1508837379 0 0) 0x7f9894069f70 con 0x7f98940cbe20 2023-10-06T04:37:00.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.831+0000 7f98927fc700 1 --2- 172.21.15.8:0/257927932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9894143090 0x7f9894068c20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f987c0098e0 tx=0x7f987c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cfdb2515396f81a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:00.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.832+0000 7f9891ffb700 1 -- 172.21.15.8:0/257927932 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987c00b640 con 0x7f9894143090 2023-10-06T04:37:00.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.832+0000 7f9891ffb700 1 -- 172.21.15.8:0/257927932 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987c00b7a0 con 0x7f9894143090 2023-10-06T04:37:00.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.832+0000 7f9891ffb700 1 -- 172.21.15.8:0/257927932 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987c00bb40 con 0x7f9894143090 2023-10-06T04:37:00.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.832+0000 7f9899986700 1 -- 172.21.15.8:0/257927932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9894143090 msgr2=0x7f9894068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:00.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.832+0000 7f9899986700 1 --2- 172.21.15.8:0/257927932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9894143090 0x7f9894068c20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f987c0098e0 tx=0x7f987c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:00.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.832+0000 7f9899986700 1 -- 172.21.15.8:0/257927932 shutdown_connections 2023-10-06T04:37:00.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.832+0000 7f9899986700 1 --2- 172.21.15.8:0/257927932 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9894142cc0 0x7f98940686e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:00.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.832+0000 7f9899986700 1 --2- 172.21.15.8:0/257927932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9894143090 0x7f9894068c20 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:00.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.832+0000 7f9899986700 1 -- 172.21.15.8:0/257927932 >> 172.21.15.8:0/257927932 conn(0x7f98940ce250 msgr2=0x7f98940ce650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:00.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.832+0000 7f9899986700 1 -- 172.21.15.8:0/257927932 shutdown_connections 2023-10-06T04:37:00.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.832+0000 7f9899986700 1 -- 172.21.15.8:0/257927932 wait complete. 2023-10-06T04:37:00.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.833+0000 7f9899986700 1 Processor -- start 2023-10-06T04:37:00.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.834+0000 7f9899986700 1 -- start start 2023-10-06T04:37:00.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.834+0000 7f9899986700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98940cbe20 0x7f989416a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:00.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.834+0000 7f9899986700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9894142cc0 0x7f9894158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:00.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.834+0000 7f9899986700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9894143090 0x7f989415b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:00.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.834+0000 7f9899986700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98940c5cd0 con 0x7f9894143090 2023-10-06T04:37:00.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.834+0000 7f9899986700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989416a7c0 con 0x7f98940cbe20 2023-10-06T04:37:00.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.834+0000 7f9899986700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98941593d0 con 0x7f9894142cc0 2023-10-06T04:37:00.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.834+0000 7f98937fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9894143090 0x7f989415b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:00.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.834+0000 7f98937fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9894143090 0x7f989415b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50104/0 (socket says 172.21.15.8:50104) 2023-10-06T04:37:00.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.834+0000 7f98937fe700 1 -- 172.21.15.8:0/3125450851 learned_addr learned my addr 172.21.15.8:0/3125450851 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:00.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.835+0000 7f9892ffd700 1 --2- 172.21.15.8:0/3125450851 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98940cbe20 0x7f989416a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:00.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.835+0000 7f98927fc700 1 --2- 172.21.15.8:0/3125450851 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9894142cc0 0x7f9894158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:00.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.835+0000 7f98937fe700 1 -- 172.21.15.8:0/3125450851 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9894142cc0 msgr2=0x7f9894158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:00.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.835+0000 7f98937fe700 1 --2- 172.21.15.8:0/3125450851 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9894142cc0 0x7f9894158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:00.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.835+0000 7f98937fe700 1 -- 172.21.15.8:0/3125450851 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98940cbe20 msgr2=0x7f989416a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:00.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.835+0000 7f98937fe700 1 --2- 172.21.15.8:0/3125450851 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98940cbe20 0x7f989416a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:00.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.835+0000 7f98937fe700 1 -- 172.21.15.8:0/3125450851 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f987c009420 con 0x7f9894143090 2023-10-06T04:37:00.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.835+0000 7f98937fe700 1 --2- 172.21.15.8:0/3125450851 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9894143090 0x7f989415b420 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f988400cc90 tx=0x7f9884001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:00.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.835+0000 7f988affd700 1 -- 172.21.15.8:0/3125450851 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988400cea0 con 0x7f9894143090 2023-10-06T04:37:00.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.835+0000 7f988affd700 1 -- 172.21.15.8:0/3125450851 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f988400ab10 con 0x7f9894143090 2023-10-06T04:37:00.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.835+0000 7f9899986700 1 -- 172.21.15.8:0/3125450851 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98940c7e20 con 0x7f9894143090 2023-10-06T04:37:00.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.835+0000 7f988affd700 1 -- 172.21.15.8:0/3125450851 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98840070f0 con 0x7f9894143090 2023-10-06T04:37:00.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.835+0000 7f9899986700 1 -- 172.21.15.8:0/3125450851 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98940c5ee0 con 0x7f9894143090 2023-10-06T04:37:00.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.836+0000 7f9899986700 1 -- 172.21.15.8:0/3125450851 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9894071550 con 0x7f9894143090 2023-10-06T04:37:00.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.836+0000 7f988affd700 1 -- 172.21.15.8:0/3125450851 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f98840074a0 con 0x7f9894143090 2023-10-06T04:37:00.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.837+0000 7f988affd700 1 --2- 172.21.15.8:0/3125450851 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9874066f30 0x7f98740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:00.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.837+0000 7f988affd700 1 -- 172.21.15.8:0/3125450851 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9884084e30 con 0x7f9894143090 2023-10-06T04:37:00.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.837+0000 7f9892ffd700 1 --2- 172.21.15.8:0/3125450851 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9874066f30 0x7f98740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:00.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.838+0000 7f9892ffd700 1 --2- 172.21.15.8:0/3125450851 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9874066f30 0x7f98740693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f988c009d30 tx=0x7f988c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:00.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:00.841+0000 7f988affd700 1 -- 172.21.15.8:0/3125450851 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9884051cd0 con 0x7f9894143090 2023-10-06T04:37:01.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.086+0000 7f9899986700 1 -- 172.21.15.8:0/3125450851 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9894069920 con 0x7f9894143090 2023-10-06T04:37:01.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.086+0000 7f988affd700 1 -- 172.21.15.8:0/3125450851 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4587 (secure 0 0 0) 0x7f98840552f0 con 0x7f9894143090 2023-10-06T04:37:01.089 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:01.089 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/516627422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":516627422},{"type":"v1","addr":"172.21.15.8:6835","nonce":516627422}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/1078182353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1078182353},{"type":"v1","addr":"172.21.15.8:6834","nonce":1078182353}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/181555783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":181555783},{"type":"v1","addr":"172.21.15.184:6836","nonce":181555783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:36:16.632579+0000","modified":"2023-10-06T04:36:29.752096+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/2590100121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":2590100121},{"type":"v1","addr":"172.21.15.184:6837","nonce":2590100121}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:37:01.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.089+0000 7f9899986700 1 -- 172.21.15.8:0/3125450851 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9874066f30 msgr2=0x7f98740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:01.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.089+0000 7f9899986700 1 --2- 172.21.15.8:0/3125450851 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9874066f30 0x7f98740693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f988c009d30 tx=0x7f988c008040 comp rx=0 tx=0).stop 2023-10-06T04:37:01.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.089+0000 7f9899986700 1 -- 172.21.15.8:0/3125450851 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9894143090 msgr2=0x7f989415b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:01.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.089+0000 7f9899986700 1 --2- 172.21.15.8:0/3125450851 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9894143090 0x7f989415b420 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f988400cc90 tx=0x7f9884001a80 comp rx=0 tx=0).stop 2023-10-06T04:37:01.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.089+0000 7f9899986700 1 -- 172.21.15.8:0/3125450851 shutdown_connections 2023-10-06T04:37:01.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.089+0000 7f9899986700 1 --2- 172.21.15.8:0/3125450851 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9874066f30 0x7f98740693e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:01.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.089+0000 7f9899986700 1 --2- 172.21.15.8:0/3125450851 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9894143090 0x7f989415b420 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:01.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.089+0000 7f9899986700 1 --2- 172.21.15.8:0/3125450851 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98940cbe20 0x7f989416a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:01.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.089+0000 7f9899986700 1 --2- 172.21.15.8:0/3125450851 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9894142cc0 0x7f9894158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:01.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.089+0000 7f9899986700 1 -- 172.21.15.8:0/3125450851 >> 172.21.15.8:0/3125450851 conn(0x7f98940ce250 msgr2=0x7f98940c3080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:01.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.089+0000 7f9899986700 1 -- 172.21.15.8:0/3125450851 shutdown_connections 2023-10-06T04:37:01.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.089+0000 7f9899986700 1 -- 172.21.15.8:0/3125450851 wait complete. 2023-10-06T04:37:01.093 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 9 2023-10-06T04:37:01.103 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:37:01.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.220+0000 7f734e092700 1 Processor -- start 2023-10-06T04:37:01.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.220+0000 7f734e092700 1 -- start start 2023-10-06T04:37:01.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.221+0000 7f734e092700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7348140c30 0x7f73480cc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:01.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.221+0000 7f734e092700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f734806be60 0x7f73480b1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:01.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.221+0000 7f734e092700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73480cd790 con 0x7f73480c8b30 2023-10-06T04:37:01.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.221+0000 7f734e092700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73480b11d0 con 0x7f734806be60 2023-10-06T04:37:01.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.221+0000 7f734e092700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73480ccef0 con 0x7f7348140c30 2023-10-06T04:37:01.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.221+0000 7f7347fff700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f734806be60 0x7f73480b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.221+0000 7f7346ffd700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f73480c8b30 0x7f734806b750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60924/0 (socket says 172.21.15.8:60924) 2023-10-06T04:37:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.221+0000 7f7346ffd700 1 -- 172.21.15.8:0/2046921884 learned_addr learned my addr 172.21.15.8:0/2046921884 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.222+0000 7f73477fe700 1 --2- 172.21.15.8:0/2046921884 >> v2:172.21.15.184:3300/0 conn(0x7f7348140c30 0x7f73480cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.222+0000 7f7347fff700 1 -- 172.21.15.8:0/2046921884 >> v2:172.21.15.184:3300/0 conn(0x7f7348140c30 msgr2=0x7f73480cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.222+0000 7f7347fff700 1 --2- 172.21.15.8:0/2046921884 >> v2:172.21.15.184:3300/0 conn(0x7f7348140c30 0x7f73480cc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.222+0000 7f7347fff700 1 -- 172.21.15.8:0/2046921884 >> v1:172.21.15.8:6789/0 conn(0x7f73480c8b30 legacy=0x7f734806b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.222+0000 7f73467fc700 1 -- 172.21.15.8:0/2046921884 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1199598191 0 0) 0x7f73480cd790 con 0x7f73480c8b30 2023-10-06T04:37:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.222+0000 7f7347fff700 1 -- 172.21.15.8:0/2046921884 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73480cd1d0 con 0x7f734806be60 2023-10-06T04:37:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.222+0000 7f7347fff700 1 --2- 172.21.15.8:0/2046921884 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f734806be60 0x7f73480b1620 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f734806ece0 tx=0x7f7340009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f784a0b9ea9973cb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.222+0000 7f73467fc700 1 -- 172.21.15.8:0/2046921884 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734000e070 con 0x7f734806be60 2023-10-06T04:37:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.222+0000 7f73467fc700 1 -- 172.21.15.8:0/2046921884 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f734000bb60 con 0x7f734806be60 2023-10-06T04:37:01.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.222+0000 7f73467fc700 1 -- 172.21.15.8:0/2046921884 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7340012430 con 0x7f734806be60 2023-10-06T04:37:01.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.223+0000 7f734e092700 1 -- 172.21.15.8:0/2046921884 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f734806be60 msgr2=0x7f73480b1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:01.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.223+0000 7f734e092700 1 --2- 172.21.15.8:0/2046921884 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f734806be60 0x7f73480b1620 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f734806ece0 tx=0x7f7340009780 comp rx=0 tx=0).stop 2023-10-06T04:37:01.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.223+0000 7f734e092700 1 -- 172.21.15.8:0/2046921884 shutdown_connections 2023-10-06T04:37:01.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.223+0000 7f734e092700 1 --2- 172.21.15.8:0/2046921884 >> v2:172.21.15.184:3300/0 conn(0x7f7348140c30 0x7f73480cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:01.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.223+0000 7f734e092700 1 --2- 172.21.15.8:0/2046921884 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f734806be60 0x7f73480b1620 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:01.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.223+0000 7f734e092700 1 -- 172.21.15.8:0/2046921884 >> 172.21.15.8:0/2046921884 conn(0x7f73480ce250 msgr2=0x7f73480ce650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:01.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.223+0000 7f734e092700 1 -- 172.21.15.8:0/2046921884 shutdown_connections 2023-10-06T04:37:01.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.223+0000 7f734e092700 1 -- 172.21.15.8:0/2046921884 wait complete. 2023-10-06T04:37:01.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.224+0000 7f734e092700 1 Processor -- start 2023-10-06T04:37:01.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.224+0000 7f734e092700 1 -- start start 2023-10-06T04:37:01.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.225+0000 7f734e092700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f734806be60 0x7f734815d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:01.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.225+0000 7f734e092700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73480c8b30 0x7f73480686e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:01.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.225+0000 7f734e092700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7348140c30 0x7f734806a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:01.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.225+0000 7f734e092700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734815d8d0 con 0x7f734806be60 2023-10-06T04:37:01.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.225+0000 7f734e092700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7348068fe0 con 0x7f73480c8b30 2023-10-06T04:37:01.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.225+0000 7f734e092700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73480692c0 con 0x7f7348140c30 2023-10-06T04:37:01.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.225+0000 7f73477fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f734806be60 0x7f734815d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:01.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.225+0000 7f73477fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f734806be60 0x7f734815d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50120/0 (socket says 172.21.15.8:50120) 2023-10-06T04:37:01.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.225+0000 7f73477fe700 1 -- 172.21.15.8:0/861287970 learned_addr learned my addr 172.21.15.8:0/861287970 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:01.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.225+0000 7f7347fff700 1 --2- 172.21.15.8:0/861287970 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7348140c30 0x7f734806a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:01.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.225+0000 7f73477fe700 1 -- 172.21.15.8:0/861287970 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7348140c30 msgr2=0x7f734806a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:01.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.225+0000 7f7346ffd700 1 --2- 172.21.15.8:0/861287970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73480c8b30 0x7f73480686e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:01.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.225+0000 7f73477fe700 1 --2- 172.21.15.8:0/861287970 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7348140c30 0x7f734806a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:01.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.225+0000 7f73477fe700 1 -- 172.21.15.8:0/861287970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73480c8b30 msgr2=0x7f73480686e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:01.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.225+0000 7f73477fe700 1 --2- 172.21.15.8:0/861287970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73480c8b30 0x7f73480686e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:01.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.225+0000 7f73477fe700 1 -- 172.21.15.8:0/861287970 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7340009a20 con 0x7f734806be60 2023-10-06T04:37:01.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.225+0000 7f7347fff700 1 --2- 172.21.15.8:0/861287970 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7348140c30 0x7f734806a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:01.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.225+0000 7f7346ffd700 1 --2- 172.21.15.8:0/861287970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73480c8b30 0x7f73480686e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:01.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.225+0000 7f73477fe700 1 --2- 172.21.15.8:0/861287970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f734806be60 0x7f734815d390 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f733800ec80 tx=0x7f7338009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:01.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.225+0000 7f732f7fe700 1 -- 172.21.15.8:0/861287970 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733800c9d0 con 0x7f734806be60 2023-10-06T04:37:01.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.225+0000 7f732f7fe700 1 -- 172.21.15.8:0/861287970 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733800cb30 con 0x7f734806be60 2023-10-06T04:37:01.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.225+0000 7f734e092700 1 -- 172.21.15.8:0/861287970 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73480695a0 con 0x7f734806be60 2023-10-06T04:37:01.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.225+0000 7f732f7fe700 1 -- 172.21.15.8:0/861287970 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7338013470 con 0x7f734806be60 2023-10-06T04:37:01.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.226+0000 7f734e092700 1 -- 172.21.15.8:0/861287970 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7348069b60 con 0x7f734806be60 2023-10-06T04:37:01.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.226+0000 7f734e092700 1 -- 172.21.15.8:0/861287970 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7348071550 con 0x7f734806be60 2023-10-06T04:37:01.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.227+0000 7f732f7fe700 1 -- 172.21.15.8:0/861287970 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7338013860 con 0x7f734806be60 2023-10-06T04:37:01.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.227+0000 7f732f7fe700 1 --2- 172.21.15.8:0/861287970 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7334066f30 0x7f73340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:01.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.227+0000 7f732f7fe700 1 -- 172.21.15.8:0/861287970 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7338085160 con 0x7f734806be60 2023-10-06T04:37:01.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.227+0000 7f7346ffd700 1 --2- 172.21.15.8:0/861287970 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7334066f30 0x7f73340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:01.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.228+0000 7f7346ffd700 1 --2- 172.21.15.8:0/861287970 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7334066f30 0x7f73340693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f734815dc50 tx=0x7f733c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:01.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.231+0000 7f732f7fe700 1 -- 172.21.15.8:0/861287970 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7338051ee0 con 0x7f734806be60 2023-10-06T04:37:01.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.431+0000 7f734e092700 1 -- 172.21.15.8:0/861287970 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7348069ed0 con 0x7f734806be60 2023-10-06T04:37:01.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.432+0000 7f732f7fe700 1 -- 172.21.15.8:0/861287970 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f7338055500 con 0x7f734806be60 2023-10-06T04:37:01.435 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:01.435 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":25,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:36:21.690266+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:36:10.148177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:36:10.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:36:14.390671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:36:15.601089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:36:19.291300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.555871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.490505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.504578+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.517217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:05.991135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.537329+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.543232+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.443715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:37:01.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.434+0000 7f734e092700 1 -- 172.21.15.8:0/861287970 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7334066f30 msgr2=0x7f73340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:01.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.434+0000 7f734e092700 1 --2- 172.21.15.8:0/861287970 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7334066f30 0x7f73340693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f734815dc50 tx=0x7f733c009040 comp rx=0 tx=0).stop 2023-10-06T04:37:01.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.434+0000 7f734e092700 1 -- 172.21.15.8:0/861287970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f734806be60 msgr2=0x7f734815d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:01.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.434+0000 7f734e092700 1 --2- 172.21.15.8:0/861287970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f734806be60 0x7f734815d390 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f733800ec80 tx=0x7f7338009120 comp rx=0 tx=0).stop 2023-10-06T04:37:01.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.434+0000 7f734e092700 1 -- 172.21.15.8:0/861287970 shutdown_connections 2023-10-06T04:37:01.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.434+0000 7f734e092700 1 --2- 172.21.15.8:0/861287970 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7334066f30 0x7f73340693e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:01.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.434+0000 7f734e092700 1 --2- 172.21.15.8:0/861287970 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7348140c30 0x7f734806a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:01.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.434+0000 7f734e092700 1 --2- 172.21.15.8:0/861287970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f734806be60 0x7f734815d390 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:01.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.434+0000 7f734e092700 1 --2- 172.21.15.8:0/861287970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73480c8b30 0x7f73480686e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:01.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.434+0000 7f734e092700 1 -- 172.21.15.8:0/861287970 >> 172.21.15.8:0/861287970 conn(0x7f73480ce250 msgr2=0x7f73480c4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:01.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.434+0000 7f734e092700 1 -- 172.21.15.8:0/861287970 shutdown_connections 2023-10-06T04:37:01.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.434+0000 7f734e092700 1 -- 172.21.15.8:0/861287970 wait complete. 2023-10-06T04:37:01.449 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:36:10.148177+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:36:10.684157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:36:14.390671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:36:15.601089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T04:36:19.291300+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:37:01.449 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:37:01.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.568+0000 7f80e359e700 1 Processor -- start 2023-10-06T04:37:01.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.568+0000 7f80e359e700 1 -- start start 2023-10-06T04:37:01.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.569+0000 7f80e359e700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f80e4156e30 0x7f80e40cf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:01.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.569+0000 7f80e359e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80e40b1c70 0x7f80e40b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:01.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.569+0000 7f80e359e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f80e415ad80 0x7f80e415b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:01.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.569+0000 7f80e359e700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e40b2620 con 0x7f80e4156e30 2023-10-06T04:37:01.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.569+0000 7f80e359e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e40cf370 con 0x7f80e415ad80 2023-10-06T04:37:01.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.569+0000 7f80e359e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e40ce800 con 0x7f80e40b1c70 2023-10-06T04:37:01.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.569+0000 7f80e259c700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f80e4156e30 0x7f80e40cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:01.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.569+0000 7f80e259c700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f80e4156e30 0x7f80e40cf800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50130/0 (socket says 172.21.15.8:50130) 2023-10-06T04:37:01.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.569+0000 7f80e259c700 1 -- 172.21.15.8:0/3758962296 learned_addr learned my addr 172.21.15.8:0/3758962296 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:01.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.569+0000 7f80e1d9b700 1 --2- 172.21.15.8:0/3758962296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80e40b1c70 0x7f80e40b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:01.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.569+0000 7f80e2d9d700 1 --2- 172.21.15.8:0/3758962296 >> v2:172.21.15.184:3300/0 conn(0x7f80e415ad80 0x7f80e415b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:01.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.569+0000 7f80e259c700 1 -- 172.21.15.8:0/3758962296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80e40b1c70 msgr2=0x7f80e40b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:01.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.569+0000 7f80e259c700 1 --2- 172.21.15.8:0/3758962296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80e40b1c70 0x7f80e40b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:01.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.569+0000 7f80e259c700 1 -- 172.21.15.8:0/3758962296 >> v2:172.21.15.184:3300/0 conn(0x7f80e415ad80 msgr2=0x7f80e415b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:01.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.569+0000 7f80e259c700 1 --2- 172.21.15.8:0/3758962296 >> v2:172.21.15.184:3300/0 conn(0x7f80e415ad80 0x7f80e415b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:01.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.569+0000 7f80e259c700 1 -- 172.21.15.8:0/3758962296 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e40cea60 con 0x7f80e4156e30 2023-10-06T04:37:01.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.569+0000 7f80e1d9b700 1 --2- 172.21.15.8:0/3758962296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80e40b1c70 0x7f80e40b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:01.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.569+0000 7f80e2d9d700 1 --2- 172.21.15.8:0/3758962296 >> v2:172.21.15.184:3300/0 conn(0x7f80e415ad80 0x7f80e415b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:01.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.570+0000 7f80e259c700 1 --2- 172.21.15.8:0/3758962296 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80e4156e30 0x7f80e40cf800 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f80e406fbd0 tx=0x7f80dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=455d9ada734de069 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:01.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.570+0000 7f80e159a700 1 -- 172.21.15.8:0/3758962296 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc00b860 con 0x7f80e4156e30 2023-10-06T04:37:01.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.570+0000 7f80e159a700 1 -- 172.21.15.8:0/3758962296 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80dc00b9c0 con 0x7f80e4156e30 2023-10-06T04:37:01.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.570+0000 7f80e159a700 1 -- 172.21.15.8:0/3758962296 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc00bd60 con 0x7f80e4156e30 2023-10-06T04:37:01.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.570+0000 7f80e359e700 1 -- 172.21.15.8:0/3758962296 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80e4156e30 msgr2=0x7f80e40cf800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:01.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.570+0000 7f80e359e700 1 --2- 172.21.15.8:0/3758962296 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80e4156e30 0x7f80e40cf800 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f80e406fbd0 tx=0x7f80dc009250 comp rx=0 tx=0).stop 2023-10-06T04:37:01.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.570+0000 7f80e359e700 1 -- 172.21.15.8:0/3758962296 shutdown_connections 2023-10-06T04:37:01.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.570+0000 7f80e359e700 1 --2- 172.21.15.8:0/3758962296 >> v2:172.21.15.184:3300/0 conn(0x7f80e415ad80 0x7f80e415b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:01.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.570+0000 7f80e359e700 1 --2- 172.21.15.8:0/3758962296 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80e4156e30 0x7f80e40cf800 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:01.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.570+0000 7f80e359e700 1 --2- 172.21.15.8:0/3758962296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80e40b1c70 0x7f80e40b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:01.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.570+0000 7f80e359e700 1 -- 172.21.15.8:0/3758962296 >> 172.21.15.8:0/3758962296 conn(0x7f80e406ed00 msgr2=0x7f80e406f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:01.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.570+0000 7f80e359e700 1 -- 172.21.15.8:0/3758962296 shutdown_connections 2023-10-06T04:37:01.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.570+0000 7f80e359e700 1 -- 172.21.15.8:0/3758962296 wait complete. 2023-10-06T04:37:01.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.571+0000 7f80e359e700 1 Processor -- start 2023-10-06T04:37:01.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.572+0000 7f80e359e700 1 -- start start 2023-10-06T04:37:01.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.572+0000 7f80e359e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80e40b1c70 0x7f80e4150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:01.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.572+0000 7f80e359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80e4156e30 0x7f80e40b1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:01.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.572+0000 7f80e359e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80e415ad80 0x7f80e415b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:01.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.572+0000 7f80e359e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e40b07d0 con 0x7f80e4156e30 2023-10-06T04:37:01.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.572+0000 7f80e359e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e40afbc0 con 0x7f80e40b1c70 2023-10-06T04:37:01.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.572+0000 7f80e359e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e40afea0 con 0x7f80e415ad80 2023-10-06T04:37:01.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.572+0000 7f80e1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80e4156e30 0x7f80e40b1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:01.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.572+0000 7f80e1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80e4156e30 0x7f80e40b1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50140/0 (socket says 172.21.15.8:50140) 2023-10-06T04:37:01.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.572+0000 7f80e1d9b700 1 -- 172.21.15.8:0/1644200611 learned_addr learned my addr 172.21.15.8:0/1644200611 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:01.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.573+0000 7f80e259c700 1 --2- 172.21.15.8:0/1644200611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80e40b1c70 0x7f80e4150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:01.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.573+0000 7f80e2d9d700 1 --2- 172.21.15.8:0/1644200611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80e415ad80 0x7f80e415b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:01.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.573+0000 7f80e1d9b700 1 -- 172.21.15.8:0/1644200611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80e415ad80 msgr2=0x7f80e415b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:01.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.573+0000 7f80e1d9b700 1 --2- 172.21.15.8:0/1644200611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80e415ad80 0x7f80e415b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:01.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.573+0000 7f80e1d9b700 1 -- 172.21.15.8:0/1644200611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80e40b1c70 msgr2=0x7f80e4150ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:01.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.573+0000 7f80e1d9b700 1 --2- 172.21.15.8:0/1644200611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80e40b1c70 0x7f80e4150ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:01.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.573+0000 7f80e1d9b700 1 -- 172.21.15.8:0/1644200611 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80dc0094f0 con 0x7f80e4156e30 2023-10-06T04:37:01.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.573+0000 7f80e1d9b700 1 --2- 172.21.15.8:0/1644200611 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80e4156e30 0x7f80e40b1180 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f80cc00c880 tx=0x7f80cc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:01.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.573+0000 7f80da7fc700 1 -- 172.21.15.8:0/1644200611 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc011600 con 0x7f80e4156e30 2023-10-06T04:37:01.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.573+0000 7f80da7fc700 1 -- 172.21.15.8:0/1644200611 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80cc011760 con 0x7f80e4156e30 2023-10-06T04:37:01.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.573+0000 7f80e359e700 1 -- 172.21.15.8:0/1644200611 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e40b0180 con 0x7f80e4156e30 2023-10-06T04:37:01.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.573+0000 7f80da7fc700 1 -- 172.21.15.8:0/1644200611 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc011ae0 con 0x7f80e4156e30 2023-10-06T04:37:01.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.573+0000 7f80e359e700 1 -- 172.21.15.8:0/1644200611 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e4151420 con 0x7f80e4156e30 2023-10-06T04:37:01.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.574+0000 7f80e359e700 1 -- 172.21.15.8:0/1644200611 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e4169660 con 0x7f80e4156e30 2023-10-06T04:37:01.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.574+0000 7f80da7fc700 1 -- 172.21.15.8:0/1644200611 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f80cc010350 con 0x7f80e4156e30 2023-10-06T04:37:01.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.575+0000 7f80da7fc700 1 --2- 172.21.15.8:0/1644200611 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f80c4066f60 0x7f80c4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:01.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.575+0000 7f80da7fc700 1 -- 172.21.15.8:0/1644200611 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f80cc0848a0 con 0x7f80e4156e30 2023-10-06T04:37:01.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.575+0000 7f80e259c700 1 --2- 172.21.15.8:0/1644200611 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f80c4066f60 0x7f80c4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:01.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.575+0000 7f80e259c700 1 --2- 172.21.15.8:0/1644200611 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f80c4066f60 0x7f80c4069410 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f80e406fbd0 tx=0x7f80dc017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:01.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.579+0000 7f80da7fc700 1 -- 172.21.15.8:0/1644200611 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f80e4169660 con 0x7f80e4156e30 2023-10-06T04:37:01.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.772+0000 7f80e359e700 1 -- 172.21.15.8:0/1644200611 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f80e4169660 con 0x7f80e4156e30 2023-10-06T04:37:01.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.773+0000 7f80da7fc700 1 -- 172.21.15.8:0/1644200611 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f80e4169660 con 0x7f80e4156e30 2023-10-06T04:37:01.775 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 8 2023-10-06T04:37:01.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.775+0000 7f80e359e700 1 -- 172.21.15.8:0/1644200611 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f80c4066f60 msgr2=0x7f80c4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:01.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.775+0000 7f80e359e700 1 --2- 172.21.15.8:0/1644200611 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f80c4066f60 0x7f80c4069410 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f80e406fbd0 tx=0x7f80dc017000 comp rx=0 tx=0).stop 2023-10-06T04:37:01.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.775+0000 7f80e359e700 1 -- 172.21.15.8:0/1644200611 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80e4156e30 msgr2=0x7f80e40b1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:01.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.775+0000 7f80e359e700 1 --2- 172.21.15.8:0/1644200611 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80e4156e30 0x7f80e40b1180 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f80cc00c880 tx=0x7f80cc008040 comp rx=0 tx=0).stop 2023-10-06T04:37:01.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.775+0000 7f80e359e700 1 -- 172.21.15.8:0/1644200611 shutdown_connections 2023-10-06T04:37:01.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.775+0000 7f80e359e700 1 --2- 172.21.15.8:0/1644200611 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f80c4066f60 0x7f80c4069410 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:01.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.775+0000 7f80e359e700 1 --2- 172.21.15.8:0/1644200611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80e415ad80 0x7f80e415b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:01.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.775+0000 7f80e359e700 1 --2- 172.21.15.8:0/1644200611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80e40b1c70 0x7f80e4150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:01.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.775+0000 7f80e359e700 1 --2- 172.21.15.8:0/1644200611 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80e4156e30 0x7f80e40b1180 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:01.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.775+0000 7f80e359e700 1 -- 172.21.15.8:0/1644200611 >> 172.21.15.8:0/1644200611 conn(0x7f80e406ed00 msgr2=0x7f80e41517a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:01.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.775+0000 7f80e359e700 1 -- 172.21.15.8:0/1644200611 shutdown_connections 2023-10-06T04:37:01.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.775+0000 7f80e359e700 1 -- 172.21.15.8:0/1644200611 wait complete. 2023-10-06T04:37:01.789 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:37:01.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.908+0000 7fe80991e700 1 Processor -- start 2023-10-06T04:37:01.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.909+0000 7fe80991e700 1 -- start start 2023-10-06T04:37:01.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.909+0000 7fe80991e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe80406d2c0 0x7fe80406c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:01.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.909+0000 7fe80991e700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe80406d8c0 con 0x7fe8040cc440 2023-10-06T04:37:01.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.909+0000 7fe80991e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe80406b910 con 0x7fe8040cc070 2023-10-06T04:37:01.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.909+0000 7fe80991e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe80406d6e0 con 0x7fe80406d2c0 2023-10-06T04:37:01.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.909+0000 7fe8027fc700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe8040cc440 0x7fe8040686e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60940/0 (socket says 172.21.15.8:60940) 2023-10-06T04:37:01.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.909+0000 7fe8027fc700 1 -- 172.21.15.8:0/2482585982 learned_addr learned my addr 172.21.15.8:0/2482585982 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:01.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.910+0000 7fe801ffb700 1 -- 172.21.15.8:0/2482585982 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3204859028 0 0) 0x7fe80406d8c0 con 0x7fe8040cc440 2023-10-06T04:37:01.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.910+0000 7fe801ffb700 1 -- 172.21.15.8:0/2482585982 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7f0003570 con 0x7fe8040cc440 2023-10-06T04:37:01.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.910+0000 7fe8037fe700 1 --2- 172.21.15.8:0/2482585982 >> v2:172.21.15.184:3300/0 conn(0x7fe80406d2c0 0x7fe80406c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:01.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.910+0000 7fe801ffb700 1 -- 172.21.15.8:0/2482585982 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2248410673 0 0) 0x7fe7f0003570 con 0x7fe8040cc440 2023-10-06T04:37:01.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.910+0000 7fe801ffb700 1 -- 172.21.15.8:0/2482585982 >> v2:172.21.15.184:3300/0 conn(0x7fe80406d2c0 msgr2=0x7fe80406c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:01.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.910+0000 7fe801ffb700 1 --2- 172.21.15.8:0/2482585982 >> v2:172.21.15.184:3300/0 conn(0x7fe80406d2c0 0x7fe80406c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:01.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.910+0000 7fe801ffb700 1 -- 172.21.15.8:0/2482585982 >> v1:172.21.15.184:6789/0 conn(0x7fe8040cc070 legacy=0x7fe80406cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:01.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.910+0000 7fe801ffb700 1 -- 172.21.15.8:0/2482585982 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe80406bbf0 con 0x7fe8040cc440 2023-10-06T04:37:01.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.910+0000 7fe801ffb700 1 -- 172.21.15.8:0/2482585982 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7fe7ec001470 con 0x7fe8040cc440 2023-10-06T04:37:01.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.910+0000 7fe8037fe700 1 --2- 172.21.15.8:0/2482585982 >> v2:172.21.15.184:3300/0 conn(0x7fe80406d2c0 0x7fe80406c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:01.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.910+0000 7fe801ffb700 1 -- 172.21.15.8:0/2482585982 >> v1:172.21.15.8:6789/0 conn(0x7fe8040cc440 legacy=0x7fe8040686e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:01.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.910+0000 7fe801ffb700 1 --2- 172.21.15.8:0/2482585982 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7f0003a60 0x7fe7f0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:01.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.910+0000 7fe801ffb700 1 --2- 172.21.15.8:0/2482585982 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7f0004810 0x7fe7f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:01.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.910+0000 7fe801ffb700 1 --2- 172.21.15.8:0/2482585982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7f00052e0 0x7fe7f000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:01.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.910+0000 7fe801ffb700 1 -- 172.21.15.8:0/2482585982 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80406d6e0 con 0x7fe7f00052e0 2023-10-06T04:37:01.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.910+0000 7fe801ffb700 1 -- 172.21.15.8:0/2482585982 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f000c190 con 0x7fe7f0003a60 2023-10-06T04:37:01.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.910+0000 7fe801ffb700 1 -- 172.21.15.8:0/2482585982 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f000c350 con 0x7fe7f0004810 2023-10-06T04:37:01.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.910+0000 7fe8037fe700 1 --2- 172.21.15.8:0/2482585982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7f00052e0 0x7fe7f000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:01.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.910+0000 7fe8027fc700 1 --2- 172.21.15.8:0/2482585982 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7f0004810 0x7fe7f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:01.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.910+0000 7fe802ffd700 1 --2- 172.21.15.8:0/2482585982 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7f0003a60 0x7fe7f0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:01.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.911+0000 7fe8037fe700 1 -- 172.21.15.8:0/2482585982 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7f0004810 msgr2=0x7fe7f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:01.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.911+0000 7fe8037fe700 1 --2- 172.21.15.8:0/2482585982 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7f0004810 0x7fe7f0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:01.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.911+0000 7fe8037fe700 1 -- 172.21.15.8:0/2482585982 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7f0003a60 msgr2=0x7fe7f0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:01.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.911+0000 7fe8037fe700 1 --2- 172.21.15.8:0/2482585982 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7f0003a60 0x7fe7f0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:01.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.911+0000 7fe8037fe700 1 -- 172.21.15.8:0/2482585982 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f0003570 con 0x7fe7f00052e0 2023-10-06T04:37:01.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.911+0000 7fe8037fe700 1 -- 172.21.15.8:0/2482585982 reap_dead start 2023-10-06T04:37:01.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.911+0000 7fe8037fe700 1 --2- 172.21.15.8:0/2482585982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7f00052e0 0x7fe7f000ba60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc007580 tx=0x7fe7fc0097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db8ca3edee8d9e7d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:01.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.911+0000 7fe801ffb700 1 -- 172.21.15.8:0/2482585982 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc009ae0 con 0x7fe7f00052e0 2023-10-06T04:37:01.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.911+0000 7fe801ffb700 1 -- 172.21.15.8:0/2482585982 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7fc007dd0 con 0x7fe7f00052e0 2023-10-06T04:37:01.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.911+0000 7fe801ffb700 1 -- 172.21.15.8:0/2482585982 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc014650 con 0x7fe7f00052e0 2023-10-06T04:37:01.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.911+0000 7fe80991e700 1 -- 172.21.15.8:0/2482585982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7f00052e0 msgr2=0x7fe7f000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:01.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.911+0000 7fe80991e700 1 --2- 172.21.15.8:0/2482585982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7f00052e0 0x7fe7f000ba60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc007580 tx=0x7fe7fc0097d0 comp rx=0 tx=0).stop 2023-10-06T04:37:01.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.911+0000 7fe80991e700 1 -- 172.21.15.8:0/2482585982 shutdown_connections 2023-10-06T04:37:01.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.911+0000 7fe80991e700 1 --2- 172.21.15.8:0/2482585982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7f00052e0 0x7fe7f000ba60 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:01.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.911+0000 7fe80991e700 1 -- 172.21.15.8:0/2482585982 >> 172.21.15.8:0/2482585982 conn(0x7fe8040ce250 msgr2=0x7fe8040ce650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:01.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.911+0000 7fe80991e700 1 -- 172.21.15.8:0/2482585982 shutdown_connections 2023-10-06T04:37:01.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.911+0000 7fe80991e700 1 -- 172.21.15.8:0/2482585982 wait complete. 2023-10-06T04:37:01.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.913+0000 7fe80991e700 1 Processor -- start 2023-10-06T04:37:01.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.913+0000 7fe80991e700 1 -- start start 2023-10-06T04:37:01.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.913+0000 7fe80991e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7f00052e0 0x7fe80416c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:01.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.913+0000 7fe80991e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe80413f880 0x7fe80413fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:01.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.913+0000 7fe80991e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe80415d310 0x7fe80415d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:01.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.913+0000 7fe80991e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe804140fe0 con 0x7fe80415d310 2023-10-06T04:37:01.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.913+0000 7fe80991e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80415dcd0 con 0x7fe7f00052e0 2023-10-06T04:37:01.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.913+0000 7fe80991e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8041696d0 con 0x7fe80413f880 2023-10-06T04:37:01.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.914+0000 7fe8037fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe80415d310 0x7fe80415d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:01.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.914+0000 7fe8037fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe80415d310 0x7fe80415d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50166/0 (socket says 172.21.15.8:50166) 2023-10-06T04:37:01.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.914+0000 7fe8037fe700 1 -- 172.21.15.8:0/1061553614 learned_addr learned my addr 172.21.15.8:0/1061553614 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:01.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.914+0000 7fe802ffd700 1 --2- 172.21.15.8:0/1061553614 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7f00052e0 0x7fe80416c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:01.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.914+0000 7fe8027fc700 1 --2- 172.21.15.8:0/1061553614 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe80413f880 0x7fe80413fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:01.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.914+0000 7fe8037fe700 1 -- 172.21.15.8:0/1061553614 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe80413f880 msgr2=0x7fe80413fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:01.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.914+0000 7fe8037fe700 1 --2- 172.21.15.8:0/1061553614 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe80413f880 0x7fe80413fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:01.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.914+0000 7fe8037fe700 1 -- 172.21.15.8:0/1061553614 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7f00052e0 msgr2=0x7fe80416c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:01.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.914+0000 7fe8037fe700 1 --2- 172.21.15.8:0/1061553614 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7f00052e0 0x7fe80416c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:01.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.914+0000 7fe8037fe700 1 -- 172.21.15.8:0/1061553614 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8041403d0 con 0x7fe80415d310 2023-10-06T04:37:01.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.914+0000 7fe8027fc700 1 --2- 172.21.15.8:0/1061553614 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe80413f880 0x7fe80413fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:01.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.914+0000 7fe8037fe700 1 --2- 172.21.15.8:0/1061553614 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe80415d310 0x7fe80415d790 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc007b70 tx=0x7fe7fc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:01.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.914+0000 7fe7faffd700 1 -- 172.21.15.8:0/1061553614 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc009ae0 con 0x7fe80415d310 2023-10-06T04:37:01.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.914+0000 7fe7faffd700 1 -- 172.21.15.8:0/1061553614 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7fc009480 con 0x7fe80415d310 2023-10-06T04:37:01.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.914+0000 7fe80991e700 1 -- 172.21.15.8:0/1061553614 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8041406b0 con 0x7fe80415d310 2023-10-06T04:37:01.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.914+0000 7fe7faffd700 1 -- 172.21.15.8:0/1061553614 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc013e10 con 0x7fe80415d310 2023-10-06T04:37:01.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.914+0000 7fe80991e700 1 -- 172.21.15.8:0/1061553614 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe804140c70 con 0x7fe80415d310 2023-10-06T04:37:01.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.915+0000 7fe80991e700 1 -- 172.21.15.8:0/1061553614 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe804141190 con 0x7fe80415d310 2023-10-06T04:37:01.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.916+0000 7fe7faffd700 1 -- 172.21.15.8:0/1061553614 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe7fc003040 con 0x7fe80415d310 2023-10-06T04:37:01.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.916+0000 7fe7faffd700 1 --2- 172.21.15.8:0/1061553614 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe7e4066f30 0x7fe7e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:01.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.916+0000 7fe7faffd700 1 -- 172.21.15.8:0/1061553614 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe7fc0866f0 con 0x7fe80415d310 2023-10-06T04:37:01.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.916+0000 7fe802ffd700 1 --2- 172.21.15.8:0/1061553614 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe7e4066f30 0x7fe7e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:01.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.917+0000 7fe802ffd700 1 --2- 172.21.15.8:0/1061553614 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe7e4066f30 0x7fe7e40693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe7f4007e40 tx=0x7fe7f4007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:01.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:01.921+0000 7fe7faffd700 1 -- 172.21.15.8:0/1061553614 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe804141190 con 0x7fe80415d310 2023-10-06T04:37:02.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.114+0000 7fe80991e700 1 -- 172.21.15.8:0/1061553614 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe804141190 con 0x7fe80415d310 2023-10-06T04:37:02.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.114+0000 7fe7faffd700 1 -- 172.21.15.8:0/1061553614 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe804141190 con 0x7fe80415d310 2023-10-06T04:37:02.117 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-06T04:37:02.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.116+0000 7fe80991e700 1 -- 172.21.15.8:0/1061553614 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe7e4066f30 msgr2=0x7fe7e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:02.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.116+0000 7fe80991e700 1 --2- 172.21.15.8:0/1061553614 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe7e4066f30 0x7fe7e40693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe7f4007e40 tx=0x7fe7f4007d30 comp rx=0 tx=0).stop 2023-10-06T04:37:02.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.116+0000 7fe80991e700 1 -- 172.21.15.8:0/1061553614 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe80415d310 msgr2=0x7fe80415d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:02.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.116+0000 7fe80991e700 1 --2- 172.21.15.8:0/1061553614 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe80415d310 0x7fe80415d790 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc007b70 tx=0x7fe7fc018000 comp rx=0 tx=0).stop 2023-10-06T04:37:02.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.116+0000 7fe80991e700 1 -- 172.21.15.8:0/1061553614 shutdown_connections 2023-10-06T04:37:02.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.116+0000 7fe80991e700 1 --2- 172.21.15.8:0/1061553614 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe7e4066f30 0x7fe7e40693e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:02.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.116+0000 7fe80991e700 1 --2- 172.21.15.8:0/1061553614 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe80415d310 0x7fe80415d790 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:02.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.116+0000 7fe80991e700 1 --2- 172.21.15.8:0/1061553614 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7f00052e0 0x7fe80416c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:02.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.116+0000 7fe80991e700 1 --2- 172.21.15.8:0/1061553614 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe80413f880 0x7fe80413fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:02.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.116+0000 7fe80991e700 1 -- 172.21.15.8:0/1061553614 >> 172.21.15.8:0/1061553614 conn(0x7fe8040ce250 msgr2=0x7fe8040cab90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:02.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.116+0000 7fe80991e700 1 -- 172.21.15.8:0/1061553614 shutdown_connections 2023-10-06T04:37:02.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.116+0000 7fe80991e700 1 -- 172.21.15.8:0/1061553614 wait complete. 2023-10-06T04:37:02.131 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:37:02.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.250+0000 7f9968608700 1 Processor -- start 2023-10-06T04:37:02.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.251+0000 7f9968608700 1 -- start start 2023-10-06T04:37:02.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.251+0000 7f9968608700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9960142cf0 0x7f99600b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:02.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.251+0000 7f9968608700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f99600b3790 0x7f99600b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:02.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.251+0000 7f9968608700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99600cf510 con 0x7f99601430c0 2023-10-06T04:37:02.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.251+0000 7f9968608700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99600b4130 con 0x7f99600b3790 2023-10-06T04:37:02.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.251+0000 7f9968608700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99600ce6a0 con 0x7f9960142cf0 2023-10-06T04:37:02.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.252+0000 7f9965ba3700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f99601430c0 0x7f99600cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60950/0 (socket says 172.21.15.8:60950) 2023-10-06T04:37:02.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.252+0000 7f9965ba3700 1 -- 172.21.15.8:0/4278646987 learned_addr learned my addr 172.21.15.8:0/4278646987 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:02.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.252+0000 7f99663a4700 1 --2- 172.21.15.8:0/4278646987 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9960142cf0 0x7f99600b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:02.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.252+0000 7f9966ba5700 1 --2- 172.21.15.8:0/4278646987 >> v2:172.21.15.184:3300/0 conn(0x7f99600b3790 0x7f99600b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:02.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.252+0000 7f99653a2700 1 -- 172.21.15.8:0/4278646987 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1447024469 0 0) 0x7f99600cf510 con 0x7f99601430c0 2023-10-06T04:37:02.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.252+0000 7f99653a2700 1 -- 172.21.15.8:0/4278646987 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9948003570 con 0x7f99601430c0 2023-10-06T04:37:02.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.252+0000 7f99663a4700 1 -- 172.21.15.8:0/4278646987 >> v2:172.21.15.184:3300/0 conn(0x7f99600b3790 msgr2=0x7f99600b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:02.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.252+0000 7f99663a4700 1 --2- 172.21.15.8:0/4278646987 >> v2:172.21.15.184:3300/0 conn(0x7f99600b3790 0x7f99600b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:02.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.252+0000 7f99663a4700 1 -- 172.21.15.8:0/4278646987 >> v1:172.21.15.8:6789/0 conn(0x7f99601430c0 legacy=0x7f99600cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:02.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.252+0000 7f99653a2700 1 -- 172.21.15.8:0/4278646987 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 612060772 0 0) 0x7f9948003570 con 0x7f99601430c0 2023-10-06T04:37:02.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.252+0000 7f99663a4700 1 -- 172.21.15.8:0/4278646987 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99600ce900 con 0x7f9960142cf0 2023-10-06T04:37:02.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.252+0000 7f99663a4700 1 --2- 172.21.15.8:0/4278646987 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9960142cf0 0x7f99600b5cd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f99580098e0 tx=0x7f99580091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc2916fe2aa85363 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:02.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.252+0000 7f99653a2700 1 -- 172.21.15.8:0/4278646987 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9954001470 con 0x7f9960142cf0 2023-10-06T04:37:02.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.253+0000 7f99653a2700 1 -- 172.21.15.8:0/4278646987 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9958011420 con 0x7f9960142cf0 2023-10-06T04:37:02.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.253+0000 7f99653a2700 1 -- 172.21.15.8:0/4278646987 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99580117c0 con 0x7f9960142cf0 2023-10-06T04:37:02.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.253+0000 7f9968608700 1 -- 172.21.15.8:0/4278646987 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9960142cf0 msgr2=0x7f99600b5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:02.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.253+0000 7f9968608700 1 --2- 172.21.15.8:0/4278646987 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9960142cf0 0x7f99600b5cd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f99580098e0 tx=0x7f99580091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:02.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.253+0000 7f9968608700 1 -- 172.21.15.8:0/4278646987 shutdown_connections 2023-10-06T04:37:02.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.253+0000 7f9968608700 1 --2- 172.21.15.8:0/4278646987 >> v2:172.21.15.184:3300/0 conn(0x7f99600b3790 0x7f99600b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:02.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.253+0000 7f9968608700 1 --2- 172.21.15.8:0/4278646987 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9960142cf0 0x7f99600b5cd0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:02.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.253+0000 7f9968608700 1 -- 172.21.15.8:0/4278646987 >> 172.21.15.8:0/4278646987 conn(0x7f996006ed00 msgr2=0x7f996006f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:02.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.253+0000 7f9968608700 1 -- 172.21.15.8:0/4278646987 shutdown_connections 2023-10-06T04:37:02.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.253+0000 7f9968608700 1 -- 172.21.15.8:0/4278646987 wait complete. 2023-10-06T04:37:02.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.254+0000 7f9968608700 1 Processor -- start 2023-10-06T04:37:02.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.254+0000 7f9968608700 1 -- start start 2023-10-06T04:37:02.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.255+0000 7f9968608700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99600b3790 0x7f9960158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:02.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.255+0000 7f9968608700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9960142cf0 0x7f996015aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:02.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.255+0000 7f9968608700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99601430c0 0x7f99600c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:02.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.255+0000 7f9968608700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99600c69f0 con 0x7f9960142cf0 2023-10-06T04:37:02.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.255+0000 7f9968608700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996015aa60 con 0x7f99601430c0 2023-10-06T04:37:02.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.255+0000 7f9968608700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9960159e50 con 0x7f99600b3790 2023-10-06T04:37:02.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.255+0000 7f9965ba3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9960142cf0 0x7f996015aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:02.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.255+0000 7f9965ba3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9960142cf0 0x7f996015aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50176/0 (socket says 172.21.15.8:50176) 2023-10-06T04:37:02.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.255+0000 7f9965ba3700 1 -- 172.21.15.8:0/2418282561 learned_addr learned my addr 172.21.15.8:0/2418282561 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:02.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.255+0000 7f99663a4700 1 --2- 172.21.15.8:0/2418282561 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99600b3790 0x7f9960158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:02.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.255+0000 7f9966ba5700 1 --2- 172.21.15.8:0/2418282561 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99601430c0 0x7f99600c5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:02.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.255+0000 7f9965ba3700 1 -- 172.21.15.8:0/2418282561 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99600b3790 msgr2=0x7f9960158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:02.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.255+0000 7f9965ba3700 1 --2- 172.21.15.8:0/2418282561 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99600b3790 0x7f9960158270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:02.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.255+0000 7f9965ba3700 1 -- 172.21.15.8:0/2418282561 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99601430c0 msgr2=0x7f99600c5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:02.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.255+0000 7f9965ba3700 1 --2- 172.21.15.8:0/2418282561 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99601430c0 0x7f99600c5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:02.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.255+0000 7f9965ba3700 1 -- 172.21.15.8:0/2418282561 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9958009420 con 0x7f9960142cf0 2023-10-06T04:37:02.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.255+0000 7f9966ba5700 1 --2- 172.21.15.8:0/2418282561 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99601430c0 0x7f99600c5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:02.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.256+0000 7f9965ba3700 1 --2- 172.21.15.8:0/2418282561 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9960142cf0 0x7f996015aef0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f995400cb90 tx=0x7f9954001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:02.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.256+0000 7f995e7fc700 1 -- 172.21.15.8:0/2418282561 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9954001d40 con 0x7f9960142cf0 2023-10-06T04:37:02.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.256+0000 7f995e7fc700 1 -- 172.21.15.8:0/2418282561 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9954007360 con 0x7f9960142cf0 2023-10-06T04:37:02.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.256+0000 7f9968608700 1 -- 172.21.15.8:0/2418282561 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f996015a130 con 0x7f9960142cf0 2023-10-06T04:37:02.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.256+0000 7f995e7fc700 1 -- 172.21.15.8:0/2418282561 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9954004830 con 0x7f9960142cf0 2023-10-06T04:37:02.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.256+0000 7f9968608700 1 -- 172.21.15.8:0/2418282561 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f996015a6f0 con 0x7f9960142cf0 2023-10-06T04:37:02.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.257+0000 7f9968608700 1 -- 172.21.15.8:0/2418282561 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f996015ac10 con 0x7f9960142cf0 2023-10-06T04:37:02.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.257+0000 7f995e7fc700 1 -- 172.21.15.8:0/2418282561 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9954004ba0 con 0x7f9960142cf0 2023-10-06T04:37:02.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.258+0000 7f995e7fc700 1 --2- 172.21.15.8:0/2418282561 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f994c066f30 0x7f994c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:02.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.258+0000 7f995e7fc700 1 -- 172.21.15.8:0/2418282561 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9954084100 con 0x7f9960142cf0 2023-10-06T04:37:02.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.258+0000 7f99663a4700 1 --2- 172.21.15.8:0/2418282561 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f994c066f30 0x7f994c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:02.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.258+0000 7f99663a4700 1 --2- 172.21.15.8:0/2418282561 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f994c066f30 0x7f994c0693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f99580093f0 tx=0x7f9958016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:02.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.262+0000 7f995e7fc700 1 -- 172.21.15.8:0/2418282561 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f996015ac10 con 0x7f9960142cf0 2023-10-06T04:37:02.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.454+0000 7f9968608700 1 -- 172.21.15.8:0/2418282561 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f996015abd0 con 0x7f9960142cf0 2023-10-06T04:37:02.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.455+0000 7f995e7fc700 1 -- 172.21.15.8:0/2418282561 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9954050fa0 con 0x7f9960142cf0 2023-10-06T04:37:02.457 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-06T04:37:02.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.457+0000 7f9968608700 1 -- 172.21.15.8:0/2418282561 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f994c066f30 msgr2=0x7f994c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:02.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.457+0000 7f9968608700 1 --2- 172.21.15.8:0/2418282561 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f994c066f30 0x7f994c0693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f99580093f0 tx=0x7f9958016000 comp rx=0 tx=0).stop 2023-10-06T04:37:02.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.457+0000 7f9968608700 1 -- 172.21.15.8:0/2418282561 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9960142cf0 msgr2=0x7f996015aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:02.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.457+0000 7f9968608700 1 --2- 172.21.15.8:0/2418282561 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9960142cf0 0x7f996015aef0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f995400cb90 tx=0x7f9954001ab0 comp rx=0 tx=0).stop 2023-10-06T04:37:02.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.457+0000 7f9968608700 1 -- 172.21.15.8:0/2418282561 shutdown_connections 2023-10-06T04:37:02.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.457+0000 7f9968608700 1 --2- 172.21.15.8:0/2418282561 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f994c066f30 0x7f994c0693e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:02.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.457+0000 7f9968608700 1 --2- 172.21.15.8:0/2418282561 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99601430c0 0x7f99600c5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:02.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.457+0000 7f9968608700 1 --2- 172.21.15.8:0/2418282561 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99600b3790 0x7f9960158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:02.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.457+0000 7f9968608700 1 --2- 172.21.15.8:0/2418282561 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9960142cf0 0x7f996015aef0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:02.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.457+0000 7f9968608700 1 -- 172.21.15.8:0/2418282561 >> 172.21.15.8:0/2418282561 conn(0x7f996006ed00 msgr2=0x7f99601590c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:02.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.457+0000 7f9968608700 1 -- 172.21.15.8:0/2418282561 shutdown_connections 2023-10-06T04:37:02.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.457+0000 7f9968608700 1 -- 172.21.15.8:0/2418282561 wait complete. 2023-10-06T04:37:02.471 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:37:02.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.590+0000 7f6f3ae5f700 1 Processor -- start 2023-10-06T04:37:02.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.590+0000 7f6f3ae5f700 1 -- start start 2023-10-06T04:37:02.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.591+0000 7f6f3ae5f700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6f34142cf0 0x7f6f340b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:02.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.591+0000 7f6f3ae5f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f340b3790 0x7f6f340b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:02.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.591+0000 7f6f3ae5f700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f340cf510 con 0x7f6f341430c0 2023-10-06T04:37:02.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.591+0000 7f6f3ae5f700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f340b4110 con 0x7f6f34142cf0 2023-10-06T04:37:02.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.591+0000 7f6f3ae5f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f340ce6a0 con 0x7f6f340b3790 2023-10-06T04:37:02.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.591+0000 7f6f38bfb700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6f34142cf0 0x7f6f340b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:02.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.591+0000 7f6f38bfb700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6f34142cf0 0x7f6f340b5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50182/0 (socket says 172.21.15.8:50182) 2023-10-06T04:37:02.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.591+0000 7f6f38bfb700 1 -- 172.21.15.8:0/2736435627 learned_addr learned my addr 172.21.15.8:0/2736435627 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:02.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.592+0000 7f6f393fc700 1 --2- 172.21.15.8:0/2736435627 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f340b3790 0x7f6f340b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:02.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.592+0000 7f6f38bfb700 1 -- 172.21.15.8:0/2736435627 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f340b3790 msgr2=0x7f6f340b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:02.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.592+0000 7f6f38bfb700 1 --2- 172.21.15.8:0/2736435627 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f340b3790 0x7f6f340b3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:02.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.592+0000 7f6f38bfb700 1 -- 172.21.15.8:0/2736435627 >> v1:172.21.15.184:6789/0 conn(0x7f6f341430c0 legacy=0x7f6f340cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:02.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.592+0000 7f6f38bfb700 1 -- 172.21.15.8:0/2736435627 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f340ce900 con 0x7f6f34142cf0 2023-10-06T04:37:02.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.592+0000 7f6f38bfb700 1 --2- 172.21.15.8:0/2736435627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f34142cf0 0x7f6f340b5cd0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c009f20 tx=0x7f6f2c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b601e73995e20b01 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:02.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.592+0000 7f6f337fe700 1 -- 172.21.15.8:0/2736435627 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c00e070 con 0x7f6f34142cf0 2023-10-06T04:37:02.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.592+0000 7f6f337fe700 1 -- 172.21.15.8:0/2736435627 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2c00ba40 con 0x7f6f34142cf0 2023-10-06T04:37:02.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.592+0000 7f6f337fe700 1 -- 172.21.15.8:0/2736435627 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c0092e0 con 0x7f6f34142cf0 2023-10-06T04:37:02.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.592+0000 7f6f3ae5f700 1 -- 172.21.15.8:0/2736435627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f34142cf0 msgr2=0x7f6f340b5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:02.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.592+0000 7f6f3ae5f700 1 --2- 172.21.15.8:0/2736435627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f34142cf0 0x7f6f340b5cd0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c009f20 tx=0x7f6f2c009840 comp rx=0 tx=0).stop 2023-10-06T04:37:02.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.592+0000 7f6f3ae5f700 1 -- 172.21.15.8:0/2736435627 shutdown_connections 2023-10-06T04:37:02.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.592+0000 7f6f3ae5f700 1 --2- 172.21.15.8:0/2736435627 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f340b3790 0x7f6f340b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:02.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.592+0000 7f6f3ae5f700 1 --2- 172.21.15.8:0/2736435627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f34142cf0 0x7f6f340b5cd0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:02.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.592+0000 7f6f3ae5f700 1 -- 172.21.15.8:0/2736435627 >> 172.21.15.8:0/2736435627 conn(0x7f6f3406ed00 msgr2=0x7f6f3406f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:02.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.593+0000 7f6f3ae5f700 1 -- 172.21.15.8:0/2736435627 shutdown_connections 2023-10-06T04:37:02.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.593+0000 7f6f3ae5f700 1 -- 172.21.15.8:0/2736435627 wait complete. 2023-10-06T04:37:02.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.594+0000 7f6f3ae5f700 1 Processor -- start 2023-10-06T04:37:02.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.594+0000 7f6f3ae5f700 1 -- start start 2023-10-06T04:37:02.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.594+0000 7f6f3ae5f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f340b3790 0x7f6f3415cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:02.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.594+0000 7f6f3ae5f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f34142cf0 0x7f6f340b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:02.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.595+0000 7f6f3ae5f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f341430c0 0x7f6f340b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:02.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.595+0000 7f6f3ae5f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3413d6a0 con 0x7f6f341430c0 2023-10-06T04:37:02.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.595+0000 7f6f3ae5f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3415ad80 con 0x7f6f34142cf0 2023-10-06T04:37:02.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.595+0000 7f6f3ae5f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f340aa330 con 0x7f6f340b3790 2023-10-06T04:37:02.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.595+0000 7f6f393fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f341430c0 0x7f6f340b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:02.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.595+0000 7f6f393fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f341430c0 0x7f6f340b2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50190/0 (socket says 172.21.15.8:50190) 2023-10-06T04:37:02.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.595+0000 7f6f393fc700 1 -- 172.21.15.8:0/105762603 learned_addr learned my addr 172.21.15.8:0/105762603 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:02.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.595+0000 7f6f38bfb700 1 --2- 172.21.15.8:0/105762603 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f340b3790 0x7f6f3415cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:02.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.595+0000 7f6f33fff700 1 --2- 172.21.15.8:0/105762603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f34142cf0 0x7f6f340b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:02.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.595+0000 7f6f393fc700 1 -- 172.21.15.8:0/105762603 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f340b3790 msgr2=0x7f6f3415cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:02.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.595+0000 7f6f393fc700 1 --2- 172.21.15.8:0/105762603 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f340b3790 0x7f6f3415cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:02.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.595+0000 7f6f393fc700 1 -- 172.21.15.8:0/105762603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f34142cf0 msgr2=0x7f6f340b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:02.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.595+0000 7f6f393fc700 1 --2- 172.21.15.8:0/105762603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f34142cf0 0x7f6f340b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:02.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.595+0000 7f6f393fc700 1 -- 172.21.15.8:0/105762603 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f2c009ae0 con 0x7f6f341430c0 2023-10-06T04:37:02.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.595+0000 7f6f33fff700 1 --2- 172.21.15.8:0/105762603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f34142cf0 0x7f6f340b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:02.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.595+0000 7f6f393fc700 1 --2- 172.21.15.8:0/105762603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f341430c0 0x7f6f340b2080 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c00c880 tx=0x7f6f1c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:02.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.595+0000 7f6f30ff9700 1 -- 172.21.15.8:0/105762603 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c011600 con 0x7f6f341430c0 2023-10-06T04:37:02.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.595+0000 7f6f30ff9700 1 -- 172.21.15.8:0/105762603 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1c011760 con 0x7f6f341430c0 2023-10-06T04:37:02.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.595+0000 7f6f3ae5f700 1 -- 172.21.15.8:0/105762603 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f340b2700 con 0x7f6f341430c0 2023-10-06T04:37:02.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.595+0000 7f6f30ff9700 1 -- 172.21.15.8:0/105762603 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c011ae0 con 0x7f6f341430c0 2023-10-06T04:37:02.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.595+0000 7f6f3ae5f700 1 -- 172.21.15.8:0/105762603 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f3415a730 con 0x7f6f341430c0 2023-10-06T04:37:02.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.596+0000 7f6f3ae5f700 1 -- 172.21.15.8:0/105762603 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f340b3c60 con 0x7f6f341430c0 2023-10-06T04:37:02.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.597+0000 7f6f30ff9700 1 -- 172.21.15.8:0/105762603 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6f1c0193f0 con 0x7f6f341430c0 2023-10-06T04:37:02.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.597+0000 7f6f30ff9700 1 --2- 172.21.15.8:0/105762603 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6f14066f30 0x7f6f140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:02.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.597+0000 7f6f30ff9700 1 -- 172.21.15.8:0/105762603 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6f1c084dd0 con 0x7f6f341430c0 2023-10-06T04:37:02.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.597+0000 7f6f38bfb700 1 --2- 172.21.15.8:0/105762603 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6f14066f30 0x7f6f140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:02.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.598+0000 7f6f38bfb700 1 --2- 172.21.15.8:0/105762603 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6f14066f30 0x7f6f140693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c009880 tx=0x7f6f2c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:02.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.601+0000 7f6f30ff9700 1 -- 172.21.15.8:0/105762603 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f1c055680 con 0x7f6f341430c0 2023-10-06T04:37:02.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.794+0000 7f6f3ae5f700 1 -- 172.21.15.8:0/105762603 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6f3415af40 con 0x7f6f341430c0 2023-10-06T04:37:02.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.794+0000 7f6f30ff9700 1 -- 172.21.15.8:0/105762603 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6f1c0860a0 con 0x7f6f341430c0 2023-10-06T04:37:02.799 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-06T04:37:02.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.796+0000 7f6f3ae5f700 1 -- 172.21.15.8:0/105762603 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6f14066f30 msgr2=0x7f6f140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:02.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.796+0000 7f6f3ae5f700 1 --2- 172.21.15.8:0/105762603 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6f14066f30 0x7f6f140693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c009880 tx=0x7f6f2c017000 comp rx=0 tx=0).stop 2023-10-06T04:37:02.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.796+0000 7f6f3ae5f700 1 -- 172.21.15.8:0/105762603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f341430c0 msgr2=0x7f6f340b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:02.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.796+0000 7f6f3ae5f700 1 --2- 172.21.15.8:0/105762603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f341430c0 0x7f6f340b2080 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c00c880 tx=0x7f6f1c008040 comp rx=0 tx=0).stop 2023-10-06T04:37:02.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.796+0000 7f6f3ae5f700 1 -- 172.21.15.8:0/105762603 shutdown_connections 2023-10-06T04:37:02.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.796+0000 7f6f3ae5f700 1 --2- 172.21.15.8:0/105762603 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6f14066f30 0x7f6f140693e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:02.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.796+0000 7f6f3ae5f700 1 --2- 172.21.15.8:0/105762603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f341430c0 0x7f6f340b2080 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:02.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.796+0000 7f6f3ae5f700 1 --2- 172.21.15.8:0/105762603 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f340b3790 0x7f6f3415cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:02.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.796+0000 7f6f3ae5f700 1 --2- 172.21.15.8:0/105762603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f34142cf0 0x7f6f340b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:02.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.796+0000 7f6f3ae5f700 1 -- 172.21.15.8:0/105762603 >> 172.21.15.8:0/105762603 conn(0x7f6f3406ed00 msgr2=0x7f6f340b0320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:02.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.796+0000 7f6f3ae5f700 1 -- 172.21.15.8:0/105762603 shutdown_connections 2023-10-06T04:37:02.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.796+0000 7f6f3ae5f700 1 -- 172.21.15.8:0/105762603 wait complete. 2023-10-06T04:37:02.811 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T04:37:02.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.930+0000 7ff071865700 1 Processor -- start 2023-10-06T04:37:02.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.930+0000 7ff071865700 1 -- start start 2023-10-06T04:37:02.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.931+0000 7ff071865700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff06c0b1c70 0x7ff06c0b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:02.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.931+0000 7ff071865700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff06c15ad80 0x7ff06c15b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:02.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.931+0000 7ff071865700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff06c0b2620 con 0x7ff06c156e30 2023-10-06T04:37:02.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.931+0000 7ff071865700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff06c0cf370 con 0x7ff06c15ad80 2023-10-06T04:37:02.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.931+0000 7ff071865700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff06c0ce800 con 0x7ff06c0b1c70 2023-10-06T04:37:02.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.931+0000 7ff071064700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff06c15ad80 0x7ff06c15b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:02.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.931+0000 7ff070863700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ff06c156e30 0x7ff06c0cf800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60952/0 (socket says 172.21.15.8:60952) 2023-10-06T04:37:02.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.931+0000 7ff070863700 1 -- 172.21.15.8:0/806682713 learned_addr learned my addr 172.21.15.8:0/806682713 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:02.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.931+0000 7ff071064700 1 -- 172.21.15.8:0/806682713 >> v2:172.21.15.184:3300/0 conn(0x7ff06c0b1c70 msgr2=0x7ff06c0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:02.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.931+0000 7ff071064700 1 --2- 172.21.15.8:0/806682713 >> v2:172.21.15.184:3300/0 conn(0x7ff06c0b1c70 0x7ff06c0b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:02.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.931+0000 7ff071064700 1 -- 172.21.15.8:0/806682713 >> v1:172.21.15.8:6789/0 conn(0x7ff06c156e30 legacy=0x7ff06c0cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:02.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.931+0000 7ff071064700 1 -- 172.21.15.8:0/806682713 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff06c0cea60 con 0x7ff06c15ad80 2023-10-06T04:37:02.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.931+0000 7ff06b7fe700 1 -- 172.21.15.8:0/806682713 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1904372066 0 0) 0x7ff06c0b2620 con 0x7ff06c156e30 2023-10-06T04:37:02.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.932+0000 7ff071064700 1 --2- 172.21.15.8:0/806682713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff06c15ad80 0x7ff06c15b1c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff06c067f30 tx=0x7ff064009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63eb35263e313c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:02.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.932+0000 7ff06b7fe700 1 -- 172.21.15.8:0/806682713 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06400e070 con 0x7ff06c15ad80 2023-10-06T04:37:02.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.932+0000 7ff06b7fe700 1 -- 172.21.15.8:0/806682713 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06400bc30 con 0x7ff06c15ad80 2023-10-06T04:37:02.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.932+0000 7ff06b7fe700 1 -- 172.21.15.8:0/806682713 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff064012430 con 0x7ff06c15ad80 2023-10-06T04:37:02.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.932+0000 7ff071865700 1 -- 172.21.15.8:0/806682713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff06c15ad80 msgr2=0x7ff06c15b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:02.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.932+0000 7ff071865700 1 --2- 172.21.15.8:0/806682713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff06c15ad80 0x7ff06c15b1c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff06c067f30 tx=0x7ff064009780 comp rx=0 tx=0).stop 2023-10-06T04:37:02.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.932+0000 7ff071865700 1 -- 172.21.15.8:0/806682713 shutdown_connections 2023-10-06T04:37:02.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.932+0000 7ff071865700 1 --2- 172.21.15.8:0/806682713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff06c15ad80 0x7ff06c15b1c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:02.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.932+0000 7ff071865700 1 --2- 172.21.15.8:0/806682713 >> v2:172.21.15.184:3300/0 conn(0x7ff06c0b1c70 0x7ff06c0b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:02.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.932+0000 7ff071865700 1 -- 172.21.15.8:0/806682713 >> 172.21.15.8:0/806682713 conn(0x7ff06c06ed00 msgr2=0x7ff06c06f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:02.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.932+0000 7ff071865700 1 -- 172.21.15.8:0/806682713 shutdown_connections 2023-10-06T04:37:02.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.932+0000 7ff071865700 1 -- 172.21.15.8:0/806682713 wait complete. 2023-10-06T04:37:02.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.933+0000 7ff071865700 1 Processor -- start 2023-10-06T04:37:02.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.934+0000 7ff071865700 1 -- start start 2023-10-06T04:37:02.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.934+0000 7ff071865700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff06c0b1c70 0x7ff06c13ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:02.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.934+0000 7ff071865700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff06c156e30 0x7ff06c1530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:02.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.934+0000 7ff071865700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff06c15ad80 0x7ff06c169920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:02.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.934+0000 7ff071865700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c152700 con 0x7ff06c156e30 2023-10-06T04:37:02.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.934+0000 7ff071865700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c152c50 con 0x7ff06c0b1c70 2023-10-06T04:37:02.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.934+0000 7ff071865700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c16a410 con 0x7ff06c15ad80 2023-10-06T04:37:02.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.934+0000 7ff06bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff06c156e30 0x7ff06c1530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:02.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.934+0000 7ff06bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff06c156e30 0x7ff06c1530e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50212/0 (socket says 172.21.15.8:50212) 2023-10-06T04:37:02.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.934+0000 7ff06bfff700 1 -- 172.21.15.8:0/3622920904 learned_addr learned my addr 172.21.15.8:0/3622920904 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:02.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.934+0000 7ff071064700 1 --2- 172.21.15.8:0/3622920904 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff06c15ad80 0x7ff06c169920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:02.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.934+0000 7ff070863700 1 --2- 172.21.15.8:0/3622920904 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff06c0b1c70 0x7ff06c13ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:02.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.935+0000 7ff06bfff700 1 -- 172.21.15.8:0/3622920904 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff06c15ad80 msgr2=0x7ff06c169920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:02.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.935+0000 7ff06bfff700 1 --2- 172.21.15.8:0/3622920904 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff06c15ad80 0x7ff06c169920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:02.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.935+0000 7ff06bfff700 1 -- 172.21.15.8:0/3622920904 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff06c0b1c70 msgr2=0x7ff06c13ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:02.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.935+0000 7ff06bfff700 1 --2- 172.21.15.8:0/3622920904 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff06c0b1c70 0x7ff06c13ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:02.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.935+0000 7ff06bfff700 1 -- 172.21.15.8:0/3622920904 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff064009a20 con 0x7ff06c156e30 2023-10-06T04:37:02.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.935+0000 7ff070863700 1 --2- 172.21.15.8:0/3622920904 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff06c0b1c70 0x7ff06c13ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:02.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.935+0000 7ff071064700 1 --2- 172.21.15.8:0/3622920904 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff06c15ad80 0x7ff06c169920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:02.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.935+0000 7ff06bfff700 1 --2- 172.21.15.8:0/3622920904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff06c156e30 0x7ff06c1530e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff05800b810 tx=0x7ff058009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:02.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.935+0000 7ff068ff9700 1 -- 172.21.15.8:0/3622920904 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05800f5f0 con 0x7ff06c156e30 2023-10-06T04:37:02.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.935+0000 7ff068ff9700 1 -- 172.21.15.8:0/3622920904 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05800f770 con 0x7ff06c156e30 2023-10-06T04:37:02.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.935+0000 7ff071865700 1 -- 172.21.15.8:0/3622920904 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff06c16a6f0 con 0x7ff06c156e30 2023-10-06T04:37:02.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.935+0000 7ff068ff9700 1 -- 172.21.15.8:0/3622920904 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05800fb30 con 0x7ff06c156e30 2023-10-06T04:37:02.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.935+0000 7ff071865700 1 -- 172.21.15.8:0/3622920904 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff06c13f190 con 0x7ff06c156e30 2023-10-06T04:37:02.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.936+0000 7ff071865700 1 -- 172.21.15.8:0/3622920904 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff06c152de0 con 0x7ff06c156e30 2023-10-06T04:37:02.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.936+0000 7ff068ff9700 1 -- 172.21.15.8:0/3622920904 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff058010480 con 0x7ff06c156e30 2023-10-06T04:37:02.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.937+0000 7ff068ff9700 1 --2- 172.21.15.8:0/3622920904 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff050066f30 0x7ff0500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:02.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.937+0000 7ff068ff9700 1 -- 172.21.15.8:0/3622920904 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff0580848c0 con 0x7ff06c156e30 2023-10-06T04:37:02.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.937+0000 7ff070863700 1 --2- 172.21.15.8:0/3622920904 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff050066f30 0x7ff0500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:02.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.938+0000 7ff070863700 1 --2- 172.21.15.8:0/3622920904 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff050066f30 0x7ff0500693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff0600011e0 tx=0x7ff060009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:02.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:02.941+0000 7ff068ff9700 1 -- 172.21.15.8:0/3622920904 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff058051760 con 0x7ff06c156e30 2023-10-06T04:37:03.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.134+0000 7ff071865700 1 -- 172.21.15.8:0/3622920904 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff06c16a8e0 con 0x7ff06c156e30 2023-10-06T04:37:03.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.134+0000 7ff068ff9700 1 -- 172.21.15.8:0/3622920904 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff058054d80 con 0x7ff06c156e30 2023-10-06T04:37:03.137 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-06T04:37:03.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.136+0000 7ff071865700 1 -- 172.21.15.8:0/3622920904 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff050066f30 msgr2=0x7ff0500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:03.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.136+0000 7ff071865700 1 --2- 172.21.15.8:0/3622920904 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff050066f30 0x7ff0500693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff0600011e0 tx=0x7ff060009040 comp rx=0 tx=0).stop 2023-10-06T04:37:03.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.136+0000 7ff071865700 1 -- 172.21.15.8:0/3622920904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff06c156e30 msgr2=0x7ff06c1530e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:03.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.136+0000 7ff071865700 1 --2- 172.21.15.8:0/3622920904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff06c156e30 0x7ff06c1530e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff05800b810 tx=0x7ff058009250 comp rx=0 tx=0).stop 2023-10-06T04:37:03.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.136+0000 7ff071865700 1 -- 172.21.15.8:0/3622920904 shutdown_connections 2023-10-06T04:37:03.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.136+0000 7ff071865700 1 --2- 172.21.15.8:0/3622920904 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff050066f30 0x7ff0500693e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:03.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.136+0000 7ff071865700 1 --2- 172.21.15.8:0/3622920904 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff06c15ad80 0x7ff06c169920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:03.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.136+0000 7ff071865700 1 --2- 172.21.15.8:0/3622920904 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff06c0b1c70 0x7ff06c13ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:03.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.136+0000 7ff071865700 1 --2- 172.21.15.8:0/3622920904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff06c156e30 0x7ff06c1530e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:03.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.136+0000 7ff071865700 1 -- 172.21.15.8:0/3622920904 >> 172.21.15.8:0/3622920904 conn(0x7ff06c06ed00 msgr2=0x7ff06c0b58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:03.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.136+0000 7ff071865700 1 -- 172.21.15.8:0/3622920904 shutdown_connections 2023-10-06T04:37:03.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.136+0000 7ff071865700 1 -- 172.21.15.8:0/3622920904 wait complete. 2023-10-06T04:37:03.151 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:37:03.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.267+0000 7f34a453b700 1 Processor -- start 2023-10-06T04:37:03.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.267+0000 7f34a453b700 1 -- start start 2023-10-06T04:37:03.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.267+0000 7f34a453b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f349c0cb360 0x7f349c0d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:03.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.267+0000 7f34a453b700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f349c0cc4c0 con 0x7f349c0d08d0 2023-10-06T04:37:03.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.268+0000 7f34a453b700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f349c0d0d20 con 0x7f349c0af680 2023-10-06T04:37:03.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.268+0000 7f34a453b700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f349c15d460 con 0x7f349c0cb360 2023-10-06T04:37:03.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.268+0000 7f34a1ad6700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f349c0cb360 0x7f349c0d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:03.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.268+0000 7f34a2ad8700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f349c0d08d0 0x7f349c0cc950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60964/0 (socket says 172.21.15.8:60964) 2023-10-06T04:37:03.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.268+0000 7f34a2ad8700 1 -- 172.21.15.8:0/182356762 learned_addr learned my addr 172.21.15.8:0/182356762 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:03.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.268+0000 7f34a1ad6700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f349c0cb360 0x7f349c0d0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50222/0 (socket says 172.21.15.8:50222) 2023-10-06T04:37:03.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.268+0000 7f34a1ad6700 1 -- 172.21.15.8:0/182356762 >> v1:172.21.15.184:6789/0 conn(0x7f349c0af680 legacy=0x7f349c15e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:03.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.268+0000 7f34a1ad6700 1 -- 172.21.15.8:0/182356762 >> v1:172.21.15.8:6789/0 conn(0x7f349c0d08d0 legacy=0x7f349c0cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:03.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.268+0000 7f34a12d5700 1 -- 172.21.15.8:0/182356762 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3546759705 0 0) 0x7f349c0d0d20 con 0x7f349c0af680 2023-10-06T04:37:03.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.268+0000 7f34a1ad6700 1 -- 172.21.15.8:0/182356762 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349c0cb8b0 con 0x7f349c0cb360 2023-10-06T04:37:03.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.268+0000 7f34a1ad6700 1 --2- 172.21.15.8:0/182356762 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f349c0cb360 0x7f349c0d0390 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f34900098e0 tx=0x7f34900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed46bfb1ca8f0354 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:03.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.268+0000 7f34a12d5700 1 -- 172.21.15.8:0/182356762 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3490009e80 con 0x7f349c0cb360 2023-10-06T04:37:03.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.268+0000 7f34a12d5700 1 -- 172.21.15.8:0/182356762 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349000b860 con 0x7f349c0cb360 2023-10-06T04:37:03.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.268+0000 7f34a12d5700 1 -- 172.21.15.8:0/182356762 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349000bbe0 con 0x7f349c0cb360 2023-10-06T04:37:03.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.269+0000 7f34a453b700 1 -- 172.21.15.8:0/182356762 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f349c0cb360 msgr2=0x7f349c0d0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:03.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.269+0000 7f34a453b700 1 --2- 172.21.15.8:0/182356762 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f349c0cb360 0x7f349c0d0390 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f34900098e0 tx=0x7f34900091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:03.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.269+0000 7f34a453b700 1 -- 172.21.15.8:0/182356762 shutdown_connections 2023-10-06T04:37:03.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.269+0000 7f34a453b700 1 --2- 172.21.15.8:0/182356762 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f349c0cb360 0x7f349c0d0390 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:03.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.269+0000 7f34a453b700 1 -- 172.21.15.8:0/182356762 >> 172.21.15.8:0/182356762 conn(0x7f349c0633d0 msgr2=0x7f349c0637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:03.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.269+0000 7f34a453b700 1 -- 172.21.15.8:0/182356762 shutdown_connections 2023-10-06T04:37:03.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.269+0000 7f34a453b700 1 -- 172.21.15.8:0/182356762 wait complete. 2023-10-06T04:37:03.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.270+0000 7f34a453b700 1 Processor -- start 2023-10-06T04:37:03.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.270+0000 7f34a453b700 1 -- start start 2023-10-06T04:37:03.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.271+0000 7f34a453b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f349c0af680 0x7f349c15bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:03.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.271+0000 7f34a453b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f349c0cb360 0x7f349c169bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:03.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.271+0000 7f34a453b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f349c0d08d0 0x7f349c0c3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:03.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.271+0000 7f34a453b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349c0c5500 con 0x7f349c0af680 2023-10-06T04:37:03.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.271+0000 7f34a453b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349c0b4bc0 con 0x7f349c0cb360 2023-10-06T04:37:03.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.271+0000 7f34a453b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349c0c48f0 con 0x7f349c0d08d0 2023-10-06T04:37:03.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.271+0000 7f34a22d7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f349c0af680 0x7f349c15bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:03.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.271+0000 7f34a22d7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f349c0af680 0x7f349c15bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50224/0 (socket says 172.21.15.8:50224) 2023-10-06T04:37:03.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.271+0000 7f34a22d7700 1 -- 172.21.15.8:0/3262593107 learned_addr learned my addr 172.21.15.8:0/3262593107 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:03.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.271+0000 7f34a1ad6700 1 --2- 172.21.15.8:0/3262593107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f349c0cb360 0x7f349c169bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:03.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.271+0000 7f34a2ad8700 1 --2- 172.21.15.8:0/3262593107 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f349c0d08d0 0x7f349c0c3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:03.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.271+0000 7f34a22d7700 1 -- 172.21.15.8:0/3262593107 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f349c0d08d0 msgr2=0x7f349c0c3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:03.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.271+0000 7f34a22d7700 1 --2- 172.21.15.8:0/3262593107 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f349c0d08d0 0x7f349c0c3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:03.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.271+0000 7f34a22d7700 1 -- 172.21.15.8:0/3262593107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f349c0cb360 msgr2=0x7f349c169bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:03.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.271+0000 7f34a22d7700 1 --2- 172.21.15.8:0/3262593107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f349c0cb360 0x7f349c169bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:03.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.271+0000 7f34a22d7700 1 -- 172.21.15.8:0/3262593107 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3490009420 con 0x7f349c0af680 2023-10-06T04:37:03.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.271+0000 7f34a2ad8700 1 --2- 172.21.15.8:0/3262593107 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f349c0d08d0 0x7f349c0c3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:03.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.271+0000 7f34a22d7700 1 --2- 172.21.15.8:0/3262593107 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f349c0af680 0x7f349c15bd20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f349400c530 tx=0x7f349400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:03.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.271+0000 7f349a7fc700 1 -- 172.21.15.8:0/3262593107 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3494011590 con 0x7f349c0af680 2023-10-06T04:37:03.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.272+0000 7f349a7fc700 1 -- 172.21.15.8:0/3262593107 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3494011710 con 0x7f349c0af680 2023-10-06T04:37:03.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.272+0000 7f34a453b700 1 -- 172.21.15.8:0/3262593107 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f349c0c4bd0 con 0x7f349c0af680 2023-10-06T04:37:03.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.272+0000 7f349a7fc700 1 -- 172.21.15.8:0/3262593107 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3494011ad0 con 0x7f349c0af680 2023-10-06T04:37:03.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.272+0000 7f34a453b700 1 -- 172.21.15.8:0/3262593107 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f349c0c5190 con 0x7f349c0af680 2023-10-06T04:37:03.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.273+0000 7f34a453b700 1 -- 172.21.15.8:0/3262593107 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f349c071550 con 0x7f349c0af680 2023-10-06T04:37:03.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.273+0000 7f349a7fc700 1 -- 172.21.15.8:0/3262593107 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f349401b3b0 con 0x7f349c0af680 2023-10-06T04:37:03.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.273+0000 7f349a7fc700 1 --2- 172.21.15.8:0/3262593107 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3488066f30 0x7f34880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:03.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.273+0000 7f349a7fc700 1 -- 172.21.15.8:0/3262593107 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f3494083ec0 con 0x7f349c0af680 2023-10-06T04:37:03.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.273+0000 7f34a1ad6700 1 --2- 172.21.15.8:0/3262593107 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3488066f30 0x7f34880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:03.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.274+0000 7f34a1ad6700 1 --2- 172.21.15.8:0/3262593107 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3488066f30 0x7f34880693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f34900093f0 tx=0x7f3490017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:03.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.277+0000 7f349a7fc700 1 -- 172.21.15.8:0/3262593107 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3494050ce0 con 0x7f349c0af680 2023-10-06T04:37:03.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.519+0000 7f34a453b700 1 -- 172.21.15.8:0/3262593107 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f349c0b4e50 con 0x7f349c0af680 2023-10-06T04:37:03.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.520+0000 7f349a7fc700 1 -- 172.21.15.8:0/3262593107 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4587 (secure 0 0 0) 0x7f3494017070 con 0x7f349c0af680 2023-10-06T04:37:03.523 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:03.523 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/516627422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":516627422},{"type":"v1","addr":"172.21.15.8:6835","nonce":516627422}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/1078182353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1078182353},{"type":"v1","addr":"172.21.15.8:6834","nonce":1078182353}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/181555783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":181555783},{"type":"v1","addr":"172.21.15.184:6836","nonce":181555783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:36:16.632579+0000","modified":"2023-10-06T04:36:29.752096+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/2590100121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":2590100121},{"type":"v1","addr":"172.21.15.184:6837","nonce":2590100121}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:37:03.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.522+0000 7f34a453b700 1 -- 172.21.15.8:0/3262593107 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3488066f30 msgr2=0x7f34880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:03.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.522+0000 7f34a453b700 1 --2- 172.21.15.8:0/3262593107 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3488066f30 0x7f34880693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f34900093f0 tx=0x7f3490017000 comp rx=0 tx=0).stop 2023-10-06T04:37:03.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.522+0000 7f34a453b700 1 -- 172.21.15.8:0/3262593107 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f349c0af680 msgr2=0x7f349c15bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:03.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.522+0000 7f34a453b700 1 --2- 172.21.15.8:0/3262593107 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f349c0af680 0x7f349c15bd20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f349400c530 tx=0x7f349400c840 comp rx=0 tx=0).stop 2023-10-06T04:37:03.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.522+0000 7f34a453b700 1 -- 172.21.15.8:0/3262593107 shutdown_connections 2023-10-06T04:37:03.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.522+0000 7f34a453b700 1 --2- 172.21.15.8:0/3262593107 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3488066f30 0x7f34880693e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:03.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.522+0000 7f34a453b700 1 --2- 172.21.15.8:0/3262593107 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f349c0d08d0 0x7f349c0c3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:03.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.522+0000 7f34a453b700 1 --2- 172.21.15.8:0/3262593107 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f349c0af680 0x7f349c15bd20 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:03.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.522+0000 7f34a453b700 1 --2- 172.21.15.8:0/3262593107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f349c0cb360 0x7f349c169bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:03.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.522+0000 7f34a453b700 1 -- 172.21.15.8:0/3262593107 >> 172.21.15.8:0/3262593107 conn(0x7f349c0633d0 msgr2=0x7f349c15ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:03.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.522+0000 7f34a453b700 1 -- 172.21.15.8:0/3262593107 shutdown_connections 2023-10-06T04:37:03.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.522+0000 7f34a453b700 1 -- 172.21.15.8:0/3262593107 wait complete. 2023-10-06T04:37:03.526 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 9 2023-10-06T04:37:03.537 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:37:03.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.654+0000 7f838a1be700 1 Processor -- start 2023-10-06T04:37:03.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.654+0000 7f838a1be700 1 -- start start 2023-10-06T04:37:03.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.655+0000 7f838a1be700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8384153740 0x7f8384153b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:03.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.655+0000 7f838a1be700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f838415d8e0 0x7f83840696c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:03.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.655+0000 7f838a1be700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f838415d170 con 0x7f838415a7b0 2023-10-06T04:37:03.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.655+0000 7f838a1be700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83840ca990 con 0x7f838415d8e0 2023-10-06T04:37:03.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.655+0000 7f838a1be700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83840cac70 con 0x7f8384153740 2023-10-06T04:37:03.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.655+0000 7f83899bd700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f838415d8e0 0x7f83840696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:03.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.655+0000 7f83899bd700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f838415d8e0 0x7f83840696c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50226/0 (socket says 172.21.15.8:50226) 2023-10-06T04:37:03.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.655+0000 7f83899bd700 1 -- 172.21.15.8:0/3434072906 learned_addr learned my addr 172.21.15.8:0/3434072906 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:03.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.655+0000 7f83891bc700 1 --2- 172.21.15.8:0/3434072906 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8384153740 0x7f8384153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:03.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.655+0000 7f83899bd700 1 -- 172.21.15.8:0/3434072906 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8384153740 msgr2=0x7f8384153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:03.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.655+0000 7f83899bd700 1 --2- 172.21.15.8:0/3434072906 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8384153740 0x7f8384153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:03.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.655+0000 7f83899bd700 1 -- 172.21.15.8:0/3434072906 >> v1:172.21.15.184:6789/0 conn(0x7f838415a7b0 legacy=0x7f83840cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:03.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.655+0000 7f83899bd700 1 -- 172.21.15.8:0/3434072906 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83840caf50 con 0x7f838415d8e0 2023-10-06T04:37:03.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.655+0000 7f83899bd700 1 --2- 172.21.15.8:0/3434072906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f838415d8e0 0x7f83840696c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8374009f20 tx=0x7f8374009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6b8d91a488ace50 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:03.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.655+0000 7f8383fff700 1 -- 172.21.15.8:0/3434072906 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837400e070 con 0x7f838415d8e0 2023-10-06T04:37:03.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.656+0000 7f8383fff700 1 -- 172.21.15.8:0/3434072906 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837400b9d0 con 0x7f838415d8e0 2023-10-06T04:37:03.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.656+0000 7f8383fff700 1 -- 172.21.15.8:0/3434072906 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83740092e0 con 0x7f838415d8e0 2023-10-06T04:37:03.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.656+0000 7f838a1be700 1 -- 172.21.15.8:0/3434072906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f838415d8e0 msgr2=0x7f83840696c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:03.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.656+0000 7f838a1be700 1 --2- 172.21.15.8:0/3434072906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f838415d8e0 0x7f83840696c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8374009f20 tx=0x7f8374009840 comp rx=0 tx=0).stop 2023-10-06T04:37:03.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.656+0000 7f838a1be700 1 -- 172.21.15.8:0/3434072906 shutdown_connections 2023-10-06T04:37:03.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.656+0000 7f838a1be700 1 --2- 172.21.15.8:0/3434072906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f838415d8e0 0x7f83840696c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:03.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.656+0000 7f838a1be700 1 --2- 172.21.15.8:0/3434072906 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8384153740 0x7f8384153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:03.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.656+0000 7f838a1be700 1 -- 172.21.15.8:0/3434072906 >> 172.21.15.8:0/3434072906 conn(0x7f83840d02b0 msgr2=0x7f83840d06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:03.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.656+0000 7f838a1be700 1 -- 172.21.15.8:0/3434072906 shutdown_connections 2023-10-06T04:37:03.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.656+0000 7f838a1be700 1 -- 172.21.15.8:0/3434072906 wait complete. 2023-10-06T04:37:03.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.657+0000 7f838a1be700 1 Processor -- start 2023-10-06T04:37:03.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.657+0000 7f838a1be700 1 -- start start 2023-10-06T04:37:03.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.658+0000 7f838a1be700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8384153740 0x7f83840c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:03.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.658+0000 7f838a1be700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f838415a7b0 0x7f8384146d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:03.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.658+0000 7f838a1be700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f838415d8e0 0x7f8384068190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:03.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.658+0000 7f838a1be700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83840c9990 con 0x7f8384153740 2023-10-06T04:37:03.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.658+0000 7f838a1be700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83840c8d80 con 0x7f838415d8e0 2023-10-06T04:37:03.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.658+0000 7f838a1be700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83840c9060 con 0x7f838415a7b0 2023-10-06T04:37:03.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.658+0000 7f83891bc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8384153740 0x7f83840c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:03.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.658+0000 7f83891bc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8384153740 0x7f83840c9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50228/0 (socket says 172.21.15.8:50228) 2023-10-06T04:37:03.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.658+0000 7f83891bc700 1 -- 172.21.15.8:0/623042556 learned_addr learned my addr 172.21.15.8:0/623042556 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:03.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.658+0000 7f83889bb700 1 --2- 172.21.15.8:0/623042556 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f838415a7b0 0x7f8384146d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:03.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.658+0000 7f83899bd700 1 --2- 172.21.15.8:0/623042556 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f838415d8e0 0x7f8384068190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:03.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.659+0000 7f83891bc700 1 -- 172.21.15.8:0/623042556 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f838415a7b0 msgr2=0x7f8384146d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:03.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.659+0000 7f83891bc700 1 --2- 172.21.15.8:0/623042556 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f838415a7b0 0x7f8384146d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:03.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.659+0000 7f83891bc700 1 -- 172.21.15.8:0/623042556 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f838415d8e0 msgr2=0x7f8384068190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:03.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.659+0000 7f83891bc700 1 --2- 172.21.15.8:0/623042556 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f838415d8e0 0x7f8384068190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:03.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.659+0000 7f83891bc700 1 -- 172.21.15.8:0/623042556 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8374009ae0 con 0x7f8384153740 2023-10-06T04:37:03.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.659+0000 7f83891bc700 1 --2- 172.21.15.8:0/623042556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8384153740 0x7f83840c9e20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f837c00ec80 tx=0x7f837c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:03.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.659+0000 7f83817fa700 1 -- 172.21.15.8:0/623042556 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c00c8e0 con 0x7f8384153740 2023-10-06T04:37:03.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.659+0000 7f83817fa700 1 -- 172.21.15.8:0/623042556 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837c00ca40 con 0x7f8384153740 2023-10-06T04:37:03.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.659+0000 7f838a1be700 1 -- 172.21.15.8:0/623042556 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83840c9340 con 0x7f8384153740 2023-10-06T04:37:03.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.659+0000 7f83817fa700 1 -- 172.21.15.8:0/623042556 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c00cde0 con 0x7f8384153740 2023-10-06T04:37:03.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.659+0000 7f838a1be700 1 -- 172.21.15.8:0/623042556 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83841472d0 con 0x7f8384153740 2023-10-06T04:37:03.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.660+0000 7f838a1be700 1 -- 172.21.15.8:0/623042556 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83840c9c70 con 0x7f8384153740 2023-10-06T04:37:03.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.660+0000 7f83817fa700 1 -- 172.21.15.8:0/623042556 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f837c013680 con 0x7f8384153740 2023-10-06T04:37:03.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.661+0000 7f83817fa700 1 --2- 172.21.15.8:0/623042556 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8370066f30 0x7f83700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:03.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.661+0000 7f83817fa700 1 -- 172.21.15.8:0/623042556 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f837c084c80 con 0x7f8384153740 2023-10-06T04:37:03.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.661+0000 7f83889bb700 1 --2- 172.21.15.8:0/623042556 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8370066f30 0x7f83700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:03.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.661+0000 7f83889bb700 1 --2- 172.21.15.8:0/623042556 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8370066f30 0x7f83700693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f83840b32f0 tx=0x7f8378007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:03.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.665+0000 7f83817fa700 1 -- 172.21.15.8:0/623042556 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f837c051aa0 con 0x7f8384153740 2023-10-06T04:37:03.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.860+0000 7f838a1be700 1 -- 172.21.15.8:0/623042556 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f838404c380 con 0x7f8384153740 2023-10-06T04:37:03.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.861+0000 7f83817fa700 1 -- 172.21.15.8:0/623042556 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f837c084020 con 0x7f8384153740 2023-10-06T04:37:03.864 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:03.864 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":25,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:36:21.690266+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:36:10.148177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:36:10.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:36:14.390671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:36:15.601089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:36:19.291300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.555871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.490505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.504578+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.517217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:05.991135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.537329+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.543232+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.443715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:37:03.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.863+0000 7f838a1be700 1 -- 172.21.15.8:0/623042556 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8370066f30 msgr2=0x7f83700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:03.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.863+0000 7f838a1be700 1 --2- 172.21.15.8:0/623042556 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8370066f30 0x7f83700693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f83840b32f0 tx=0x7f8378007ec0 comp rx=0 tx=0).stop 2023-10-06T04:37:03.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.863+0000 7f838a1be700 1 -- 172.21.15.8:0/623042556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8384153740 msgr2=0x7f83840c9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:03.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.863+0000 7f838a1be700 1 --2- 172.21.15.8:0/623042556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8384153740 0x7f83840c9e20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f837c00ec80 tx=0x7f837c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:03.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.863+0000 7f838a1be700 1 -- 172.21.15.8:0/623042556 shutdown_connections 2023-10-06T04:37:03.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.863+0000 7f838a1be700 1 --2- 172.21.15.8:0/623042556 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8370066f30 0x7f83700693e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:03.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.863+0000 7f838a1be700 1 --2- 172.21.15.8:0/623042556 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f838415d8e0 0x7f8384068190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:03.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.863+0000 7f838a1be700 1 --2- 172.21.15.8:0/623042556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8384153740 0x7f83840c9e20 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:03.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.863+0000 7f838a1be700 1 --2- 172.21.15.8:0/623042556 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f838415a7b0 0x7f8384146d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:03.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.863+0000 7f838a1be700 1 -- 172.21.15.8:0/623042556 >> 172.21.15.8:0/623042556 conn(0x7f83840d02b0 msgr2=0x7f83840b00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:03.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.863+0000 7f838a1be700 1 -- 172.21.15.8:0/623042556 shutdown_connections 2023-10-06T04:37:03.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.863+0000 7f838a1be700 1 -- 172.21.15.8:0/623042556 wait complete. 2023-10-06T04:37:03.878 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T04:37:03.879 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:37:03.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.995+0000 7fe526c68700 1 Processor -- start 2023-10-06T04:37:03.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.995+0000 7fe526c68700 1 -- start start 2023-10-06T04:37:04.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.996+0000 7fe526c68700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe5200af680 0x7fe52015e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:04.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.996+0000 7fe526c68700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5200cb360 0x7fe5200d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:04.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.996+0000 7fe526c68700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe5200d08d0 0x7fe5200b0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:04.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.996+0000 7fe526c68700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe52015d460 con 0x7fe5200af680 2023-10-06T04:37:04.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.996+0000 7fe526c68700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5200d0d50 con 0x7fe5200d08d0 2023-10-06T04:37:04.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.996+0000 7fe526c68700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5200cc4c0 con 0x7fe5200cb360 2023-10-06T04:37:04.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.996+0000 7fe525205700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe5200d08d0 0x7fe5200b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:04.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.996+0000 7fe51ffff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5200cb360 0x7fe5200d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:04.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.996+0000 7fe524a04700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe5200af680 0x7fe52015e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:04.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.996+0000 7fe525205700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe5200d08d0 0x7fe5200b0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.8:47432/0 (socket says 172.21.15.8:47432) 2023-10-06T04:37:04.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.996+0000 7fe525205700 1 -- 172.21.15.8:0/385237200 learned_addr learned my addr 172.21.15.8:0/385237200 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:04.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.996+0000 7fe51ffff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5200cb360 0x7fe5200d0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.8:48284/0 (socket says 172.21.15.8:48284) 2023-10-06T04:37:04.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.997+0000 7fe524a04700 1 -- 172.21.15.8:0/385237200 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5200cb360 msgr2=0x7fe5200d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:04.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.997+0000 7fe524a04700 1 --2- 172.21.15.8:0/385237200 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5200cb360 0x7fe5200d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:04.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.997+0000 7fe524a04700 1 -- 172.21.15.8:0/385237200 >> v2:172.21.15.184:3300/0 conn(0x7fe5200d08d0 msgr2=0x7fe5200b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:04.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.997+0000 7fe524a04700 1 --2- 172.21.15.8:0/385237200 >> v2:172.21.15.184:3300/0 conn(0x7fe5200d08d0 0x7fe5200b0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:04.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.997+0000 7fe524a04700 1 -- 172.21.15.8:0/385237200 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe52015e580 con 0x7fe5200af680 2023-10-06T04:37:04.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.997+0000 7fe525205700 1 --2- 172.21.15.8:0/385237200 >> v2:172.21.15.184:3300/0 conn(0x7fe5200d08d0 0x7fe5200b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:37:04.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.997+0000 7fe524a04700 1 --2- 172.21.15.8:0/385237200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5200af680 0x7fe52015e040 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe5200b21d0 tx=0x7fe5180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a503a40a92ddb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:04.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.997+0000 7fe51f7fe700 1 -- 172.21.15.8:0/385237200 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe518011630 con 0x7fe5200af680 2023-10-06T04:37:04.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.997+0000 7fe51f7fe700 1 -- 172.21.15.8:0/385237200 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe518011790 con 0x7fe5200af680 2023-10-06T04:37:04.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.997+0000 7fe51f7fe700 1 -- 172.21.15.8:0/385237200 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe518011b30 con 0x7fe5200af680 2023-10-06T04:37:04.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.998+0000 7fe526c68700 1 -- 172.21.15.8:0/385237200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5200af680 msgr2=0x7fe52015e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:04.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.998+0000 7fe526c68700 1 --2- 172.21.15.8:0/385237200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5200af680 0x7fe52015e040 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe5200b21d0 tx=0x7fe5180091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:04.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.998+0000 7fe526c68700 1 -- 172.21.15.8:0/385237200 shutdown_connections 2023-10-06T04:37:04.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.998+0000 7fe526c68700 1 --2- 172.21.15.8:0/385237200 >> v2:172.21.15.184:3300/0 conn(0x7fe5200d08d0 0x7fe5200b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:04.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.998+0000 7fe526c68700 1 --2- 172.21.15.8:0/385237200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5200af680 0x7fe52015e040 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:04.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.998+0000 7fe526c68700 1 --2- 172.21.15.8:0/385237200 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5200cb360 0x7fe5200d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:04.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.998+0000 7fe526c68700 1 -- 172.21.15.8:0/385237200 >> 172.21.15.8:0/385237200 conn(0x7fe5200633d0 msgr2=0x7fe5200637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:04.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.998+0000 7fe526c68700 1 -- 172.21.15.8:0/385237200 shutdown_connections 2023-10-06T04:37:04.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.998+0000 7fe526c68700 1 -- 172.21.15.8:0/385237200 wait complete. 2023-10-06T04:37:04.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.999+0000 7fe526c68700 1 Processor -- start 2023-10-06T04:37:04.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:03.999+0000 7fe526c68700 1 -- start start 2023-10-06T04:37:04.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.000+0000 7fe526c68700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5200af680 0x7fe52015b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:04.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.000+0000 7fe526c68700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5200cb360 0x7fe5200b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:04.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.000+0000 7fe526c68700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5200d08d0 0x7fe52015a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:04.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.000+0000 7fe526c68700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5200c4b70 con 0x7fe5200d08d0 2023-10-06T04:37:04.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.000+0000 7fe526c68700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5200c7ee0 con 0x7fe5200af680 2023-10-06T04:37:04.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.000+0000 7fe526c68700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5200c8370 con 0x7fe5200cb360 2023-10-06T04:37:04.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.000+0000 7fe525205700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5200d08d0 0x7fe52015a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:04.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.000+0000 7fe525205700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5200d08d0 0x7fe52015a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50252/0 (socket says 172.21.15.8:50252) 2023-10-06T04:37:04.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.000+0000 7fe525205700 1 -- 172.21.15.8:0/153457546 learned_addr learned my addr 172.21.15.8:0/153457546 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:04.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.000+0000 7fe524a04700 1 --2- 172.21.15.8:0/153457546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5200af680 0x7fe52015b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:04.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.000+0000 7fe51ffff700 1 --2- 172.21.15.8:0/153457546 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5200cb360 0x7fe5200b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:04.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.000+0000 7fe525205700 1 -- 172.21.15.8:0/153457546 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5200cb360 msgr2=0x7fe5200b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:04.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.000+0000 7fe525205700 1 --2- 172.21.15.8:0/153457546 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5200cb360 0x7fe5200b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:04.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.000+0000 7fe525205700 1 -- 172.21.15.8:0/153457546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5200af680 msgr2=0x7fe52015b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:04.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.000+0000 7fe525205700 1 --2- 172.21.15.8:0/153457546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5200af680 0x7fe52015b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:04.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.000+0000 7fe525205700 1 -- 172.21.15.8:0/153457546 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5080094f0 con 0x7fe5200d08d0 2023-10-06T04:37:04.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.000+0000 7fe525205700 1 --2- 172.21.15.8:0/153457546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5200d08d0 0x7fe52015a7f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe50800ec50 tx=0x7fe508009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:04.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.000+0000 7fe51cff9700 1 -- 172.21.15.8:0/153457546 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50800c850 con 0x7fe5200d08d0 2023-10-06T04:37:04.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.001+0000 7fe51cff9700 1 -- 172.21.15.8:0/153457546 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50800c9b0 con 0x7fe5200d08d0 2023-10-06T04:37:04.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.001+0000 7fe51cff9700 1 -- 172.21.15.8:0/153457546 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50800cd50 con 0x7fe5200d08d0 2023-10-06T04:37:04.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.001+0000 7fe526c68700 1 -- 172.21.15.8:0/153457546 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe518009420 con 0x7fe5200d08d0 2023-10-06T04:37:04.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.001+0000 7fe526c68700 1 -- 172.21.15.8:0/153457546 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5200c7890 con 0x7fe5200d08d0 2023-10-06T04:37:04.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.002+0000 7fe526c68700 1 -- 172.21.15.8:0/153457546 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5200c8050 con 0x7fe5200d08d0 2023-10-06T04:37:04.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.002+0000 7fe51cff9700 1 -- 172.21.15.8:0/153457546 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe508013680 con 0x7fe5200d08d0 2023-10-06T04:37:04.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.002+0000 7fe51cff9700 1 --2- 172.21.15.8:0/153457546 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe500066f30 0x7fe5000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:04.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.002+0000 7fe51cff9700 1 -- 172.21.15.8:0/153457546 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe508084b10 con 0x7fe5200d08d0 2023-10-06T04:37:04.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.003+0000 7fe524a04700 1 --2- 172.21.15.8:0/153457546 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe500066f30 0x7fe5000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:04.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.003+0000 7fe524a04700 1 --2- 172.21.15.8:0/153457546 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe500066f30 0x7fe5000693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe5180098e0 tx=0x7fe518017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:04.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.007+0000 7fe51cff9700 1 -- 172.21.15.8:0/153457546 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe508051930 con 0x7fe5200d08d0 2023-10-06T04:37:04.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.244+0000 7fe526c68700 1 -- 172.21.15.8:0/153457546 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe520071550 con 0x7fe5200d08d0 2023-10-06T04:37:04.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.245+0000 7fe51cff9700 1 -- 172.21.15.8:0/153457546 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4587 (secure 0 0 0) 0x7fe508054f50 con 0x7fe5200d08d0 2023-10-06T04:37:04.247 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:04.247 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/516627422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":516627422},{"type":"v1","addr":"172.21.15.8:6835","nonce":516627422}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/1078182353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1078182353},{"type":"v1","addr":"172.21.15.8:6834","nonce":1078182353}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/181555783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":181555783},{"type":"v1","addr":"172.21.15.184:6836","nonce":181555783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:36:16.632579+0000","modified":"2023-10-06T04:36:29.752096+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/2590100121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":2590100121},{"type":"v1","addr":"172.21.15.184:6837","nonce":2590100121}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:37:04.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.247+0000 7fe526c68700 1 -- 172.21.15.8:0/153457546 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe500066f30 msgr2=0x7fe5000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:04.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.247+0000 7fe526c68700 1 --2- 172.21.15.8:0/153457546 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe500066f30 0x7fe5000693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe5180098e0 tx=0x7fe518017000 comp rx=0 tx=0).stop 2023-10-06T04:37:04.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.247+0000 7fe526c68700 1 -- 172.21.15.8:0/153457546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5200d08d0 msgr2=0x7fe52015a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:04.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.247+0000 7fe526c68700 1 --2- 172.21.15.8:0/153457546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5200d08d0 0x7fe52015a7f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe50800ec50 tx=0x7fe508009250 comp rx=0 tx=0).stop 2023-10-06T04:37:04.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.247+0000 7fe526c68700 1 -- 172.21.15.8:0/153457546 shutdown_connections 2023-10-06T04:37:04.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.247+0000 7fe526c68700 1 --2- 172.21.15.8:0/153457546 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe500066f30 0x7fe5000693e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:04.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.247+0000 7fe526c68700 1 --2- 172.21.15.8:0/153457546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5200d08d0 0x7fe52015a7f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:04.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.247+0000 7fe526c68700 1 --2- 172.21.15.8:0/153457546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5200af680 0x7fe52015b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:04.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.247+0000 7fe526c68700 1 --2- 172.21.15.8:0/153457546 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5200cb360 0x7fe5200b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:04.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.247+0000 7fe526c68700 1 -- 172.21.15.8:0/153457546 >> 172.21.15.8:0/153457546 conn(0x7fe5200633d0 msgr2=0x7fe5200ce320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:04.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.247+0000 7fe526c68700 1 -- 172.21.15.8:0/153457546 shutdown_connections 2023-10-06T04:37:04.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.247+0000 7fe526c68700 1 -- 172.21.15.8:0/153457546 wait complete. 2023-10-06T04:37:04.251 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 9 2023-10-06T04:37:04.261 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:37:04.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.377+0000 7faee04ad700 1 Processor -- start 2023-10-06T04:37:04.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.377+0000 7faee04ad700 1 -- start start 2023-10-06T04:37:04.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.378+0000 7faee04ad700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faed8156530 0x7faed80c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:04.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.378+0000 7faee04ad700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7faed80ca1a0 0x7faed806b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:04.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.378+0000 7faee04ad700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed80b0c70 con 0x7faed8156160 2023-10-06T04:37:04.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.378+0000 7faee04ad700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faed80c8520 con 0x7faed80ca1a0 2023-10-06T04:37:04.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.378+0000 7faee04ad700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed80b0ae0 con 0x7faed8156530 2023-10-06T04:37:04.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.378+0000 7faede249700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7faed8156160 0x7faed80c9a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41058/0 (socket says 172.21.15.8:41058) 2023-10-06T04:37:04.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.379+0000 7faede249700 1 -- 172.21.15.8:0/3705360247 learned_addr learned my addr 172.21.15.8:0/3705360247 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:04.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.379+0000 7faedda48700 1 --2- 172.21.15.8:0/3705360247 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faed8156530 0x7faed80c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:04.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.379+0000 7faedea4a700 1 --2- 172.21.15.8:0/3705360247 >> v2:172.21.15.184:3300/0 conn(0x7faed80ca1a0 0x7faed806b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:04.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.379+0000 7faedd247700 1 -- 172.21.15.8:0/3705360247 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3344825284 0 0) 0x7faed80b0c70 con 0x7faed8156160 2023-10-06T04:37:04.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.379+0000 7faedd247700 1 -- 172.21.15.8:0/3705360247 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faec0003570 con 0x7faed8156160 2023-10-06T04:37:04.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.379+0000 7faedd247700 1 -- 172.21.15.8:0/3705360247 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2479079372 0 0) 0x7faec0003570 con 0x7faed8156160 2023-10-06T04:37:04.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.379+0000 7faedda48700 1 -- 172.21.15.8:0/3705360247 >> v2:172.21.15.184:3300/0 conn(0x7faed80ca1a0 msgr2=0x7faed806b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:04.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.379+0000 7faedda48700 1 --2- 172.21.15.8:0/3705360247 >> v2:172.21.15.184:3300/0 conn(0x7faed80ca1a0 0x7faed806b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:04.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.379+0000 7faedda48700 1 -- 172.21.15.8:0/3705360247 >> v1:172.21.15.8:6789/0 conn(0x7faed8156160 legacy=0x7faed80c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:04.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.379+0000 7faedda48700 1 -- 172.21.15.8:0/3705360247 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed80c8720 con 0x7faed8156530 2023-10-06T04:37:04.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.379+0000 7faedda48700 1 --2- 172.21.15.8:0/3705360247 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faed8156530 0x7faed80c7fe0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faecc009910 tx=0x7faecc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fce13ba45abde57 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:04.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.379+0000 7faedd247700 1 -- 172.21.15.8:0/3705360247 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed0001470 con 0x7faed8156530 2023-10-06T04:37:04.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.379+0000 7faedd247700 1 -- 172.21.15.8:0/3705360247 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faecc011420 con 0x7faed8156530 2023-10-06T04:37:04.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.379+0000 7faedd247700 1 -- 172.21.15.8:0/3705360247 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc0117c0 con 0x7faed8156530 2023-10-06T04:37:04.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.380+0000 7faee04ad700 1 -- 172.21.15.8:0/3705360247 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faed8156530 msgr2=0x7faed80c7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:04.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.380+0000 7faee04ad700 1 --2- 172.21.15.8:0/3705360247 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faed8156530 0x7faed80c7fe0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faecc009910 tx=0x7faecc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:04.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.380+0000 7faee04ad700 1 -- 172.21.15.8:0/3705360247 shutdown_connections 2023-10-06T04:37:04.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.380+0000 7faee04ad700 1 --2- 172.21.15.8:0/3705360247 >> v2:172.21.15.184:3300/0 conn(0x7faed80ca1a0 0x7faed806b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:04.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.380+0000 7faee04ad700 1 --2- 172.21.15.8:0/3705360247 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faed8156530 0x7faed80c7fe0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:04.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.380+0000 7faee04ad700 1 -- 172.21.15.8:0/3705360247 >> 172.21.15.8:0/3705360247 conn(0x7faed80686e0 msgr2=0x7faed8068ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:04.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.380+0000 7faee04ad700 1 -- 172.21.15.8:0/3705360247 shutdown_connections 2023-10-06T04:37:04.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.380+0000 7faee04ad700 1 -- 172.21.15.8:0/3705360247 wait complete. 2023-10-06T04:37:04.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.381+0000 7faee04ad700 1 Processor -- start 2023-10-06T04:37:04.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.381+0000 7faee04ad700 1 -- start start 2023-10-06T04:37:04.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.382+0000 7faee04ad700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faed80ca1a0 0x7faed81592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:04.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.382+0000 7faee04ad700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faed8156160 0x7faed80adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:04.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.382+0000 7faee04ad700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faed8156530 0x7faed814b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:04.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.382+0000 7faee04ad700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed80af5b0 con 0x7faed8156530 2023-10-06T04:37:04.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.382+0000 7faee04ad700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed80aecc0 con 0x7faed8156160 2023-10-06T04:37:04.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.382+0000 7faee04ad700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed80ae0a0 con 0x7faed80ca1a0 2023-10-06T04:37:04.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.382+0000 7faedea4a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faed8156530 0x7faed814b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:04.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.382+0000 7faedea4a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faed8156530 0x7faed814b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48996/0 (socket says 172.21.15.8:48996) 2023-10-06T04:37:04.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.382+0000 7faedea4a700 1 -- 172.21.15.8:0/2134310223 learned_addr learned my addr 172.21.15.8:0/2134310223 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:04.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.382+0000 7faede249700 1 --2- 172.21.15.8:0/2134310223 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faed80ca1a0 0x7faed81592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:04.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.382+0000 7faedda48700 1 --2- 172.21.15.8:0/2134310223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faed8156160 0x7faed80adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:04.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.382+0000 7faedea4a700 1 -- 172.21.15.8:0/2134310223 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faed80ca1a0 msgr2=0x7faed81592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:04.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.382+0000 7faedea4a700 1 --2- 172.21.15.8:0/2134310223 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faed80ca1a0 0x7faed81592e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:04.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.382+0000 7faedea4a700 1 -- 172.21.15.8:0/2134310223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faed8156160 msgr2=0x7faed80adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:04.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.382+0000 7faedea4a700 1 --2- 172.21.15.8:0/2134310223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faed8156160 0x7faed80adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:04.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.382+0000 7faedea4a700 1 -- 172.21.15.8:0/2134310223 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faecc009420 con 0x7faed8156530 2023-10-06T04:37:04.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.383+0000 7faedea4a700 1 --2- 172.21.15.8:0/2134310223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faed8156530 0x7faed814b370 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7faec8009d70 tx=0x7faec800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:04.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.383+0000 7faed67fc700 1 -- 172.21.15.8:0/2134310223 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec800caa0 con 0x7faed8156530 2023-10-06T04:37:04.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.383+0000 7faed67fc700 1 -- 172.21.15.8:0/2134310223 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec800f040 con 0x7faed8156530 2023-10-06T04:37:04.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.383+0000 7faee04ad700 1 -- 172.21.15.8:0/2134310223 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed81599a0 con 0x7faed8156530 2023-10-06T04:37:04.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.383+0000 7faed67fc700 1 -- 172.21.15.8:0/2134310223 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec800ce50 con 0x7faed8156530 2023-10-06T04:37:04.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.383+0000 7faee04ad700 1 -- 172.21.15.8:0/2134310223 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed80af240 con 0x7faed8156530 2023-10-06T04:37:04.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.384+0000 7faee04ad700 1 -- 172.21.15.8:0/2134310223 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed80af720 con 0x7faed8156530 2023-10-06T04:37:04.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.384+0000 7faed67fc700 1 -- 172.21.15.8:0/2134310223 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faec8014690 con 0x7faed8156530 2023-10-06T04:37:04.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.385+0000 7faed67fc700 1 --2- 172.21.15.8:0/2134310223 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7faec4066f30 0x7faec40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:04.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.385+0000 7faed67fc700 1 -- 172.21.15.8:0/2134310223 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7faec80854a0 con 0x7faed8156530 2023-10-06T04:37:04.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.385+0000 7faede249700 1 --2- 172.21.15.8:0/2134310223 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7faec4066f30 0x7faec40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:04.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.385+0000 7faede249700 1 --2- 172.21.15.8:0/2134310223 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7faec4066f30 0x7faec40693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7faed00011e0 tx=0x7faed0001560 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:04.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.389+0000 7faed67fc700 1 -- 172.21.15.8:0/2134310223 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faec80522c0 con 0x7faed8156530 2023-10-06T04:37:04.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.624+0000 7faee04ad700 1 -- 172.21.15.8:0/2134310223 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faed8071550 con 0x7faed8156530 2023-10-06T04:37:04.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.624+0000 7faed67fc700 1 -- 172.21.15.8:0/2134310223 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4587 (secure 0 0 0) 0x7faec80558e0 con 0x7faed8156530 2023-10-06T04:37:04.627 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:04.627 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/516627422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":516627422},{"type":"v1","addr":"172.21.15.8:6835","nonce":516627422}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/1078182353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1078182353},{"type":"v1","addr":"172.21.15.8:6834","nonce":1078182353}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/181555783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":181555783},{"type":"v1","addr":"172.21.15.184:6836","nonce":181555783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:36:16.632579+0000","modified":"2023-10-06T04:36:29.752096+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/2590100121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":2590100121},{"type":"v1","addr":"172.21.15.184:6837","nonce":2590100121}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:37:04.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.626+0000 7faee04ad700 1 -- 172.21.15.8:0/2134310223 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7faec4066f30 msgr2=0x7faec40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:04.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.626+0000 7faee04ad700 1 --2- 172.21.15.8:0/2134310223 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7faec4066f30 0x7faec40693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7faed00011e0 tx=0x7faed0001560 comp rx=0 tx=0).stop 2023-10-06T04:37:04.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.626+0000 7faee04ad700 1 -- 172.21.15.8:0/2134310223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faed8156530 msgr2=0x7faed814b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:04.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.626+0000 7faee04ad700 1 --2- 172.21.15.8:0/2134310223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faed8156530 0x7faed814b370 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7faec8009d70 tx=0x7faec800b040 comp rx=0 tx=0).stop 2023-10-06T04:37:04.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.626+0000 7faee04ad700 1 -- 172.21.15.8:0/2134310223 shutdown_connections 2023-10-06T04:37:04.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.626+0000 7faee04ad700 1 --2- 172.21.15.8:0/2134310223 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7faec4066f30 0x7faec40693e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:04.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.626+0000 7faee04ad700 1 --2- 172.21.15.8:0/2134310223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faed8156530 0x7faed814b370 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:04.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.626+0000 7faee04ad700 1 --2- 172.21.15.8:0/2134310223 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faed80ca1a0 0x7faed81592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:04.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.626+0000 7faee04ad700 1 --2- 172.21.15.8:0/2134310223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faed8156160 0x7faed80adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:04.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.626+0000 7faee04ad700 1 -- 172.21.15.8:0/2134310223 >> 172.21.15.8:0/2134310223 conn(0x7faed80686e0 msgr2=0x7faed80b16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:04.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.626+0000 7faee04ad700 1 -- 172.21.15.8:0/2134310223 shutdown_connections 2023-10-06T04:37:04.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.626+0000 7faee04ad700 1 -- 172.21.15.8:0/2134310223 wait complete. 2023-10-06T04:37:04.630 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 9 2023-10-06T04:37:04.641 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:37:04.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.757+0000 7fe984836700 1 Processor -- start 2023-10-06T04:37:04.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.757+0000 7fe984836700 1 -- start start 2023-10-06T04:37:04.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.758+0000 7fe984836700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe980159590 0x7fe9800686e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:04.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.758+0000 7fe984836700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe9800b0e70 0x7fe9800b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:04.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.758+0000 7fe984836700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9800b1820 con 0x7fe9801591c0 2023-10-06T04:37:04.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.758+0000 7fe984836700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9800b1ce0 con 0x7fe9800b0e70 2023-10-06T04:37:04.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.758+0000 7fe984836700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9800cd370 con 0x7fe980159590 2023-10-06T04:37:04.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.758+0000 7fe97f59e700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe9800b0e70 0x7fe9800b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:04.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.758+0000 7fe97f59e700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe9800b0e70 0x7fe9800b12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49012/0 (socket says 172.21.15.8:49012) 2023-10-06T04:37:04.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.758+0000 7fe97f59e700 1 -- 172.21.15.8:0/1457561996 learned_addr learned my addr 172.21.15.8:0/1457561996 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:04.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.758+0000 7fe97e59c700 1 --2- 172.21.15.8:0/1457561996 >> v2:172.21.15.184:3300/0 conn(0x7fe980159590 0x7fe9800686e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:04.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.758+0000 7fe97f59e700 1 -- 172.21.15.8:0/1457561996 >> v2:172.21.15.184:3300/0 conn(0x7fe980159590 msgr2=0x7fe9800686e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:04.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.758+0000 7fe97f59e700 1 --2- 172.21.15.8:0/1457561996 >> v2:172.21.15.184:3300/0 conn(0x7fe980159590 0x7fe9800686e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:04.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.758+0000 7fe97f59e700 1 -- 172.21.15.8:0/1457561996 >> v1:172.21.15.184:6789/0 conn(0x7fe9801591c0 legacy=0x7fe98015cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:04.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.758+0000 7fe97f59e700 1 -- 172.21.15.8:0/1457561996 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98015da70 con 0x7fe9800b0e70 2023-10-06T04:37:04.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.758+0000 7fe97e59c700 1 --2- 172.21.15.8:0/1457561996 >> v2:172.21.15.184:3300/0 conn(0x7fe980159590 0x7fe9800686e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:04.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.758+0000 7fe97f59e700 1 --2- 172.21.15.8:0/1457561996 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9800b0e70 0x7fe9800b12e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe9800b0a90 tx=0x7fe978009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a400fef7ee335e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:04.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.758+0000 7fe97dd9b700 1 -- 172.21.15.8:0/1457561996 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97800b820 con 0x7fe9800b0e70 2023-10-06T04:37:04.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.759+0000 7fe97dd9b700 1 -- 172.21.15.8:0/1457561996 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97800b980 con 0x7fe9800b0e70 2023-10-06T04:37:04.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.759+0000 7fe97dd9b700 1 -- 172.21.15.8:0/1457561996 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97800bd20 con 0x7fe9800b0e70 2023-10-06T04:37:04.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.759+0000 7fe984836700 1 -- 172.21.15.8:0/1457561996 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9800b0e70 msgr2=0x7fe9800b12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:04.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.759+0000 7fe984836700 1 --2- 172.21.15.8:0/1457561996 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9800b0e70 0x7fe9800b12e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe9800b0a90 tx=0x7fe978009250 comp rx=0 tx=0).stop 2023-10-06T04:37:04.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.759+0000 7fe984836700 1 -- 172.21.15.8:0/1457561996 shutdown_connections 2023-10-06T04:37:04.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.759+0000 7fe984836700 1 --2- 172.21.15.8:0/1457561996 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9800b0e70 0x7fe9800b12e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:04.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.759+0000 7fe984836700 1 --2- 172.21.15.8:0/1457561996 >> v2:172.21.15.184:3300/0 conn(0x7fe980159590 0x7fe9800686e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:04.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.759+0000 7fe984836700 1 -- 172.21.15.8:0/1457561996 >> 172.21.15.8:0/1457561996 conn(0x7fe9800675d0 msgr2=0x7fe9800679d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:04.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.759+0000 7fe984836700 1 -- 172.21.15.8:0/1457561996 shutdown_connections 2023-10-06T04:37:04.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.759+0000 7fe984836700 1 -- 172.21.15.8:0/1457561996 wait complete. 2023-10-06T04:37:04.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.760+0000 7fe984836700 1 Processor -- start 2023-10-06T04:37:04.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.760+0000 7fe984836700 1 -- start start 2023-10-06T04:37:04.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.761+0000 7fe984836700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9800b0e70 0x7fe9800b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:04.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.761+0000 7fe984836700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9801591c0 0x7fe9800c9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:04.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.761+0000 7fe984836700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe980159590 0x7fe9800add90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:04.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.761+0000 7fe984836700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98015f3a0 con 0x7fe9800b0e70 2023-10-06T04:37:04.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.761+0000 7fe984836700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98015fe40 con 0x7fe9801591c0 2023-10-06T04:37:04.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.761+0000 7fe984836700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98015f5a0 con 0x7fe980159590 2023-10-06T04:37:04.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.761+0000 7fe97ed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9800b0e70 0x7fe9800b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:04.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.761+0000 7fe97ed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9800b0e70 0x7fe9800b01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49018/0 (socket says 172.21.15.8:49018) 2023-10-06T04:37:04.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.761+0000 7fe97ed9d700 1 -- 172.21.15.8:0/109011670 learned_addr learned my addr 172.21.15.8:0/109011670 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:04.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.761+0000 7fe97e59c700 1 --2- 172.21.15.8:0/109011670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9801591c0 0x7fe9800c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:04.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.761+0000 7fe97f59e700 1 --2- 172.21.15.8:0/109011670 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe980159590 0x7fe9800add90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:04.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.761+0000 7fe97ed9d700 1 -- 172.21.15.8:0/109011670 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe980159590 msgr2=0x7fe9800add90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:04.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.761+0000 7fe97ed9d700 1 --2- 172.21.15.8:0/109011670 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe980159590 0x7fe9800add90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:04.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.761+0000 7fe97ed9d700 1 -- 172.21.15.8:0/109011670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9801591c0 msgr2=0x7fe9800c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:04.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.761+0000 7fe97ed9d700 1 --2- 172.21.15.8:0/109011670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9801591c0 0x7fe9800c9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:04.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.761+0000 7fe97ed9d700 1 -- 172.21.15.8:0/109011670 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9780094f0 con 0x7fe9800b0e70 2023-10-06T04:37:04.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.761+0000 7fe97f59e700 1 --2- 172.21.15.8:0/109011670 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe980159590 0x7fe9800add90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:04.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.762+0000 7fe97ed9d700 1 --2- 172.21.15.8:0/109011670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9800b0e70 0x7fe9800b01f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe97000c980 tx=0x7fe970002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:04.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.762+0000 7fe976ffd700 1 -- 172.21.15.8:0/109011670 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97000ce70 con 0x7fe9800b0e70 2023-10-06T04:37:04.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.762+0000 7fe976ffd700 1 -- 172.21.15.8:0/109011670 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97000a7a0 con 0x7fe9800b0e70 2023-10-06T04:37:04.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.762+0000 7fe984836700 1 -- 172.21.15.8:0/109011670 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe98015f880 con 0x7fe9800b0e70 2023-10-06T04:37:04.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.762+0000 7fe976ffd700 1 -- 172.21.15.8:0/109011670 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97000ab60 con 0x7fe9800b0e70 2023-10-06T04:37:04.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.762+0000 7fe984836700 1 -- 172.21.15.8:0/109011670 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe98015fc10 con 0x7fe9800b0e70 2023-10-06T04:37:04.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.763+0000 7fe984836700 1 -- 172.21.15.8:0/109011670 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe98004c380 con 0x7fe9800b0e70 2023-10-06T04:37:04.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.763+0000 7fe976ffd700 1 -- 172.21.15.8:0/109011670 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe970012420 con 0x7fe9800b0e70 2023-10-06T04:37:04.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.763+0000 7fe976ffd700 1 --2- 172.21.15.8:0/109011670 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe960066f30 0x7fe9600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:04.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.764+0000 7fe976ffd700 1 -- 172.21.15.8:0/109011670 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe970084d50 con 0x7fe9800b0e70 2023-10-06T04:37:04.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.764+0000 7fe97e59c700 1 --2- 172.21.15.8:0/109011670 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe960066f30 0x7fe9600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:04.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.764+0000 7fe97e59c700 1 --2- 172.21.15.8:0/109011670 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe960066f30 0x7fe9600693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe9800aeea0 tx=0x7fe968008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:04.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.768+0000 7fe976ffd700 1 -- 172.21.15.8:0/109011670 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe970088030 con 0x7fe9800b0e70 2023-10-06T04:37:04.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.965+0000 7fe984836700 1 -- 172.21.15.8:0/109011670 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9800b07f0 con 0x7fe9800b0e70 2023-10-06T04:37:04.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.966+0000 7fe976ffd700 1 -- 172.21.15.8:0/109011670 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18754 (secure 0 0 0) 0x7fe9700556b0 con 0x7fe9800b0e70 2023-10-06T04:37:04.968 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:04.968 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":26,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:37:04.902259+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:36:10.148177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:36:10.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:36:14.390671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:36:15.601089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:36:19.291300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.555871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.490505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.504578+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.517217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:05.991135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.537329+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.543232+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.443715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:37:04.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.968+0000 7fe984836700 1 -- 172.21.15.8:0/109011670 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe960066f30 msgr2=0x7fe9600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:04.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.968+0000 7fe984836700 1 --2- 172.21.15.8:0/109011670 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe960066f30 0x7fe9600693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe9800aeea0 tx=0x7fe968008040 comp rx=0 tx=0).stop 2023-10-06T04:37:04.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.968+0000 7fe984836700 1 -- 172.21.15.8:0/109011670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9800b0e70 msgr2=0x7fe9800b01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:04.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.968+0000 7fe984836700 1 --2- 172.21.15.8:0/109011670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9800b0e70 0x7fe9800b01f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe97000c980 tx=0x7fe970002760 comp rx=0 tx=0).stop 2023-10-06T04:37:04.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.968+0000 7fe984836700 1 -- 172.21.15.8:0/109011670 shutdown_connections 2023-10-06T04:37:04.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.968+0000 7fe984836700 1 --2- 172.21.15.8:0/109011670 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe960066f30 0x7fe9600693e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:04.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.968+0000 7fe984836700 1 --2- 172.21.15.8:0/109011670 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe980159590 0x7fe9800add90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:04.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.968+0000 7fe984836700 1 --2- 172.21.15.8:0/109011670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9800b0e70 0x7fe9800b01f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:04.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.968+0000 7fe984836700 1 --2- 172.21.15.8:0/109011670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9801591c0 0x7fe9800c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:04.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.968+0000 7fe984836700 1 -- 172.21.15.8:0/109011670 >> 172.21.15.8:0/109011670 conn(0x7fe9800675d0 msgr2=0x7fe9800b3250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:04.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.968+0000 7fe984836700 1 -- 172.21.15.8:0/109011670 shutdown_connections 2023-10-06T04:37:04.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:04.968+0000 7fe984836700 1 -- 172.21.15.8:0/109011670 wait complete. 2023-10-06T04:37:04.983 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T04:37:05.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.103+0000 7f137aa9b700 1 Processor -- start 2023-10-06T04:37:05.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.103+0000 7f137aa9b700 1 -- start start 2023-10-06T04:37:05.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.103+0000 7f137aa9b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f13740af410 0x7f13740cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:05.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.104+0000 7f137aa9b700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f137415ddd0 con 0x7f13740cd4c0 2023-10-06T04:37:05.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.104+0000 7f137aa9b700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f137415d4a0 con 0x7f13740af7e0 2023-10-06T04:37:05.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.104+0000 7f137aa9b700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13740cd8b0 con 0x7f13740af410 2023-10-06T04:37:05.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.104+0000 7f1378837700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f13740af410 0x7f13740cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:05.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.104+0000 7f1379038700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f13740cd4c0 0x7f13740ce4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41068/0 (socket says 172.21.15.8:41068) 2023-10-06T04:37:05.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.104+0000 7f1378837700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f13740af410 0x7f13740cb3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49032/0 (socket says 172.21.15.8:49032) 2023-10-06T04:37:05.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.104+0000 7f1379038700 1 -- 172.21.15.8:0/3321712440 learned_addr learned my addr 172.21.15.8:0/3321712440 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:05.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.104+0000 7f1378837700 1 -- 172.21.15.8:0/3321712440 >> v1:172.21.15.184:6789/0 conn(0x7f13740af7e0 legacy=0x7f13740ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:05.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.104+0000 7f1378837700 1 -- 172.21.15.8:0/3321712440 >> v1:172.21.15.8:6789/0 conn(0x7f13740cd4c0 legacy=0x7f13740ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:05.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.104+0000 7f13737fe700 1 -- 172.21.15.8:0/3321712440 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2136061465 0 0) 0x7f137415ddd0 con 0x7f13740cd4c0 2023-10-06T04:37:05.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.104+0000 7f1378837700 1 -- 172.21.15.8:0/3321712440 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f137415d780 con 0x7f13740af410 2023-10-06T04:37:05.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.104+0000 7f1378837700 1 --2- 172.21.15.8:0/3321712440 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13740af410 0x7f13740cb3a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f136c009e60 tx=0x7f136c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=729523957053877e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:05.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.104+0000 7f13737fe700 1 -- 172.21.15.8:0/3321712440 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c00e070 con 0x7f13740af410 2023-10-06T04:37:05.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.104+0000 7f13737fe700 1 -- 172.21.15.8:0/3321712440 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136c00bcc0 con 0x7f13740af410 2023-10-06T04:37:05.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.104+0000 7f13737fe700 1 -- 172.21.15.8:0/3321712440 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c012680 con 0x7f13740af410 2023-10-06T04:37:05.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.105+0000 7f137aa9b700 1 -- 172.21.15.8:0/3321712440 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13740af410 msgr2=0x7f13740cb3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:05.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.105+0000 7f137aa9b700 1 --2- 172.21.15.8:0/3321712440 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13740af410 0x7f13740cb3a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f136c009e60 tx=0x7f136c009780 comp rx=0 tx=0).stop 2023-10-06T04:37:05.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.105+0000 7f137aa9b700 1 -- 172.21.15.8:0/3321712440 shutdown_connections 2023-10-06T04:37:05.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.105+0000 7f137aa9b700 1 --2- 172.21.15.8:0/3321712440 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13740af410 0x7f13740cb3a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:05.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.105+0000 7f137aa9b700 1 -- 172.21.15.8:0/3321712440 >> 172.21.15.8:0/3321712440 conn(0x7f1374069890 msgr2=0x7f1374069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:05.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.105+0000 7f137aa9b700 1 -- 172.21.15.8:0/3321712440 shutdown_connections 2023-10-06T04:37:05.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.105+0000 7f137aa9b700 1 -- 172.21.15.8:0/3321712440 wait complete. 2023-10-06T04:37:05.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.106+0000 7f137aa9b700 1 Processor -- start 2023-10-06T04:37:05.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.106+0000 7f137aa9b700 1 -- start start 2023-10-06T04:37:05.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.107+0000 7f137aa9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13740af410 0x7f13740b5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:05.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.107+0000 7f137aa9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13740af7e0 0x7f13740c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:05.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.107+0000 7f137aa9b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13740cd4c0 0x7f1374151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:05.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.107+0000 7f137aa9b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13740b47a0 con 0x7f13740af7e0 2023-10-06T04:37:05.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.107+0000 7f137aa9b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13740b6210 con 0x7f13740cd4c0 2023-10-06T04:37:05.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.107+0000 7f137aa9b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1374150b90 con 0x7f13740af410 2023-10-06T04:37:05.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.107+0000 7f1373fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13740af7e0 0x7f13740c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:05.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.107+0000 7f1373fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13740af7e0 0x7f13740c8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49040/0 (socket says 172.21.15.8:49040) 2023-10-06T04:37:05.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.107+0000 7f1373fff700 1 -- 172.21.15.8:0/2049213373 learned_addr learned my addr 172.21.15.8:0/2049213373 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:05.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.107+0000 7f1379038700 1 --2- 172.21.15.8:0/2049213373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13740cd4c0 0x7f1374151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:05.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.107+0000 7f1373fff700 1 -- 172.21.15.8:0/2049213373 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13740af410 msgr2=0x7f13740b5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:05.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.107+0000 7f1378837700 1 --2- 172.21.15.8:0/2049213373 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13740af410 0x7f13740b5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:05.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.107+0000 7f1373fff700 1 --2- 172.21.15.8:0/2049213373 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13740af410 0x7f13740b5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:05.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.107+0000 7f1373fff700 1 -- 172.21.15.8:0/2049213373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13740cd4c0 msgr2=0x7f1374151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:05.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.107+0000 7f1373fff700 1 --2- 172.21.15.8:0/2049213373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13740cd4c0 0x7f1374151950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:05.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.107+0000 7f1373fff700 1 -- 172.21.15.8:0/2049213373 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136c009a20 con 0x7f13740af7e0 2023-10-06T04:37:05.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.107+0000 7f1379038700 1 --2- 172.21.15.8:0/2049213373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13740cd4c0 0x7f1374151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:05.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.107+0000 7f1373fff700 1 --2- 172.21.15.8:0/2049213373 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13740af7e0 0x7f13740c8a50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f136400c590 tx=0x7f136400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:05.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.108+0000 7f1370ff9700 1 -- 172.21.15.8:0/2049213373 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1364011590 con 0x7f13740af7e0 2023-10-06T04:37:05.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.108+0000 7f1370ff9700 1 -- 172.21.15.8:0/2049213373 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13640116f0 con 0x7f13740af7e0 2023-10-06T04:37:05.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.108+0000 7f137aa9b700 1 -- 172.21.15.8:0/2049213373 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1374150e70 con 0x7f13740af7e0 2023-10-06T04:37:05.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.108+0000 7f1370ff9700 1 -- 172.21.15.8:0/2049213373 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1364011ab0 con 0x7f13740af7e0 2023-10-06T04:37:05.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.108+0000 7f137aa9b700 1 -- 172.21.15.8:0/2049213373 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1374151430 con 0x7f13740af7e0 2023-10-06T04:37:05.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.108+0000 7f137aa9b700 1 -- 172.21.15.8:0/2049213373 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1374071550 con 0x7f13740af7e0 2023-10-06T04:37:05.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.109+0000 7f1370ff9700 1 -- 172.21.15.8:0/2049213373 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f136401b3b0 con 0x7f13740af7e0 2023-10-06T04:37:05.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.109+0000 7f1370ff9700 1 --2- 172.21.15.8:0/2049213373 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1354066f30 0x7f13540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:05.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.109+0000 7f1370ff9700 1 -- 172.21.15.8:0/2049213373 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f1364083f50 con 0x7f13740af7e0 2023-10-06T04:37:05.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.110+0000 7f1378837700 1 --2- 172.21.15.8:0/2049213373 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1354066f30 0x7f13540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:05.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.110+0000 7f1378837700 1 --2- 172.21.15.8:0/2049213373 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1354066f30 0x7f13540693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f136c0097c0 tx=0x7f136c019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:05.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.114+0000 7f1370ff9700 1 -- 172.21.15.8:0/2049213373 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1364050d30 con 0x7f13740af7e0 2023-10-06T04:37:05.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.354+0000 7f137aa9b700 1 -- 172.21.15.8:0/2049213373 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f13740ce090 con 0x7f13740af7e0 2023-10-06T04:37:05.357 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-06T04:37:05.355+0000 7f590ad7d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T04:37:05.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.358+0000 7f1370ff9700 1 -- 172.21.15.8:0/2049213373 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1364017070 con 0x7f13740af7e0 2023-10-06T04:37:05.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.361+0000 7f137aa9b700 1 -- 172.21.15.8:0/2049213373 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1354066f30 msgr2=0x7f13540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:05.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.361+0000 7f137aa9b700 1 --2- 172.21.15.8:0/2049213373 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1354066f30 0x7f13540693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f136c0097c0 tx=0x7f136c019000 comp rx=0 tx=0).stop 2023-10-06T04:37:05.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.361+0000 7f137aa9b700 1 -- 172.21.15.8:0/2049213373 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13740af7e0 msgr2=0x7f13740c8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:05.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.361+0000 7f137aa9b700 1 --2- 172.21.15.8:0/2049213373 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13740af7e0 0x7f13740c8a50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f136400c590 tx=0x7f136400c950 comp rx=0 tx=0).stop 2023-10-06T04:37:05.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.361+0000 7f137aa9b700 1 -- 172.21.15.8:0/2049213373 shutdown_connections 2023-10-06T04:37:05.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.361+0000 7f137aa9b700 1 --2- 172.21.15.8:0/2049213373 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1354066f30 0x7f13540693e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:05.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.361+0000 7f137aa9b700 1 --2- 172.21.15.8:0/2049213373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13740cd4c0 0x7f1374151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:05.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.361+0000 7f137aa9b700 1 --2- 172.21.15.8:0/2049213373 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13740af410 0x7f13740b5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:05.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.361+0000 7f137aa9b700 1 --2- 172.21.15.8:0/2049213373 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13740af7e0 0x7f13740c8a50 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:05.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.361+0000 7f137aa9b700 1 -- 172.21.15.8:0/2049213373 >> 172.21.15.8:0/2049213373 conn(0x7f1374069890 msgr2=0x7f13740b1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:05.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.361+0000 7f137aa9b700 1 -- 172.21.15.8:0/2049213373 shutdown_connections 2023-10-06T04:37:05.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.361+0000 7f137aa9b700 1 -- 172.21.15.8:0/2049213373 wait complete. 2023-10-06T04:37:05.365 INFO:teuthology.orchestra.run.smithi008.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T04:37:05.365 INFO:tasks.ceph.mds.d.smithi184.stderr: -4990> 2023-10-06T04:36:11.281+0000 7f9ba77ca700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-06T04:37:05.365 INFO:tasks.ceph.mds.d.smithi184.stderr: -3737> 2023-10-06T04:36:22.301+0000 7f9ba17be700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T04:37:05.375 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T04:37:05.390 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-10-06T04:37:05.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.494+0000 7ff7043e6700 1 Processor -- start 2023-10-06T04:37:05.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.494+0000 7ff7043e6700 1 -- start start 2023-10-06T04:37:05.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.494+0000 7ff7043e6700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff6fc1430c0 0x7ff6fc0cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:05.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.495+0000 7ff7043e6700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff6fc0cfee0 0x7ff6fc0b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:05.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.495+0000 7ff7043e6700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6fc0cf510 con 0x7ff6fc142cf0 2023-10-06T04:37:05.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.495+0000 7ff7043e6700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6fc0ce6a0 con 0x7ff6fc1430c0 2023-10-06T04:37:05.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.495+0000 7ff7043e6700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6fc0ce900 con 0x7ff6fc0cfee0 2023-10-06T04:37:05.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.495+0000 7ff701981700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff6fc1430c0 0x7ff6fc0cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:05.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.495+0000 7ff702182700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ff6fc142cf0 0x7ff6fc0b5cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41082/0 (socket says 172.21.15.8:41082) 2023-10-06T04:37:05.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.495+0000 7ff702182700 1 -- 172.21.15.8:0/129529104 learned_addr learned my addr 172.21.15.8:0/129529104 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:05.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.495+0000 7ff702983700 1 --2- 172.21.15.8:0/129529104 >> v2:172.21.15.184:3300/0 conn(0x7ff6fc0cfee0 0x7ff6fc0b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:05.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.495+0000 7ff701981700 1 -- 172.21.15.8:0/129529104 >> v2:172.21.15.184:3300/0 conn(0x7ff6fc0cfee0 msgr2=0x7ff6fc0b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:05.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.495+0000 7ff701981700 1 --2- 172.21.15.8:0/129529104 >> v2:172.21.15.184:3300/0 conn(0x7ff6fc0cfee0 0x7ff6fc0b3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:05.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.495+0000 7ff701981700 1 -- 172.21.15.8:0/129529104 >> v1:172.21.15.8:6789/0 conn(0x7ff6fc142cf0 legacy=0x7ff6fc0b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:05.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.495+0000 7ff701981700 1 -- 172.21.15.8:0/129529104 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6fc0cebe0 con 0x7ff6fc1430c0 2023-10-06T04:37:05.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.495+0000 7ff701180700 1 -- 172.21.15.8:0/129529104 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1264626349 0 0) 0x7ff6fc0cf510 con 0x7ff6fc142cf0 2023-10-06T04:37:05.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.495+0000 7ff701981700 1 --2- 172.21.15.8:0/129529104 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6fc1430c0 0x7ff6fc0cf9a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0afa30 tx=0x7ff6f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a157944ef437bce0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:05.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.495+0000 7ff701180700 1 -- 172.21.15.8:0/129529104 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0011630 con 0x7ff6fc1430c0 2023-10-06T04:37:05.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.495+0000 7ff701180700 1 -- 172.21.15.8:0/129529104 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f0011790 con 0x7ff6fc1430c0 2023-10-06T04:37:05.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.495+0000 7ff701180700 1 -- 172.21.15.8:0/129529104 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0011b30 con 0x7ff6fc1430c0 2023-10-06T04:37:05.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.496+0000 7ff7043e6700 1 -- 172.21.15.8:0/129529104 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6fc1430c0 msgr2=0x7ff6fc0cf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:05.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.496+0000 7ff7043e6700 1 --2- 172.21.15.8:0/129529104 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6fc1430c0 0x7ff6fc0cf9a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0afa30 tx=0x7ff6f00091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:05.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.496+0000 7ff7043e6700 1 -- 172.21.15.8:0/129529104 shutdown_connections 2023-10-06T04:37:05.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.496+0000 7ff7043e6700 1 --2- 172.21.15.8:0/129529104 >> v2:172.21.15.184:3300/0 conn(0x7ff6fc0cfee0 0x7ff6fc0b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:05.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.496+0000 7ff7043e6700 1 --2- 172.21.15.8:0/129529104 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6fc1430c0 0x7ff6fc0cf9a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:05.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.496+0000 7ff7043e6700 1 -- 172.21.15.8:0/129529104 >> 172.21.15.8:0/129529104 conn(0x7ff6fc06ed00 msgr2=0x7ff6fc06f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:05.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.496+0000 7ff7043e6700 1 -- 172.21.15.8:0/129529104 shutdown_connections 2023-10-06T04:37:05.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.496+0000 7ff7043e6700 1 -- 172.21.15.8:0/129529104 wait complete. 2023-10-06T04:37:05.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.497+0000 7ff7043e6700 1 Processor -- start 2023-10-06T04:37:05.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.497+0000 7ff7043e6700 1 -- start start 2023-10-06T04:37:05.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.498+0000 7ff7043e6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6fc0cfee0 0x7ff6fc13f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:05.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.498+0000 7ff7043e6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6fc142cf0 0x7ff6fc0a9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:05.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.498+0000 7ff7043e6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff6fc1430c0 0x7ff6fc13e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:05.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.498+0000 7ff7043e6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc13f710 con 0x7ff6fc142cf0 2023-10-06T04:37:05.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.498+0000 7ff7043e6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc0a9860 con 0x7ff6fc0cfee0 2023-10-06T04:37:05.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.498+0000 7ff7043e6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc140510 con 0x7ff6fc1430c0 2023-10-06T04:37:05.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.498+0000 7ff701981700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6fc142cf0 0x7ff6fc0a9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:05.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.498+0000 7ff701981700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6fc142cf0 0x7ff6fc0a9320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49060/0 (socket says 172.21.15.8:49060) 2023-10-06T04:37:05.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.498+0000 7ff701981700 1 -- 172.21.15.8:0/3659352012 learned_addr learned my addr 172.21.15.8:0/3659352012 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:05.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.498+0000 7ff702182700 1 --2- 172.21.15.8:0/3659352012 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6fc0cfee0 0x7ff6fc13f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:05.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.498+0000 7ff702983700 1 --2- 172.21.15.8:0/3659352012 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff6fc1430c0 0x7ff6fc13e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:05.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.498+0000 7ff701981700 1 -- 172.21.15.8:0/3659352012 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff6fc1430c0 msgr2=0x7ff6fc13e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:05.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.498+0000 7ff701981700 1 --2- 172.21.15.8:0/3659352012 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff6fc1430c0 0x7ff6fc13e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:05.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.498+0000 7ff701981700 1 -- 172.21.15.8:0/3659352012 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6fc0cfee0 msgr2=0x7ff6fc13f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:05.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.498+0000 7ff701981700 1 --2- 172.21.15.8:0/3659352012 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6fc0cfee0 0x7ff6fc13f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:05.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.498+0000 7ff701981700 1 -- 172.21.15.8:0/3659352012 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f0009420 con 0x7ff6fc142cf0 2023-10-06T04:37:05.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.499+0000 7ff701981700 1 --2- 172.21.15.8:0/3659352012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6fc142cf0 0x7ff6fc0a9320 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0009f50 tx=0x7ff6f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:05.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.499+0000 7ff6fa7fc700 1 -- 172.21.15.8:0/3659352012 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0011900 con 0x7ff6fc142cf0 2023-10-06T04:37:05.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.499+0000 7ff6fa7fc700 1 -- 172.21.15.8:0/3659352012 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f0011a60 con 0x7ff6fc142cf0 2023-10-06T04:37:05.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.499+0000 7ff7043e6700 1 -- 172.21.15.8:0/3659352012 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6fc13f900 con 0x7ff6fc142cf0 2023-10-06T04:37:05.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.499+0000 7ff6fa7fc700 1 -- 172.21.15.8:0/3659352012 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0023640 con 0x7ff6fc142cf0 2023-10-06T04:37:05.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.499+0000 7ff7043e6700 1 -- 172.21.15.8:0/3659352012 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6fc1401a0 con 0x7ff6fc142cf0 2023-10-06T04:37:05.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.500+0000 7ff7043e6700 1 -- 172.21.15.8:0/3659352012 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6fc1406c0 con 0x7ff6fc142cf0 2023-10-06T04:37:05.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.500+0000 7ff6fa7fc700 1 -- 172.21.15.8:0/3659352012 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff6f00193b0 con 0x7ff6fc142cf0 2023-10-06T04:37:05.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.501+0000 7ff6fa7fc700 1 --2- 172.21.15.8:0/3659352012 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff6e8066f30 0x7ff6e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:05.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.501+0000 7ff6fa7fc700 1 -- 172.21.15.8:0/3659352012 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6953+0+0 (secure 0 0 0) 0x7ff6f0085d30 con 0x7ff6fc142cf0 2023-10-06T04:37:05.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.501+0000 7ff702182700 1 --2- 172.21.15.8:0/3659352012 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff6e8066f30 0x7ff6e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:05.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.501+0000 7ff702182700 1 --2- 172.21.15.8:0/3659352012 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff6e8066f30 0x7ff6e80693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4007fd0 tx=0x7ff6f4007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:05.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.505+0000 7ff6fa7fc700 1 -- 172.21.15.8:0/3659352012 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6fc1406c0 con 0x7ff6fc142cf0 2023-10-06T04:37:05.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:05.748+0000 7ff7043e6700 1 -- 172.21.15.8:0/3659352012 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff6fc140680 con 0x7ff6fc142cf0 2023-10-06T04:37:06.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.359+0000 7ff6fa7fc700 1 -- 172.21.15.8:0/3659352012 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff6f00150a0 con 0x7ff6fc142cf0 2023-10-06T04:37:06.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.361+0000 7ff7043e6700 1 -- 172.21.15.8:0/3659352012 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff6e8066f30 msgr2=0x7ff6e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:06.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.361+0000 7ff7043e6700 1 --2- 172.21.15.8:0/3659352012 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff6e8066f30 0x7ff6e80693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4007fd0 tx=0x7ff6f4007d30 comp rx=0 tx=0).stop 2023-10-06T04:37:06.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.361+0000 7ff7043e6700 1 -- 172.21.15.8:0/3659352012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6fc142cf0 msgr2=0x7ff6fc0a9320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:06.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.361+0000 7ff7043e6700 1 --2- 172.21.15.8:0/3659352012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6fc142cf0 0x7ff6fc0a9320 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0009f50 tx=0x7ff6f0017000 comp rx=0 tx=0).stop 2023-10-06T04:37:06.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.361+0000 7ff7043e6700 1 -- 172.21.15.8:0/3659352012 shutdown_connections 2023-10-06T04:37:06.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.361+0000 7ff7043e6700 1 --2- 172.21.15.8:0/3659352012 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff6e8066f30 0x7ff6e80693e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:06.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.361+0000 7ff7043e6700 1 --2- 172.21.15.8:0/3659352012 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff6fc1430c0 0x7ff6fc13e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:06.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.361+0000 7ff7043e6700 1 --2- 172.21.15.8:0/3659352012 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6fc0cfee0 0x7ff6fc13f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:06.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.361+0000 7ff7043e6700 1 --2- 172.21.15.8:0/3659352012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6fc142cf0 0x7ff6fc0a9320 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:06.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.361+0000 7ff7043e6700 1 -- 172.21.15.8:0/3659352012 >> 172.21.15.8:0/3659352012 conn(0x7ff6fc06ed00 msgr2=0x7ff6fc0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:06.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.361+0000 7ff7043e6700 1 -- 172.21.15.8:0/3659352012 shutdown_connections 2023-10-06T04:37:06.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.361+0000 7ff7043e6700 1 -- 172.21.15.8:0/3659352012 wait complete. 2023-10-06T04:37:06.378 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T04:37:06.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.503+0000 7fc2b3216700 1 Processor -- start 2023-10-06T04:37:06.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.503+0000 7fc2b3216700 1 -- start start 2023-10-06T04:37:06.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.504+0000 7fc2b3216700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc2ac0cd530 0x7fc2ac15d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:06.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.504+0000 7fc2b3216700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2ac0ce820 con 0x7fc2ac0af970 2023-10-06T04:37:06.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.504+0000 7fc2b3216700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2ac15da30 con 0x7fc2ac0af5a0 2023-10-06T04:37:06.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.504+0000 7fc2b3216700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2ac15e2d0 con 0x7fc2ac0cd530 2023-10-06T04:37:06.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.504+0000 7fc2b17b3700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fc2ac0af970 0x7fc2ac0cecb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41096/0 (socket says 172.21.15.8:41096) 2023-10-06T04:37:06.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.504+0000 7fc2b17b3700 1 -- 172.21.15.8:0/3419729565 learned_addr learned my addr 172.21.15.8:0/3419729565 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:06.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.504+0000 7fc2abfff700 1 --2- 172.21.15.8:0/3419729565 >> v2:172.21.15.184:3300/0 conn(0x7fc2ac0cd530 0x7fc2ac15d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:06.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.505+0000 7fc2ab7fe700 1 -- 172.21.15.8:0/3419729565 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 39477031 0 0) 0x7fc2ac0ce820 con 0x7fc2ac0af970 2023-10-06T04:37:06.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.505+0000 7fc2ab7fe700 1 -- 172.21.15.8:0/3419729565 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc294003570 con 0x7fc2ac0af970 2023-10-06T04:37:06.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.505+0000 7fc2abfff700 1 -- 172.21.15.8:0/3419729565 >> v1:172.21.15.184:6789/0 conn(0x7fc2ac0af5a0 legacy=0x7fc2ac0cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:06.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.505+0000 7fc2abfff700 1 -- 172.21.15.8:0/3419729565 >> v1:172.21.15.8:6789/0 conn(0x7fc2ac0af970 legacy=0x7fc2ac0cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:06.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.505+0000 7fc2abfff700 1 -- 172.21.15.8:0/3419729565 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ac15dd10 con 0x7fc2ac0cd530 2023-10-06T04:37:06.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.505+0000 7fc2abfff700 1 --2- 172.21.15.8:0/3419729565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2ac0cd530 0x7fc2ac15d330 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc2a00098e0 tx=0x7fc2a00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f2e085e71981ea2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:06.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.505+0000 7fc2ab7fe700 1 -- 172.21.15.8:0/3419729565 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a000b640 con 0x7fc2ac0cd530 2023-10-06T04:37:06.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.505+0000 7fc2ab7fe700 1 -- 172.21.15.8:0/3419729565 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a000b7a0 con 0x7fc2ac0cd530 2023-10-06T04:37:06.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.505+0000 7fc2ab7fe700 1 -- 172.21.15.8:0/3419729565 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a000bb40 con 0x7fc2ac0cd530 2023-10-06T04:37:06.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.506+0000 7fc2b3216700 1 -- 172.21.15.8:0/3419729565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2ac0cd530 msgr2=0x7fc2ac15d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:06.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.506+0000 7fc2b3216700 1 --2- 172.21.15.8:0/3419729565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2ac0cd530 0x7fc2ac15d330 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc2a00098e0 tx=0x7fc2a00091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:06.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.506+0000 7fc2b3216700 1 -- 172.21.15.8:0/3419729565 shutdown_connections 2023-10-06T04:37:06.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.506+0000 7fc2b3216700 1 --2- 172.21.15.8:0/3419729565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2ac0cd530 0x7fc2ac15d330 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:06.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.506+0000 7fc2b3216700 1 -- 172.21.15.8:0/3419729565 >> 172.21.15.8:0/3419729565 conn(0x7fc2ac06ed00 msgr2=0x7fc2ac06f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:06.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.506+0000 7fc2b3216700 1 -- 172.21.15.8:0/3419729565 shutdown_connections 2023-10-06T04:37:06.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.506+0000 7fc2b3216700 1 -- 172.21.15.8:0/3419729565 wait complete. 2023-10-06T04:37:06.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.507+0000 7fc2b3216700 1 Processor -- start 2023-10-06T04:37:06.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.507+0000 7fc2b3216700 1 -- start start 2023-10-06T04:37:06.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.508+0000 7fc2b3216700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2ac0af5a0 0x7fc2ac146270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:06.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.508+0000 7fc2b3216700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2ac0af970 0x7fc2ac0b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:06.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.508+0000 7fc2b3216700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2ac0cd530 0x7fc2ac0b0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:06.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.508+0000 7fc2b3216700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac0b1230 con 0x7fc2ac0af5a0 2023-10-06T04:37:06.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.508+0000 7fc2b3216700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac151380 con 0x7fc2ac0cd530 2023-10-06T04:37:06.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.508+0000 7fc2b3216700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac0b0b50 con 0x7fc2ac0af970 2023-10-06T04:37:06.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.508+0000 7fc2b0fb2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2ac0af5a0 0x7fc2ac146270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:06.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.508+0000 7fc2b0fb2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2ac0af5a0 0x7fc2ac146270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49066/0 (socket says 172.21.15.8:49066) 2023-10-06T04:37:06.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.508+0000 7fc2b0fb2700 1 -- 172.21.15.8:0/484585276 learned_addr learned my addr 172.21.15.8:0/484585276 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:06.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.508+0000 7fc2b17b3700 1 --2- 172.21.15.8:0/484585276 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2ac0cd530 0x7fc2ac0b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:06.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.508+0000 7fc2abfff700 1 --2- 172.21.15.8:0/484585276 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2ac0af970 0x7fc2ac0b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:06.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.508+0000 7fc2b0fb2700 1 -- 172.21.15.8:0/484585276 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2ac0af970 msgr2=0x7fc2ac0b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:06.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.508+0000 7fc2b0fb2700 1 --2- 172.21.15.8:0/484585276 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2ac0af970 0x7fc2ac0b31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:06.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.508+0000 7fc2b0fb2700 1 -- 172.21.15.8:0/484585276 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2ac0cd530 msgr2=0x7fc2ac0b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:06.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.508+0000 7fc2b0fb2700 1 --2- 172.21.15.8:0/484585276 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2ac0cd530 0x7fc2ac0b0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:06.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.508+0000 7fc2b0fb2700 1 -- 172.21.15.8:0/484585276 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a0009420 con 0x7fc2ac0af5a0 2023-10-06T04:37:06.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.508+0000 7fc2b0fb2700 1 --2- 172.21.15.8:0/484585276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2ac0af5a0 0x7fc2ac146270 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc29c00c4e0 tx=0x7fc29c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:06.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.509+0000 7fc2a8ff9700 1 -- 172.21.15.8:0/484585276 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c011590 con 0x7fc2ac0af5a0 2023-10-06T04:37:06.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.509+0000 7fc2a8ff9700 1 -- 172.21.15.8:0/484585276 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29c011710 con 0x7fc2ac0af5a0 2023-10-06T04:37:06.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.509+0000 7fc2b3216700 1 -- 172.21.15.8:0/484585276 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2ac0b0e30 con 0x7fc2ac0af5a0 2023-10-06T04:37:06.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.509+0000 7fc2a8ff9700 1 -- 172.21.15.8:0/484585276 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c011ad0 con 0x7fc2ac0af5a0 2023-10-06T04:37:06.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.509+0000 7fc2b3216700 1 -- 172.21.15.8:0/484585276 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2ac0b1760 con 0x7fc2ac0af5a0 2023-10-06T04:37:06.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.509+0000 7fc2b3216700 1 -- 172.21.15.8:0/484585276 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2ac071550 con 0x7fc2ac0af5a0 2023-10-06T04:37:06.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.510+0000 7fc2a8ff9700 1 -- 172.21.15.8:0/484585276 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc29c01b3b0 con 0x7fc2ac0af5a0 2023-10-06T04:37:06.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.510+0000 7fc2a8ff9700 1 --2- 172.21.15.8:0/484585276 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc298066f30 0x7fc2980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:06.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.511+0000 7fc2a8ff9700 1 -- 172.21.15.8:0/484585276 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6953+0+0 (secure 0 0 0) 0x7fc29c083f50 con 0x7fc2ac0af5a0 2023-10-06T04:37:06.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.511+0000 7fc2abfff700 1 --2- 172.21.15.8:0/484585276 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc298066f30 0x7fc2980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:06.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.511+0000 7fc2abfff700 1 --2- 172.21.15.8:0/484585276 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc298066f30 0x7fc2980693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac0cd950 tx=0x7fc2a0017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:06.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.515+0000 7fc2a8ff9700 1 -- 172.21.15.8:0/484585276 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc29c050ce0 con 0x7fc2ac0af5a0 2023-10-06T04:37:06.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:06.708+0000 7fc2b3216700 1 -- 172.21.15.8:0/484585276 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc2ac151690 con 0x7fc2ac0af5a0 2023-10-06T04:37:07.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.361+0000 7fc2a8ff9700 1 -- 172.21.15.8:0/484585276 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc29c017070 con 0x7fc2ac0af5a0 2023-10-06T04:37:07.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.365+0000 7fc2b3216700 1 -- 172.21.15.8:0/484585276 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc298066f30 msgr2=0x7fc2980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:07.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.365+0000 7fc2b3216700 1 --2- 172.21.15.8:0/484585276 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc298066f30 0x7fc2980693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac0cd950 tx=0x7fc2a0017000 comp rx=0 tx=0).stop 2023-10-06T04:37:07.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.365+0000 7fc2b3216700 1 -- 172.21.15.8:0/484585276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2ac0af5a0 msgr2=0x7fc2ac146270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:07.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.365+0000 7fc2b3216700 1 --2- 172.21.15.8:0/484585276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2ac0af5a0 0x7fc2ac146270 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc29c00c4e0 tx=0x7fc29c00c8a0 comp rx=0 tx=0).stop 2023-10-06T04:37:07.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.365+0000 7fc2b3216700 1 -- 172.21.15.8:0/484585276 shutdown_connections 2023-10-06T04:37:07.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.365+0000 7fc2b3216700 1 --2- 172.21.15.8:0/484585276 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc298066f30 0x7fc2980693e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:07.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.365+0000 7fc2b3216700 1 --2- 172.21.15.8:0/484585276 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2ac0cd530 0x7fc2ac0b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:07.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.365+0000 7fc2b3216700 1 --2- 172.21.15.8:0/484585276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2ac0af5a0 0x7fc2ac146270 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:07.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.365+0000 7fc2b3216700 1 --2- 172.21.15.8:0/484585276 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2ac0af970 0x7fc2ac0b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:07.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.365+0000 7fc2b3216700 1 -- 172.21.15.8:0/484585276 >> 172.21.15.8:0/484585276 conn(0x7fc2ac06ed00 msgr2=0x7fc2ac15bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:07.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.366+0000 7fc2b3216700 1 -- 172.21.15.8:0/484585276 shutdown_connections 2023-10-06T04:37:07.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.366+0000 7fc2b3216700 1 -- 172.21.15.8:0/484585276 wait complete. 2023-10-06T04:37:07.369 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_metadata' removed 2023-10-06T04:37:07.383 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T04:37:07.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.509+0000 7f6cc77f5700 1 Processor -- start 2023-10-06T04:37:07.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.509+0000 7f6cc77f5700 1 -- start start 2023-10-06T04:37:07.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.510+0000 7f6cc77f5700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6cc00acdf0 0x7f6cc01579a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:07.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.510+0000 7f6cc77f5700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6cc0157ee0 0x7f6cc00c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:07.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.510+0000 7f6cc77f5700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cc00ca490 con 0x7f6cc00ca030 2023-10-06T04:37:07.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.510+0000 7f6cc77f5700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cc01589a0 con 0x7f6cc0157ee0 2023-10-06T04:37:07.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.510+0000 7f6cc77f5700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc0151ea0 con 0x7f6cc00acdf0 2023-10-06T04:37:07.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.510+0000 7f6cc4d90700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6cc0157ee0 0x7f6cc00c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:07.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.510+0000 7f6cc4d90700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6cc0157ee0 0x7f6cc00c9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49068/0 (socket says 172.21.15.8:49068) 2023-10-06T04:37:07.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.510+0000 7f6cc4d90700 1 -- 172.21.15.8:0/799437464 learned_addr learned my addr 172.21.15.8:0/799437464 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:07.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.510+0000 7f6cc5591700 1 --2- 172.21.15.8:0/799437464 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6cc00acdf0 0x7f6cc01579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:07.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.511+0000 7f6cc4d90700 1 -- 172.21.15.8:0/799437464 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6cc00acdf0 msgr2=0x7f6cc01579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:07.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.511+0000 7f6cc4d90700 1 --2- 172.21.15.8:0/799437464 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6cc00acdf0 0x7f6cc01579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:07.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.511+0000 7f6cc4d90700 1 -- 172.21.15.8:0/799437464 >> v1:172.21.15.184:6789/0 conn(0x7f6cc00ca030 legacy=0x7f6cc006a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:07.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.511+0000 7f6cc4d90700 1 -- 172.21.15.8:0/799437464 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc015b510 con 0x7f6cc0157ee0 2023-10-06T04:37:07.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.511+0000 7f6cc4d90700 1 --2- 172.21.15.8:0/799437464 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc0157ee0 0x7f6cc00c9af0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4009990 tx=0x7f6cb4009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f105178e468a840e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:07.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.511+0000 7f6cbffff700 1 -- 172.21.15.8:0/799437464 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb4005c10 con 0x7f6cc0157ee0 2023-10-06T04:37:07.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.511+0000 7f6cbffff700 1 -- 172.21.15.8:0/799437464 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb4005d70 con 0x7f6cc0157ee0 2023-10-06T04:37:07.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.511+0000 7f6cbffff700 1 -- 172.21.15.8:0/799437464 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb400b840 con 0x7f6cc0157ee0 2023-10-06T04:37:07.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.511+0000 7f6cc77f5700 1 -- 172.21.15.8:0/799437464 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc0157ee0 msgr2=0x7f6cc00c9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:07.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.511+0000 7f6cc77f5700 1 --2- 172.21.15.8:0/799437464 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc0157ee0 0x7f6cc00c9af0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4009990 tx=0x7f6cb4009220 comp rx=0 tx=0).stop 2023-10-06T04:37:07.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.511+0000 7f6cc77f5700 1 -- 172.21.15.8:0/799437464 shutdown_connections 2023-10-06T04:37:07.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.511+0000 7f6cc77f5700 1 --2- 172.21.15.8:0/799437464 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6cc00acdf0 0x7f6cc01579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:07.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.511+0000 7f6cc77f5700 1 --2- 172.21.15.8:0/799437464 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc0157ee0 0x7f6cc00c9af0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:07.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.511+0000 7f6cc77f5700 1 -- 172.21.15.8:0/799437464 >> 172.21.15.8:0/799437464 conn(0x7f6cc00686e0 msgr2=0x7f6cc0068ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:07.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.512+0000 7f6cc77f5700 1 -- 172.21.15.8:0/799437464 shutdown_connections 2023-10-06T04:37:07.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.512+0000 7f6cc77f5700 1 -- 172.21.15.8:0/799437464 wait complete. 2023-10-06T04:37:07.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.513+0000 7f6cc77f5700 1 Processor -- start 2023-10-06T04:37:07.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.513+0000 7f6cc77f5700 1 -- start start 2023-10-06T04:37:07.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.513+0000 7f6cc77f5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc00acdf0 0x7f6cc00c2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:07.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.514+0000 7f6cc77f5700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6cc00ca030 0x7f6cc00c2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:07.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.514+0000 7f6cc77f5700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cc0157ee0 0x7f6cc01596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:07.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.514+0000 7f6cc77f5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc014ce50 con 0x7f6cc00acdf0 2023-10-06T04:37:07.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.514+0000 7f6cc77f5700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc00c3760 con 0x7f6cc0157ee0 2023-10-06T04:37:07.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.514+0000 7f6cc77f5700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc00c3a40 con 0x7f6cc00ca030 2023-10-06T04:37:07.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.514+0000 7f6cc5591700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc00acdf0 0x7f6cc00c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:07.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.514+0000 7f6cc5591700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc00acdf0 0x7f6cc00c2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49082/0 (socket says 172.21.15.8:49082) 2023-10-06T04:37:07.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.514+0000 7f6cc5591700 1 -- 172.21.15.8:0/4256367932 learned_addr learned my addr 172.21.15.8:0/4256367932 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:07.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.514+0000 7f6cc5591700 1 -- 172.21.15.8:0/4256367932 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6cc00ca030 msgr2=0x7f6cc00c2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:07.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.514+0000 7f6cc5591700 1 --2- 172.21.15.8:0/4256367932 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6cc00ca030 0x7f6cc00c2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:07.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.514+0000 7f6cc5591700 1 -- 172.21.15.8:0/4256367932 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cc0157ee0 msgr2=0x7f6cc01596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:07.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.514+0000 7f6cc5591700 1 --2- 172.21.15.8:0/4256367932 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cc0157ee0 0x7f6cc01596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:07.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.514+0000 7f6cc5591700 1 -- 172.21.15.8:0/4256367932 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb4009480 con 0x7f6cc00acdf0 2023-10-06T04:37:07.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.514+0000 7f6cc5591700 1 --2- 172.21.15.8:0/4256367932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc00acdf0 0x7f6cc00c2950 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000e190 tx=0x7f6cb0009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:07.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.514+0000 7f6cbd7fa700 1 -- 172.21.15.8:0/4256367932 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb000ee30 con 0x7f6cc00acdf0 2023-10-06T04:37:07.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.514+0000 7f6cbd7fa700 1 -- 172.21.15.8:0/4256367932 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb0014420 con 0x7f6cc00acdf0 2023-10-06T04:37:07.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.514+0000 7f6cc77f5700 1 -- 172.21.15.8:0/4256367932 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cc0158bd0 con 0x7f6cc00acdf0 2023-10-06T04:37:07.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.514+0000 7f6cbd7fa700 1 -- 172.21.15.8:0/4256367932 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb00147e0 con 0x7f6cc00acdf0 2023-10-06T04:37:07.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.514+0000 7f6cc77f5700 1 -- 172.21.15.8:0/4256367932 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cc0159190 con 0x7f6cc00acdf0 2023-10-06T04:37:07.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.515+0000 7f6cc77f5700 1 -- 172.21.15.8:0/4256367932 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cc0071550 con 0x7f6cc00acdf0 2023-10-06T04:37:07.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.516+0000 7f6cbd7fa700 1 -- 172.21.15.8:0/4256367932 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6cb0014b90 con 0x7f6cc00acdf0 2023-10-06T04:37:07.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.516+0000 7f6cbd7fa700 1 --2- 172.21.15.8:0/4256367932 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6cac066f30 0x7f6cac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:07.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.516+0000 7f6cbd7fa700 1 -- 172.21.15.8:0/4256367932 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6515+0+0 (secure 0 0 0) 0x7f6cb00850c0 con 0x7f6cc00acdf0 2023-10-06T04:37:07.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.516+0000 7f6cc4d90700 1 --2- 172.21.15.8:0/4256367932 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6cac066f30 0x7f6cac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:07.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.517+0000 7f6cc4d90700 1 --2- 172.21.15.8:0/4256367932 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6cac066f30 0x7f6cac0693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0158310 tx=0x7f6cb4015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:07.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.520+0000 7f6cbd7fa700 1 -- 172.21.15.8:0/4256367932 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6cb0052000 con 0x7f6cc00acdf0 2023-10-06T04:37:07.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:07.717+0000 7f6cc77f5700 1 -- 172.21.15.8:0/4256367932 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6cc01583e0 con 0x7f6cc00acdf0 2023-10-06T04:37:08.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.367+0000 7f6cbd7fa700 1 -- 172.21.15.8:0/4256367932 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6cb0055620 con 0x7f6cc00acdf0 2023-10-06T04:37:08.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.371+0000 7f6cc77f5700 1 -- 172.21.15.8:0/4256367932 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6cac066f30 msgr2=0x7f6cac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:08.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.371+0000 7f6cc77f5700 1 --2- 172.21.15.8:0/4256367932 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6cac066f30 0x7f6cac0693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0158310 tx=0x7f6cb4015000 comp rx=0 tx=0).stop 2023-10-06T04:37:08.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.371+0000 7f6cc77f5700 1 -- 172.21.15.8:0/4256367932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc00acdf0 msgr2=0x7f6cc00c2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:08.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.371+0000 7f6cc77f5700 1 --2- 172.21.15.8:0/4256367932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc00acdf0 0x7f6cc00c2950 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000e190 tx=0x7f6cb0009920 comp rx=0 tx=0).stop 2023-10-06T04:37:08.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.371+0000 7f6cc77f5700 1 -- 172.21.15.8:0/4256367932 shutdown_connections 2023-10-06T04:37:08.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.371+0000 7f6cc77f5700 1 --2- 172.21.15.8:0/4256367932 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6cac066f30 0x7f6cac0693e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:08.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.371+0000 7f6cc77f5700 1 --2- 172.21.15.8:0/4256367932 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cc0157ee0 0x7f6cc01596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:08.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.371+0000 7f6cc77f5700 1 --2- 172.21.15.8:0/4256367932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc00acdf0 0x7f6cc00c2950 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:08.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.371+0000 7f6cc77f5700 1 --2- 172.21.15.8:0/4256367932 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6cc00ca030 0x7f6cc00c2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:08.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.371+0000 7f6cc77f5700 1 -- 172.21.15.8:0/4256367932 >> 172.21.15.8:0/4256367932 conn(0x7f6cc00686e0 msgr2=0x7f6cc006af30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:08.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.372+0000 7f6cc77f5700 1 -- 172.21.15.8:0/4256367932 shutdown_connections 2023-10-06T04:37:08.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.372+0000 7f6cc77f5700 1 -- 172.21.15.8:0/4256367932 wait complete. 2023-10-06T04:37:08.376 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_data' removed 2023-10-06T04:37:08.390 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-10-06T04:37:08.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.515+0000 7f4c565b9700 1 Processor -- start 2023-10-06T04:37:08.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.515+0000 7f4c565b9700 1 -- start start 2023-10-06T04:37:08.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.516+0000 7f4c565b9700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4c500af5a0 0x7f4c5015d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:08.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.516+0000 7f4c565b9700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c5015e2b0 con 0x7f4c500af970 2023-10-06T04:37:08.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.516+0000 7f4c565b9700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c500ce800 con 0x7f4c500cd210 2023-10-06T04:37:08.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.516+0000 7f4c565b9700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c5015da10 con 0x7f4c500af5a0 2023-10-06T04:37:08.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.516+0000 7f4c4ffff700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4c500af5a0 0x7f4c5015d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:08.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.516+0000 7f4c4f7fe700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f4c500af970 0x7f4c500ccb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41098/0 (socket says 172.21.15.8:41098) 2023-10-06T04:37:08.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.516+0000 7f4c4f7fe700 1 -- 172.21.15.8:0/1863530705 learned_addr learned my addr 172.21.15.8:0/1863530705 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:08.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.516+0000 7f4c4ffff700 1 -- 172.21.15.8:0/1863530705 >> v1:172.21.15.184:6789/0 conn(0x7f4c500cd210 legacy=0x7f4c500cec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:08.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.516+0000 7f4c4ffff700 1 -- 172.21.15.8:0/1863530705 >> v1:172.21.15.8:6789/0 conn(0x7f4c500af970 legacy=0x7f4c500ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:08.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.516+0000 7f4c4effd700 1 -- 172.21.15.8:0/1863530705 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3212771100 0 0) 0x7f4c5015e2b0 con 0x7f4c500af970 2023-10-06T04:37:08.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.516+0000 7f4c4ffff700 1 -- 172.21.15.8:0/1863530705 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c5015dcf0 con 0x7f4c500af5a0 2023-10-06T04:37:08.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.516+0000 7f4c4ffff700 1 --2- 172.21.15.8:0/1863530705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c500af5a0 0x7f4c5015d330 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4c400098e0 tx=0x7f4c400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c5d72ed64efc82 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:08.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.517+0000 7f4c4effd700 1 -- 172.21.15.8:0/1863530705 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c40009e80 con 0x7f4c500af5a0 2023-10-06T04:37:08.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.517+0000 7f4c4effd700 1 -- 172.21.15.8:0/1863530705 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4000b820 con 0x7f4c500af5a0 2023-10-06T04:37:08.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.517+0000 7f4c4effd700 1 -- 172.21.15.8:0/1863530705 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4000bba0 con 0x7f4c500af5a0 2023-10-06T04:37:08.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.517+0000 7f4c565b9700 1 -- 172.21.15.8:0/1863530705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c500af5a0 msgr2=0x7f4c5015d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:08.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.517+0000 7f4c565b9700 1 --2- 172.21.15.8:0/1863530705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c500af5a0 0x7f4c5015d330 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4c400098e0 tx=0x7f4c400091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:08.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.517+0000 7f4c565b9700 1 -- 172.21.15.8:0/1863530705 shutdown_connections 2023-10-06T04:37:08.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.517+0000 7f4c565b9700 1 --2- 172.21.15.8:0/1863530705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c500af5a0 0x7f4c5015d330 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:08.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.517+0000 7f4c565b9700 1 -- 172.21.15.8:0/1863530705 >> 172.21.15.8:0/1863530705 conn(0x7f4c5006ed00 msgr2=0x7f4c5006f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:08.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.517+0000 7f4c565b9700 1 -- 172.21.15.8:0/1863530705 shutdown_connections 2023-10-06T04:37:08.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.517+0000 7f4c565b9700 1 -- 172.21.15.8:0/1863530705 wait complete. 2023-10-06T04:37:08.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.518+0000 7f4c565b9700 1 Processor -- start 2023-10-06T04:37:08.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.518+0000 7f4c565b9700 1 -- start start 2023-10-06T04:37:08.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.519+0000 7f4c565b9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c500af5a0 0x7f4c50146400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:08.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.519+0000 7f4c565b9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c500af970 0x7f4c50159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:08.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.519+0000 7f4c565b9700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4c500cd210 0x7f4c500b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:08.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.519+0000 7f4c565b9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c500b4820 con 0x7f4c500af5a0 2023-10-06T04:37:08.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.519+0000 7f4c565b9700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c500b4210 con 0x7f4c500af970 2023-10-06T04:37:08.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.519+0000 7f4c565b9700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5015a7f0 con 0x7f4c500cd210 2023-10-06T04:37:08.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.519+0000 7f4c4ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c500af5a0 0x7f4c50146400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:08.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.519+0000 7f4c4ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c500af5a0 0x7f4c50146400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49106/0 (socket says 172.21.15.8:49106) 2023-10-06T04:37:08.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.519+0000 7f4c4ffff700 1 -- 172.21.15.8:0/3087614598 learned_addr learned my addr 172.21.15.8:0/3087614598 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:08.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.519+0000 7f4c4f7fe700 1 --2- 172.21.15.8:0/3087614598 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c500af970 0x7f4c50159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:08.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.519+0000 7f4c54b56700 1 --2- 172.21.15.8:0/3087614598 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4c500cd210 0x7f4c500b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:08.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.520+0000 7f4c4ffff700 1 -- 172.21.15.8:0/3087614598 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4c500cd210 msgr2=0x7f4c500b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:08.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.520+0000 7f4c4ffff700 1 --2- 172.21.15.8:0/3087614598 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4c500cd210 0x7f4c500b4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:08.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.520+0000 7f4c4ffff700 1 -- 172.21.15.8:0/3087614598 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c500af970 msgr2=0x7f4c50159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:08.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.520+0000 7f4c4ffff700 1 --2- 172.21.15.8:0/3087614598 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c500af970 0x7f4c50159da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:08.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.520+0000 7f4c4ffff700 1 -- 172.21.15.8:0/3087614598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c40009420 con 0x7f4c500af5a0 2023-10-06T04:37:08.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.520+0000 7f4c54b56700 1 --2- 172.21.15.8:0/3087614598 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4c500cd210 0x7f4c500b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:08.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.520+0000 7f4c4ffff700 1 --2- 172.21.15.8:0/3087614598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c500af5a0 0x7f4c50146400 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4c400030c0 tx=0x7f4c40016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:08.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.520+0000 7f4c37fff700 1 -- 172.21.15.8:0/3087614598 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4000ba10 con 0x7f4c500af5a0 2023-10-06T04:37:08.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.520+0000 7f4c37fff700 1 -- 172.21.15.8:0/3087614598 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c40020070 con 0x7f4c500af5a0 2023-10-06T04:37:08.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.520+0000 7f4c565b9700 1 -- 172.21.15.8:0/3087614598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c5015aad0 con 0x7f4c500af5a0 2023-10-06T04:37:08.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.520+0000 7f4c37fff700 1 -- 172.21.15.8:0/3087614598 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4001b6a0 con 0x7f4c500af5a0 2023-10-06T04:37:08.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.520+0000 7f4c565b9700 1 -- 172.21.15.8:0/3087614598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c500b3ec0 con 0x7f4c500af5a0 2023-10-06T04:37:08.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.521+0000 7f4c565b9700 1 -- 172.21.15.8:0/3087614598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c500b4b00 con 0x7f4c500af5a0 2023-10-06T04:37:08.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.522+0000 7f4c37fff700 1 -- 172.21.15.8:0/3087614598 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4c40022030 con 0x7f4c500af5a0 2023-10-06T04:37:08.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.522+0000 7f4c37fff700 1 --2- 172.21.15.8:0/3087614598 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4c3c066f30 0x7f4c3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:08.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.522+0000 7f4c37fff700 1 -- 172.21.15.8:0/3087614598 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6043+0+0 (secure 0 0 0) 0x7f4c40086ba0 con 0x7f4c500af5a0 2023-10-06T04:37:08.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.522+0000 7f4c4f7fe700 1 --2- 172.21.15.8:0/3087614598 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4c3c066f30 0x7f4c3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:08.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.523+0000 7f4c4f7fe700 1 --2- 172.21.15.8:0/3087614598 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4c3c066f30 0x7f4c3c0693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4c500b62e0 tx=0x7f4c44009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:08.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.526+0000 7f4c37fff700 1 -- 172.21.15.8:0/3087614598 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c40086e60 con 0x7f4c500af5a0 2023-10-06T04:37:08.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:08.717+0000 7f4c565b9700 1 -- 172.21.15.8:0/3087614598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4c500b4670 con 0x7f4c500af5a0 2023-10-06T04:37:09.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.372+0000 7f4c37fff700 1 -- 172.21.15.8:0/3087614598 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) v1 ==== 178+0+0 (secure 0 0 0) 0x7f4c40053d40 con 0x7f4c500af5a0 2023-10-06T04:37:09.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.376+0000 7f4c565b9700 1 -- 172.21.15.8:0/3087614598 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4c3c066f30 msgr2=0x7f4c3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:09.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.376+0000 7f4c565b9700 1 --2- 172.21.15.8:0/3087614598 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4c3c066f30 0x7f4c3c0693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4c500b62e0 tx=0x7f4c44009040 comp rx=0 tx=0).stop 2023-10-06T04:37:09.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.376+0000 7f4c565b9700 1 -- 172.21.15.8:0/3087614598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c500af5a0 msgr2=0x7f4c50146400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:09.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.376+0000 7f4c565b9700 1 --2- 172.21.15.8:0/3087614598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c500af5a0 0x7f4c50146400 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4c400030c0 tx=0x7f4c40016000 comp rx=0 tx=0).stop 2023-10-06T04:37:09.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.376+0000 7f4c565b9700 1 -- 172.21.15.8:0/3087614598 shutdown_connections 2023-10-06T04:37:09.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.376+0000 7f4c565b9700 1 --2- 172.21.15.8:0/3087614598 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4c3c066f30 0x7f4c3c0693e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:09.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.376+0000 7f4c565b9700 1 --2- 172.21.15.8:0/3087614598 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4c500cd210 0x7f4c500b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:09.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.376+0000 7f4c565b9700 1 --2- 172.21.15.8:0/3087614598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c500af5a0 0x7f4c50146400 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:09.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.376+0000 7f4c565b9700 1 --2- 172.21.15.8:0/3087614598 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c500af970 0x7f4c50159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:09.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.376+0000 7f4c565b9700 1 -- 172.21.15.8:0/3087614598 >> 172.21.15.8:0/3087614598 conn(0x7f4c5006ed00 msgr2=0x7f4c500cefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:09.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.377+0000 7f4c565b9700 1 -- 172.21.15.8:0/3087614598 shutdown_connections 2023-10-06T04:37:09.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.377+0000 7f4c565b9700 1 -- 172.21.15.8:0/3087614598 wait complete. 2023-10-06T04:37:09.380 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_data_ec' removed 2023-10-06T04:37:09.394 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T04:37:09.394 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T04:37:09.394 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T04:37:09.394 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:37:09.394 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T04:37:09.394 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T04:37:09.395 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T04:37:09.395 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:37:09.395 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T04:37:09.395 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T04:37:09.395 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T04:37:09.395 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:37:09.396 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T04:37:09.396 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T04:37:09.396 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T04:37:09.396 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:37:09.404 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T04:37:09.404 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T04:37:09.405 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T04:37:09.405 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T04:37:09.406 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T04:37:09.406 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T04:37:09.407 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T04:37:09.407 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T04:37:09.446 INFO:tasks.ceph.mds.a:Started 2023-10-06T04:37:09.447 DEBUG:teuthology.parallel:result is None 2023-10-06T04:37:09.447 INFO:tasks.ceph.mds.c:Started 2023-10-06T04:37:09.447 DEBUG:teuthology.parallel:result is None 2023-10-06T04:37:09.449 INFO:tasks.ceph.mds.b:Started 2023-10-06T04:37:09.450 DEBUG:teuthology.parallel:result is None 2023-10-06T04:37:09.450 INFO:tasks.ceph.mds.d:Started 2023-10-06T04:37:09.450 DEBUG:teuthology.parallel:result is None 2023-10-06T04:37:09.450 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T04:37:09.527 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2023-10-06T04:37:09.527 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-10-06T04:37:09.527 INFO:tasks.ceph.mds.c.smithi008.stdout:starting mds.c at 2023-10-06T04:37:09.528 INFO:tasks.ceph.mds.a.smithi008.stdout:starting mds.a at 2023-10-06T04:37:09.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.576+0000 7f44433a1700 1 Processor -- start 2023-10-06T04:37:09.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.577+0000 7f44433a1700 1 -- start start 2023-10-06T04:37:09.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.577+0000 7f44433a1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f443c0af410 0x7f443c0cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:09.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.577+0000 7f44433a1700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f443c0af7e0 0x7f443c0ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:09.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.577+0000 7f44433a1700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f443c15ddd0 con 0x7f443c0cd2f0 2023-10-06T04:37:09.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.577+0000 7f44433a1700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f443c15e260 con 0x7f443c0af7e0 2023-10-06T04:37:09.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.577+0000 7f44433a1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f443c15d4a0 con 0x7f443c0af410 2023-10-06T04:37:09.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.578+0000 7f444113d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f443c0af410 0x7f443c0cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:09.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.578+0000 7f444093c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f443c0af7e0 0x7f443c0ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:09.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.578+0000 7f444193e700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f443c0cd2f0 0x7f443c068470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.8:58440/0 (socket says 172.21.15.8:58440) 2023-10-06T04:37:09.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.578+0000 7f444193e700 1 -- 172.21.15.8:0/2127569687 learned_addr learned my addr 172.21.15.8:0/2127569687 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:09.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.578+0000 7f444113d700 1 -- 172.21.15.8:0/2127569687 >> v2:172.21.15.184:3300/0 conn(0x7f443c0af7e0 msgr2=0x7f443c0ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:09.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.578+0000 7f444113d700 1 --2- 172.21.15.8:0/2127569687 >> v2:172.21.15.184:3300/0 conn(0x7f443c0af7e0 0x7f443c0ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:09.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.578+0000 7f444113d700 1 -- 172.21.15.8:0/2127569687 >> v1:172.21.15.184:6789/0 conn(0x7f443c0cd2f0 legacy=0x7f443c068470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:09.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.578+0000 7f444113d700 1 -- 172.21.15.8:0/2127569687 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443c15d780 con 0x7f443c0af410 2023-10-06T04:37:09.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.578+0000 7f444113d700 1 --2- 172.21.15.8:0/2127569687 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f443c0af410 0x7f443c0cb3a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f44380098e0 tx=0x7f44380091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a80c557ae368748 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:09.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.578+0000 7f442ffff700 1 -- 172.21.15.8:0/2127569687 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443800b6d0 con 0x7f443c0af410 2023-10-06T04:37:09.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.578+0000 7f442ffff700 1 -- 172.21.15.8:0/2127569687 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443800b830 con 0x7f443c0af410 2023-10-06T04:37:09.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.578+0000 7f442ffff700 1 -- 172.21.15.8:0/2127569687 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443800bbd0 con 0x7f443c0af410 2023-10-06T04:37:09.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.579+0000 7f44433a1700 1 -- 172.21.15.8:0/2127569687 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f443c0af410 msgr2=0x7f443c0cb3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:09.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.579+0000 7f44433a1700 1 --2- 172.21.15.8:0/2127569687 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f443c0af410 0x7f443c0cb3a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f44380098e0 tx=0x7f44380091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:09.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.579+0000 7f44433a1700 1 -- 172.21.15.8:0/2127569687 shutdown_connections 2023-10-06T04:37:09.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.579+0000 7f44433a1700 1 --2- 172.21.15.8:0/2127569687 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f443c0af410 0x7f443c0cb3a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:09.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.579+0000 7f44433a1700 1 --2- 172.21.15.8:0/2127569687 >> v2:172.21.15.184:3300/0 conn(0x7f443c0af7e0 0x7f443c0ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:09.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.579+0000 7f44433a1700 1 -- 172.21.15.8:0/2127569687 >> 172.21.15.8:0/2127569687 conn(0x7f443c069890 msgr2=0x7f443c069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:09.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.579+0000 7f44433a1700 1 -- 172.21.15.8:0/2127569687 shutdown_connections 2023-10-06T04:37:09.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.579+0000 7f44433a1700 1 -- 172.21.15.8:0/2127569687 wait complete. 2023-10-06T04:37:09.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.580+0000 7f44433a1700 1 Processor -- start 2023-10-06T04:37:09.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.580+0000 7f44433a1700 1 -- start start 2023-10-06T04:37:09.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.581+0000 7f44433a1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f443c0af410 0x7f443c148340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:09.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.581+0000 7f44433a1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f443c0af7e0 0x7f443c0c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:09.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.581+0000 7f44433a1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f443c0cd2f0 0x7f443c0c5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:09.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.581+0000 7f44433a1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443c0c81c0 con 0x7f443c0af7e0 2023-10-06T04:37:09.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.581+0000 7f44433a1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443c0c75b0 con 0x7f443c0af410 2023-10-06T04:37:09.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.581+0000 7f44433a1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f443c0c7890 con 0x7f443c0cd2f0 2023-10-06T04:37:09.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.581+0000 7f444093c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f443c0af7e0 0x7f443c0c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:09.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.581+0000 7f444113d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f443c0af410 0x7f443c148340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:09.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.581+0000 7f444093c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f443c0af7e0 0x7f443c0c57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49162/0 (socket says 172.21.15.8:49162) 2023-10-06T04:37:09.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.581+0000 7f444093c700 1 -- 172.21.15.8:0/2032726101 learned_addr learned my addr 172.21.15.8:0/2032726101 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:09.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.581+0000 7f444193e700 1 --2- 172.21.15.8:0/2032726101 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f443c0cd2f0 0x7f443c0c5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:09.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.581+0000 7f444113d700 1 -- 172.21.15.8:0/2032726101 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f443c0cd2f0 msgr2=0x7f443c0c5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:09.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.581+0000 7f444113d700 1 --2- 172.21.15.8:0/2032726101 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f443c0cd2f0 0x7f443c0c5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:09.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.581+0000 7f444113d700 1 -- 172.21.15.8:0/2032726101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f443c0af7e0 msgr2=0x7f443c0c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:09.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.581+0000 7f444113d700 1 --2- 172.21.15.8:0/2032726101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f443c0af7e0 0x7f443c0c57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:09.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.581+0000 7f444113d700 1 -- 172.21.15.8:0/2032726101 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4438009420 con 0x7f443c0af410 2023-10-06T04:37:09.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.581+0000 7f444093c700 1 --2- 172.21.15.8:0/2032726101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f443c0af7e0 0x7f443c0c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:37:09.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.582+0000 7f444193e700 1 --2- 172.21.15.8:0/2032726101 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f443c0cd2f0 0x7f443c0c5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:37:09.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.582+0000 7f444113d700 1 --2- 172.21.15.8:0/2032726101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f443c0af410 0x7f443c148340 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4438016000 tx=0x7f4438017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:09.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.582+0000 7f442d7fa700 1 -- 172.21.15.8:0/2032726101 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443801bcc0 con 0x7f443c0af410 2023-10-06T04:37:09.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.582+0000 7f442d7fa700 1 -- 172.21.15.8:0/2032726101 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443801be60 con 0x7f443c0af410 2023-10-06T04:37:09.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.582+0000 7f442d7fa700 1 -- 172.21.15.8:0/2032726101 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4438011670 con 0x7f443c0af410 2023-10-06T04:37:09.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.582+0000 7f44433a1700 1 -- 172.21.15.8:0/2032726101 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f443c0c7b70 con 0x7f443c0af410 2023-10-06T04:37:09.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.582+0000 7f44433a1700 1 -- 172.21.15.8:0/2032726101 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f443c0b4b50 con 0x7f443c0af410 2023-10-06T04:37:09.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.583+0000 7f44433a1700 1 -- 172.21.15.8:0/2032726101 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f443c0c79d0 con 0x7f443c0af410 2023-10-06T04:37:09.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.583+0000 7f442d7fa700 1 -- 172.21.15.8:0/2032726101 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f44380119e0 con 0x7f443c0af410 2023-10-06T04:37:09.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.584+0000 7f442d7fa700 1 --2- 172.21.15.8:0/2032726101 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4420066f30 0x7f44200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:09.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.584+0000 7f442d7fa700 1 -- 172.21.15.8:0/2032726101 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f4438085d00 con 0x7f443c0af410 2023-10-06T04:37:09.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.584+0000 7f444093c700 1 --2- 172.21.15.8:0/2032726101 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4420066f30 0x7f44200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:09.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.584+0000 7f444093c700 1 --2- 172.21.15.8:0/2032726101 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4420066f30 0x7f44200693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4430009fd0 tx=0x7f44300091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:09.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.589+0000 7f442d7fa700 1 -- 172.21.15.8:0/2032726101 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f443c0c79d0 con 0x7f443c0af410 2023-10-06T04:37:09.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:09.807+0000 7f44433a1700 1 -- 172.21.15.8:0/2032726101 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f443c0c79d0 con 0x7f443c0af410 2023-10-06T04:37:10.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.389+0000 7f442d7fa700 1 -- 172.21.15.8:0/2032726101 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) v1 ==== 97+0+0 (secure 0 0 0) 0x7f443c0c79d0 con 0x7f443c0af410 2023-10-06T04:37:10.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.391+0000 7f44433a1700 1 -- 172.21.15.8:0/2032726101 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4420066f30 msgr2=0x7f44200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:10.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.391+0000 7f44433a1700 1 --2- 172.21.15.8:0/2032726101 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4420066f30 0x7f44200693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4430009fd0 tx=0x7f44300091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:10.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.391+0000 7f44433a1700 1 -- 172.21.15.8:0/2032726101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f443c0af410 msgr2=0x7f443c148340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:10.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.391+0000 7f44433a1700 1 --2- 172.21.15.8:0/2032726101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f443c0af410 0x7f443c148340 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4438016000 tx=0x7f4438017000 comp rx=0 tx=0).stop 2023-10-06T04:37:10.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.391+0000 7f44433a1700 1 -- 172.21.15.8:0/2032726101 shutdown_connections 2023-10-06T04:37:10.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.391+0000 7f44433a1700 1 --2- 172.21.15.8:0/2032726101 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4420066f30 0x7f44200693e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:10.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.391+0000 7f44433a1700 1 --2- 172.21.15.8:0/2032726101 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f443c0cd2f0 0x7f443c0c5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:10.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.391+0000 7f44433a1700 1 --2- 172.21.15.8:0/2032726101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f443c0af410 0x7f443c148340 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:10.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.391+0000 7f44433a1700 1 --2- 172.21.15.8:0/2032726101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f443c0af7e0 0x7f443c0c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:10.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.391+0000 7f44433a1700 1 -- 172.21.15.8:0/2032726101 >> 172.21.15.8:0/2032726101 conn(0x7f443c069890 msgr2=0x7f443c14ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:10.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.392+0000 7f44433a1700 1 -- 172.21.15.8:0/2032726101 shutdown_connections 2023-10-06T04:37:10.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.392+0000 7f44433a1700 1 -- 172.21.15.8:0/2032726101 wait complete. 2023-10-06T04:37:10.397 INFO:teuthology.orchestra.run.smithi008.stderr: removed all blocklist entries 2023-10-06T04:37:10.409 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T04:37:10.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.530+0000 7f1439f40700 1 Processor -- start 2023-10-06T04:37:10.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.530+0000 7f1439f40700 1 -- start start 2023-10-06T04:37:10.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.532+0000 7f1439f40700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f14340af680 0x7f143415e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:10.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.532+0000 7f1439f40700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f14340cb360 0x7f14340d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:10.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.532+0000 7f1439f40700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14340cc4c0 con 0x7f14340d08d0 2023-10-06T04:37:10.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.532+0000 7f1439f40700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f143415d460 con 0x7f14340af680 2023-10-06T04:37:10.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.532+0000 7f1439f40700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14340d0d50 con 0x7f14340cb360 2023-10-06T04:37:10.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.532+0000 7f14337fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f14340af680 0x7f143415e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:10.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.532+0000 7f1433fff700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f14340d08d0 0x7f14340b0000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41104/0 (socket says 172.21.15.8:41104) 2023-10-06T04:37:10.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.532+0000 7f1433fff700 1 -- 172.21.15.8:0/533423081 learned_addr learned my addr 172.21.15.8:0/533423081 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:10.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.532+0000 7f14337fe700 1 -- 172.21.15.8:0/533423081 >> v2:172.21.15.184:3300/0 conn(0x7f14340cb360 msgr2=0x7f14340d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:10.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.532+0000 7f14337fe700 1 --2- 172.21.15.8:0/533423081 >> v2:172.21.15.184:3300/0 conn(0x7f14340cb360 0x7f14340d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:10.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.532+0000 7f14337fe700 1 -- 172.21.15.8:0/533423081 >> v1:172.21.15.8:6789/0 conn(0x7f14340d08d0 legacy=0x7f14340b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:10.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.532+0000 7f14337fe700 1 -- 172.21.15.8:0/533423081 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f143415e580 con 0x7f14340af680 2023-10-06T04:37:10.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.532+0000 7f14327fc700 1 -- 172.21.15.8:0/533423081 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3378094804 0 0) 0x7f14340cc4c0 con 0x7f14340d08d0 2023-10-06T04:37:10.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.532+0000 7f14337fe700 1 --2- 172.21.15.8:0/533423081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14340af680 0x7f143415e040 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f14340b2f70 tx=0x7f14240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=499c012f1bb4b6b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:10.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.532+0000 7f14327fc700 1 -- 172.21.15.8:0/533423081 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1424009e80 con 0x7f14340af680 2023-10-06T04:37:10.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.532+0000 7f14327fc700 1 -- 172.21.15.8:0/533423081 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142400b820 con 0x7f14340af680 2023-10-06T04:37:10.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.532+0000 7f14327fc700 1 -- 172.21.15.8:0/533423081 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142400bba0 con 0x7f14340af680 2023-10-06T04:37:10.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.532+0000 7f1439f40700 1 -- 172.21.15.8:0/533423081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14340af680 msgr2=0x7f143415e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:10.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.532+0000 7f1439f40700 1 --2- 172.21.15.8:0/533423081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14340af680 0x7f143415e040 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f14340b2f70 tx=0x7f14240091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:10.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.532+0000 7f1439f40700 1 -- 172.21.15.8:0/533423081 shutdown_connections 2023-10-06T04:37:10.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.532+0000 7f1439f40700 1 --2- 172.21.15.8:0/533423081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14340af680 0x7f143415e040 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:10.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.532+0000 7f1439f40700 1 --2- 172.21.15.8:0/533423081 >> v2:172.21.15.184:3300/0 conn(0x7f14340cb360 0x7f14340d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:10.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.532+0000 7f1439f40700 1 -- 172.21.15.8:0/533423081 >> 172.21.15.8:0/533423081 conn(0x7f14340633d0 msgr2=0x7f14340637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:10.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.532+0000 7f1439f40700 1 -- 172.21.15.8:0/533423081 shutdown_connections 2023-10-06T04:37:10.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.532+0000 7f1439f40700 1 -- 172.21.15.8:0/533423081 wait complete. 2023-10-06T04:37:10.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.533+0000 7f1439f40700 1 Processor -- start 2023-10-06T04:37:10.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.534+0000 7f1439f40700 1 -- start start 2023-10-06T04:37:10.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.534+0000 7f1439f40700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14340af680 0x7f14340c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:10.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.534+0000 7f1439f40700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14340cb360 0x7f14340c6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:10.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.534+0000 7f1439f40700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14340d08d0 0x7f143416a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:10.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.534+0000 7f1439f40700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14340b31d0 con 0x7f14340cb360 2023-10-06T04:37:10.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.534+0000 7f1439f40700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14340b3790 con 0x7f14340d08d0 2023-10-06T04:37:10.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.534+0000 7f1439f40700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14340c6730 con 0x7f14340af680 2023-10-06T04:37:10.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.534+0000 7f1432ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14340cb360 0x7f14340c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:10.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.534+0000 7f1432ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14340cb360 0x7f14340c6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49190/0 (socket says 172.21.15.8:49190) 2023-10-06T04:37:10.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.534+0000 7f1432ffd700 1 -- 172.21.15.8:0/3021075265 learned_addr learned my addr 172.21.15.8:0/3021075265 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:10.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.534+0000 7f1433fff700 1 --2- 172.21.15.8:0/3021075265 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14340d08d0 0x7f143416a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:10.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.534+0000 7f14337fe700 1 --2- 172.21.15.8:0/3021075265 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14340af680 0x7f14340c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:10.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.535+0000 7f1432ffd700 1 -- 172.21.15.8:0/3021075265 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14340af680 msgr2=0x7f14340c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:10.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.535+0000 7f1432ffd700 1 --2- 172.21.15.8:0/3021075265 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14340af680 0x7f14340c5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:10.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.535+0000 7f1432ffd700 1 -- 172.21.15.8:0/3021075265 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14340d08d0 msgr2=0x7f143416a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:10.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.535+0000 7f1432ffd700 1 --2- 172.21.15.8:0/3021075265 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14340d08d0 0x7f143416a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:10.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.535+0000 7f1432ffd700 1 -- 172.21.15.8:0/3021075265 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1424009420 con 0x7f14340cb360 2023-10-06T04:37:10.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.535+0000 7f1432ffd700 1 --2- 172.21.15.8:0/3021075265 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14340cb360 0x7f14340c6080 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f142800b810 tx=0x7f1428009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:10.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.535+0000 7f141b7fe700 1 -- 172.21.15.8:0/3021075265 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142800f510 con 0x7f14340cb360 2023-10-06T04:37:10.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.535+0000 7f141b7fe700 1 -- 172.21.15.8:0/3021075265 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142800f690 con 0x7f14340cb360 2023-10-06T04:37:10.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.535+0000 7f1439f40700 1 -- 172.21.15.8:0/3021075265 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14340c6a10 con 0x7f14340cb360 2023-10-06T04:37:10.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.535+0000 7f141b7fe700 1 -- 172.21.15.8:0/3021075265 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142800fa50 con 0x7f14340cb360 2023-10-06T04:37:10.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.535+0000 7f1439f40700 1 -- 172.21.15.8:0/3021075265 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f143416b740 con 0x7f14340cb360 2023-10-06T04:37:10.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.536+0000 7f1439f40700 1 -- 172.21.15.8:0/3021075265 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14340b3900 con 0x7f14340cb360 2023-10-06T04:37:10.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.537+0000 7f141b7fe700 1 -- 172.21.15.8:0/3021075265 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f142801a400 con 0x7f14340cb360 2023-10-06T04:37:10.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.537+0000 7f141b7fe700 1 --2- 172.21.15.8:0/3021075265 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1420066f30 0x7f14200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:10.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.537+0000 7f141b7fe700 1 -- 172.21.15.8:0/3021075265 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f1428083f00 con 0x7f14340cb360 2023-10-06T04:37:10.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.537+0000 7f14337fe700 1 --2- 172.21.15.8:0/3021075265 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1420066f30 0x7f14200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:10.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.538+0000 7f14337fe700 1 --2- 172.21.15.8:0/3021075265 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1420066f30 0x7f14200693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f14240093f0 tx=0x7f1424017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:10.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.542+0000 7f141b7fe700 1 -- 172.21.15.8:0/3021075265 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f14280512a0 con 0x7f14340cb360 2023-10-06T04:37:10.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.813+0000 7f1439f40700 1 -- 172.21.15.8:0/3021075265 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f1434071550 con 0x7f14340cb360 2023-10-06T04:37:10.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.813+0000 7f141b7fe700 1 -- 172.21.15.8:0/3021075265 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f14280548c0 con 0x7f14340cb360 2023-10-06T04:37:10.816 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:10.816 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T04:37:10.816 INFO:teuthology.orchestra.run.smithi008.stdout: "auth_dump": [ 2023-10-06T04:37:10.816 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T04:37:10.816 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "mds.a", 2023-10-06T04:37:10.816 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCPjh9lfxDVGhAAODog98R5tHChtpDsRajf1g==", 2023-10-06T04:37:10.816 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-06T04:37:10.816 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2023-10-06T04:37:10.816 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow *", 2023-10-06T04:37:10.817 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow *", 2023-10-06T04:37:10.817 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-10-06T04:37:10.817 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T04:37:10.817 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T04:37:10.817 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T04:37:10.817 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "mds.b", 2023-10-06T04:37:10.817 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCPjh9lQvlKJhAAsJLmIIv6+2au3kPZENPiAw==", 2023-10-06T04:37:10.817 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-06T04:37:10.817 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2023-10-06T04:37:10.817 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow *", 2023-10-06T04:37:10.818 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow *", 2023-10-06T04:37:10.818 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-10-06T04:37:10.818 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T04:37:10.818 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T04:37:10.818 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T04:37:10.818 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "mds.c", 2023-10-06T04:37:10.818 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCPjh9lMTTJIRAAZ5OosgG6Ww0R1XRro3FxoA==", 2023-10-06T04:37:10.818 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-06T04:37:10.818 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2023-10-06T04:37:10.818 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow *", 2023-10-06T04:37:10.818 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow *", 2023-10-06T04:37:10.818 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-10-06T04:37:10.819 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T04:37:10.819 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T04:37:10.819 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T04:37:10.819 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "mds.d", 2023-10-06T04:37:10.819 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCPjh9lXIYfLRAA+LYE9GjH4oZ2NueRZ4mbqw==", 2023-10-06T04:37:10.819 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-06T04:37:10.819 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2023-10-06T04:37:10.819 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow *", 2023-10-06T04:37:10.819 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow *", 2023-10-06T04:37:10.819 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-10-06T04:37:10.819 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T04:37:10.820 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T04:37:10.820 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T04:37:10.820 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.0", 2023-10-06T04:37:10.820 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCRjh9lR6N8ExAA8eR08nn3J8yjx/qt/AC0MA==", 2023-10-06T04:37:10.820 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-06T04:37:10.820 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2023-10-06T04:37:10.820 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2023-10-06T04:37:10.820 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-10-06T04:37:10.820 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T04:37:10.820 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T04:37:10.820 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T04:37:10.821 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.1", 2023-10-06T04:37:10.821 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCUjh9lEw6WERAAw/XfcuFzx2KI/WSftn3RWA==", 2023-10-06T04:37:10.821 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-06T04:37:10.821 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2023-10-06T04:37:10.821 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2023-10-06T04:37:10.821 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-10-06T04:37:10.821 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T04:37:10.821 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T04:37:10.821 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T04:37:10.821 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.2", 2023-10-06T04:37:10.821 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCXjh9lr4Y6DxAAhWgijTbLQ6RIpa9ExGCFog==", 2023-10-06T04:37:10.821 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-06T04:37:10.822 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2023-10-06T04:37:10.822 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2023-10-06T04:37:10.822 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-10-06T04:37:10.822 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T04:37:10.822 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T04:37:10.822 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T04:37:10.822 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.3", 2023-10-06T04:37:10.822 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCajh9l6E6XDRAAkQODaPiSIQrAIoL8QfdfuA==", 2023-10-06T04:37:10.822 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-06T04:37:10.822 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2023-10-06T04:37:10.822 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2023-10-06T04:37:10.823 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-10-06T04:37:10.823 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T04:37:10.823 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T04:37:10.823 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T04:37:10.823 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.4", 2023-10-06T04:37:10.823 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCgjh9l68gEEBAAK9gsPRVukBGYujgwDrtI8Q==", 2023-10-06T04:37:10.823 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-06T04:37:10.823 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2023-10-06T04:37:10.823 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2023-10-06T04:37:10.823 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-10-06T04:37:10.823 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T04:37:10.824 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T04:37:10.824 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T04:37:10.824 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.5", 2023-10-06T04:37:10.824 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCjjh9lNa6qDRAAw4zSAfovCeD+eqNOGdj9fg==", 2023-10-06T04:37:10.824 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-06T04:37:10.824 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2023-10-06T04:37:10.824 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2023-10-06T04:37:10.824 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-10-06T04:37:10.824 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T04:37:10.824 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T04:37:10.824 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T04:37:10.824 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.6", 2023-10-06T04:37:10.825 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCmjh9lD31iDRAAerwV4nm8w7d8HFZt6LPmaA==", 2023-10-06T04:37:10.825 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-06T04:37:10.825 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2023-10-06T04:37:10.825 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2023-10-06T04:37:10.825 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-10-06T04:37:10.825 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T04:37:10.825 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T04:37:10.825 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T04:37:10.825 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.7", 2023-10-06T04:37:10.825 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCpjh9lyeQWDhAAdeVKxkbrLG13moJjKYX1vg==", 2023-10-06T04:37:10.825 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-06T04:37:10.826 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2023-10-06T04:37:10.826 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2023-10-06T04:37:10.826 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-10-06T04:37:10.826 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T04:37:10.826 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T04:37:10.826 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T04:37:10.826 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.0", 2023-10-06T04:37:10.827 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCPjh9lYOgNMRAA1PcvEPICqihYp7CmFpiL6g==", 2023-10-06T04:37:10.827 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-06T04:37:10.827 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2023-10-06T04:37:10.827 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow r", 2023-10-06T04:37:10.827 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow rw", 2023-10-06T04:37:10.827 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow rwx" 2023-10-06T04:37:10.827 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T04:37:10.827 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T04:37:10.827 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T04:37:10.827 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.1", 2023-10-06T04:37:10.828 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCPjh9lt0+AORAAlUw/v+lWpy9FSAmDcSf/HA==", 2023-10-06T04:37:10.828 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-06T04:37:10.828 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2023-10-06T04:37:10.828 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow r", 2023-10-06T04:37:10.828 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow rw", 2023-10-06T04:37:10.828 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow rwx" 2023-10-06T04:37:10.828 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T04:37:10.828 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T04:37:10.828 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T04:37:10.828 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.2", 2023-10-06T04:37:10.828 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCPjh9lLzp/NhAAbK1IxMay7cuKrtXTPc87Ng==", 2023-10-06T04:37:10.829 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-06T04:37:10.829 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2023-10-06T04:37:10.829 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow r", 2023-10-06T04:37:10.829 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow rw", 2023-10-06T04:37:10.829 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow rwx" 2023-10-06T04:37:10.829 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T04:37:10.829 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T04:37:10.829 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T04:37:10.829 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.3", 2023-10-06T04:37:10.829 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCQjh9l+Mw/AxAA1CRME0TJ/uUeg6rskqD09A==", 2023-10-06T04:37:10.829 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-06T04:37:10.830 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2023-10-06T04:37:10.830 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow r", 2023-10-06T04:37:10.830 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow rw", 2023-10-06T04:37:10.830 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow rwx" 2023-10-06T04:37:10.830 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T04:37:10.830 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T04:37:10.830 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T04:37:10.830 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.admin", 2023-10-06T04:37:10.830 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCOjh9lGAwCORAARDt2FwciB8E8pZFs9LFRGg==", 2023-10-06T04:37:10.830 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-06T04:37:10.831 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow *", 2023-10-06T04:37:10.831 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow *", 2023-10-06T04:37:10.831 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow *", 2023-10-06T04:37:10.831 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-10-06T04:37:10.831 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T04:37:10.831 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T04:37:10.831 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T04:37:10.832 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.bootstrap-mds", 2023-10-06T04:37:10.832 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCujh9lrsalOhAAdVrHq7pG0J6KnRSZPaSA9Q==", 2023-10-06T04:37:10.833 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-06T04:37:10.833 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile bootstrap-mds" 2023-10-06T04:37:10.833 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T04:37:10.834 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T04:37:10.834 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T04:37:10.834 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.bootstrap-mgr", 2023-10-06T04:37:10.834 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCujh9l58+lOhAAofIO6UgvvYfWDLUvOek+/A==", 2023-10-06T04:37:10.834 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-06T04:37:10.834 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-06T04:37:10.834 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T04:37:10.834 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T04:37:10.834 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T04:37:10.835 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.bootstrap-osd", 2023-10-06T04:37:10.835 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCujh9lZtulOhAAUxAI6DclXBw19JjMlcE3Ww==", 2023-10-06T04:37:10.835 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-06T04:37:10.835 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile bootstrap-osd" 2023-10-06T04:37:10.835 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T04:37:10.835 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T04:37:10.835 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T04:37:10.835 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.bootstrap-rbd", 2023-10-06T04:37:10.835 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCujh9lOeOlOhAAPvEXHivGQQkUcZbLOws0Dg==", 2023-10-06T04:37:10.835 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-06T04:37:10.835 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-06T04:37:10.836 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T04:37:10.836 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T04:37:10.836 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T04:37:10.836 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-06T04:37:10.836 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCujh9lLOulOhAA7IQwp0jxS+lFu1AzE9w0+w==", 2023-10-06T04:37:10.836 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-06T04:37:10.836 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-06T04:37:10.836 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T04:37:10.836 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T04:37:10.836 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T04:37:10.837 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.bootstrap-rgw", 2023-10-06T04:37:10.837 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCujh9lV/OlOhAA9udLy/4dUx8bQ0gQEHZsMw==", 2023-10-06T04:37:10.837 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-06T04:37:10.837 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-06T04:37:10.837 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T04:37:10.837 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T04:37:10.837 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T04:37:10.837 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "mgr.x", 2023-10-06T04:37:10.837 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCPjh9lDK28FxAA5hiKYO0UOBRgw7NFYyT3Fw==", 2023-10-06T04:37:10.837 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-06T04:37:10.838 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow *", 2023-10-06T04:37:10.838 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile mgr", 2023-10-06T04:37:10.838 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-10-06T04:37:10.838 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T04:37:10.838 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T04:37:10.838 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T04:37:10.838 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "mgr.y", 2023-10-06T04:37:10.838 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCPjh9lZcvGERAAEw4HpYi6rEPbqrUJ63cQnA==", 2023-10-06T04:37:10.838 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-06T04:37:10.838 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow *", 2023-10-06T04:37:10.839 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile mgr", 2023-10-06T04:37:10.839 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-10-06T04:37:10.839 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T04:37:10.839 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T04:37:10.839 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-10-06T04:37:10.839 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T04:37:10.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.815+0000 7f1439f40700 1 -- 172.21.15.8:0/3021075265 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1420066f30 msgr2=0x7f14200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:10.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.815+0000 7f1439f40700 1 --2- 172.21.15.8:0/3021075265 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1420066f30 0x7f14200693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f14240093f0 tx=0x7f1424017000 comp rx=0 tx=0).stop 2023-10-06T04:37:10.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.815+0000 7f1439f40700 1 -- 172.21.15.8:0/3021075265 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14340cb360 msgr2=0x7f14340c6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:10.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.815+0000 7f1439f40700 1 --2- 172.21.15.8:0/3021075265 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14340cb360 0x7f14340c6080 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f142800b810 tx=0x7f1428009250 comp rx=0 tx=0).stop 2023-10-06T04:37:10.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.815+0000 7f1439f40700 1 -- 172.21.15.8:0/3021075265 shutdown_connections 2023-10-06T04:37:10.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.815+0000 7f1439f40700 1 --2- 172.21.15.8:0/3021075265 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1420066f30 0x7f14200693e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:10.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.815+0000 7f1439f40700 1 --2- 172.21.15.8:0/3021075265 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14340d08d0 0x7f143416a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:10.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.815+0000 7f1439f40700 1 --2- 172.21.15.8:0/3021075265 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14340af680 0x7f14340c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:10.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.815+0000 7f1439f40700 1 --2- 172.21.15.8:0/3021075265 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14340cb360 0x7f14340c6080 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:10.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.815+0000 7f1439f40700 1 -- 172.21.15.8:0/3021075265 >> 172.21.15.8:0/3021075265 conn(0x7f14340633d0 msgr2=0x7f143415a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:10.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.815+0000 7f1439f40700 1 -- 172.21.15.8:0/3021075265 shutdown_connections 2023-10-06T04:37:10.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.815+0000 7f1439f40700 1 -- 172.21.15.8:0/3021075265 wait complete. 2023-10-06T04:37:10.842 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-06T04:37:10.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.962+0000 7f21507b4700 1 Processor -- start 2023-10-06T04:37:10.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.962+0000 7f21507b4700 1 -- start start 2023-10-06T04:37:10.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.962+0000 7f21507b4700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2148156160 0x7f21480aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:10.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.962+0000 7f21507b4700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21480af0c0 0x7f214806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:10.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.962+0000 7f21507b4700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f214806f3c0 0x7f2148159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:10.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.962+0000 7f21507b4700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21480af530 con 0x7f2148156160 2023-10-06T04:37:10.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.962+0000 7f21507b4700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21480b0ce0 con 0x7f214806f3c0 2023-10-06T04:37:10.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.962+0000 7f21507b4700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21480b00d0 con 0x7f21480af0c0 2023-10-06T04:37:10.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.962+0000 7f214e550700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2148156160 0x7f21480aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:10.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.962+0000 7f214e550700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2148156160 0x7f21480aeb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49194/0 (socket says 172.21.15.8:49194) 2023-10-06T04:37:10.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.962+0000 7f214e550700 1 -- 172.21.15.8:0/1060359832 learned_addr learned my addr 172.21.15.8:0/1060359832 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:10.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.962+0000 7f214dd4f700 1 --2- 172.21.15.8:0/1060359832 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21480af0c0 0x7f214806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:10.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.962+0000 7f214ed51700 1 --2- 172.21.15.8:0/1060359832 >> v2:172.21.15.184:3300/0 conn(0x7f214806f3c0 0x7f2148159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:10.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.962+0000 7f214e550700 1 -- 172.21.15.8:0/1060359832 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21480af0c0 msgr2=0x7f214806ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:10.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.962+0000 7f214e550700 1 --2- 172.21.15.8:0/1060359832 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21480af0c0 0x7f214806ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:10.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.962+0000 7f214e550700 1 -- 172.21.15.8:0/1060359832 >> v2:172.21.15.184:3300/0 conn(0x7f214806f3c0 msgr2=0x7f2148159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:10.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.962+0000 7f214e550700 1 --2- 172.21.15.8:0/1060359832 >> v2:172.21.15.184:3300/0 conn(0x7f214806f3c0 0x7f2148159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:10.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.962+0000 7f214e550700 1 -- 172.21.15.8:0/1060359832 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21480b03b0 con 0x7f2148156160 2023-10-06T04:37:10.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.962+0000 7f214e550700 1 --2- 172.21.15.8:0/1060359832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2148156160 0x7f21480aeb80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f21480ce120 tx=0x7f213800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9d8b1b21b958784 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:10.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.962+0000 7f214d54e700 1 -- 172.21.15.8:0/1060359832 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213800dc50 con 0x7f2148156160 2023-10-06T04:37:10.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.963+0000 7f214d54e700 1 -- 172.21.15.8:0/1060359832 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213800ddb0 con 0x7f2148156160 2023-10-06T04:37:10.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.963+0000 7f214d54e700 1 -- 172.21.15.8:0/1060359832 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21380196d0 con 0x7f2148156160 2023-10-06T04:37:10.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.963+0000 7f21507b4700 1 -- 172.21.15.8:0/1060359832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2148156160 msgr2=0x7f21480aeb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:10.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.963+0000 7f21507b4700 1 --2- 172.21.15.8:0/1060359832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2148156160 0x7f21480aeb80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f21480ce120 tx=0x7f213800b4f0 comp rx=0 tx=0).stop 2023-10-06T04:37:10.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.963+0000 7f21507b4700 1 -- 172.21.15.8:0/1060359832 shutdown_connections 2023-10-06T04:37:10.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.963+0000 7f21507b4700 1 --2- 172.21.15.8:0/1060359832 >> v2:172.21.15.184:3300/0 conn(0x7f214806f3c0 0x7f2148159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:10.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.963+0000 7f21507b4700 1 --2- 172.21.15.8:0/1060359832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2148156160 0x7f21480aeb80 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:10.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.963+0000 7f21507b4700 1 --2- 172.21.15.8:0/1060359832 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21480af0c0 0x7f214806ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:10.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.963+0000 7f21507b4700 1 -- 172.21.15.8:0/1060359832 >> 172.21.15.8:0/1060359832 conn(0x7f214806a770 msgr2=0x7f214806ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:10.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.963+0000 7f21507b4700 1 -- 172.21.15.8:0/1060359832 shutdown_connections 2023-10-06T04:37:10.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.963+0000 7f21507b4700 1 -- 172.21.15.8:0/1060359832 wait complete. 2023-10-06T04:37:10.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.964+0000 7f21507b4700 1 Processor -- start 2023-10-06T04:37:10.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.964+0000 7f21507b4700 1 -- start start 2023-10-06T04:37:10.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.965+0000 7f21507b4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f214806f3c0 0x7f2148149940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:10.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.965+0000 7f21507b4700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21480af0c0 0x7f21480cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:10.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.965+0000 7f21507b4700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2148156160 0x7f21480cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:10.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.965+0000 7f21507b4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214814d000 con 0x7f214806f3c0 2023-10-06T04:37:10.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.965+0000 7f21507b4700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21480cac90 con 0x7f2148156160 2023-10-06T04:37:10.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.965+0000 7f21507b4700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21480caf70 con 0x7f21480af0c0 2023-10-06T04:37:10.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.965+0000 7f214e550700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f214806f3c0 0x7f2148149940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:10.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.965+0000 7f214e550700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f214806f3c0 0x7f2148149940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49202/0 (socket says 172.21.15.8:49202) 2023-10-06T04:37:10.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.965+0000 7f214e550700 1 -- 172.21.15.8:0/4273107338 learned_addr learned my addr 172.21.15.8:0/4273107338 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:10.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.965+0000 7f214dd4f700 1 --2- 172.21.15.8:0/4273107338 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21480af0c0 0x7f21480cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:10.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.965+0000 7f214ed51700 1 --2- 172.21.15.8:0/4273107338 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2148156160 0x7f21480cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:10.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.965+0000 7f214e550700 1 -- 172.21.15.8:0/4273107338 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21480af0c0 msgr2=0x7f21480cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:10.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.965+0000 7f214e550700 1 --2- 172.21.15.8:0/4273107338 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21480af0c0 0x7f21480cd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:10.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.965+0000 7f214e550700 1 -- 172.21.15.8:0/4273107338 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2148156160 msgr2=0x7f21480cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:10.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.965+0000 7f214e550700 1 --2- 172.21.15.8:0/4273107338 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2148156160 0x7f21480cd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:10.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.965+0000 7f214e550700 1 -- 172.21.15.8:0/4273107338 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f213800b790 con 0x7f214806f3c0 2023-10-06T04:37:10.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.965+0000 7f214ed51700 1 --2- 172.21.15.8:0/4273107338 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2148156160 0x7f21480cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:10.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.965+0000 7f214e550700 1 --2- 172.21.15.8:0/4273107338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f214806f3c0 0x7f2148149940 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f214806c080 tx=0x7f213801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:10.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.966+0000 7f21467fc700 1 -- 172.21.15.8:0/4273107338 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21380107d0 con 0x7f214806f3c0 2023-10-06T04:37:10.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.966+0000 7f21467fc700 1 -- 172.21.15.8:0/4273107338 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213801e070 con 0x7f214806f3c0 2023-10-06T04:37:10.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.966+0000 7f21507b4700 1 -- 172.21.15.8:0/4273107338 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21480cb250 con 0x7f214806f3c0 2023-10-06T04:37:10.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.966+0000 7f21467fc700 1 -- 172.21.15.8:0/4273107338 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2138010b80 con 0x7f214806f3c0 2023-10-06T04:37:10.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.966+0000 7f21507b4700 1 -- 172.21.15.8:0/4273107338 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f214814c280 con 0x7f214806f3c0 2023-10-06T04:37:10.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.967+0000 7f21507b4700 1 -- 172.21.15.8:0/4273107338 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2148151970 con 0x7f214806f3c0 2023-10-06T04:37:10.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.967+0000 7f21467fc700 1 -- 172.21.15.8:0/4273107338 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f213802c410 con 0x7f214806f3c0 2023-10-06T04:37:10.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.967+0000 7f21467fc700 1 --2- 172.21.15.8:0/4273107338 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2134066f30 0x7f21340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:10.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.967+0000 7f21467fc700 1 -- 172.21.15.8:0/4273107338 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f2138014070 con 0x7f214806f3c0 2023-10-06T04:37:10.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.968+0000 7f214dd4f700 1 --2- 172.21.15.8:0/4273107338 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2134066f30 0x7f21340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:10.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.968+0000 7f214dd4f700 1 --2- 172.21.15.8:0/4273107338 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2134066f30 0x7f21340693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f21480ccb40 tx=0x7f213c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:10.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:10.972+0000 7f21467fc700 1 -- 172.21.15.8:0/4273107338 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2138056050 con 0x7f214806f3c0 2023-10-06T04:37:11.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.245+0000 7f21507b4700 1 -- 172.21.15.8:0/4273107338 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f2148071550 con 0x7f214806f3c0 2023-10-06T04:37:11.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.248+0000 7f21467fc700 1 -- 172.21.15.8:0/4273107338 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2138059670 con 0x7f214806f3c0 2023-10-06T04:37:11.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.250+0000 7f21507b4700 1 -- 172.21.15.8:0/4273107338 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2134066f30 msgr2=0x7f21340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:11.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.250+0000 7f21507b4700 1 --2- 172.21.15.8:0/4273107338 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2134066f30 0x7f21340693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f21480ccb40 tx=0x7f213c008040 comp rx=0 tx=0).stop 2023-10-06T04:37:11.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.250+0000 7f21507b4700 1 -- 172.21.15.8:0/4273107338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f214806f3c0 msgr2=0x7f2148149940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:11.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.250+0000 7f21507b4700 1 --2- 172.21.15.8:0/4273107338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f214806f3c0 0x7f2148149940 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f214806c080 tx=0x7f213801b000 comp rx=0 tx=0).stop 2023-10-06T04:37:11.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.250+0000 7f21507b4700 1 -- 172.21.15.8:0/4273107338 shutdown_connections 2023-10-06T04:37:11.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.251+0000 7f21507b4700 1 --2- 172.21.15.8:0/4273107338 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2134066f30 0x7f21340693e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:11.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.251+0000 7f21507b4700 1 --2- 172.21.15.8:0/4273107338 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2148156160 0x7f21480cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:11.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.251+0000 7f21507b4700 1 --2- 172.21.15.8:0/4273107338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f214806f3c0 0x7f2148149940 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:11.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.251+0000 7f21507b4700 1 --2- 172.21.15.8:0/4273107338 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21480af0c0 0x7f21480cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:11.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.251+0000 7f21507b4700 1 -- 172.21.15.8:0/4273107338 >> 172.21.15.8:0/4273107338 conn(0x7f214806a770 msgr2=0x7f21481552e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:11.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.251+0000 7f21507b4700 1 -- 172.21.15.8:0/4273107338 shutdown_connections 2023-10-06T04:37:11.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.251+0000 7f21507b4700 1 -- 172.21.15.8:0/4273107338 wait complete. 2023-10-06T04:37:11.265 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-06T04:37:11.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.384+0000 7f603f59e700 1 Processor -- start 2023-10-06T04:37:11.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.384+0000 7f603f59e700 1 -- start start 2023-10-06T04:37:11.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.385+0000 7f603f59e700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f604015a160 0x7f604015a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:11.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.385+0000 7f603f59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60400c7520 0x7f604015ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:11.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.385+0000 7f603f59e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60400c9220 con 0x7f604015b380 2023-10-06T04:37:11.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.385+0000 7f603f59e700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60400c7d00 con 0x7f604015a160 2023-10-06T04:37:11.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.385+0000 7f603f59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f604006aa60 con 0x7f60400c7520 2023-10-06T04:37:11.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.385+0000 7f603e59c700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f604015a160 0x7f604015a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:11.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.385+0000 7f603e59c700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f604015a160 0x7f604015a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49212/0 (socket says 172.21.15.8:49212) 2023-10-06T04:37:11.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.385+0000 7f603e59c700 1 -- 172.21.15.8:0/2450644902 learned_addr learned my addr 172.21.15.8:0/2450644902 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:11.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.385+0000 7f603dd9b700 1 --2- 172.21.15.8:0/2450644902 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60400c7520 0x7f604015ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:11.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.386+0000 7f603e59c700 1 -- 172.21.15.8:0/2450644902 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60400c7520 msgr2=0x7f604015ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:11.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.386+0000 7f603e59c700 1 --2- 172.21.15.8:0/2450644902 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60400c7520 0x7f604015ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:11.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.386+0000 7f603e59c700 1 -- 172.21.15.8:0/2450644902 >> v1:172.21.15.184:6789/0 conn(0x7f604015b380 legacy=0x7f60400c9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:11.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.386+0000 7f603e59c700 1 -- 172.21.15.8:0/2450644902 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60400c7a20 con 0x7f604015a160 2023-10-06T04:37:11.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.386+0000 7f603e59c700 1 --2- 172.21.15.8:0/2450644902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f604015a160 0x7f604015a530 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f60300099b0 tx=0x7f6030009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2de16b2d1d01b45e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:11.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.386+0000 7f603d59a700 1 -- 172.21.15.8:0/2450644902 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6030009ea0 con 0x7f604015a160 2023-10-06T04:37:11.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.386+0000 7f603d59a700 1 -- 172.21.15.8:0/2450644902 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603000b860 con 0x7f604015a160 2023-10-06T04:37:11.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.386+0000 7f603d59a700 1 -- 172.21.15.8:0/2450644902 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603000bc00 con 0x7f604015a160 2023-10-06T04:37:11.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.387+0000 7f603f59e700 1 -- 172.21.15.8:0/2450644902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f604015a160 msgr2=0x7f604015a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:11.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.387+0000 7f603f59e700 1 --2- 172.21.15.8:0/2450644902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f604015a160 0x7f604015a530 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f60300099b0 tx=0x7f6030009250 comp rx=0 tx=0).stop 2023-10-06T04:37:11.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.387+0000 7f603f59e700 1 -- 172.21.15.8:0/2450644902 shutdown_connections 2023-10-06T04:37:11.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.387+0000 7f603f59e700 1 --2- 172.21.15.8:0/2450644902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f604015a160 0x7f604015a530 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:11.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.387+0000 7f603f59e700 1 --2- 172.21.15.8:0/2450644902 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60400c7520 0x7f604015ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:11.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.387+0000 7f603f59e700 1 -- 172.21.15.8:0/2450644902 >> 172.21.15.8:0/2450644902 conn(0x7f604006c150 msgr2=0x7f604006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:11.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.387+0000 7f603f59e700 1 -- 172.21.15.8:0/2450644902 shutdown_connections 2023-10-06T04:37:11.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.387+0000 7f603f59e700 1 -- 172.21.15.8:0/2450644902 wait complete. 2023-10-06T04:37:11.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.388+0000 7f603f59e700 1 Processor -- start 2023-10-06T04:37:11.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.388+0000 7f603f59e700 1 -- start start 2023-10-06T04:37:11.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.389+0000 7f603f59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60400c7520 0x7f60400c09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:11.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.389+0000 7f603f59e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f604015a160 0x7f60400b20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:11.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.389+0000 7f603f59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f604015b380 0x7f60400c4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:11.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.389+0000 7f603f59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60400c4a80 con 0x7f604015b380 2023-10-06T04:37:11.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.389+0000 7f603f59e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60400c12e0 con 0x7f604015a160 2023-10-06T04:37:11.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.389+0000 7f603f59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60400c15c0 con 0x7f60400c7520 2023-10-06T04:37:11.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.389+0000 7f603ed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f604015b380 0x7f60400c4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:11.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.389+0000 7f603ed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f604015b380 0x7f60400c4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49216/0 (socket says 172.21.15.8:49216) 2023-10-06T04:37:11.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.389+0000 7f603ed9d700 1 -- 172.21.15.8:0/2845947589 learned_addr learned my addr 172.21.15.8:0/2845947589 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:11.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.389+0000 7f603dd9b700 1 --2- 172.21.15.8:0/2845947589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f604015a160 0x7f60400b20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:11.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.389+0000 7f603e59c700 1 --2- 172.21.15.8:0/2845947589 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60400c7520 0x7f60400c09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:11.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.389+0000 7f603ed9d700 1 -- 172.21.15.8:0/2845947589 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60400c7520 msgr2=0x7f60400c09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:11.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.389+0000 7f603ed9d700 1 --2- 172.21.15.8:0/2845947589 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60400c7520 0x7f60400c09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:11.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.389+0000 7f603ed9d700 1 -- 172.21.15.8:0/2845947589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f604015a160 msgr2=0x7f60400b20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:11.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.389+0000 7f603ed9d700 1 --2- 172.21.15.8:0/2845947589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f604015a160 0x7f60400b20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:11.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.389+0000 7f603ed9d700 1 -- 172.21.15.8:0/2845947589 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60300094f0 con 0x7f604015b380 2023-10-06T04:37:11.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.389+0000 7f603ed9d700 1 --2- 172.21.15.8:0/2845947589 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f604015b380 0x7f60400c4f10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f603800c8e0 tx=0x7f6038001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:11.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.389+0000 7f60367fc700 1 -- 172.21.15.8:0/2845947589 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6038012630 con 0x7f604015b380 2023-10-06T04:37:11.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.389+0000 7f60367fc700 1 -- 172.21.15.8:0/2845947589 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6038012790 con 0x7f604015b380 2023-10-06T04:37:11.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.389+0000 7f60367fc700 1 -- 172.21.15.8:0/2845947589 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6038012b50 con 0x7f604015b380 2023-10-06T04:37:11.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.389+0000 7f603f59e700 1 -- 172.21.15.8:0/2845947589 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60400c18a0 con 0x7f604015b380 2023-10-06T04:37:11.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.390+0000 7f603f59e700 1 -- 172.21.15.8:0/2845947589 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60400c0f20 con 0x7f604015b380 2023-10-06T04:37:11.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.391+0000 7f603f59e700 1 -- 172.21.15.8:0/2845947589 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60400c4c30 con 0x7f604015b380 2023-10-06T04:37:11.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.391+0000 7f60367fc700 1 -- 172.21.15.8:0/2845947589 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f603801a3a0 con 0x7f604015b380 2023-10-06T04:37:11.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.391+0000 7f60367fc700 1 --2- 172.21.15.8:0/2845947589 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6020066f60 0x7f6020069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:11.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.391+0000 7f60367fc700 1 -- 172.21.15.8:0/2845947589 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f60380845c0 con 0x7f604015b380 2023-10-06T04:37:11.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.392+0000 7f603e59c700 1 --2- 172.21.15.8:0/2845947589 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6020066f60 0x7f6020069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:11.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.392+0000 7f603e59c700 1 --2- 172.21.15.8:0/2845947589 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6020066f60 0x7f6020069410 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f60300099b0 tx=0x7f6030017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:11.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.396+0000 7f60367fc700 1 -- 172.21.15.8:0/2845947589 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f60400c4c30 con 0x7f604015b380 2023-10-06T04:37:11.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.666+0000 7f603f59e700 1 -- 172.21.15.8:0/2845947589 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f60400675d0 con 0x7f604015b380 2023-10-06T04:37:11.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.669+0000 7f60367fc700 1 -- 172.21.15.8:0/2845947589 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f6038055370 con 0x7f604015b380 2023-10-06T04:37:11.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.671+0000 7f603f59e700 1 -- 172.21.15.8:0/2845947589 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6020066f60 msgr2=0x7f6020069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:11.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.671+0000 7f603f59e700 1 --2- 172.21.15.8:0/2845947589 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6020066f60 0x7f6020069410 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f60300099b0 tx=0x7f6030017000 comp rx=0 tx=0).stop 2023-10-06T04:37:11.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.671+0000 7f603f59e700 1 -- 172.21.15.8:0/2845947589 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f604015b380 msgr2=0x7f60400c4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:11.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.671+0000 7f603f59e700 1 --2- 172.21.15.8:0/2845947589 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f604015b380 0x7f60400c4f10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f603800c8e0 tx=0x7f6038001710 comp rx=0 tx=0).stop 2023-10-06T04:37:11.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.671+0000 7f603f59e700 1 -- 172.21.15.8:0/2845947589 shutdown_connections 2023-10-06T04:37:11.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.671+0000 7f603f59e700 1 --2- 172.21.15.8:0/2845947589 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6020066f60 0x7f6020069410 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:11.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.671+0000 7f603f59e700 1 --2- 172.21.15.8:0/2845947589 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f604015b380 0x7f60400c4f10 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:11.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.671+0000 7f603f59e700 1 --2- 172.21.15.8:0/2845947589 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60400c7520 0x7f60400c09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:11.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.671+0000 7f603f59e700 1 --2- 172.21.15.8:0/2845947589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f604015a160 0x7f60400b20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:11.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.671+0000 7f603f59e700 1 -- 172.21.15.8:0/2845947589 >> 172.21.15.8:0/2845947589 conn(0x7f604006c150 msgr2=0x7f60400cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:11.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.671+0000 7f603f59e700 1 -- 172.21.15.8:0/2845947589 shutdown_connections 2023-10-06T04:37:11.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.671+0000 7f603f59e700 1 -- 172.21.15.8:0/2845947589 wait complete. 2023-10-06T04:37:11.686 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-06T04:37:11.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.803+0000 7fc854c0f700 1 Processor -- start 2023-10-06T04:37:11.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.803+0000 7fc854c0f700 1 -- start start 2023-10-06T04:37:11.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.805+0000 7fc854c0f700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc8501573a0 0x7fc8500aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:11.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.805+0000 7fc854c0f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8500cdc70 0x7fc8500af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:11.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.805+0000 7fc854c0f700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc85015a990 con 0x7fc850156fd0 2023-10-06T04:37:11.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.805+0000 7fc854c0f700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc850159dc0 con 0x7fc8501573a0 2023-10-06T04:37:11.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.805+0000 7fc854c0f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85015a060 con 0x7fc8500cdc70 2023-10-06T04:37:11.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.805+0000 7fc84ed9d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8500cdc70 0x7fc8500af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:11.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.805+0000 7fc84dd9b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc8501573a0 0x7fc8500aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:11.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.805+0000 7fc84dd9b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc8501573a0 0x7fc8500aeb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.8:33648/0 (socket says 172.21.15.8:33648) 2023-10-06T04:37:11.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.805+0000 7fc84dd9b700 1 -- 172.21.15.8:0/1706604852 learned_addr learned my addr 172.21.15.8:0/1706604852 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:11.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.805+0000 7fc84e59c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fc850156fd0 0x7fc8500aa2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.8:58470/0 (socket says 172.21.15.8:58470) 2023-10-06T04:37:11.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.805+0000 7fc84ed9d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8500cdc70 0x7fc8500af0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.8:54634/0 (socket says 172.21.15.8:54634) 2023-10-06T04:37:11.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.805+0000 7fc84dd9b700 1 -- 172.21.15.8:0/1706604852 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8500cdc70 msgr2=0x7fc8500af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:11.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.805+0000 7fc84dd9b700 1 --2- 172.21.15.8:0/1706604852 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8500cdc70 0x7fc8500af0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:11.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.805+0000 7fc84dd9b700 1 -- 172.21.15.8:0/1706604852 >> v1:172.21.15.184:6789/0 conn(0x7fc850156fd0 legacy=0x7fc8500aa2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:11.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.805+0000 7fc84dd9b700 1 -- 172.21.15.8:0/1706604852 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85015a340 con 0x7fc8501573a0 2023-10-06T04:37:11.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.805+0000 7fc84ed9d700 1 --2- 172.21.15.8:0/1706604852 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8500cdc70 0x7fc8500af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:37:11.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.805+0000 7fc84dd9b700 1 --2- 172.21.15.8:0/1706604852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8501573a0 0x7fc8500aeb80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc8380099b0 tx=0x7fc838009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=594bf852b009a330 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:11.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.805+0000 7fc84d59a700 1 -- 172.21.15.8:0/1706604852 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc838009ea0 con 0x7fc8501573a0 2023-10-06T04:37:11.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.805+0000 7fc84d59a700 1 -- 172.21.15.8:0/1706604852 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83800b860 con 0x7fc8501573a0 2023-10-06T04:37:11.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.805+0000 7fc84d59a700 1 -- 172.21.15.8:0/1706604852 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83800bc20 con 0x7fc8501573a0 2023-10-06T04:37:11.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.806+0000 7fc854c0f700 1 -- 172.21.15.8:0/1706604852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8501573a0 msgr2=0x7fc8500aeb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:11.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.806+0000 7fc854c0f700 1 --2- 172.21.15.8:0/1706604852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8501573a0 0x7fc8500aeb80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc8380099b0 tx=0x7fc838009250 comp rx=0 tx=0).stop 2023-10-06T04:37:11.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.806+0000 7fc854c0f700 1 -- 172.21.15.8:0/1706604852 shutdown_connections 2023-10-06T04:37:11.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.806+0000 7fc854c0f700 1 --2- 172.21.15.8:0/1706604852 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8500cdc70 0x7fc8500af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:11.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.806+0000 7fc854c0f700 1 --2- 172.21.15.8:0/1706604852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8501573a0 0x7fc8500aeb80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:11.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.806+0000 7fc854c0f700 1 -- 172.21.15.8:0/1706604852 >> 172.21.15.8:0/1706604852 conn(0x7fc85006a770 msgr2=0x7fc85006ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:11.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.806+0000 7fc854c0f700 1 -- 172.21.15.8:0/1706604852 shutdown_connections 2023-10-06T04:37:11.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.806+0000 7fc854c0f700 1 -- 172.21.15.8:0/1706604852 wait complete. 2023-10-06T04:37:11.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.807+0000 7fc854c0f700 1 Processor -- start 2023-10-06T04:37:11.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.807+0000 7fc854c0f700 1 -- start start 2023-10-06T04:37:11.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.808+0000 7fc854c0f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8500cdc70 0x7fc850158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:11.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.808+0000 7fc854c0f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc850156fd0 0x7fc8500b2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:11.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.808+0000 7fc854c0f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8501573a0 0x7fc85016ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:11.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.808+0000 7fc854c0f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8500b0ff0 con 0x7fc8501573a0 2023-10-06T04:37:11.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.808+0000 7fc854c0f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8500b0d10 con 0x7fc8500cdc70 2023-10-06T04:37:11.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.808+0000 7fc854c0f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc850158300 con 0x7fc850156fd0 2023-10-06T04:37:11.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.808+0000 7fc84ed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8501573a0 0x7fc85016ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:11.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.808+0000 7fc84ed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8501573a0 0x7fc85016ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49224/0 (socket says 172.21.15.8:49224) 2023-10-06T04:37:11.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.808+0000 7fc84ed9d700 1 -- 172.21.15.8:0/3219107574 learned_addr learned my addr 172.21.15.8:0/3219107574 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:11.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.808+0000 7fc84e59c700 1 --2- 172.21.15.8:0/3219107574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8500cdc70 0x7fc850158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:11.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.808+0000 7fc84dd9b700 1 --2- 172.21.15.8:0/3219107574 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc850156fd0 0x7fc8500b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:11.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.808+0000 7fc84ed9d700 1 -- 172.21.15.8:0/3219107574 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc850156fd0 msgr2=0x7fc8500b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:11.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.808+0000 7fc84ed9d700 1 --2- 172.21.15.8:0/3219107574 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc850156fd0 0x7fc8500b2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:11.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.808+0000 7fc84ed9d700 1 -- 172.21.15.8:0/3219107574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8500cdc70 msgr2=0x7fc850158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:11.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.808+0000 7fc84ed9d700 1 --2- 172.21.15.8:0/3219107574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8500cdc70 0x7fc850158de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:11.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.808+0000 7fc84ed9d700 1 -- 172.21.15.8:0/3219107574 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc840009a20 con 0x7fc8501573a0 2023-10-06T04:37:11.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.808+0000 7fc84ed9d700 1 --2- 172.21.15.8:0/3219107574 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8501573a0 0x7fc85016ae10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc840009f20 tx=0x7fc84000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:11.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.809+0000 7fc8467fc700 1 -- 172.21.15.8:0/3219107574 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84000cb70 con 0x7fc8501573a0 2023-10-06T04:37:11.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.809+0000 7fc8467fc700 1 -- 172.21.15.8:0/3219107574 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84000f040 con 0x7fc8501573a0 2023-10-06T04:37:11.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.809+0000 7fc854c0f700 1 -- 172.21.15.8:0/3219107574 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8380094f0 con 0x7fc8501573a0 2023-10-06T04:37:11.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.809+0000 7fc8467fc700 1 -- 172.21.15.8:0/3219107574 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc840014480 con 0x7fc8501573a0 2023-10-06T04:37:11.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.809+0000 7fc854c0f700 1 -- 172.21.15.8:0/3219107574 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8501588c0 con 0x7fc8501573a0 2023-10-06T04:37:11.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.810+0000 7fc854c0f700 1 -- 172.21.15.8:0/3219107574 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc850071550 con 0x7fc8501573a0 2023-10-06T04:37:11.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.810+0000 7fc8467fc700 1 -- 172.21.15.8:0/3219107574 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc840003020 con 0x7fc8501573a0 2023-10-06T04:37:11.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.811+0000 7fc8467fc700 1 --2- 172.21.15.8:0/3219107574 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc830066f30 0x7fc8300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:11.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.811+0000 7fc8467fc700 1 -- 172.21.15.8:0/3219107574 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fc840084d50 con 0x7fc8501573a0 2023-10-06T04:37:11.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.811+0000 7fc84e59c700 1 --2- 172.21.15.8:0/3219107574 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc830066f30 0x7fc8300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:11.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.811+0000 7fc84e59c700 1 --2- 172.21.15.8:0/3219107574 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc830066f30 0x7fc8300693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc850159450 tx=0x7fc848007eb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:11.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:11.816+0000 7fc8467fc700 1 -- 172.21.15.8:0/3219107574 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc840088030 con 0x7fc8501573a0 2023-10-06T04:37:12.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.089+0000 7fc854c0f700 1 -- 172.21.15.8:0/3219107574 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fc850159a80 con 0x7fc8501573a0 2023-10-06T04:37:12.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.093+0000 7fc8467fc700 1 -- 172.21.15.8:0/3219107574 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc840052070 con 0x7fc8501573a0 2023-10-06T04:37:12.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.095+0000 7fc854c0f700 1 -- 172.21.15.8:0/3219107574 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc830066f30 msgr2=0x7fc8300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:12.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.095+0000 7fc854c0f700 1 --2- 172.21.15.8:0/3219107574 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc830066f30 0x7fc8300693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc850159450 tx=0x7fc848007eb0 comp rx=0 tx=0).stop 2023-10-06T04:37:12.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.095+0000 7fc854c0f700 1 -- 172.21.15.8:0/3219107574 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8501573a0 msgr2=0x7fc85016ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:12.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.095+0000 7fc854c0f700 1 --2- 172.21.15.8:0/3219107574 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8501573a0 0x7fc85016ae10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc840009f20 tx=0x7fc84000b040 comp rx=0 tx=0).stop 2023-10-06T04:37:12.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.095+0000 7fc854c0f700 1 -- 172.21.15.8:0/3219107574 shutdown_connections 2023-10-06T04:37:12.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.095+0000 7fc854c0f700 1 --2- 172.21.15.8:0/3219107574 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc830066f30 0x7fc8300693e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:12.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.095+0000 7fc854c0f700 1 --2- 172.21.15.8:0/3219107574 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8501573a0 0x7fc85016ae10 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:12.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.095+0000 7fc854c0f700 1 --2- 172.21.15.8:0/3219107574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8500cdc70 0x7fc850158de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:12.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.095+0000 7fc854c0f700 1 --2- 172.21.15.8:0/3219107574 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc850156fd0 0x7fc8500b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:12.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.095+0000 7fc854c0f700 1 -- 172.21.15.8:0/3219107574 >> 172.21.15.8:0/3219107574 conn(0x7fc85006a770 msgr2=0x7fc8500abd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:12.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.095+0000 7fc854c0f700 1 -- 172.21.15.8:0/3219107574 shutdown_connections 2023-10-06T04:37:12.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.095+0000 7fc854c0f700 1 -- 172.21.15.8:0/3219107574 wait complete. 2023-10-06T04:37:12.109 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-06T04:37:12.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.228+0000 7f043d525700 1 Processor -- start 2023-10-06T04:37:12.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.228+0000 7f043d525700 1 -- start start 2023-10-06T04:37:12.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.229+0000 7f043d525700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04380caba0 0x7f0438159b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:12.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.229+0000 7f043d525700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f04380698c0 0x7f0438067900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:12.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.229+0000 7f043d525700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f043806a010 con 0x7f04381570d0 2023-10-06T04:37:12.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.229+0000 7f043d525700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f043806ac20 con 0x7f04380698c0 2023-10-06T04:37:12.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.229+0000 7f043d525700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04380cc750 con 0x7f04380caba0 2023-10-06T04:37:12.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.229+0000 7f0436ffd700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f04381570d0 0x7f04380ca490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41118/0 (socket says 172.21.15.8:41118) 2023-10-06T04:37:12.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.229+0000 7f0436ffd700 1 -- 172.21.15.8:0/4163143485 learned_addr learned my addr 172.21.15.8:0/4163143485 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:12.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.229+0000 7f0435ffb700 1 -- 172.21.15.8:0/4163143485 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2891303524 0 0) 0x7f043806a010 con 0x7f04381570d0 2023-10-06T04:37:12.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.229+0000 7f04367fc700 1 --2- 172.21.15.8:0/4163143485 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04380caba0 0x7f0438159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:12.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.229+0000 7f04377fe700 1 --2- 172.21.15.8:0/4163143485 >> v2:172.21.15.184:3300/0 conn(0x7f04380698c0 0x7f0438067900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:12.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.229+0000 7f0435ffb700 1 -- 172.21.15.8:0/4163143485 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0420003570 con 0x7f04381570d0 2023-10-06T04:37:12.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.229+0000 7f0435ffb700 1 -- 172.21.15.8:0/4163143485 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2810302867 0 0) 0x7f0420003570 con 0x7f04381570d0 2023-10-06T04:37:12.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.229+0000 7f0435ffb700 1 -- 172.21.15.8:0/4163143485 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04380caba0 msgr2=0x7f0438159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:12.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.229+0000 7f0435ffb700 1 --2- 172.21.15.8:0/4163143485 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04380caba0 0x7f0438159b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:12.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.229+0000 7f0435ffb700 1 -- 172.21.15.8:0/4163143485 >> v2:172.21.15.184:3300/0 conn(0x7f04380698c0 msgr2=0x7f0438067900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:12.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.229+0000 7f0435ffb700 1 --2- 172.21.15.8:0/4163143485 >> v2:172.21.15.184:3300/0 conn(0x7f04380698c0 0x7f0438067900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:12.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.229+0000 7f0435ffb700 1 -- 172.21.15.8:0/4163143485 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043806a2f0 con 0x7f04381570d0 2023-10-06T04:37:12.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.229+0000 7f0435ffb700 1 -- 172.21.15.8:0/4163143485 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7f0428001470 con 0x7f04381570d0 2023-10-06T04:37:12.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.229+0000 7f0435ffb700 1 -- 172.21.15.8:0/4163143485 >> v1:172.21.15.8:6789/0 conn(0x7f04381570d0 legacy=0x7f04380ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:12.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.230+0000 7f0435ffb700 1 --2- 172.21.15.8:0/4163143485 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0420003a60 0x7f0420003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:12.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.230+0000 7f0435ffb700 1 --2- 172.21.15.8:0/4163143485 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0420004810 0x7f0420004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:12.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.230+0000 7f0435ffb700 1 --2- 172.21.15.8:0/4163143485 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04380caba0 0x7f04200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:12.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.230+0000 7f0435ffb700 1 -- 172.21.15.8:0/4163143485 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043806ac20 con 0x7f0420003a60 2023-10-06T04:37:12.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.230+0000 7f0435ffb700 1 -- 172.21.15.8:0/4163143485 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04380cc750 con 0x7f0420004810 2023-10-06T04:37:12.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.230+0000 7f0435ffb700 1 -- 172.21.15.8:0/4163143485 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042000ba60 con 0x7f04380caba0 2023-10-06T04:37:12.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.230+0000 7f0436ffd700 1 --2- 172.21.15.8:0/4163143485 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0420003a60 0x7f0420003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:12.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.230+0000 7f04367fc700 1 --2- 172.21.15.8:0/4163143485 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0420004810 0x7f0420004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:12.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.230+0000 7f04377fe700 1 --2- 172.21.15.8:0/4163143485 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04380caba0 0x7f04200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:12.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.230+0000 7f0436ffd700 1 -- 172.21.15.8:0/4163143485 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04380caba0 msgr2=0x7f04200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:12.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.230+0000 7f0436ffd700 1 --2- 172.21.15.8:0/4163143485 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04380caba0 0x7f04200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:12.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.230+0000 7f0436ffd700 1 -- 172.21.15.8:0/4163143485 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0420004810 msgr2=0x7f0420004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:12.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.230+0000 7f0436ffd700 1 --2- 172.21.15.8:0/4163143485 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0420004810 0x7f0420004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:12.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.230+0000 7f0436ffd700 1 -- 172.21.15.8:0/4163143485 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0420003570 con 0x7f0420003a60 2023-10-06T04:37:12.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.230+0000 7f0436ffd700 1 --2- 172.21.15.8:0/4163143485 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0420003a60 0x7f0420003e70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f042800c3f0 tx=0x7f0428001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee72d2d3af2bf99 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:12.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.230+0000 7f0435ffb700 1 -- 172.21.15.8:0/4163143485 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042800cc80 con 0x7f0420003a60 2023-10-06T04:37:12.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.230+0000 7f0435ffb700 1 -- 172.21.15.8:0/4163143485 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042800ce00 con 0x7f0420003a60 2023-10-06T04:37:12.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.230+0000 7f0435ffb700 1 -- 172.21.15.8:0/4163143485 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0428005b70 con 0x7f0420003a60 2023-10-06T04:37:12.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.231+0000 7f043d525700 1 -- 172.21.15.8:0/4163143485 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0420003a60 msgr2=0x7f0420003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:12.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.231+0000 7f043d525700 1 --2- 172.21.15.8:0/4163143485 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0420003a60 0x7f0420003e70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f042800c3f0 tx=0x7f0428001e90 comp rx=0 tx=0).stop 2023-10-06T04:37:12.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.231+0000 7f04377fe700 1 -- 172.21.15.8:0/4163143485 reap_dead start 2023-10-06T04:37:12.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.231+0000 7f043d525700 1 -- 172.21.15.8:0/4163143485 shutdown_connections 2023-10-06T04:37:12.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.231+0000 7f043d525700 1 -- 172.21.15.8:0/4163143485 >> 172.21.15.8:0/4163143485 conn(0x7f04380c9330 msgr2=0x7f04380c9730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:12.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.231+0000 7f043d525700 1 -- 172.21.15.8:0/4163143485 shutdown_connections 2023-10-06T04:37:12.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.231+0000 7f043d525700 1 -- 172.21.15.8:0/4163143485 wait complete. 2023-10-06T04:37:12.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.232+0000 7f043d525700 1 Processor -- start 2023-10-06T04:37:12.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.232+0000 7f043d525700 1 -- start start 2023-10-06T04:37:12.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.233+0000 7f043d525700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0420003a60 0x7f04380c4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:12.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.233+0000 7f043d525700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04380c51f0 0x7f0438169640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:12.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.233+0000 7f043d525700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0438169b80 0x7f0438169fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:12.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.233+0000 7f043d525700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04380af8d0 con 0x7f0438169b80 2023-10-06T04:37:12.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.233+0000 7f043d525700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043816a510 con 0x7f04380c51f0 2023-10-06T04:37:12.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.233+0000 7f043d525700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04380c59e0 con 0x7f0420003a60 2023-10-06T04:37:12.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.233+0000 7f04377fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0438169b80 0x7f0438169fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:12.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.233+0000 7f04377fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0438169b80 0x7f0438169fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49246/0 (socket says 172.21.15.8:49246) 2023-10-06T04:37:12.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.233+0000 7f04377fe700 1 -- 172.21.15.8:0/82337156 learned_addr learned my addr 172.21.15.8:0/82337156 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:12.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.233+0000 7f0436ffd700 1 --2- 172.21.15.8:0/82337156 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0420003a60 0x7f04380c4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:12.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.233+0000 7f04367fc700 1 --2- 172.21.15.8:0/82337156 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04380c51f0 0x7f0438169640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:12.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.233+0000 7f04377fe700 1 -- 172.21.15.8:0/82337156 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0420003a60 msgr2=0x7f04380c4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:12.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.233+0000 7f04377fe700 1 --2- 172.21.15.8:0/82337156 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0420003a60 0x7f04380c4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:12.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.233+0000 7f04377fe700 1 -- 172.21.15.8:0/82337156 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04380c51f0 msgr2=0x7f0438169640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:12.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.233+0000 7f04377fe700 1 --2- 172.21.15.8:0/82337156 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04380c51f0 0x7f0438169640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:12.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.233+0000 7f04377fe700 1 -- 172.21.15.8:0/82337156 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04380c5cc0 con 0x7f0438169b80 2023-10-06T04:37:12.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.233+0000 7f04377fe700 1 --2- 172.21.15.8:0/82337156 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0438169b80 0x7f0438169fd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f04300094d0 tx=0x7f043000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:12.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.234+0000 7f041effd700 1 -- 172.21.15.8:0/82337156 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043000e040 con 0x7f0438169b80 2023-10-06T04:37:12.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.234+0000 7f041effd700 1 -- 172.21.15.8:0/82337156 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043000f040 con 0x7f0438169b80 2023-10-06T04:37:12.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.234+0000 7f041effd700 1 -- 172.21.15.8:0/82337156 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043000fda0 con 0x7f0438169b80 2023-10-06T04:37:12.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.234+0000 7f043d525700 1 -- 172.21.15.8:0/82337156 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04380c5fa0 con 0x7f0438169b80 2023-10-06T04:37:12.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.234+0000 7f043d525700 1 -- 172.21.15.8:0/82337156 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0438155010 con 0x7f0438169b80 2023-10-06T04:37:12.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.235+0000 7f043d525700 1 -- 172.21.15.8:0/82337156 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0438071550 con 0x7f0438169b80 2023-10-06T04:37:12.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.235+0000 7f041effd700 1 -- 172.21.15.8:0/82337156 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0430015640 con 0x7f0438169b80 2023-10-06T04:37:12.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.236+0000 7f041effd700 1 --2- 172.21.15.8:0/82337156 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f0424066f30 0x7f04240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:12.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.236+0000 7f041effd700 1 -- 172.21.15.8:0/82337156 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f0430084a80 con 0x7f0438169b80 2023-10-06T04:37:12.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.236+0000 7f0436ffd700 1 --2- 172.21.15.8:0/82337156 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f0424066f30 0x7f04240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:12.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.236+0000 7f0436ffd700 1 --2- 172.21.15.8:0/82337156 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f0424066f30 0x7f04240693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0428001ed0 tx=0x7f0428015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:12.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.240+0000 7f041effd700 1 -- 172.21.15.8:0/82337156 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0430051da0 con 0x7f0438169b80 2023-10-06T04:37:12.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.511+0000 7f043d525700 1 -- 172.21.15.8:0/82337156 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f043806a5d0 con 0x7f0438169b80 2023-10-06T04:37:12.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.514+0000 7f041effd700 1 -- 172.21.15.8:0/82337156 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f04300553c0 con 0x7f0438169b80 2023-10-06T04:37:12.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.516+0000 7f043d525700 1 -- 172.21.15.8:0/82337156 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f0424066f30 msgr2=0x7f04240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:12.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.516+0000 7f043d525700 1 --2- 172.21.15.8:0/82337156 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f0424066f30 0x7f04240693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0428001ed0 tx=0x7f0428015000 comp rx=0 tx=0).stop 2023-10-06T04:37:12.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.516+0000 7f043d525700 1 -- 172.21.15.8:0/82337156 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0438169b80 msgr2=0x7f0438169fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:12.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.516+0000 7f043d525700 1 --2- 172.21.15.8:0/82337156 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0438169b80 0x7f0438169fd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f04300094d0 tx=0x7f043000b040 comp rx=0 tx=0).stop 2023-10-06T04:37:12.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.516+0000 7f043d525700 1 -- 172.21.15.8:0/82337156 shutdown_connections 2023-10-06T04:37:12.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.516+0000 7f043d525700 1 --2- 172.21.15.8:0/82337156 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f0424066f30 0x7f04240693e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:12.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.516+0000 7f043d525700 1 --2- 172.21.15.8:0/82337156 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0438169b80 0x7f0438169fd0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:12.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.516+0000 7f043d525700 1 --2- 172.21.15.8:0/82337156 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0420003a60 0x7f04380c4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:12.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.516+0000 7f043d525700 1 --2- 172.21.15.8:0/82337156 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04380c51f0 0x7f0438169640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:12.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.516+0000 7f043d525700 1 -- 172.21.15.8:0/82337156 >> 172.21.15.8:0/82337156 conn(0x7f04380c9330 msgr2=0x7f04380c1660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:12.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.516+0000 7f043d525700 1 -- 172.21.15.8:0/82337156 shutdown_connections 2023-10-06T04:37:12.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.516+0000 7f043d525700 1 -- 172.21.15.8:0/82337156 wait complete. 2023-10-06T04:37:12.529 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-06T04:37:12.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.648+0000 7f420e325700 1 Processor -- start 2023-10-06T04:37:12.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.648+0000 7f420e325700 1 -- start start 2023-10-06T04:37:12.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.648+0000 7f420e325700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f42080c9730 0x7f42080680d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:12.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.648+0000 7f420e325700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f420815b040 con 0x7f4208157a10 2023-10-06T04:37:12.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.648+0000 7f420e325700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f420815b320 con 0x7f42080cd0e0 2023-10-06T04:37:12.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.648+0000 7f420e325700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4208158270 con 0x7f42080c9730 2023-10-06T04:37:12.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.649+0000 7f4207fff700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f42080c9730 0x7f42080680d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:12.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.649+0000 7f42077fe700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f4208157a10 0x7f420815b7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41134/0 (socket says 172.21.15.8:41134) 2023-10-06T04:37:12.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.649+0000 7f42077fe700 1 -- 172.21.15.8:0/1757350760 learned_addr learned my addr 172.21.15.8:0/1757350760 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:12.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.649+0000 7f4207fff700 1 -- 172.21.15.8:0/1757350760 >> v1:172.21.15.184:6789/0 conn(0x7f42080cd0e0 legacy=0x7f42080b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:12.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.649+0000 7f4207fff700 1 -- 172.21.15.8:0/1757350760 >> v1:172.21.15.8:6789/0 conn(0x7f4208157a10 legacy=0x7f420815b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:12.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.649+0000 7f4206ffd700 1 -- 172.21.15.8:0/1757350760 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3455618598 0 0) 0x7f420815b040 con 0x7f4208157a10 2023-10-06T04:37:12.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.649+0000 7f4207fff700 1 -- 172.21.15.8:0/1757350760 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4208158550 con 0x7f42080c9730 2023-10-06T04:37:12.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.649+0000 7f4207fff700 1 --2- 172.21.15.8:0/1757350760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42080c9730 0x7f42080680d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f41f80098e0 tx=0x7f41f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2038676bad3a8bec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:12.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.649+0000 7f4206ffd700 1 -- 172.21.15.8:0/1757350760 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f8009e80 con 0x7f42080c9730 2023-10-06T04:37:12.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.649+0000 7f4206ffd700 1 -- 172.21.15.8:0/1757350760 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f800b820 con 0x7f42080c9730 2023-10-06T04:37:12.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.649+0000 7f4206ffd700 1 -- 172.21.15.8:0/1757350760 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f800bba0 con 0x7f42080c9730 2023-10-06T04:37:12.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.650+0000 7f420e325700 1 -- 172.21.15.8:0/1757350760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42080c9730 msgr2=0x7f42080680d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:12.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.650+0000 7f420e325700 1 --2- 172.21.15.8:0/1757350760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42080c9730 0x7f42080680d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f41f80098e0 tx=0x7f41f80091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:12.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.650+0000 7f420e325700 1 -- 172.21.15.8:0/1757350760 shutdown_connections 2023-10-06T04:37:12.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.650+0000 7f420e325700 1 --2- 172.21.15.8:0/1757350760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42080c9730 0x7f42080680d0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:12.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.650+0000 7f420e325700 1 -- 172.21.15.8:0/1757350760 >> 172.21.15.8:0/1757350760 conn(0x7f420806a770 msgr2=0x7f420806ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:12.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.650+0000 7f420e325700 1 -- 172.21.15.8:0/1757350760 shutdown_connections 2023-10-06T04:37:12.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.650+0000 7f420e325700 1 -- 172.21.15.8:0/1757350760 wait complete. 2023-10-06T04:37:12.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.651+0000 7f420e325700 1 Processor -- start 2023-10-06T04:37:12.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.651+0000 7f420e325700 1 -- start start 2023-10-06T04:37:12.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.652+0000 7f420e325700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42080c9730 0x7f42081678e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:12.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.652+0000 7f420e325700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42080cd0e0 0x7f4208152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:12.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.652+0000 7f420e325700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4208157a10 0x7f42080ac730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:12.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.652+0000 7f420e325700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42080adce0 con 0x7f42080cd0e0 2023-10-06T04:37:12.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.652+0000 7f420e325700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42080ad0b0 con 0x7f4208157a10 2023-10-06T04:37:12.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.652+0000 7f420e325700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42080ad390 con 0x7f42080c9730 2023-10-06T04:37:12.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.652+0000 7f42077fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42080cd0e0 0x7f4208152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:12.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.652+0000 7f42077fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42080cd0e0 0x7f4208152c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49268/0 (socket says 172.21.15.8:49268) 2023-10-06T04:37:12.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.652+0000 7f42077fe700 1 -- 172.21.15.8:0/1521010845 learned_addr learned my addr 172.21.15.8:0/1521010845 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:12.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.652+0000 7f420c8c2700 1 --2- 172.21.15.8:0/1521010845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4208157a10 0x7f42080ac730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:12.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.652+0000 7f42077fe700 1 -- 172.21.15.8:0/1521010845 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42080c9730 msgr2=0x7f42081678e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:12.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.652+0000 7f42077fe700 1 --2- 172.21.15.8:0/1521010845 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42080c9730 0x7f42081678e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:12.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.652+0000 7f42077fe700 1 -- 172.21.15.8:0/1521010845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4208157a10 msgr2=0x7f42080ac730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:12.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.652+0000 7f42077fe700 1 --2- 172.21.15.8:0/1521010845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4208157a10 0x7f42080ac730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:12.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.652+0000 7f42077fe700 1 -- 172.21.15.8:0/1521010845 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f8009420 con 0x7f42080cd0e0 2023-10-06T04:37:12.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.652+0000 7f42077fe700 1 --2- 172.21.15.8:0/1521010845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42080cd0e0 0x7f4208152c60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f41fc00c7e0 tx=0x7f41fc007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:12.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.653+0000 7f41effff700 1 -- 172.21.15.8:0/1521010845 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41fc005b30 con 0x7f42080cd0e0 2023-10-06T04:37:12.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.653+0000 7f41effff700 1 -- 172.21.15.8:0/1521010845 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41fc005c90 con 0x7f42080cd0e0 2023-10-06T04:37:12.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.653+0000 7f420e325700 1 -- 172.21.15.8:0/1521010845 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42080ad670 con 0x7f42080cd0e0 2023-10-06T04:37:12.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.653+0000 7f41effff700 1 -- 172.21.15.8:0/1521010845 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41fc007300 con 0x7f42080cd0e0 2023-10-06T04:37:12.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.653+0000 7f420e325700 1 -- 172.21.15.8:0/1521010845 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4208167e20 con 0x7f42080cd0e0 2023-10-06T04:37:12.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.654+0000 7f420e325700 1 -- 172.21.15.8:0/1521010845 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f420806b290 con 0x7f42080cd0e0 2023-10-06T04:37:12.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.654+0000 7f41effff700 1 -- 172.21.15.8:0/1521010845 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f41fc01b400 con 0x7f42080cd0e0 2023-10-06T04:37:12.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.654+0000 7f41effff700 1 --2- 172.21.15.8:0/1521010845 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f41f4066f60 0x7f41f4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:12.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.655+0000 7f41effff700 1 -- 172.21.15.8:0/1521010845 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f41fc083f20 con 0x7f42080cd0e0 2023-10-06T04:37:12.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.655+0000 7f4207fff700 1 --2- 172.21.15.8:0/1521010845 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f41f4066f60 0x7f41f4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:12.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.655+0000 7f4207fff700 1 --2- 172.21.15.8:0/1521010845 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f41f4066f60 0x7f41f4069410 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f41f80098e0 tx=0x7f41f8016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:12.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.659+0000 7f41effff700 1 -- 172.21.15.8:0/1521010845 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f41fc0512c0 con 0x7f42080cd0e0 2023-10-06T04:37:12.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.929+0000 7f420e325700 1 -- 172.21.15.8:0/1521010845 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f4208071550 con 0x7f42080cd0e0 2023-10-06T04:37:12.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.933+0000 7f41effff700 1 -- 172.21.15.8:0/1521010845 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f41fc0548e0 con 0x7f42080cd0e0 2023-10-06T04:37:12.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.935+0000 7f420e325700 1 -- 172.21.15.8:0/1521010845 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f41f4066f60 msgr2=0x7f41f4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:12.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.935+0000 7f420e325700 1 --2- 172.21.15.8:0/1521010845 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f41f4066f60 0x7f41f4069410 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f41f80098e0 tx=0x7f41f8016000 comp rx=0 tx=0).stop 2023-10-06T04:37:12.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.935+0000 7f420e325700 1 -- 172.21.15.8:0/1521010845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42080cd0e0 msgr2=0x7f4208152c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:12.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.935+0000 7f420e325700 1 --2- 172.21.15.8:0/1521010845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42080cd0e0 0x7f4208152c60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f41fc00c7e0 tx=0x7f41fc007df0 comp rx=0 tx=0).stop 2023-10-06T04:37:12.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.935+0000 7f420e325700 1 -- 172.21.15.8:0/1521010845 shutdown_connections 2023-10-06T04:37:12.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.935+0000 7f420e325700 1 --2- 172.21.15.8:0/1521010845 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f41f4066f60 0x7f41f4069410 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:12.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.935+0000 7f420e325700 1 --2- 172.21.15.8:0/1521010845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4208157a10 0x7f42080ac730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:12.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.935+0000 7f420e325700 1 --2- 172.21.15.8:0/1521010845 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42080c9730 0x7f42081678e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:12.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.935+0000 7f420e325700 1 --2- 172.21.15.8:0/1521010845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42080cd0e0 0x7f4208152c60 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:12.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.935+0000 7f420e325700 1 -- 172.21.15.8:0/1521010845 >> 172.21.15.8:0/1521010845 conn(0x7f420806a770 msgr2=0x7f4208159de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:12.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.936+0000 7f420e325700 1 -- 172.21.15.8:0/1521010845 shutdown_connections 2023-10-06T04:37:12.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:12.936+0000 7f420e325700 1 -- 172.21.15.8:0/1521010845 wait complete. 2023-10-06T04:37:12.949 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-06T04:37:13.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.067+0000 7eff4d847700 1 Processor -- start 2023-10-06T04:37:13.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.067+0000 7eff4d847700 1 -- start start 2023-10-06T04:37:13.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.068+0000 7eff4d847700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7eff481595e0 0x7eff480d0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:13.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.068+0000 7eff4d847700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff480b4eb0 0x7eff480d0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:13.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.068+0000 7eff4d847700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff480b3a10 con 0x7eff48159210 2023-10-06T04:37:13.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.068+0000 7eff4d847700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff480cfc70 con 0x7eff481595e0 2023-10-06T04:37:13.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.068+0000 7eff4d847700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff480b3100 con 0x7eff480b4eb0 2023-10-06T04:37:13.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.068+0000 7eff477fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff480b4eb0 0x7eff480d0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:13.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.068+0000 7eff467fc700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7eff481595e0 0x7eff480d0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:13.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.069+0000 7eff467fc700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7eff481595e0 0x7eff480d0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.8:33710/0 (socket says 172.21.15.8:33710) 2023-10-06T04:37:13.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.069+0000 7eff467fc700 1 -- 172.21.15.8:0/1678287908 learned_addr learned my addr 172.21.15.8:0/1678287908 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:13.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.069+0000 7eff45ffb700 1 -- 172.21.15.8:0/1678287908 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1314595132 0 0) 0x7eff480b3a10 con 0x7eff48159210 2023-10-06T04:37:13.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.069+0000 7eff45ffb700 1 -- 172.21.15.8:0/1678287908 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff34003570 con 0x7eff48159210 2023-10-06T04:37:13.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.069+0000 7eff477fe700 1 -- 172.21.15.8:0/1678287908 >> v2:172.21.15.184:3300/0 conn(0x7eff481595e0 msgr2=0x7eff480d0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:13.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.069+0000 7eff477fe700 1 --2- 172.21.15.8:0/1678287908 >> v2:172.21.15.184:3300/0 conn(0x7eff481595e0 0x7eff480d0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:13.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.069+0000 7eff477fe700 1 -- 172.21.15.8:0/1678287908 >> v1:172.21.15.184:6789/0 conn(0x7eff48159210 legacy=0x7eff480cf3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:13.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.069+0000 7eff477fe700 1 -- 172.21.15.8:0/1678287908 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff480b33c0 con 0x7eff480b4eb0 2023-10-06T04:37:13.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.069+0000 7eff467fc700 1 --2- 172.21.15.8:0/1678287908 >> v2:172.21.15.184:3300/0 conn(0x7eff481595e0 0x7eff480d0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:37:13.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.069+0000 7eff477fe700 1 --2- 172.21.15.8:0/1678287908 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff480b4eb0 0x7eff480d0650 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7eff40009e60 tx=0x7eff40009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fd04894a75b577c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:13.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.069+0000 7eff45ffb700 1 -- 172.21.15.8:0/1678287908 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4000e070 con 0x7eff480b4eb0 2023-10-06T04:37:13.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.069+0000 7eff45ffb700 1 -- 172.21.15.8:0/1678287908 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4000bab0 con 0x7eff480b4eb0 2023-10-06T04:37:13.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.069+0000 7eff45ffb700 1 -- 172.21.15.8:0/1678287908 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4000be70 con 0x7eff480b4eb0 2023-10-06T04:37:13.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.070+0000 7eff4d847700 1 -- 172.21.15.8:0/1678287908 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff480b4eb0 msgr2=0x7eff480d0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:13.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.070+0000 7eff4d847700 1 --2- 172.21.15.8:0/1678287908 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff480b4eb0 0x7eff480d0650 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7eff40009e60 tx=0x7eff40009780 comp rx=0 tx=0).stop 2023-10-06T04:37:13.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.070+0000 7eff4d847700 1 -- 172.21.15.8:0/1678287908 shutdown_connections 2023-10-06T04:37:13.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.070+0000 7eff4d847700 1 --2- 172.21.15.8:0/1678287908 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff480b4eb0 0x7eff480d0650 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:13.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.070+0000 7eff4d847700 1 --2- 172.21.15.8:0/1678287908 >> v2:172.21.15.184:3300/0 conn(0x7eff481595e0 0x7eff480d0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:13.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.070+0000 7eff4d847700 1 -- 172.21.15.8:0/1678287908 >> 172.21.15.8:0/1678287908 conn(0x7eff4806f790 msgr2=0x7eff48068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:13.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.070+0000 7eff4d847700 1 -- 172.21.15.8:0/1678287908 shutdown_connections 2023-10-06T04:37:13.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.070+0000 7eff4d847700 1 -- 172.21.15.8:0/1678287908 wait complete. 2023-10-06T04:37:13.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.071+0000 7eff4d847700 1 Processor -- start 2023-10-06T04:37:13.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.071+0000 7eff4d847700 1 -- start start 2023-10-06T04:37:13.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.072+0000 7eff4d847700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff480b4eb0 0x7eff4815b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:13.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.072+0000 7eff4d847700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff48159210 0x7eff4815cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:13.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.072+0000 7eff4d847700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff481595e0 0x7eff4815d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:13.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.072+0000 7eff4d847700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff48168bc0 con 0x7eff481595e0 2023-10-06T04:37:13.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.072+0000 7eff4d847700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff48169110 con 0x7eff480b4eb0 2023-10-06T04:37:13.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.072+0000 7eff4d847700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff48168de0 con 0x7eff48159210 2023-10-06T04:37:13.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.072+0000 7eff477fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff481595e0 0x7eff4815d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:13.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.072+0000 7eff477fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff481595e0 0x7eff4815d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49282/0 (socket says 172.21.15.8:49282) 2023-10-06T04:37:13.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.072+0000 7eff477fe700 1 -- 172.21.15.8:0/2868823955 learned_addr learned my addr 172.21.15.8:0/2868823955 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:13.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.072+0000 7eff467fc700 1 --2- 172.21.15.8:0/2868823955 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff48159210 0x7eff4815cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:13.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.072+0000 7eff46ffd700 1 --2- 172.21.15.8:0/2868823955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff480b4eb0 0x7eff4815b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:13.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.073+0000 7eff477fe700 1 -- 172.21.15.8:0/2868823955 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff48159210 msgr2=0x7eff4815cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:13.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.073+0000 7eff477fe700 1 --2- 172.21.15.8:0/2868823955 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff48159210 0x7eff4815cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:13.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.073+0000 7eff477fe700 1 -- 172.21.15.8:0/2868823955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff480b4eb0 msgr2=0x7eff4815b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:13.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.073+0000 7eff477fe700 1 --2- 172.21.15.8:0/2868823955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff480b4eb0 0x7eff4815b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:13.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.073+0000 7eff477fe700 1 -- 172.21.15.8:0/2868823955 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff300094f0 con 0x7eff481595e0 2023-10-06T04:37:13.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.073+0000 7eff477fe700 1 --2- 172.21.15.8:0/2868823955 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff481595e0 0x7eff4815d480 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7eff4000b610 tx=0x7eff40019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:13.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.073+0000 7eff3effd700 1 -- 172.21.15.8:0/2868823955 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff40012dd0 con 0x7eff481595e0 2023-10-06T04:37:13.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.073+0000 7eff3effd700 1 -- 172.21.15.8:0/2868823955 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff40027470 con 0x7eff481595e0 2023-10-06T04:37:13.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.073+0000 7eff4d847700 1 -- 172.21.15.8:0/2868823955 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff40009a20 con 0x7eff481595e0 2023-10-06T04:37:13.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.073+0000 7eff3effd700 1 -- 172.21.15.8:0/2868823955 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff40027830 con 0x7eff481595e0 2023-10-06T04:37:13.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.073+0000 7eff4d847700 1 -- 172.21.15.8:0/2868823955 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff4815c0a0 con 0x7eff481595e0 2023-10-06T04:37:13.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.074+0000 7eff4d847700 1 -- 172.21.15.8:0/2868823955 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff4804c380 con 0x7eff481595e0 2023-10-06T04:37:13.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.074+0000 7eff3effd700 1 -- 172.21.15.8:0/2868823955 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff40024070 con 0x7eff481595e0 2023-10-06T04:37:13.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.075+0000 7eff3effd700 1 --2- 172.21.15.8:0/2868823955 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7eff28066f30 0x7eff280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:13.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.075+0000 7eff3effd700 1 -- 172.21.15.8:0/2868823955 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5526+0+0 (secure 0 0 0) 0x7eff40086e60 con 0x7eff481595e0 2023-10-06T04:37:13.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.075+0000 7eff46ffd700 1 --2- 172.21.15.8:0/2868823955 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7eff28066f30 0x7eff280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:13.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.076+0000 7eff46ffd700 1 --2- 172.21.15.8:0/2868823955 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7eff28066f30 0x7eff280693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7eff38007fd0 tx=0x7eff38007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:13.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.079+0000 7eff3effd700 1 -- 172.21.15.8:0/2868823955 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff40054180 con 0x7eff481595e0 2023-10-06T04:37:13.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.352+0000 7eff4d847700 1 -- 172.21.15.8:0/2868823955 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7eff48169250 con 0x7eff481595e0 2023-10-06T04:37:13.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.355+0000 7eff3effd700 1 -- 172.21.15.8:0/2868823955 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7eff400577a0 con 0x7eff481595e0 2023-10-06T04:37:13.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.357+0000 7eff4d847700 1 -- 172.21.15.8:0/2868823955 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7eff28066f30 msgr2=0x7eff280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:13.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.357+0000 7eff4d847700 1 --2- 172.21.15.8:0/2868823955 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7eff28066f30 0x7eff280693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7eff38007fd0 tx=0x7eff38007d50 comp rx=0 tx=0).stop 2023-10-06T04:37:13.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.357+0000 7eff4d847700 1 -- 172.21.15.8:0/2868823955 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff481595e0 msgr2=0x7eff4815d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:13.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.357+0000 7eff4d847700 1 --2- 172.21.15.8:0/2868823955 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff481595e0 0x7eff4815d480 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7eff4000b610 tx=0x7eff40019000 comp rx=0 tx=0).stop 2023-10-06T04:37:13.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.357+0000 7eff4d847700 1 -- 172.21.15.8:0/2868823955 shutdown_connections 2023-10-06T04:37:13.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.357+0000 7eff4d847700 1 --2- 172.21.15.8:0/2868823955 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7eff28066f30 0x7eff280693e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:13.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.357+0000 7eff4d847700 1 --2- 172.21.15.8:0/2868823955 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff481595e0 0x7eff4815d480 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:13.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.357+0000 7eff4d847700 1 --2- 172.21.15.8:0/2868823955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff480b4eb0 0x7eff4815b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:13.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.357+0000 7eff4d847700 1 --2- 172.21.15.8:0/2868823955 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff48159210 0x7eff4815cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:13.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.357+0000 7eff4d847700 1 -- 172.21.15.8:0/2868823955 >> 172.21.15.8:0/2868823955 conn(0x7eff4806f790 msgr2=0x7eff480cc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:13.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.357+0000 7eff4d847700 1 -- 172.21.15.8:0/2868823955 shutdown_connections 2023-10-06T04:37:13.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.357+0000 7eff4d847700 1 -- 172.21.15.8:0/2868823955 wait complete. 2023-10-06T04:37:13.371 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:37:13.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.488+0000 7f2277689700 1 Processor -- start 2023-10-06T04:37:13.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.488+0000 7f2277689700 1 -- start start 2023-10-06T04:37:13.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.489+0000 7f2277689700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f22700af680 0x7f227015e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:13.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.489+0000 7f2277689700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22700d0aa0 0x7f22700cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:13.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.489+0000 7f2277689700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22700cc4c0 con 0x7f22700cb360 2023-10-06T04:37:13.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.489+0000 7f2277689700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f227015d460 con 0x7f22700af680 2023-10-06T04:37:13.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.489+0000 7f2277689700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227015e580 con 0x7f22700d0aa0 2023-10-06T04:37:13.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.489+0000 7f2275425700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f22700af680 0x7f227015e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:13.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.489+0000 7f2274c24700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f22700cb360 0x7f22700d0390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41146/0 (socket says 172.21.15.8:41146) 2023-10-06T04:37:13.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.489+0000 7f2274c24700 1 -- 172.21.15.8:0/3321955308 learned_addr learned my addr 172.21.15.8:0/3321955308 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:13.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.490+0000 7f2275c26700 1 --2- 172.21.15.8:0/3321955308 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22700d0aa0 0x7f22700cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:13.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.490+0000 7f2275425700 1 -- 172.21.15.8:0/3321955308 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22700d0aa0 msgr2=0x7f22700cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:13.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.490+0000 7f2275425700 1 --2- 172.21.15.8:0/3321955308 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22700d0aa0 0x7f22700cc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:13.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.490+0000 7f2275425700 1 -- 172.21.15.8:0/3321955308 >> v1:172.21.15.8:6789/0 conn(0x7f22700cb360 legacy=0x7f22700d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:13.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.490+0000 7f226ffff700 1 -- 172.21.15.8:0/3321955308 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494450044 0 0) 0x7f22700cc4c0 con 0x7f22700cb360 2023-10-06T04:37:13.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.490+0000 7f2275425700 1 -- 172.21.15.8:0/3321955308 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22700cb8b0 con 0x7f22700af680 2023-10-06T04:37:13.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.490+0000 7f2275425700 1 --2- 172.21.15.8:0/3321955308 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22700af680 0x7f227015e040 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f22680098e0 tx=0x7f22680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f518fcd2a2bd6cf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:13.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.490+0000 7f226ffff700 1 -- 172.21.15.8:0/3321955308 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2268009e80 con 0x7f22700af680 2023-10-06T04:37:13.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.490+0000 7f226ffff700 1 -- 172.21.15.8:0/3321955308 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226800b860 con 0x7f22700af680 2023-10-06T04:37:13.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.490+0000 7f226ffff700 1 -- 172.21.15.8:0/3321955308 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226800bbe0 con 0x7f22700af680 2023-10-06T04:37:13.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.490+0000 7f2277689700 1 -- 172.21.15.8:0/3321955308 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22700af680 msgr2=0x7f227015e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:13.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.490+0000 7f2277689700 1 --2- 172.21.15.8:0/3321955308 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22700af680 0x7f227015e040 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f22680098e0 tx=0x7f22680091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:13.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.490+0000 7f2277689700 1 -- 172.21.15.8:0/3321955308 shutdown_connections 2023-10-06T04:37:13.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.490+0000 7f2277689700 1 --2- 172.21.15.8:0/3321955308 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22700d0aa0 0x7f22700cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:13.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.490+0000 7f2277689700 1 --2- 172.21.15.8:0/3321955308 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22700af680 0x7f227015e040 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:13.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.491+0000 7f2277689700 1 -- 172.21.15.8:0/3321955308 >> 172.21.15.8:0/3321955308 conn(0x7f22700633d0 msgr2=0x7f22700637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:13.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.491+0000 7f2277689700 1 -- 172.21.15.8:0/3321955308 shutdown_connections 2023-10-06T04:37:13.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.491+0000 7f2277689700 1 -- 172.21.15.8:0/3321955308 wait complete. 2023-10-06T04:37:13.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.492+0000 7f2277689700 1 Processor -- start 2023-10-06T04:37:13.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.492+0000 7f2277689700 1 -- start start 2023-10-06T04:37:13.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.493+0000 7f2277689700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22700af680 0x7f2270152c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:13.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.493+0000 7f2277689700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22700cb360 0x7f227006ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:13.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.493+0000 7f2277689700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22700d0aa0 0x7f227006f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:13.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.493+0000 7f2277689700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22700c5ae0 con 0x7f22700d0aa0 2023-10-06T04:37:13.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.493+0000 7f2277689700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2270153190 con 0x7f22700cb360 2023-10-06T04:37:13.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.493+0000 7f2277689700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2270169eb0 con 0x7f22700af680 2023-10-06T04:37:13.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.493+0000 7f2275c26700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22700d0aa0 0x7f227006f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:13.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.493+0000 7f2275c26700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22700d0aa0 0x7f227006f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49296/0 (socket says 172.21.15.8:49296) 2023-10-06T04:37:13.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.493+0000 7f2275c26700 1 -- 172.21.15.8:0/1089165688 learned_addr learned my addr 172.21.15.8:0/1089165688 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:13.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.493+0000 7f2274c24700 1 --2- 172.21.15.8:0/1089165688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22700cb360 0x7f227006ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:13.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.493+0000 7f2275c26700 1 -- 172.21.15.8:0/1089165688 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22700af680 msgr2=0x7f2270152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:13.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.493+0000 7f2275425700 1 --2- 172.21.15.8:0/1089165688 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22700af680 0x7f2270152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:13.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.493+0000 7f2275c26700 1 --2- 172.21.15.8:0/1089165688 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22700af680 0x7f2270152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:13.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.493+0000 7f2275c26700 1 -- 172.21.15.8:0/1089165688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22700cb360 msgr2=0x7f227006ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:13.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.493+0000 7f2275c26700 1 --2- 172.21.15.8:0/1089165688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22700cb360 0x7f227006ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:13.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.493+0000 7f2275c26700 1 -- 172.21.15.8:0/1089165688 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2268009420 con 0x7f22700d0aa0 2023-10-06T04:37:13.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.493+0000 7f2274c24700 1 --2- 172.21.15.8:0/1089165688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22700cb360 0x7f227006ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:13.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.493+0000 7f2275425700 1 --2- 172.21.15.8:0/1089165688 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22700af680 0x7f2270152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:13.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.493+0000 7f2275c26700 1 --2- 172.21.15.8:0/1089165688 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22700d0aa0 0x7f227006f240 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f226000ceb0 tx=0x7f2260007840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:13.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.493+0000 7f226d7fa700 1 -- 172.21.15.8:0/1089165688 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226000ada0 con 0x7f22700d0aa0 2023-10-06T04:37:13.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.493+0000 7f226d7fa700 1 -- 172.21.15.8:0/1089165688 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2260016430 con 0x7f22700d0aa0 2023-10-06T04:37:13.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.493+0000 7f2277689700 1 -- 172.21.15.8:0/1089165688 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f227016aec0 con 0x7f22700d0aa0 2023-10-06T04:37:13.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.493+0000 7f226d7fa700 1 -- 172.21.15.8:0/1089165688 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22600167d0 con 0x7f22700d0aa0 2023-10-06T04:37:13.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.493+0000 7f2277689700 1 -- 172.21.15.8:0/1089165688 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f227016a400 con 0x7f22700d0aa0 2023-10-06T04:37:13.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.494+0000 7f2277689700 1 -- 172.21.15.8:0/1089165688 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f227016ad30 con 0x7f22700d0aa0 2023-10-06T04:37:13.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.495+0000 7f226d7fa700 1 -- 172.21.15.8:0/1089165688 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2260003020 con 0x7f22700d0aa0 2023-10-06T04:37:13.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.495+0000 7f226d7fa700 1 --2- 172.21.15.8:0/1089165688 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f225c066f30 0x7f225c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:13.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.495+0000 7f226d7fa700 1 -- 172.21.15.8:0/1089165688 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f2260012070 con 0x7f22700d0aa0 2023-10-06T04:37:13.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.495+0000 7f2275425700 1 --2- 172.21.15.8:0/1089165688 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f225c066f30 0x7f225c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:13.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.496+0000 7f2275425700 1 --2- 172.21.15.8:0/1089165688 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f225c066f30 0x7f225c0693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f22700b4720 tx=0x7f2268017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:13.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.499+0000 7f226d7fa700 1 -- 172.21.15.8:0/1089165688 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2260052650 con 0x7f22700d0aa0 2023-10-06T04:37:13.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.695+0000 7f2277689700 1 -- 172.21.15.8:0/1089165688 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22700ce8c0 con 0x7f22700d0aa0 2023-10-06T04:37:13.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.695+0000 7f226d7fa700 1 -- 172.21.15.8:0/1089165688 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+13807 (secure 0 0 0) 0x7f2260055c70 con 0x7f22700d0aa0 2023-10-06T04:37:13.697 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:13.698 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":34,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:37:10.393149+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:36:10.148177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:36:10.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.555871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.490505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.504578+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.517217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:05.991135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.537329+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.543232+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.443715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:37:13.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.697+0000 7f2277689700 1 -- 172.21.15.8:0/1089165688 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f225c066f30 msgr2=0x7f225c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:13.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.697+0000 7f2277689700 1 --2- 172.21.15.8:0/1089165688 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f225c066f30 0x7f225c0693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f22700b4720 tx=0x7f2268017000 comp rx=0 tx=0).stop 2023-10-06T04:37:13.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.697+0000 7f2277689700 1 -- 172.21.15.8:0/1089165688 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22700d0aa0 msgr2=0x7f227006f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:13.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.697+0000 7f2277689700 1 --2- 172.21.15.8:0/1089165688 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22700d0aa0 0x7f227006f240 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f226000ceb0 tx=0x7f2260007840 comp rx=0 tx=0).stop 2023-10-06T04:37:13.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.697+0000 7f2277689700 1 -- 172.21.15.8:0/1089165688 shutdown_connections 2023-10-06T04:37:13.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.697+0000 7f2277689700 1 --2- 172.21.15.8:0/1089165688 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f225c066f30 0x7f225c0693e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:13.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.697+0000 7f2277689700 1 --2- 172.21.15.8:0/1089165688 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22700d0aa0 0x7f227006f240 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:13.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.697+0000 7f2277689700 1 --2- 172.21.15.8:0/1089165688 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22700af680 0x7f2270152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:13.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.697+0000 7f2277689700 1 --2- 172.21.15.8:0/1089165688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22700cb360 0x7f227006ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:13.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.697+0000 7f2277689700 1 -- 172.21.15.8:0/1089165688 >> 172.21.15.8:0/1089165688 conn(0x7f22700633d0 msgr2=0x7f22700cea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:13.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.698+0000 7f2277689700 1 -- 172.21.15.8:0/1089165688 shutdown_connections 2023-10-06T04:37:13.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.698+0000 7f2277689700 1 -- 172.21.15.8:0/1089165688 wait complete. 2023-10-06T04:37:13.711 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:36:10.148177+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:36:10.684157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T04:37:13.712 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:37:13.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.834+0000 7f4adadd8700 1 Processor -- start 2023-10-06T04:37:13.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.834+0000 7f4adadd8700 1 -- start start 2023-10-06T04:37:13.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.835+0000 7f4adadd8700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4ad41430c0 0x7f4ad40cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:13.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.835+0000 7f4adadd8700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad40cf510 con 0x7f4ad4142cf0 2023-10-06T04:37:13.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.835+0000 7f4adadd8700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad40ce6a0 con 0x7f4ad40cfee0 2023-10-06T04:37:13.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.835+0000 7f4adadd8700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad40ce900 con 0x7f4ad41430c0 2023-10-06T04:37:13.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.835+0000 7f4ad8b74700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f4ad4142cf0 0x7f4ad40b5cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41156/0 (socket says 172.21.15.8:41156) 2023-10-06T04:37:13.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.835+0000 7f4ad8b74700 1 -- 172.21.15.8:0/3758453965 learned_addr learned my addr 172.21.15.8:0/3758453965 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:13.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.835+0000 7f4ad3fff700 1 --2- 172.21.15.8:0/3758453965 >> v2:172.21.15.184:3300/0 conn(0x7f4ad41430c0 0x7f4ad40cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:13.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.835+0000 7f4ad37fe700 1 -- 172.21.15.8:0/3758453965 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 964629676 0 0) 0x7f4ad40cf510 con 0x7f4ad4142cf0 2023-10-06T04:37:13.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.835+0000 7f4ad37fe700 1 -- 172.21.15.8:0/3758453965 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ac4003570 con 0x7f4ad4142cf0 2023-10-06T04:37:13.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.835+0000 7f4ad37fe700 1 -- 172.21.15.8:0/3758453965 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 740706791 0 0) 0x7f4ad40ce6a0 con 0x7f4ad40cfee0 2023-10-06T04:37:13.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.835+0000 7f4ad37fe700 1 -- 172.21.15.8:0/3758453965 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ad40cf510 con 0x7f4ad40cfee0 2023-10-06T04:37:13.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.835+0000 7f4ad3fff700 1 -- 172.21.15.8:0/3758453965 >> v1:172.21.15.184:6789/0 conn(0x7f4ad40cfee0 legacy=0x7f4ad40b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:13.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.835+0000 7f4ad3fff700 1 -- 172.21.15.8:0/3758453965 >> v1:172.21.15.8:6789/0 conn(0x7f4ad4142cf0 legacy=0x7f4ad40b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:13.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.835+0000 7f4ad37fe700 1 -- 172.21.15.8:0/3758453965 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 163513475 0 0) 0x7f4ac4003570 con 0x7f4ad4142cf0 2023-10-06T04:37:13.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.835+0000 7f4ad3fff700 1 -- 172.21.15.8:0/3758453965 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad40cebe0 con 0x7f4ad41430c0 2023-10-06T04:37:13.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.836+0000 7f4ad3fff700 1 --2- 172.21.15.8:0/3758453965 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ad41430c0 0x7f4ad40cf9a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4ac00098e0 tx=0x7f4ac00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=538aa79419d68912 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:13.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.836+0000 7f4ad37fe700 1 -- 172.21.15.8:0/3758453965 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8001470 con 0x7f4ad41430c0 2023-10-06T04:37:13.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.836+0000 7f4ad37fe700 1 -- 172.21.15.8:0/3758453965 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac0011420 con 0x7f4ad41430c0 2023-10-06T04:37:13.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.836+0000 7f4ad37fe700 1 -- 172.21.15.8:0/3758453965 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac00117c0 con 0x7f4ad41430c0 2023-10-06T04:37:13.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.836+0000 7f4adadd8700 1 -- 172.21.15.8:0/3758453965 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ad41430c0 msgr2=0x7f4ad40cf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:13.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.836+0000 7f4adadd8700 1 --2- 172.21.15.8:0/3758453965 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ad41430c0 0x7f4ad40cf9a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4ac00098e0 tx=0x7f4ac00091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:13.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.836+0000 7f4adadd8700 1 -- 172.21.15.8:0/3758453965 shutdown_connections 2023-10-06T04:37:13.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.836+0000 7f4adadd8700 1 --2- 172.21.15.8:0/3758453965 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ad41430c0 0x7f4ad40cf9a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:13.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.836+0000 7f4adadd8700 1 -- 172.21.15.8:0/3758453965 >> 172.21.15.8:0/3758453965 conn(0x7f4ad406ed00 msgr2=0x7f4ad406f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:13.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.836+0000 7f4adadd8700 1 -- 172.21.15.8:0/3758453965 shutdown_connections 2023-10-06T04:37:13.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.836+0000 7f4adadd8700 1 -- 172.21.15.8:0/3758453965 wait complete. 2023-10-06T04:37:13.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.837+0000 7f4adadd8700 1 Processor -- start 2023-10-06T04:37:13.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.838+0000 7f4adadd8700 1 -- start start 2023-10-06T04:37:13.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.838+0000 7f4adadd8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ad40cfee0 0x7f4ad416a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:13.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.838+0000 7f4adadd8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ad4142cf0 0x7f4ad415f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:13.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.838+0000 7f4adadd8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ad41430c0 0x7f4ad40aa670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:13.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.838+0000 7f4adadd8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad416d1b0 con 0x7f4ad40cfee0 2023-10-06T04:37:13.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.838+0000 7f4adadd8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad415f9a0 con 0x7f4ad4142cf0 2023-10-06T04:37:13.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.838+0000 7f4adadd8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad416d400 con 0x7f4ad41430c0 2023-10-06T04:37:13.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.838+0000 7f4ad8b74700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ad40cfee0 0x7f4ad416a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:13.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.839+0000 7f4ad8b74700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ad40cfee0 0x7f4ad416a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49298/0 (socket says 172.21.15.8:49298) 2023-10-06T04:37:13.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.839+0000 7f4ad8b74700 1 -- 172.21.15.8:0/1862655574 learned_addr learned my addr 172.21.15.8:0/1862655574 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:13.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.839+0000 7f4ad3fff700 1 --2- 172.21.15.8:0/1862655574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ad4142cf0 0x7f4ad415f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:13.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.839+0000 7f4ad9375700 1 --2- 172.21.15.8:0/1862655574 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ad41430c0 0x7f4ad40aa670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:13.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.839+0000 7f4ad8b74700 1 -- 172.21.15.8:0/1862655574 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ad41430c0 msgr2=0x7f4ad40aa670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:13.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.839+0000 7f4ad8b74700 1 --2- 172.21.15.8:0/1862655574 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ad41430c0 0x7f4ad40aa670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:13.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.839+0000 7f4ad8b74700 1 -- 172.21.15.8:0/1862655574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ad4142cf0 msgr2=0x7f4ad415f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:13.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.839+0000 7f4ad8b74700 1 --2- 172.21.15.8:0/1862655574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ad4142cf0 0x7f4ad415f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:13.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.839+0000 7f4ad8b74700 1 -- 172.21.15.8:0/1862655574 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac0009420 con 0x7f4ad40cfee0 2023-10-06T04:37:13.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.839+0000 7f4ad9375700 1 --2- 172.21.15.8:0/1862655574 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ad41430c0 0x7f4ad40aa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:13.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.839+0000 7f4ad8b74700 1 --2- 172.21.15.8:0/1862655574 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ad40cfee0 0x7f4ad416a700 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800cb90 tx=0x7f4ac8001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:13.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.839+0000 7f4ad0ff9700 1 -- 172.21.15.8:0/1862655574 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8007360 con 0x7f4ad40cfee0 2023-10-06T04:37:13.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.839+0000 7f4ad0ff9700 1 -- 172.21.15.8:0/1862655574 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac80074e0 con 0x7f4ad40cfee0 2023-10-06T04:37:13.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.839+0000 7f4adadd8700 1 -- 172.21.15.8:0/1862655574 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad416d6e0 con 0x7f4ad40cfee0 2023-10-06T04:37:13.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.839+0000 7f4ad0ff9700 1 -- 172.21.15.8:0/1862655574 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8004830 con 0x7f4ad40cfee0 2023-10-06T04:37:13.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.839+0000 7f4adadd8700 1 -- 172.21.15.8:0/1862655574 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad416dca0 con 0x7f4ad40cfee0 2023-10-06T04:37:13.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.840+0000 7f4adadd8700 1 -- 172.21.15.8:0/1862655574 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad4071550 con 0x7f4ad40cfee0 2023-10-06T04:37:13.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.841+0000 7f4ad0ff9700 1 -- 172.21.15.8:0/1862655574 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4ac8004be0 con 0x7f4ad40cfee0 2023-10-06T04:37:13.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.841+0000 7f4ad0ff9700 1 --2- 172.21.15.8:0/1862655574 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4ab8066f30 0x7f4ab80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:13.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.841+0000 7f4ad0ff9700 1 -- 172.21.15.8:0/1862655574 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f4ac8083c00 con 0x7f4ad40cfee0 2023-10-06T04:37:13.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.841+0000 7f4ad3fff700 1 --2- 172.21.15.8:0/1862655574 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4ab8066f30 0x7f4ab80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:13.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.842+0000 7f4ad3fff700 1 --2- 172.21.15.8:0/1862655574 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4ab8066f30 0x7f4ab80693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4ac00093f0 tx=0x7f4ac0016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:13.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:13.846+0000 7f4ad0ff9700 1 -- 172.21.15.8:0/1862655574 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ac808a080 con 0x7f4ad40cfee0 2023-10-06T04:37:14.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.038+0000 7f4adadd8700 1 -- 172.21.15.8:0/1862655574 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4ad40ceec0 con 0x7f4ad40cfee0 2023-10-06T04:37:14.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.038+0000 7f4ad0ff9700 1 -- 172.21.15.8:0/1862655574 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v34) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4ac80180a0 con 0x7f4ad40cfee0 2023-10-06T04:37:14.040 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 8 2023-10-06T04:37:14.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.040+0000 7f4adadd8700 1 -- 172.21.15.8:0/1862655574 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4ab8066f30 msgr2=0x7f4ab80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:14.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.040+0000 7f4adadd8700 1 --2- 172.21.15.8:0/1862655574 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4ab8066f30 0x7f4ab80693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4ac00093f0 tx=0x7f4ac0016000 comp rx=0 tx=0).stop 2023-10-06T04:37:14.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.040+0000 7f4adadd8700 1 -- 172.21.15.8:0/1862655574 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ad40cfee0 msgr2=0x7f4ad416a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:14.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.040+0000 7f4adadd8700 1 --2- 172.21.15.8:0/1862655574 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ad40cfee0 0x7f4ad416a700 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800cb90 tx=0x7f4ac8001b50 comp rx=0 tx=0).stop 2023-10-06T04:37:14.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.040+0000 7f4adadd8700 1 -- 172.21.15.8:0/1862655574 shutdown_connections 2023-10-06T04:37:14.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.040+0000 7f4adadd8700 1 --2- 172.21.15.8:0/1862655574 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4ab8066f30 0x7f4ab80693e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:14.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.040+0000 7f4adadd8700 1 --2- 172.21.15.8:0/1862655574 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ad41430c0 0x7f4ad40aa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:14.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.040+0000 7f4adadd8700 1 --2- 172.21.15.8:0/1862655574 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ad40cfee0 0x7f4ad416a700 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:14.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.040+0000 7f4adadd8700 1 --2- 172.21.15.8:0/1862655574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ad4142cf0 0x7f4ad415f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:14.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.040+0000 7f4adadd8700 1 -- 172.21.15.8:0/1862655574 >> 172.21.15.8:0/1862655574 conn(0x7f4ad406ed00 msgr2=0x7f4ad40b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:14.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.040+0000 7f4adadd8700 1 -- 172.21.15.8:0/1862655574 shutdown_connections 2023-10-06T04:37:14.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.040+0000 7f4adadd8700 1 -- 172.21.15.8:0/1862655574 wait complete. 2023-10-06T04:37:14.053 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:37:14.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.173+0000 7f5250eed700 1 Processor -- start 2023-10-06T04:37:14.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.173+0000 7f5250eed700 1 -- start start 2023-10-06T04:37:14.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.174+0000 7f5250eed700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f524c06d1f0 0x7f524c142690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:14.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.174+0000 7f5250eed700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f524c06d5c0 0x7f524c142bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:14.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.174+0000 7f5250eed700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f524c15d340 0x7f524c15d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:14.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.174+0000 7f5250eed700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f524c15e0b0 con 0x7f524c06d1f0 2023-10-06T04:37:14.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.174+0000 7f5250eed700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f524c1599c0 con 0x7f524c15d340 2023-10-06T04:37:14.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.174+0000 7f5250eed700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f524c068810 con 0x7f524c06d5c0 2023-10-06T04:37:14.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.174+0000 7f524a59c700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f524c06d1f0 0x7f524c142690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:14.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.175+0000 7f524a59c700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f524c06d1f0 0x7f524c142690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49314/0 (socket says 172.21.15.8:49314) 2023-10-06T04:37:14.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.175+0000 7f524a59c700 1 -- 172.21.15.8:0/965110672 learned_addr learned my addr 172.21.15.8:0/965110672 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:14.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.175+0000 7f524ad9d700 1 --2- 172.21.15.8:0/965110672 >> v2:172.21.15.184:3300/0 conn(0x7f524c15d340 0x7f524c15d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:14.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.175+0000 7f5249d9b700 1 --2- 172.21.15.8:0/965110672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f524c06d5c0 0x7f524c142bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:14.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.175+0000 7f524a59c700 1 -- 172.21.15.8:0/965110672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f524c06d5c0 msgr2=0x7f524c142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:14.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.175+0000 7f524a59c700 1 --2- 172.21.15.8:0/965110672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f524c06d5c0 0x7f524c142bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:14.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.175+0000 7f524a59c700 1 -- 172.21.15.8:0/965110672 >> v2:172.21.15.184:3300/0 conn(0x7f524c15d340 msgr2=0x7f524c15d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:14.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.175+0000 7f524a59c700 1 --2- 172.21.15.8:0/965110672 >> v2:172.21.15.184:3300/0 conn(0x7f524c15d340 0x7f524c15d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:14.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.175+0000 7f524a59c700 1 -- 172.21.15.8:0/965110672 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524c068af0 con 0x7f524c06d1f0 2023-10-06T04:37:14.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.175+0000 7f524a59c700 1 --2- 172.21.15.8:0/965110672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f524c06d1f0 0x7f524c142690 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f524c0ca160 tx=0x7f5244009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce84934b89b59aa6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:14.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.175+0000 7f524959a700 1 -- 172.21.15.8:0/965110672 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524400e070 con 0x7f524c06d1f0 2023-10-06T04:37:14.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.175+0000 7f524959a700 1 -- 172.21.15.8:0/965110672 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f524400b970 con 0x7f524c06d1f0 2023-10-06T04:37:14.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.175+0000 7f524959a700 1 -- 172.21.15.8:0/965110672 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52440092e0 con 0x7f524c06d1f0 2023-10-06T04:37:14.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.176+0000 7f5250eed700 1 -- 172.21.15.8:0/965110672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f524c06d1f0 msgr2=0x7f524c142690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:14.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.176+0000 7f5250eed700 1 --2- 172.21.15.8:0/965110672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f524c06d1f0 0x7f524c142690 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f524c0ca160 tx=0x7f5244009840 comp rx=0 tx=0).stop 2023-10-06T04:37:14.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.176+0000 7f5250eed700 1 -- 172.21.15.8:0/965110672 shutdown_connections 2023-10-06T04:37:14.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.176+0000 7f5250eed700 1 --2- 172.21.15.8:0/965110672 >> v2:172.21.15.184:3300/0 conn(0x7f524c15d340 0x7f524c15d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:14.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.176+0000 7f5250eed700 1 --2- 172.21.15.8:0/965110672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f524c06d1f0 0x7f524c142690 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:14.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.176+0000 7f5250eed700 1 --2- 172.21.15.8:0/965110672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f524c06d5c0 0x7f524c142bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:14.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.176+0000 7f5250eed700 1 -- 172.21.15.8:0/965110672 >> 172.21.15.8:0/965110672 conn(0x7f524c0680a0 msgr2=0x7f524c0ce210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:14.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.176+0000 7f5250eed700 1 -- 172.21.15.8:0/965110672 shutdown_connections 2023-10-06T04:37:14.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.176+0000 7f5250eed700 1 -- 172.21.15.8:0/965110672 wait complete. 2023-10-06T04:37:14.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.177+0000 7f5250eed700 1 Processor -- start 2023-10-06T04:37:14.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.177+0000 7f5250eed700 1 -- start start 2023-10-06T04:37:14.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.178+0000 7f5250eed700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f524c06d1f0 0x7f524c0b2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:14.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.178+0000 7f5250eed700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f524c06d5c0 0x7f524c0c3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:14.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.178+0000 7f5250eed700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f524c15d340 0x7f524c0c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:14.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.178+0000 7f5250eed700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524c0b20d0 con 0x7f524c15d340 2023-10-06T04:37:14.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.178+0000 7f5250eed700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524c0b2aa0 con 0x7f524c06d5c0 2023-10-06T04:37:14.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.178+0000 7f5250eed700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f524c0b14c0 con 0x7f524c06d1f0 2023-10-06T04:37:14.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.178+0000 7f524ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f524c15d340 0x7f524c0c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:14.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.178+0000 7f5249d9b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f524c06d5c0 0x7f524c0c3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:14.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.178+0000 7f524ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f524c15d340 0x7f524c0c5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49324/0 (socket says 172.21.15.8:49324) 2023-10-06T04:37:14.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.178+0000 7f524a59c700 1 --2- 172.21.15.8:0/3842001825 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f524c06d1f0 0x7f524c0b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:14.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.178+0000 7f524ad9d700 1 -- 172.21.15.8:0/3842001825 learned_addr learned my addr 172.21.15.8:0/3842001825 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:14.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.178+0000 7f524ad9d700 1 -- 172.21.15.8:0/3842001825 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f524c06d1f0 msgr2=0x7f524c0b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:14.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.178+0000 7f524ad9d700 1 --2- 172.21.15.8:0/3842001825 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f524c06d1f0 0x7f524c0b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:14.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.178+0000 7f524ad9d700 1 -- 172.21.15.8:0/3842001825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f524c06d5c0 msgr2=0x7f524c0c3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:14.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.178+0000 7f524ad9d700 1 --2- 172.21.15.8:0/3842001825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f524c06d5c0 0x7f524c0c3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:14.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.178+0000 7f524ad9d700 1 -- 172.21.15.8:0/3842001825 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5244009ae0 con 0x7f524c15d340 2023-10-06T04:37:14.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.178+0000 7f524ad9d700 1 --2- 172.21.15.8:0/3842001825 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f524c15d340 0x7f524c0c5de0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f523c00e8d0 tx=0x7f523c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:14.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.178+0000 7f52427fc700 1 -- 172.21.15.8:0/3842001825 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c013680 con 0x7f524c15d340 2023-10-06T04:37:14.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.178+0000 7f52427fc700 1 -- 172.21.15.8:0/3842001825 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523c0137e0 con 0x7f524c15d340 2023-10-06T04:37:14.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.179+0000 7f5250eed700 1 -- 172.21.15.8:0/3842001825 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f524c0b17a0 con 0x7f524c15d340 2023-10-06T04:37:14.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.179+0000 7f52427fc700 1 -- 172.21.15.8:0/3842001825 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c013ba0 con 0x7f524c15d340 2023-10-06T04:37:14.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.179+0000 7f5250eed700 1 -- 172.21.15.8:0/3842001825 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f524c0b1d60 con 0x7f524c15d340 2023-10-06T04:37:14.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.179+0000 7f5250eed700 1 -- 172.21.15.8:0/3842001825 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f524c0b2280 con 0x7f524c15d340 2023-10-06T04:37:14.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.180+0000 7f52427fc700 1 -- 172.21.15.8:0/3842001825 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f523c0123d0 con 0x7f524c15d340 2023-10-06T04:37:14.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.180+0000 7f52427fc700 1 --2- 172.21.15.8:0/3842001825 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f522c066f30 0x7f522c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:14.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.180+0000 7f52427fc700 1 -- 172.21.15.8:0/3842001825 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f523c084560 con 0x7f524c15d340 2023-10-06T04:37:14.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.181+0000 7f524a59c700 1 --2- 172.21.15.8:0/3842001825 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f522c066f30 0x7f522c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:14.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.181+0000 7f524a59c700 1 --2- 172.21.15.8:0/3842001825 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f522c066f30 0x7f522c0693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5244009880 tx=0x7f5244018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:14.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.185+0000 7f52427fc700 1 -- 172.21.15.8:0/3842001825 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f524c0b2280 con 0x7f524c15d340 2023-10-06T04:37:14.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.376+0000 7f5250eed700 1 -- 172.21.15.8:0/3842001825 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f524c071550 con 0x7f524c15d340 2023-10-06T04:37:14.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.377+0000 7f52427fc700 1 -- 172.21.15.8:0/3842001825 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f523c051880 con 0x7f524c15d340 2023-10-06T04:37:14.378 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-06T04:37:14.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.379+0000 7f5250eed700 1 -- 172.21.15.8:0/3842001825 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f522c066f30 msgr2=0x7f522c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:14.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.379+0000 7f5250eed700 1 --2- 172.21.15.8:0/3842001825 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f522c066f30 0x7f522c0693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5244009880 tx=0x7f5244018000 comp rx=0 tx=0).stop 2023-10-06T04:37:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.379+0000 7f5250eed700 1 -- 172.21.15.8:0/3842001825 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f524c15d340 msgr2=0x7f524c0c5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.379+0000 7f5250eed700 1 --2- 172.21.15.8:0/3842001825 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f524c15d340 0x7f524c0c5de0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f523c00e8d0 tx=0x7f523c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.379+0000 7f5250eed700 1 -- 172.21.15.8:0/3842001825 shutdown_connections 2023-10-06T04:37:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.379+0000 7f5250eed700 1 --2- 172.21.15.8:0/3842001825 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f522c066f30 0x7f522c0693e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.379+0000 7f5250eed700 1 --2- 172.21.15.8:0/3842001825 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f524c15d340 0x7f524c0c5de0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.379+0000 7f5250eed700 1 --2- 172.21.15.8:0/3842001825 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f524c06d1f0 0x7f524c0b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.379+0000 7f5250eed700 1 --2- 172.21.15.8:0/3842001825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f524c06d5c0 0x7f524c0c3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.379+0000 7f5250eed700 1 -- 172.21.15.8:0/3842001825 >> 172.21.15.8:0/3842001825 conn(0x7f524c0680a0 msgr2=0x7f524c0ca6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.379+0000 7f5250eed700 1 -- 172.21.15.8:0/3842001825 shutdown_connections 2023-10-06T04:37:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.379+0000 7f5250eed700 1 -- 172.21.15.8:0/3842001825 wait complete. 2023-10-06T04:37:14.392 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T04:37:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.510+0000 7f912f118700 1 Processor -- start 2023-10-06T04:37:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.511+0000 7f912f118700 1 -- start start 2023-10-06T04:37:14.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.511+0000 7f912f118700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9128156160 0x7f91280c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.511+0000 7f912f118700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9128156530 0x7f912806b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.511+0000 7f912f118700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91280b0c70 con 0x7f91280c9a90 2023-10-06T04:37:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.511+0000 7f912f118700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91280c8520 con 0x7f9128156530 2023-10-06T04:37:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.511+0000 7f912f118700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91280b0ae0 con 0x7f9128156160 2023-10-06T04:37:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.512+0000 7f912ceb4700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9128156160 0x7f91280c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.512+0000 7f912ceb4700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9128156160 0x7f91280c7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.8:42338/0 (socket says 172.21.15.8:42338) 2023-10-06T04:37:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.512+0000 7f912ceb4700 1 -- 172.21.15.8:0/3625434301 learned_addr learned my addr 172.21.15.8:0/3625434301 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.512+0000 7f9127fff700 1 --2- 172.21.15.8:0/3625434301 >> v2:172.21.15.184:3300/0 conn(0x7f9128156530 0x7f912806b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.512+0000 7f912ceb4700 1 -- 172.21.15.8:0/3625434301 >> v2:172.21.15.184:3300/0 conn(0x7f9128156530 msgr2=0x7f912806b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.512+0000 7f912ceb4700 1 --2- 172.21.15.8:0/3625434301 >> v2:172.21.15.184:3300/0 conn(0x7f9128156530 0x7f912806b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:14.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.512+0000 7f912ceb4700 1 -- 172.21.15.8:0/3625434301 >> v1:172.21.15.184:6789/0 conn(0x7f91280c9a90 legacy=0x7f912806e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:14.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.512+0000 7f912ceb4700 1 -- 172.21.15.8:0/3625434301 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91280c8720 con 0x7f9128156160 2023-10-06T04:37:14.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.512+0000 7f912ceb4700 1 --2- 172.21.15.8:0/3625434301 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9128156160 0x7f91280c7fe0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f91200099b0 tx=0x7f9120009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7eddea7c3b4cc5c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:14.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.512+0000 7f91277fe700 1 -- 172.21.15.8:0/3625434301 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9120009ea0 con 0x7f9128156160 2023-10-06T04:37:14.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.513+0000 7f91277fe700 1 -- 172.21.15.8:0/3625434301 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912000b860 con 0x7f9128156160 2023-10-06T04:37:14.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.513+0000 7f91277fe700 1 -- 172.21.15.8:0/3625434301 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912000bc00 con 0x7f9128156160 2023-10-06T04:37:14.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.513+0000 7f912f118700 1 -- 172.21.15.8:0/3625434301 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9128156160 msgr2=0x7f91280c7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:14.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.513+0000 7f912f118700 1 --2- 172.21.15.8:0/3625434301 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9128156160 0x7f91280c7fe0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f91200099b0 tx=0x7f9120009250 comp rx=0 tx=0).stop 2023-10-06T04:37:14.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.513+0000 7f912f118700 1 -- 172.21.15.8:0/3625434301 shutdown_connections 2023-10-06T04:37:14.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.513+0000 7f912f118700 1 --2- 172.21.15.8:0/3625434301 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9128156160 0x7f91280c7fe0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:14.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.513+0000 7f912f118700 1 --2- 172.21.15.8:0/3625434301 >> v2:172.21.15.184:3300/0 conn(0x7f9128156530 0x7f912806b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:14.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.513+0000 7f912f118700 1 -- 172.21.15.8:0/3625434301 >> 172.21.15.8:0/3625434301 conn(0x7f91280686e0 msgr2=0x7f9128068ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:14.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.513+0000 7f912f118700 1 -- 172.21.15.8:0/3625434301 shutdown_connections 2023-10-06T04:37:14.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.513+0000 7f912f118700 1 -- 172.21.15.8:0/3625434301 wait complete. 2023-10-06T04:37:14.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.514+0000 7f912f118700 1 Processor -- start 2023-10-06T04:37:14.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.515+0000 7f912f118700 1 -- start start 2023-10-06T04:37:14.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.516+0000 7f912f118700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91280c9a90 0x7f91280c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:14.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.516+0000 7f912f118700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9128156160 0x7f9128152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:14.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.516+0000 7f912f118700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9128156530 0x7f9128158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:14.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.516+0000 7f912f118700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91280c24b0 con 0x7f91280c9a90 2023-10-06T04:37:14.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.516+0000 7f912f118700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91281529a0 con 0x7f9128156160 2023-10-06T04:37:14.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.516+0000 7f912f118700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91280c18a0 con 0x7f9128156530 2023-10-06T04:37:14.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.516+0000 7f912ceb4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91280c9a90 0x7f91280c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:14.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.516+0000 7f912ceb4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91280c9a90 0x7f91280c34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34920/0 (socket says 172.21.15.8:34920) 2023-10-06T04:37:14.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.516+0000 7f912ceb4700 1 -- 172.21.15.8:0/2322737181 learned_addr learned my addr 172.21.15.8:0/2322737181 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:14.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.516+0000 7f912d6b5700 1 --2- 172.21.15.8:0/2322737181 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9128156530 0x7f9128158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:14.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.516+0000 7f9127fff700 1 --2- 172.21.15.8:0/2322737181 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9128156160 0x7f9128152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:14.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.516+0000 7f912ceb4700 1 -- 172.21.15.8:0/2322737181 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9128156530 msgr2=0x7f9128158c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:14.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.516+0000 7f912ceb4700 1 --2- 172.21.15.8:0/2322737181 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9128156530 0x7f9128158c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:14.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.516+0000 7f912ceb4700 1 -- 172.21.15.8:0/2322737181 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9128156160 msgr2=0x7f9128152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:14.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.516+0000 7f912ceb4700 1 --2- 172.21.15.8:0/2322737181 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9128156160 0x7f9128152460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:14.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.516+0000 7f912ceb4700 1 -- 172.21.15.8:0/2322737181 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91200094f0 con 0x7f91280c9a90 2023-10-06T04:37:14.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.516+0000 7f9127fff700 1 --2- 172.21.15.8:0/2322737181 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9128156160 0x7f9128152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:14.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.517+0000 7f912ceb4700 1 --2- 172.21.15.8:0/2322737181 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91280c9a90 0x7f91280c34b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f91280b0c20 tx=0x7f9120017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:14.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.517+0000 7f9124ff9700 1 -- 172.21.15.8:0/2322737181 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912000bbe0 con 0x7f91280c9a90 2023-10-06T04:37:14.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.517+0000 7f912f118700 1 -- 172.21.15.8:0/2322737181 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91280c1b80 con 0x7f91280c9a90 2023-10-06T04:37:14.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.517+0000 7f9124ff9700 1 -- 172.21.15.8:0/2322737181 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9120011420 con 0x7f91280c9a90 2023-10-06T04:37:14.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.517+0000 7f9124ff9700 1 -- 172.21.15.8:0/2322737181 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91200117c0 con 0x7f91280c9a90 2023-10-06T04:37:14.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.517+0000 7f912f118700 1 -- 172.21.15.8:0/2322737181 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91280c2140 con 0x7f91280c9a90 2023-10-06T04:37:14.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.518+0000 7f912f118700 1 -- 172.21.15.8:0/2322737181 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9128071550 con 0x7f91280c9a90 2023-10-06T04:37:14.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.518+0000 7f9124ff9700 1 -- 172.21.15.8:0/2322737181 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9120011bf0 con 0x7f91280c9a90 2023-10-06T04:37:14.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.519+0000 7f9124ff9700 1 --2- 172.21.15.8:0/2322737181 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9108066f30 0x7f91080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:14.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.519+0000 7f9124ff9700 1 -- 172.21.15.8:0/2322737181 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f9120085a70 con 0x7f91280c9a90 2023-10-06T04:37:14.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.519+0000 7f9127fff700 1 --2- 172.21.15.8:0/2322737181 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9108066f30 0x7f91080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:14.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.520+0000 7f9127fff700 1 --2- 172.21.15.8:0/2322737181 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9108066f30 0x7f91080693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f912816a600 tx=0x7f911800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:14.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.523+0000 7f9124ff9700 1 -- 172.21.15.8:0/2322737181 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9120052cf0 con 0x7f91280c9a90 2023-10-06T04:37:14.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.725+0000 7f912f118700 1 -- 172.21.15.8:0/2322737181 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f912815ae90 con 0x7f91280c9a90 2023-10-06T04:37:14.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.725+0000 7f9124ff9700 1 -- 172.21.15.8:0/2322737181 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) v1 ==== 84+0+126 (secure 0 0 0) 0x7f9120056310 con 0x7f91280c9a90 2023-10-06T04:37:14.727 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:14.727 INFO:teuthology.orchestra.run.smithi008.stdout:[ 2023-10-06T04:37:14.727 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T04:37:14.727 INFO:teuthology.orchestra.run.smithi008.stdout: "poolnum": 1, 2023-10-06T04:37:14.727 INFO:teuthology.orchestra.run.smithi008.stdout: "poolname": "rbd" 2023-10-06T04:37:14.727 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T04:37:14.727 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T04:37:14.727 INFO:teuthology.orchestra.run.smithi008.stdout: "poolnum": 2, 2023-10-06T04:37:14.728 INFO:teuthology.orchestra.run.smithi008.stdout: "poolname": ".mgr" 2023-10-06T04:37:14.728 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T04:37:14.728 INFO:teuthology.orchestra.run.smithi008.stdout:] 2023-10-06T04:37:14.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.727+0000 7f912f118700 1 -- 172.21.15.8:0/2322737181 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9108066f30 msgr2=0x7f91080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:14.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.727+0000 7f912f118700 1 --2- 172.21.15.8:0/2322737181 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9108066f30 0x7f91080693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f912816a600 tx=0x7f911800b040 comp rx=0 tx=0).stop 2023-10-06T04:37:14.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.727+0000 7f912f118700 1 -- 172.21.15.8:0/2322737181 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91280c9a90 msgr2=0x7f91280c34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:14.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.727+0000 7f912f118700 1 --2- 172.21.15.8:0/2322737181 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91280c9a90 0x7f91280c34b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f91280b0c20 tx=0x7f9120017000 comp rx=0 tx=0).stop 2023-10-06T04:37:14.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.727+0000 7f912f118700 1 -- 172.21.15.8:0/2322737181 shutdown_connections 2023-10-06T04:37:14.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.727+0000 7f912f118700 1 --2- 172.21.15.8:0/2322737181 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9108066f30 0x7f91080693e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:14.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.727+0000 7f912f118700 1 --2- 172.21.15.8:0/2322737181 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9128156530 0x7f9128158c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:14.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.727+0000 7f912f118700 1 --2- 172.21.15.8:0/2322737181 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91280c9a90 0x7f91280c34b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:14.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.727+0000 7f912f118700 1 --2- 172.21.15.8:0/2322737181 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9128156160 0x7f9128152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:14.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.727+0000 7f912f118700 1 -- 172.21.15.8:0/2322737181 >> 172.21.15.8:0/2322737181 conn(0x7f91280686e0 msgr2=0x7f912806af80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:14.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.727+0000 7f912f118700 1 -- 172.21.15.8:0/2322737181 shutdown_connections 2023-10-06T04:37:14.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.727+0000 7f912f118700 1 -- 172.21.15.8:0/2322737181 wait complete. 2023-10-06T04:37:14.740 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T04:37:14.742 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T04:37:14.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.863+0000 7f147f59e700 1 Processor -- start 2023-10-06T04:37:14.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.863+0000 7f147f59e700 1 -- start start 2023-10-06T04:37:14.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.864+0000 7f147f59e700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1480069720 0x7f1480069ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:14.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.864+0000 7f147f59e700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f148015e160 con 0x7f14800ce850 2023-10-06T04:37:14.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.864+0000 7f147f59e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14800afac0 con 0x7f14800af6f0 2023-10-06T04:37:14.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.864+0000 7f147f59e700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f148006a0e0 con 0x7f1480069720 2023-10-06T04:37:14.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.864+0000 7f147dd9b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1480069720 0x7f1480069ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:14.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.864+0000 7f147ed9d700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f14800ce850 0x7f14800cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:40220/0 (socket says 172.21.15.8:40220) 2023-10-06T04:37:14.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.864+0000 7f147ed9d700 1 -- 172.21.15.8:0/2380898220 learned_addr learned my addr 172.21.15.8:0/2380898220 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:14.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.864+0000 7f147dd9b700 1 -- 172.21.15.8:0/2380898220 >> v1:172.21.15.184:6789/0 conn(0x7f14800af6f0 legacy=0x7f148015a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:14.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.864+0000 7f147dd9b700 1 -- 172.21.15.8:0/2380898220 >> v1:172.21.15.8:6789/0 conn(0x7f14800ce850 legacy=0x7f14800cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:14.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.864+0000 7f147dd9b700 1 -- 172.21.15.8:0/2380898220 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148015d550 con 0x7f1480069720 2023-10-06T04:37:14.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.865+0000 7f147dd9b700 1 --2- 172.21.15.8:0/2380898220 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1480069720 0x7f1480069ba0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f14680098e0 tx=0x7f14680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12fdf7d2733aaf7b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:14.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.865+0000 7f147d59a700 1 -- 172.21.15.8:0/2380898220 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1468009e80 con 0x7f1480069720 2023-10-06T04:37:14.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.865+0000 7f147d59a700 1 -- 172.21.15.8:0/2380898220 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146800b820 con 0x7f1480069720 2023-10-06T04:37:14.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.865+0000 7f147d59a700 1 -- 172.21.15.8:0/2380898220 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146800bba0 con 0x7f1480069720 2023-10-06T04:37:14.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.865+0000 7f147f59e700 1 -- 172.21.15.8:0/2380898220 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1480069720 msgr2=0x7f1480069ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:14.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.865+0000 7f147f59e700 1 --2- 172.21.15.8:0/2380898220 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1480069720 0x7f1480069ba0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f14680098e0 tx=0x7f14680091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:14.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.865+0000 7f147f59e700 1 -- 172.21.15.8:0/2380898220 shutdown_connections 2023-10-06T04:37:14.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.865+0000 7f147f59e700 1 --2- 172.21.15.8:0/2380898220 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1480069720 0x7f1480069ba0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:14.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.865+0000 7f147f59e700 1 -- 172.21.15.8:0/2380898220 >> 172.21.15.8:0/2380898220 conn(0x7f14800d0280 msgr2=0x7f14800d0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:14.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.865+0000 7f147f59e700 1 -- 172.21.15.8:0/2380898220 shutdown_connections 2023-10-06T04:37:14.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.865+0000 7f147f59e700 1 -- 172.21.15.8:0/2380898220 wait complete. 2023-10-06T04:37:14.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.866+0000 7f147f59e700 1 Processor -- start 2023-10-06T04:37:14.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.867+0000 7f147f59e700 1 -- start start 2023-10-06T04:37:14.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.867+0000 7f147f59e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1480069720 0x7f14800b5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:14.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.867+0000 7f147f59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14800af6f0 0x7f148016aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:14.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.867+0000 7f147f59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14800ce850 0x7f14800c9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:14.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.867+0000 7f147f59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14800b41c0 con 0x7f14800af6f0 2023-10-06T04:37:14.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.867+0000 7f147f59e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148016b010 con 0x7f1480069720 2023-10-06T04:37:14.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.867+0000 7f147f59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14800c7680 con 0x7f14800ce850 2023-10-06T04:37:14.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.867+0000 7f147dd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14800af6f0 0x7f148016aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:14.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.867+0000 7f147dd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14800af6f0 0x7f148016aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34940/0 (socket says 172.21.15.8:34940) 2023-10-06T04:37:14.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.867+0000 7f147dd9b700 1 -- 172.21.15.8:0/2272481365 learned_addr learned my addr 172.21.15.8:0/2272481365 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:14.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.868+0000 7f147e59c700 1 --2- 172.21.15.8:0/2272481365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1480069720 0x7f14800b5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:14.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.868+0000 7f147ed9d700 1 --2- 172.21.15.8:0/2272481365 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14800ce850 0x7f14800c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:14.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.868+0000 7f147dd9b700 1 -- 172.21.15.8:0/2272481365 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14800ce850 msgr2=0x7f14800c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:14.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.868+0000 7f147dd9b700 1 --2- 172.21.15.8:0/2272481365 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14800ce850 0x7f14800c9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:14.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.868+0000 7f147dd9b700 1 -- 172.21.15.8:0/2272481365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1480069720 msgr2=0x7f14800b5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:14.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.868+0000 7f147dd9b700 1 --2- 172.21.15.8:0/2272481365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1480069720 0x7f14800b5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:14.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.868+0000 7f147dd9b700 1 -- 172.21.15.8:0/2272481365 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1468009420 con 0x7f14800af6f0 2023-10-06T04:37:14.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.868+0000 7f147ed9d700 1 --2- 172.21.15.8:0/2272481365 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14800ce850 0x7f14800c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:14.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.868+0000 7f147dd9b700 1 --2- 172.21.15.8:0/2272481365 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14800af6f0 0x7f148016aad0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f14680030c0 tx=0x7f1468016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:14.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.868+0000 7f14767fc700 1 -- 172.21.15.8:0/2272481365 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146800bae0 con 0x7f14800af6f0 2023-10-06T04:37:14.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.868+0000 7f14767fc700 1 -- 172.21.15.8:0/2272481365 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1468020070 con 0x7f14800af6f0 2023-10-06T04:37:14.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.868+0000 7f147f59e700 1 -- 172.21.15.8:0/2272481365 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14800b3c00 con 0x7f14800af6f0 2023-10-06T04:37:14.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.868+0000 7f14767fc700 1 -- 172.21.15.8:0/2272481365 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146801b6a0 con 0x7f14800af6f0 2023-10-06T04:37:14.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.868+0000 7f147f59e700 1 -- 172.21.15.8:0/2272481365 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14800c7330 con 0x7f14800af6f0 2023-10-06T04:37:14.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.869+0000 7f147f59e700 1 -- 172.21.15.8:0/2272481365 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f148004c380 con 0x7f14800af6f0 2023-10-06T04:37:14.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.869+0000 7f14767fc700 1 -- 172.21.15.8:0/2272481365 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1468022030 con 0x7f14800af6f0 2023-10-06T04:37:14.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.870+0000 7f14767fc700 1 --2- 172.21.15.8:0/2272481365 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1460066f30 0x7f14600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:14.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.870+0000 7f14767fc700 1 -- 172.21.15.8:0/2272481365 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f1468086450 con 0x7f14800af6f0 2023-10-06T04:37:14.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.870+0000 7f147e59c700 1 --2- 172.21.15.8:0/2272481365 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1460066f30 0x7f14600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:14.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.871+0000 7f147e59c700 1 --2- 172.21.15.8:0/2272481365 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1460066f30 0x7f14600693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f14800c6d70 tx=0x7f1478009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:14.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:14.874+0000 7f14767fc700 1 -- 172.21.15.8:0/2272481365 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1468053770 con 0x7f14800af6f0 2023-10-06T04:37:15.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.069+0000 7f147f59e700 1 -- 172.21.15.8:0/2272481365 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f148004c380 con 0x7f14800af6f0 2023-10-06T04:37:15.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.520+0000 7f14767fc700 1 -- 172.21.15.8:0/2272481365 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1468056d90 con 0x7f14800af6f0 2023-10-06T04:37:15.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.524+0000 7f147f59e700 1 -- 172.21.15.8:0/2272481365 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1460066f30 msgr2=0x7f14600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:15.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.524+0000 7f147f59e700 1 --2- 172.21.15.8:0/2272481365 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1460066f30 0x7f14600693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f14800c6d70 tx=0x7f1478009040 comp rx=0 tx=0).stop 2023-10-06T04:37:15.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.524+0000 7f147f59e700 1 -- 172.21.15.8:0/2272481365 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14800af6f0 msgr2=0x7f148016aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:15.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.524+0000 7f147f59e700 1 --2- 172.21.15.8:0/2272481365 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14800af6f0 0x7f148016aad0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f14680030c0 tx=0x7f1468016000 comp rx=0 tx=0).stop 2023-10-06T04:37:15.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.525+0000 7f147f59e700 1 -- 172.21.15.8:0/2272481365 shutdown_connections 2023-10-06T04:37:15.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.525+0000 7f147f59e700 1 --2- 172.21.15.8:0/2272481365 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1460066f30 0x7f14600693e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:15.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.525+0000 7f147f59e700 1 --2- 172.21.15.8:0/2272481365 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14800ce850 0x7f14800c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:15.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.525+0000 7f147f59e700 1 --2- 172.21.15.8:0/2272481365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1480069720 0x7f14800b5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:15.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.525+0000 7f147f59e700 1 --2- 172.21.15.8:0/2272481365 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f14800af6f0 0x7f148016aad0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:15.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.525+0000 7f147f59e700 1 -- 172.21.15.8:0/2272481365 >> 172.21.15.8:0/2272481365 conn(0x7f14800d0280 msgr2=0x7f1480156d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:15.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.525+0000 7f147f59e700 1 -- 172.21.15.8:0/2272481365 shutdown_connections 2023-10-06T04:37:15.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.525+0000 7f147f59e700 1 -- 172.21.15.8:0/2272481365 wait complete. 2023-10-06T04:37:15.528 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_metadata' created 2023-10-06T04:37:15.541 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T04:37:15.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.666+0000 7f947c7f8700 1 Processor -- start 2023-10-06T04:37:15.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.666+0000 7f947c7f8700 1 -- start start 2023-10-06T04:37:15.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.667+0000 7f947c7f8700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f94741430c0 0x7f94740cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:15.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.667+0000 7f947c7f8700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94740cf510 con 0x7f9474142cf0 2023-10-06T04:37:15.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.667+0000 7f947c7f8700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94740ce6a0 con 0x7f94740cfee0 2023-10-06T04:37:15.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.667+0000 7f947c7f8700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94740ce900 con 0x7f94741430c0 2023-10-06T04:37:15.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.667+0000 7f947a594700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f9474142cf0 0x7f94740b5cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:40222/0 (socket says 172.21.15.8:40222) 2023-10-06T04:37:15.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.667+0000 7f947a594700 1 -- 172.21.15.8:0/1825521692 learned_addr learned my addr 172.21.15.8:0/1825521692 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:15.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.667+0000 7f9479d93700 1 --2- 172.21.15.8:0/1825521692 >> v2:172.21.15.184:3300/0 conn(0x7f94741430c0 0x7f94740cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:15.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.667+0000 7f9479592700 1 -- 172.21.15.8:0/1825521692 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3266206531 0 0) 0x7f94740cf510 con 0x7f9474142cf0 2023-10-06T04:37:15.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.667+0000 7f9479592700 1 -- 172.21.15.8:0/1825521692 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9460003570 con 0x7f9474142cf0 2023-10-06T04:37:15.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.667+0000 7f9479592700 1 -- 172.21.15.8:0/1825521692 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1457134886 0 0) 0x7f9460003570 con 0x7f9474142cf0 2023-10-06T04:37:15.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.667+0000 7f9479592700 1 -- 172.21.15.8:0/1825521692 >> v2:172.21.15.184:3300/0 conn(0x7f94741430c0 msgr2=0x7f94740cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:15.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.667+0000 7f9479592700 1 --2- 172.21.15.8:0/1825521692 >> v2:172.21.15.184:3300/0 conn(0x7f94741430c0 0x7f94740cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:15.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.667+0000 7f9479592700 1 -- 172.21.15.8:0/1825521692 >> v1:172.21.15.184:6789/0 conn(0x7f94740cfee0 legacy=0x7f94740b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:15.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.667+0000 7f9479592700 1 -- 172.21.15.8:0/1825521692 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94740cebe0 con 0x7f9474142cf0 2023-10-06T04:37:15.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.667+0000 7f9479592700 1 -- 172.21.15.8:0/1825521692 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7f9470001470 con 0x7f9474142cf0 2023-10-06T04:37:15.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.667+0000 7f9479592700 1 -- 172.21.15.8:0/1825521692 >> v1:172.21.15.8:6789/0 conn(0x7f9474142cf0 legacy=0x7f94740b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:15.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.667+0000 7f9479592700 1 --2- 172.21.15.8:0/1825521692 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9460003a60 0x7f9460003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:15.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.667+0000 7f9479592700 1 --2- 172.21.15.8:0/1825521692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9460004810 0x7f9460004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:15.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.667+0000 7f9479592700 1 --2- 172.21.15.8:0/1825521692 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94600051c0 0x7f946000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:15.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.667+0000 7f9479592700 1 -- 172.21.15.8:0/1825521692 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94740ce900 con 0x7f94600051c0 2023-10-06T04:37:15.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.667+0000 7f9479592700 1 -- 172.21.15.8:0/1825521692 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946000c160 con 0x7f9460004810 2023-10-06T04:37:15.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.667+0000 7f9479592700 1 -- 172.21.15.8:0/1825521692 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f946000c320 con 0x7f9460003a60 2023-10-06T04:37:15.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.668+0000 7f947ad95700 1 --2- 172.21.15.8:0/1825521692 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94600051c0 0x7f946000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:15.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.668+0000 7f9479d93700 1 --2- 172.21.15.8:0/1825521692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9460004810 0x7f9460004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:15.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.668+0000 7f947a594700 1 --2- 172.21.15.8:0/1825521692 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9460003a60 0x7f9460003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:15.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.668+0000 7f947ad95700 1 -- 172.21.15.8:0/1825521692 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9460003a60 msgr2=0x7f9460003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:15.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.668+0000 7f947ad95700 1 --2- 172.21.15.8:0/1825521692 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9460003a60 0x7f9460003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:15.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.668+0000 7f947ad95700 1 -- 172.21.15.8:0/1825521692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9460004810 msgr2=0x7f9460004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:15.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.668+0000 7f947ad95700 1 --2- 172.21.15.8:0/1825521692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9460004810 0x7f9460004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:15.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.668+0000 7f947ad95700 1 -- 172.21.15.8:0/1825521692 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9460003570 con 0x7f94600051c0 2023-10-06T04:37:15.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.668+0000 7f947ad95700 1 -- 172.21.15.8:0/1825521692 reap_dead start 2023-10-06T04:37:15.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.668+0000 7f947ad95700 1 --2- 172.21.15.8:0/1825521692 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94600051c0 0x7f946000ba60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f946c001fc0 tx=0x7f946c001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c79a2a76964e46fc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:15.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.668+0000 7f9479592700 1 -- 172.21.15.8:0/1825521692 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946c001950 con 0x7f94600051c0 2023-10-06T04:37:15.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.668+0000 7f9479592700 1 -- 172.21.15.8:0/1825521692 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946c00c8b0 con 0x7f94600051c0 2023-10-06T04:37:15.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.668+0000 7f9479592700 1 -- 172.21.15.8:0/1825521692 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946c00cc90 con 0x7f94600051c0 2023-10-06T04:37:15.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.669+0000 7f947c7f8700 1 -- 172.21.15.8:0/1825521692 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94600051c0 msgr2=0x7f946000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:15.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.669+0000 7f947c7f8700 1 --2- 172.21.15.8:0/1825521692 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94600051c0 0x7f946000ba60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f946c001fc0 tx=0x7f946c001640 comp rx=0 tx=0).stop 2023-10-06T04:37:15.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.669+0000 7f947c7f8700 1 -- 172.21.15.8:0/1825521692 shutdown_connections 2023-10-06T04:37:15.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.669+0000 7f947c7f8700 1 --2- 172.21.15.8:0/1825521692 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94600051c0 0x7f946000ba60 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:15.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.669+0000 7f947c7f8700 1 -- 172.21.15.8:0/1825521692 >> 172.21.15.8:0/1825521692 conn(0x7f947406ed00 msgr2=0x7f947406f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:15.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.669+0000 7f947c7f8700 1 -- 172.21.15.8:0/1825521692 shutdown_connections 2023-10-06T04:37:15.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.669+0000 7f947c7f8700 1 -- 172.21.15.8:0/1825521692 wait complete. 2023-10-06T04:37:15.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.670+0000 7f947c7f8700 1 Processor -- start 2023-10-06T04:37:15.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.670+0000 7f947c7f8700 1 -- start start 2023-10-06T04:37:15.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.671+0000 7f947c7f8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94600051c0 0x7f94740af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:15.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.671+0000 7f947c7f8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94740aa6d0 0x7f947415c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:15.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.671+0000 7f947c7f8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f947413d8a0 0x7f947413dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:15.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.671+0000 7f947c7f8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94740af920 con 0x7f94740aa6d0 2023-10-06T04:37:15.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.671+0000 7f947c7f8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947413e840 con 0x7f947413d8a0 2023-10-06T04:37:15.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.671+0000 7f947c7f8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9474169a20 con 0x7f94600051c0 2023-10-06T04:37:15.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.671+0000 7f9479d93700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94740aa6d0 0x7f947415c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:15.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.671+0000 7f9479d93700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94740aa6d0 0x7f947415c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34964/0 (socket says 172.21.15.8:34964) 2023-10-06T04:37:15.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.671+0000 7f9479d93700 1 -- 172.21.15.8:0/3606071088 learned_addr learned my addr 172.21.15.8:0/3606071088 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:15.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.671+0000 7f947a594700 1 --2- 172.21.15.8:0/3606071088 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94600051c0 0x7f94740af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:15.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.671+0000 7f947ad95700 1 --2- 172.21.15.8:0/3606071088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f947413d8a0 0x7f947413dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:15.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.671+0000 7f9479d93700 1 -- 172.21.15.8:0/3606071088 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94600051c0 msgr2=0x7f94740af3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:15.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.671+0000 7f9479d93700 1 --2- 172.21.15.8:0/3606071088 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94600051c0 0x7f94740af3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:15.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.671+0000 7f9479d93700 1 -- 172.21.15.8:0/3606071088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f947413d8a0 msgr2=0x7f947413dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:15.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.671+0000 7f9479d93700 1 --2- 172.21.15.8:0/3606071088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f947413d8a0 0x7f947413dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:15.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.671+0000 7f9479d93700 1 -- 172.21.15.8:0/3606071088 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94740aac70 con 0x7f94740aa6d0 2023-10-06T04:37:15.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.671+0000 7f947ad95700 1 --2- 172.21.15.8:0/3606071088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f947413d8a0 0x7f947413dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:15.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.671+0000 7f9479d93700 1 --2- 172.21.15.8:0/3606071088 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94740aa6d0 0x7f947415c120 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9464006ac0 tx=0x7f94640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:15.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.671+0000 7f946a7fc700 1 -- 172.21.15.8:0/3606071088 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946400f940 con 0x7f94740aa6d0 2023-10-06T04:37:15.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.671+0000 7f946a7fc700 1 -- 172.21.15.8:0/3606071088 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946400faa0 con 0x7f94740aa6d0 2023-10-06T04:37:15.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.671+0000 7f947c7f8700 1 -- 172.21.15.8:0/3606071088 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9474169ce0 con 0x7f94740aa6d0 2023-10-06T04:37:15.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.671+0000 7f946a7fc700 1 -- 172.21.15.8:0/3606071088 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946400fe20 con 0x7f94740aa6d0 2023-10-06T04:37:15.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.671+0000 7f947c7f8700 1 -- 172.21.15.8:0/3606071088 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f947416a2a0 con 0x7f94740aa6d0 2023-10-06T04:37:15.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.672+0000 7f947c7f8700 1 -- 172.21.15.8:0/3606071088 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9474071550 con 0x7f94740aa6d0 2023-10-06T04:37:15.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.673+0000 7f946a7fc700 1 -- 172.21.15.8:0/3606071088 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9464014650 con 0x7f94740aa6d0 2023-10-06T04:37:15.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.673+0000 7f946a7fc700 1 --2- 172.21.15.8:0/3606071088 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9458066f30 0x7f94580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:15.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.673+0000 7f946a7fc700 1 -- 172.21.15.8:0/3606071088 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5896+0+0 (secure 0 0 0) 0x7f9464018030 con 0x7f94740aa6d0 2023-10-06T04:37:15.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.674+0000 7f947a594700 1 --2- 172.21.15.8:0/3606071088 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9458066f30 0x7f94580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:15.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.674+0000 7f947a594700 1 --2- 172.21.15.8:0/3606071088 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9458066f30 0x7f94580693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9470001ed0 tx=0x7f9474143560 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:15.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.678+0000 7f946a7fc700 1 -- 172.21.15.8:0/3606071088 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9464052100 con 0x7f94740aa6d0 2023-10-06T04:37:15.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:15.872+0000 7f947c7f8700 1 -- 172.21.15.8:0/3606071088 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f94740ceec0 con 0x7f94740aa6d0 2023-10-06T04:37:16.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.526+0000 7f946a7fc700 1 -- 172.21.15.8:0/3606071088 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v36) v1 ==== 170+0+0 (secure 0 0 0) 0x7f94640220d0 con 0x7f94740aa6d0 2023-10-06T04:37:16.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.532+0000 7f947c7f8700 1 -- 172.21.15.8:0/3606071088 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9458066f30 msgr2=0x7f94580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:16.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.532+0000 7f947c7f8700 1 --2- 172.21.15.8:0/3606071088 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9458066f30 0x7f94580693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9470001ed0 tx=0x7f9474143560 comp rx=0 tx=0).stop 2023-10-06T04:37:16.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.532+0000 7f947c7f8700 1 -- 172.21.15.8:0/3606071088 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94740aa6d0 msgr2=0x7f947415c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:16.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.532+0000 7f947c7f8700 1 --2- 172.21.15.8:0/3606071088 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94740aa6d0 0x7f947415c120 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9464006ac0 tx=0x7f94640091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:16.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.532+0000 7f947c7f8700 1 -- 172.21.15.8:0/3606071088 shutdown_connections 2023-10-06T04:37:16.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.532+0000 7f947c7f8700 1 --2- 172.21.15.8:0/3606071088 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9458066f30 0x7f94580693e0 secure :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9470001ed0 tx=0x7f9474143560 comp rx=0 tx=0).stop 2023-10-06T04:37:16.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.532+0000 7f947c7f8700 1 --2- 172.21.15.8:0/3606071088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f947413d8a0 0x7f947413dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:16.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.532+0000 7f947c7f8700 1 --2- 172.21.15.8:0/3606071088 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94600051c0 0x7f94740af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:16.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.532+0000 7f947c7f8700 1 --2- 172.21.15.8:0/3606071088 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94740aa6d0 0x7f947415c120 secure :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9464006ac0 tx=0x7f94640091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:16.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.532+0000 7f947c7f8700 1 -- 172.21.15.8:0/3606071088 >> 172.21.15.8:0/3606071088 conn(0x7f947406ed00 msgr2=0x7f94741591e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:16.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.536+0000 7f947c7f8700 1 -- 172.21.15.8:0/3606071088 shutdown_connections 2023-10-06T04:37:16.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.536+0000 7f947c7f8700 1 -- 172.21.15.8:0/3606071088 wait complete. 2023-10-06T04:37:16.547 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_data' created 2023-10-06T04:37:16.557 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T04:37:16.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.680+0000 7f8aa2f3b700 1 Processor -- start 2023-10-06T04:37:16.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.680+0000 7f8aa2f3b700 1 -- start start 2023-10-06T04:37:16.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.681+0000 7f8aa2f3b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8a9c0cc070 0x7f8a9c06c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:16.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.681+0000 7f8aa2f3b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a9c0cc440 0x7f8a9c06cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:16.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.681+0000 7f8aa2f3b700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a9c06d8c0 con 0x7f8a9c06d0f0 2023-10-06T04:37:16.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.681+0000 7f8aa2f3b700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a9c143270 con 0x7f8a9c0cc070 2023-10-06T04:37:16.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.681+0000 7f8aa2f3b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c06b910 con 0x7f8a9c0cc440 2023-10-06T04:37:16.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.681+0000 7f8aa0cd7700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8a9c0cc070 0x7f8a9c06c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:16.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.681+0000 7f8aa14d8700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f8a9c06d0f0 0x7f8a9c0686e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:40236/0 (socket says 172.21.15.8:40236) 2023-10-06T04:37:16.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.681+0000 7f8aa14d8700 1 -- 172.21.15.8:0/4017826375 learned_addr learned my addr 172.21.15.8:0/4017826375 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:16.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.682+0000 7f8a9bfff700 1 --2- 172.21.15.8:0/4017826375 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a9c0cc440 0x7f8a9c06cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:16.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.682+0000 7f8aa0cd7700 1 -- 172.21.15.8:0/4017826375 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a9c0cc440 msgr2=0x7f8a9c06cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:16.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.682+0000 7f8aa0cd7700 1 --2- 172.21.15.8:0/4017826375 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a9c0cc440 0x7f8a9c06cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:16.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.682+0000 7f8aa0cd7700 1 -- 172.21.15.8:0/4017826375 >> v1:172.21.15.8:6789/0 conn(0x7f8a9c06d0f0 legacy=0x7f8a9c0686e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:16.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.682+0000 7f8aa0cd7700 1 -- 172.21.15.8:0/4017826375 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a9c06bbf0 con 0x7f8a9c0cc070 2023-10-06T04:37:16.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.682+0000 7f8a9b7fe700 1 -- 172.21.15.8:0/4017826375 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3567376138 0 0) 0x7f8a9c06d8c0 con 0x7f8a9c06d0f0 2023-10-06T04:37:16.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.682+0000 7f8aa0cd7700 1 --2- 172.21.15.8:0/4017826375 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a9c0cc070 0x7f8a9c06c3f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8a900098e0 tx=0x7f8a900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe00cd44554939fb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:16.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.682+0000 7f8a9b7fe700 1 -- 172.21.15.8:0/4017826375 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a90009e80 con 0x7f8a9c0cc070 2023-10-06T04:37:16.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.682+0000 7f8a9b7fe700 1 -- 172.21.15.8:0/4017826375 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9000b860 con 0x7f8a9c0cc070 2023-10-06T04:37:16.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.682+0000 7f8a9b7fe700 1 -- 172.21.15.8:0/4017826375 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9000bbe0 con 0x7f8a9c0cc070 2023-10-06T04:37:16.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.683+0000 7f8aa2f3b700 1 -- 172.21.15.8:0/4017826375 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a9c0cc070 msgr2=0x7f8a9c06c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:16.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.683+0000 7f8aa2f3b700 1 --2- 172.21.15.8:0/4017826375 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a9c0cc070 0x7f8a9c06c3f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8a900098e0 tx=0x7f8a900091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:16.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.683+0000 7f8aa2f3b700 1 -- 172.21.15.8:0/4017826375 shutdown_connections 2023-10-06T04:37:16.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.683+0000 7f8aa2f3b700 1 --2- 172.21.15.8:0/4017826375 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a9c0cc070 0x7f8a9c06c3f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:16.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.683+0000 7f8aa2f3b700 1 --2- 172.21.15.8:0/4017826375 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a9c0cc440 0x7f8a9c06cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:16.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.683+0000 7f8aa2f3b700 1 -- 172.21.15.8:0/4017826375 >> 172.21.15.8:0/4017826375 conn(0x7f8a9c0ce250 msgr2=0x7f8a9c0ce650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:16.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.683+0000 7f8aa2f3b700 1 -- 172.21.15.8:0/4017826375 shutdown_connections 2023-10-06T04:37:16.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.683+0000 7f8aa2f3b700 1 -- 172.21.15.8:0/4017826375 wait complete. 2023-10-06T04:37:16.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.684+0000 7f8aa2f3b700 1 Processor -- start 2023-10-06T04:37:16.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.684+0000 7f8aa2f3b700 1 -- start start 2023-10-06T04:37:16.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.685+0000 7f8aa2f3b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a9c06d0f0 0x7f8a9c16a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:16.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.685+0000 7f8aa2f3b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a9c0cc070 0x7f8a9c13c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:16.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.685+0000 7f8aa2f3b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a9c0cc440 0x7f8a9c0b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:16.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.685+0000 7f8aa2f3b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c15e620 con 0x7f8a9c06d0f0 2023-10-06T04:37:16.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.685+0000 7f8aa2f3b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c140b90 con 0x7f8a9c0cc440 2023-10-06T04:37:16.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.685+0000 7f8aa2f3b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c13ff80 con 0x7f8a9c0cc070 2023-10-06T04:37:16.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.685+0000 7f8aa0cd7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a9c06d0f0 0x7f8a9c16a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:16.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.685+0000 7f8aa0cd7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a9c06d0f0 0x7f8a9c16a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34984/0 (socket says 172.21.15.8:34984) 2023-10-06T04:37:16.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.685+0000 7f8aa0cd7700 1 -- 172.21.15.8:0/1107870154 learned_addr learned my addr 172.21.15.8:0/1107870154 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:16.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.685+0000 7f8aa0cd7700 1 -- 172.21.15.8:0/1107870154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a9c0cc070 msgr2=0x7f8a9c13c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:16.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.685+0000 7f8a9bfff700 1 --2- 172.21.15.8:0/1107870154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a9c0cc070 0x7f8a9c13c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:16.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.685+0000 7f8aa0cd7700 1 --2- 172.21.15.8:0/1107870154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a9c0cc070 0x7f8a9c13c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:16.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.685+0000 7f8aa0cd7700 1 -- 172.21.15.8:0/1107870154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a9c0cc440 msgr2=0x7f8a9c0b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:16.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.685+0000 7f8aa0cd7700 1 --2- 172.21.15.8:0/1107870154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a9c0cc440 0x7f8a9c0b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:16.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.685+0000 7f8aa0cd7700 1 -- 172.21.15.8:0/1107870154 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a90009420 con 0x7f8a9c06d0f0 2023-10-06T04:37:16.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.685+0000 7f8aa0cd7700 1 --2- 172.21.15.8:0/1107870154 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a9c06d0f0 0x7f8a9c16a0b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c06f2e0 tx=0x7f8a90017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:16.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.685+0000 7f8a98ff9700 1 -- 172.21.15.8:0/1107870154 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9000bbe0 con 0x7f8a9c06d0f0 2023-10-06T04:37:16.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.685+0000 7f8a98ff9700 1 -- 172.21.15.8:0/1107870154 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a90011420 con 0x7f8a9c06d0f0 2023-10-06T04:37:16.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.685+0000 7f8aa2f3b700 1 -- 172.21.15.8:0/1107870154 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a9c140260 con 0x7f8a9c06d0f0 2023-10-06T04:37:16.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.685+0000 7f8a98ff9700 1 -- 172.21.15.8:0/1107870154 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a900117e0 con 0x7f8a9c06d0f0 2023-10-06T04:37:16.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.686+0000 7f8aa2f3b700 1 -- 172.21.15.8:0/1107870154 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a9c140820 con 0x7f8a9c06d0f0 2023-10-06T04:37:16.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.686+0000 7f8aa2f3b700 1 -- 172.21.15.8:0/1107870154 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a9c071550 con 0x7f8a9c06d0f0 2023-10-06T04:37:16.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.687+0000 7f8a98ff9700 1 -- 172.21.15.8:0/1107870154 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8a90011b90 con 0x7f8a9c06d0f0 2023-10-06T04:37:16.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.687+0000 7f8a98ff9700 1 --2- 172.21.15.8:0/1107870154 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8a80066f30 0x7f8a800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:16.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.688+0000 7f8a98ff9700 1 -- 172.21.15.8:0/1107870154 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f8a900860e0 con 0x7f8a9c06d0f0 2023-10-06T04:37:16.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.688+0000 7f8a9bfff700 1 --2- 172.21.15.8:0/1107870154 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8a80066f30 0x7f8a800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:16.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.688+0000 7f8a9bfff700 1 --2- 172.21.15.8:0/1107870154 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8a80066f30 0x7f8a800693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c142cc0 tx=0x7f8a88008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:16.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.692+0000 7f8a98ff9700 1 -- 172.21.15.8:0/1107870154 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a90053110 con 0x7f8a9c06d0f0 2023-10-06T04:37:16.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:16.930+0000 7f8aa2f3b700 1 -- 172.21.15.8:0/1107870154 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8a9c0cf170 con 0x7f8a9c06d0f0 2023-10-06T04:37:17.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.551+0000 7f8a98ff9700 1 -- 172.21.15.8:0/1107870154 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8a90056730 con 0x7f8a9c06d0f0 2023-10-06T04:37:17.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.557+0000 7f8aa2f3b700 1 -- 172.21.15.8:0/1107870154 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8a80066f30 msgr2=0x7f8a800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:17.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.557+0000 7f8aa2f3b700 1 --2- 172.21.15.8:0/1107870154 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8a80066f30 0x7f8a800693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c142cc0 tx=0x7f8a88008040 comp rx=0 tx=0).stop 2023-10-06T04:37:17.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.557+0000 7f8aa2f3b700 1 -- 172.21.15.8:0/1107870154 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a9c06d0f0 msgr2=0x7f8a9c16a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:17.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.557+0000 7f8aa2f3b700 1 --2- 172.21.15.8:0/1107870154 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a9c06d0f0 0x7f8a9c16a0b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c06f2e0 tx=0x7f8a90017000 comp rx=0 tx=0).stop 2023-10-06T04:37:17.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.558+0000 7f8aa2f3b700 1 -- 172.21.15.8:0/1107870154 shutdown_connections 2023-10-06T04:37:17.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.558+0000 7f8aa2f3b700 1 --2- 172.21.15.8:0/1107870154 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8a80066f30 0x7f8a800693e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:17.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.558+0000 7f8aa2f3b700 1 --2- 172.21.15.8:0/1107870154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a9c0cc440 0x7f8a9c0b2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:17.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.558+0000 7f8aa2f3b700 1 --2- 172.21.15.8:0/1107870154 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a9c06d0f0 0x7f8a9c16a0b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:17.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.558+0000 7f8aa2f3b700 1 --2- 172.21.15.8:0/1107870154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a9c0cc070 0x7f8a9c13c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:17.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.558+0000 7f8aa2f3b700 1 -- 172.21.15.8:0/1107870154 >> 172.21.15.8:0/1107870154 conn(0x7f8a9c0ce250 msgr2=0x7f8a9c13f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:17.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.558+0000 7f8aa2f3b700 1 -- 172.21.15.8:0/1107870154 shutdown_connections 2023-10-06T04:37:17.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.558+0000 7f8aa2f3b700 1 -- 172.21.15.8:0/1107870154 wait complete. 2023-10-06T04:37:17.562 INFO:teuthology.orchestra.run.smithi008.stderr:new fs with metadata pool 6 and data pool 7 2023-10-06T04:37:17.576 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:37:17.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.697+0000 7fb3f8baa700 1 Processor -- start 2023-10-06T04:37:17.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.697+0000 7fb3f8baa700 1 -- start start 2023-10-06T04:37:17.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.698+0000 7fb3f8baa700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb3f406c3e0 0x7fb3f40686e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:17.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.698+0000 7fb3f8baa700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3f4159c60 0x7fb3f415a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:17.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.698+0000 7fb3f8baa700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3f415a5c0 con 0x7fb3f4142c30 2023-10-06T04:37:17.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.698+0000 7fb3f8baa700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3f406c880 con 0x7fb3f406c3e0 2023-10-06T04:37:17.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.698+0000 7fb3f8baa700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f40699f0 con 0x7fb3f4159c60 2023-10-06T04:37:17.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.698+0000 7fb3f259c700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fb3f4142c30 0x7fb3f4069e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:40244/0 (socket says 172.21.15.8:40244) 2023-10-06T04:37:17.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.698+0000 7fb3f259c700 1 -- 172.21.15.8:0/3162482062 learned_addr learned my addr 172.21.15.8:0/3162482062 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:17.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.699+0000 7fb3f1d9b700 1 --2- 172.21.15.8:0/3162482062 >> v2:172.21.15.184:3300/0 conn(0x7fb3f406c3e0 0x7fb3f40686e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:17.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.699+0000 7fb3f2d9d700 1 --2- 172.21.15.8:0/3162482062 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3f4159c60 0x7fb3f415a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:17.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.699+0000 7fb3f159a700 1 -- 172.21.15.8:0/3162482062 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 766389632 0 0) 0x7fb3ec001490 con 0x7fb3f4142c30 2023-10-06T04:37:17.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.699+0000 7fb3f159a700 1 -- 172.21.15.8:0/3162482062 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3e0003570 con 0x7fb3f4142c30 2023-10-06T04:37:17.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.699+0000 7fb3f159a700 1 -- 172.21.15.8:0/3162482062 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3505995179 0 0) 0x7fb3e0003570 con 0x7fb3f4142c30 2023-10-06T04:37:17.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.699+0000 7fb3f159a700 1 -- 172.21.15.8:0/3162482062 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3f4159c60 msgr2=0x7fb3f415a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:17.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.699+0000 7fb3f159a700 1 --2- 172.21.15.8:0/3162482062 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3f4159c60 0x7fb3f415a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:17.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.699+0000 7fb3f159a700 1 -- 172.21.15.8:0/3162482062 >> v2:172.21.15.184:3300/0 conn(0x7fb3f406c3e0 msgr2=0x7fb3f40686e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:17.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.699+0000 7fb3f159a700 1 --2- 172.21.15.8:0/3162482062 >> v2:172.21.15.184:3300/0 conn(0x7fb3f406c3e0 0x7fb3f40686e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:17.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.699+0000 7fb3f159a700 1 -- 172.21.15.8:0/3162482062 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f4068de0 con 0x7fb3f4142c30 2023-10-06T04:37:17.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.699+0000 7fb3f159a700 1 -- 172.21.15.8:0/3162482062 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7fb3ec001980 con 0x7fb3f4142c30 2023-10-06T04:37:17.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.699+0000 7fb3f159a700 1 -- 172.21.15.8:0/3162482062 >> v1:172.21.15.8:6789/0 conn(0x7fb3f4142c30 legacy=0x7fb3f4069e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:17.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.699+0000 7fb3f159a700 1 --2- 172.21.15.8:0/3162482062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3e0003a60 0x7fb3e0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:17.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.699+0000 7fb3f159a700 1 --2- 172.21.15.8:0/3162482062 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3f4159c60 0x7fb3e0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:17.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.699+0000 7fb3f159a700 1 --2- 172.21.15.8:0/3162482062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3e0004d50 0x7fb3e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:17.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.699+0000 7fb3f159a700 1 -- 172.21.15.8:0/3162482062 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f40699f0 con 0x7fb3e0004d50 2023-10-06T04:37:17.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.699+0000 7fb3f159a700 1 -- 172.21.15.8:0/3162482062 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e000ba60 con 0x7fb3e0003a60 2023-10-06T04:37:17.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.699+0000 7fb3f159a700 1 -- 172.21.15.8:0/3162482062 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e000bba0 con 0x7fb3f4159c60 2023-10-06T04:37:17.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.699+0000 7fb3f2d9d700 1 --2- 172.21.15.8:0/3162482062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3e0004d50 0x7fb3e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:17.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.699+0000 7fb3f259c700 1 --2- 172.21.15.8:0/3162482062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3e0003a60 0x7fb3e0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:17.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.699+0000 7fb3f1d9b700 1 --2- 172.21.15.8:0/3162482062 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3f4159c60 0x7fb3e0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:17.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.700+0000 7fb3f2d9d700 1 -- 172.21.15.8:0/3162482062 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3f4159c60 msgr2=0x7fb3e0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:17.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.700+0000 7fb3f2d9d700 1 --2- 172.21.15.8:0/3162482062 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3f4159c60 0x7fb3e0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:17.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.700+0000 7fb3f2d9d700 1 -- 172.21.15.8:0/3162482062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3e0003a60 msgr2=0x7fb3e0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:17.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.700+0000 7fb3f2d9d700 1 --2- 172.21.15.8:0/3162482062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3e0003a60 0x7fb3e0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:17.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.700+0000 7fb3f2d9d700 1 -- 172.21.15.8:0/3162482062 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e0003570 con 0x7fb3e0004d50 2023-10-06T04:37:17.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.700+0000 7fb3f2d9d700 1 --2- 172.21.15.8:0/3162482062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3e0004d50 0x7fb3e00051c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4009c00 tx=0x7fb3e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa1c9a7b4f54543c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:17.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.700+0000 7fb3f159a700 1 -- 172.21.15.8:0/3162482062 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e400e6b0 con 0x7fb3e0004d50 2023-10-06T04:37:17.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.700+0000 7fb3f159a700 1 -- 172.21.15.8:0/3162482062 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e400e810 con 0x7fb3e0004d50 2023-10-06T04:37:17.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.700+0000 7fb3f159a700 1 -- 172.21.15.8:0/3162482062 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e400ebd0 con 0x7fb3e0004d50 2023-10-06T04:37:17.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.700+0000 7fb3f8baa700 1 -- 172.21.15.8:0/3162482062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3e0004d50 msgr2=0x7fb3e00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:17.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.700+0000 7fb3f8baa700 1 --2- 172.21.15.8:0/3162482062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3e0004d50 0x7fb3e00051c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4009c00 tx=0x7fb3e40091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:17.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.700+0000 7fb3f2d9d700 1 -- 172.21.15.8:0/3162482062 reap_dead start 2023-10-06T04:37:17.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.701+0000 7fb3f8baa700 1 -- 172.21.15.8:0/3162482062 shutdown_connections 2023-10-06T04:37:17.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.701+0000 7fb3f8baa700 1 -- 172.21.15.8:0/3162482062 >> 172.21.15.8:0/3162482062 conn(0x7fb3f40675d0 msgr2=0x7fb3f40679d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:17.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.701+0000 7fb3f8baa700 1 -- 172.21.15.8:0/3162482062 shutdown_connections 2023-10-06T04:37:17.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.701+0000 7fb3f8baa700 1 -- 172.21.15.8:0/3162482062 wait complete. 2023-10-06T04:37:17.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.702+0000 7fb3f8baa700 1 Processor -- start 2023-10-06T04:37:17.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.702+0000 7fb3f8baa700 1 -- start start 2023-10-06T04:37:17.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.702+0000 7fb3f8baa700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3e0004d50 0x7fb3f4158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:17.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.702+0000 7fb3f8baa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3f416aad0 0x7fb3f40c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:17.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.702+0000 7fb3f8baa700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3f416af40 0x7fb3f40ca480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:17.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.702+0000 7fb3f8baa700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f40ae850 con 0x7fb3f416aad0 2023-10-06T04:37:17.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.702+0000 7fb3f8baa700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f40aeb30 con 0x7fb3e0004d50 2023-10-06T04:37:17.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.703+0000 7fb3f8baa700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f40aee10 con 0x7fb3f416af40 2023-10-06T04:37:17.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.703+0000 7fb3f1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3f416aad0 0x7fb3f40c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:17.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.703+0000 7fb3f1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3f416aad0 0x7fb3f40c9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34990/0 (socket says 172.21.15.8:34990) 2023-10-06T04:37:17.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.703+0000 7fb3f1d9b700 1 -- 172.21.15.8:0/2323286341 learned_addr learned my addr 172.21.15.8:0/2323286341 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:17.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.703+0000 7fb3f259c700 1 --2- 172.21.15.8:0/2323286341 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3e0004d50 0x7fb3f4158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:17.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.703+0000 7fb3f2d9d700 1 --2- 172.21.15.8:0/2323286341 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3f416af40 0x7fb3f40ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:17.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.703+0000 7fb3f1d9b700 1 -- 172.21.15.8:0/2323286341 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3f416af40 msgr2=0x7fb3f40ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:17.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.703+0000 7fb3f1d9b700 1 --2- 172.21.15.8:0/2323286341 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3f416af40 0x7fb3f40ca480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:17.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.703+0000 7fb3f1d9b700 1 -- 172.21.15.8:0/2323286341 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3e0004d50 msgr2=0x7fb3f4158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:17.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.703+0000 7fb3f1d9b700 1 --2- 172.21.15.8:0/2323286341 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3e0004d50 0x7fb3f4158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:17.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.703+0000 7fb3f1d9b700 1 -- 172.21.15.8:0/2323286341 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f40af0f0 con 0x7fb3f416aad0 2023-10-06T04:37:17.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.703+0000 7fb3f259c700 1 --2- 172.21.15.8:0/2323286341 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3e0004d50 0x7fb3f4158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:17.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.703+0000 7fb3f1d9b700 1 --2- 172.21.15.8:0/2323286341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3f416aad0 0x7fb3f40c9f40 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc006ac0 tx=0x7fb3dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:17.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.703+0000 7fb3ea7fc700 1 -- 172.21.15.8:0/2323286341 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc00fa10 con 0x7fb3f416aad0 2023-10-06T04:37:17.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.703+0000 7fb3ea7fc700 1 -- 172.21.15.8:0/2323286341 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3dc00fb70 con 0x7fb3f416aad0 2023-10-06T04:37:17.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.703+0000 7fb3f8baa700 1 -- 172.21.15.8:0/2323286341 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3f40af3d0 con 0x7fb3f416aad0 2023-10-06T04:37:17.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.703+0000 7fb3ea7fc700 1 -- 172.21.15.8:0/2323286341 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc014440 con 0x7fb3f416aad0 2023-10-06T04:37:17.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.703+0000 7fb3f8baa700 1 -- 172.21.15.8:0/2323286341 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3f40af8f0 con 0x7fb3f416aad0 2023-10-06T04:37:17.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.704+0000 7fb3f8baa700 1 -- 172.21.15.8:0/2323286341 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3f4071550 con 0x7fb3f416aad0 2023-10-06T04:37:17.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.705+0000 7fb3ea7fc700 1 -- 172.21.15.8:0/2323286341 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb3dc014830 con 0x7fb3f416aad0 2023-10-06T04:37:17.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.705+0000 7fb3ea7fc700 1 --2- 172.21.15.8:0/2323286341 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb3d4066f30 0x7fb3d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:17.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.705+0000 7fb3ea7fc700 1 -- 172.21.15.8:0/2323286341 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fb3dc018030 con 0x7fb3f416aad0 2023-10-06T04:37:17.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.705+0000 7fb3f259c700 1 --2- 172.21.15.8:0/2323286341 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb3d4066f30 0x7fb3d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:17.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.706+0000 7fb3f259c700 1 --2- 172.21.15.8:0/2323286341 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb3d4066f30 0x7fb3d40693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec001190 tx=0x7fb3ec006040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:17.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.710+0000 7fb3ea7fc700 1 -- 172.21.15.8:0/2323286341 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3dc052210 con 0x7fb3f416aad0 2023-10-06T04:37:17.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.905+0000 7fb3f8baa700 1 -- 172.21.15.8:0/2323286341 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3f41423f0 con 0x7fb3f416aad0 2023-10-06T04:37:17.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.906+0000 7fb3ea7fc700 1 -- 172.21.15.8:0/2323286341 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+17036 (secure 0 0 0) 0x7fb3dc059e60 con 0x7fb3f416aad0 2023-10-06T04:37:17.908 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:17.908 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":37,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:37:16.931689+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:36:10.148177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:36:10.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:37:15.099258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T04:37:15.902657+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.555871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.490505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.504578+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.517217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:05.991135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.537329+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.543232+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.443715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:37:17.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.908+0000 7fb3f8baa700 1 -- 172.21.15.8:0/2323286341 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb3d4066f30 msgr2=0x7fb3d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:17.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.908+0000 7fb3f8baa700 1 --2- 172.21.15.8:0/2323286341 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb3d4066f30 0x7fb3d40693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec001190 tx=0x7fb3ec006040 comp rx=0 tx=0).stop 2023-10-06T04:37:17.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.908+0000 7fb3f8baa700 1 -- 172.21.15.8:0/2323286341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3f416aad0 msgr2=0x7fb3f40c9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:17.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.908+0000 7fb3f8baa700 1 --2- 172.21.15.8:0/2323286341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3f416aad0 0x7fb3f40c9f40 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc006ac0 tx=0x7fb3dc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:17.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.908+0000 7fb3f8baa700 1 -- 172.21.15.8:0/2323286341 shutdown_connections 2023-10-06T04:37:17.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.908+0000 7fb3f8baa700 1 --2- 172.21.15.8:0/2323286341 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb3d4066f30 0x7fb3d40693e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:17.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.908+0000 7fb3f8baa700 1 --2- 172.21.15.8:0/2323286341 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3f416af40 0x7fb3f40ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:17.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.908+0000 7fb3f8baa700 1 --2- 172.21.15.8:0/2323286341 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3e0004d50 0x7fb3f4158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:17.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.908+0000 7fb3f8baa700 1 --2- 172.21.15.8:0/2323286341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3f416aad0 0x7fb3f40c9f40 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:17.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.908+0000 7fb3f8baa700 1 -- 172.21.15.8:0/2323286341 >> 172.21.15.8:0/2323286341 conn(0x7fb3f40675d0 msgr2=0x7fb3f4070790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:17.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.908+0000 7fb3f8baa700 1 -- 172.21.15.8:0/2323286341 shutdown_connections 2023-10-06T04:37:17.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:17.908+0000 7fb3f8baa700 1 -- 172.21.15.8:0/2323286341 wait complete. 2023-10-06T04:37:17.922 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:37:18.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.039+0000 7fe91f2fc700 1 Processor -- start 2023-10-06T04:37:18.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.040+0000 7fe91f2fc700 1 -- start start 2023-10-06T04:37:18.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.040+0000 7fe91f2fc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9180af680 0x7fe91815e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:18.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.040+0000 7fe91f2fc700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe9180cb360 0x7fe9180d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:18.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.040+0000 7fe91f2fc700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9180cc4c0 con 0x7fe9180d08d0 2023-10-06T04:37:18.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.040+0000 7fe91f2fc700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe91815d460 con 0x7fe9180cb360 2023-10-06T04:37:18.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.040+0000 7fe91f2fc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9180d0d50 con 0x7fe9180af680 2023-10-06T04:37:18.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.041+0000 7fe91d899700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe9180d08d0 0x7fe9180b0000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:40256/0 (socket says 172.21.15.8:40256) 2023-10-06T04:37:18.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.041+0000 7fe91d899700 1 -- 172.21.15.8:0/1672799563 learned_addr learned my addr 172.21.15.8:0/1672799563 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:18.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.041+0000 7fe91d098700 1 --2- 172.21.15.8:0/1672799563 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9180af680 0x7fe91815e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:18.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.041+0000 7fe917fff700 1 -- 172.21.15.8:0/1672799563 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2337630834 0 0) 0x7fe9180cc4c0 con 0x7fe9180d08d0 2023-10-06T04:37:18.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.041+0000 7fe917fff700 1 -- 172.21.15.8:0/1672799563 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe900003570 con 0x7fe9180d08d0 2023-10-06T04:37:18.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.041+0000 7fe91c897700 1 --2- 172.21.15.8:0/1672799563 >> v2:172.21.15.184:3300/0 conn(0x7fe9180cb360 0x7fe9180d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:18.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.041+0000 7fe917fff700 1 -- 172.21.15.8:0/1672799563 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2721770983 0 0) 0x7fe900003570 con 0x7fe9180d08d0 2023-10-06T04:37:18.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.041+0000 7fe917fff700 1 -- 172.21.15.8:0/1672799563 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9180af680 msgr2=0x7fe91815e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:18.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.041+0000 7fe917fff700 1 --2- 172.21.15.8:0/1672799563 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9180af680 0x7fe91815e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:18.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.041+0000 7fe917fff700 1 -- 172.21.15.8:0/1672799563 >> v2:172.21.15.184:3300/0 conn(0x7fe9180cb360 msgr2=0x7fe9180d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:18.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.041+0000 7fe917fff700 1 --2- 172.21.15.8:0/1672799563 >> v2:172.21.15.184:3300/0 conn(0x7fe9180cb360 0x7fe9180d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:18.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.041+0000 7fe917fff700 1 -- 172.21.15.8:0/1672799563 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe91815e580 con 0x7fe9180d08d0 2023-10-06T04:37:18.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.041+0000 7fe917fff700 1 -- 172.21.15.8:0/1672799563 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7fe910001470 con 0x7fe9180d08d0 2023-10-06T04:37:18.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.041+0000 7fe917fff700 1 -- 172.21.15.8:0/1672799563 >> v1:172.21.15.8:6789/0 conn(0x7fe9180d08d0 legacy=0x7fe9180b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:18.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.041+0000 7fe917fff700 1 --2- 172.21.15.8:0/1672799563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe900003a90 0x7fe900003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:18.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.041+0000 7fe917fff700 1 --2- 172.21.15.8:0/1672799563 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9180af680 0x7fe900004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:18.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.041+0000 7fe917fff700 1 --2- 172.21.15.8:0/1672799563 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe900004d50 0x7fe9000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:18.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.041+0000 7fe917fff700 1 -- 172.21.15.8:0/1672799563 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91815d460 con 0x7fe900003a90 2023-10-06T04:37:18.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.041+0000 7fe917fff700 1 -- 172.21.15.8:0/1672799563 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9180d0d50 con 0x7fe900004d50 2023-10-06T04:37:18.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.041+0000 7fe917fff700 1 -- 172.21.15.8:0/1672799563 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe90000bb10 con 0x7fe9180af680 2023-10-06T04:37:18.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.041+0000 7fe91d098700 1 --2- 172.21.15.8:0/1672799563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe900003a90 0x7fe900003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:18.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.041+0000 7fe91c897700 1 --2- 172.21.15.8:0/1672799563 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9180af680 0x7fe900004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:18.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.041+0000 7fe91d899700 1 --2- 172.21.15.8:0/1672799563 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe900004d50 0x7fe9000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:18.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.042+0000 7fe91d098700 1 -- 172.21.15.8:0/1672799563 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9180af680 msgr2=0x7fe900004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:18.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.042+0000 7fe91d098700 1 --2- 172.21.15.8:0/1672799563 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9180af680 0x7fe900004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:18.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.042+0000 7fe91d098700 1 -- 172.21.15.8:0/1672799563 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe900004d50 msgr2=0x7fe9000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:18.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.042+0000 7fe91d098700 1 --2- 172.21.15.8:0/1672799563 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe900004d50 0x7fe9000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:18.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.042+0000 7fe91d098700 1 -- 172.21.15.8:0/1672799563 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe900003570 con 0x7fe900003a90 2023-10-06T04:37:18.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.042+0000 7fe91d899700 1 --2- 172.21.15.8:0/1672799563 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe900004d50 0x7fe9000051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:18.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.042+0000 7fe91d098700 1 --2- 172.21.15.8:0/1672799563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe900003a90 0x7fe900003ea0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe90800e210 tx=0x7fe90800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34fee41bc068fdc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:18.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.042+0000 7fe917fff700 1 -- 172.21.15.8:0/1672799563 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90800eac0 con 0x7fe900003a90 2023-10-06T04:37:18.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.042+0000 7fe917fff700 1 -- 172.21.15.8:0/1672799563 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90800f040 con 0x7fe900003a90 2023-10-06T04:37:18.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.042+0000 7fe917fff700 1 -- 172.21.15.8:0/1672799563 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90800ee70 con 0x7fe900003a90 2023-10-06T04:37:18.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.042+0000 7fe91f2fc700 1 -- 172.21.15.8:0/1672799563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe900003a90 msgr2=0x7fe900003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:18.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.042+0000 7fe91f2fc700 1 --2- 172.21.15.8:0/1672799563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe900003a90 0x7fe900003ea0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe90800e210 tx=0x7fe90800b040 comp rx=0 tx=0).stop 2023-10-06T04:37:18.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.042+0000 7fe91d899700 1 -- 172.21.15.8:0/1672799563 reap_dead start 2023-10-06T04:37:18.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.042+0000 7fe91f2fc700 1 -- 172.21.15.8:0/1672799563 shutdown_connections 2023-10-06T04:37:18.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.042+0000 7fe91f2fc700 1 -- 172.21.15.8:0/1672799563 >> 172.21.15.8:0/1672799563 conn(0x7fe9180633d0 msgr2=0x7fe9180637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:18.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.043+0000 7fe91f2fc700 1 -- 172.21.15.8:0/1672799563 shutdown_connections 2023-10-06T04:37:18.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.043+0000 7fe91f2fc700 1 -- 172.21.15.8:0/1672799563 wait complete. 2023-10-06T04:37:18.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.044+0000 7fe91f2fc700 1 Processor -- start 2023-10-06T04:37:18.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.044+0000 7fe91f2fc700 1 -- start start 2023-10-06T04:37:18.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.044+0000 7fe91f2fc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe918166c90 0x7fe9180afa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:18.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.044+0000 7fe91f2fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe91816a630 0x7fe9180aff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:18.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.045+0000 7fe91f2fc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe918167060 0x7fe91815e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:18.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.045+0000 7fe91f2fc700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe918169920 con 0x7fe91816a630 2023-10-06T04:37:18.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.045+0000 7fe91f2fc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91815f480 con 0x7fe918167060 2023-10-06T04:37:18.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.045+0000 7fe91f2fc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe918169b50 con 0x7fe918166c90 2023-10-06T04:37:18.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.045+0000 7fe91c897700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe91816a630 0x7fe9180aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:18.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.045+0000 7fe91c897700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe91816a630 0x7fe9180aff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35016/0 (socket says 172.21.15.8:35016) 2023-10-06T04:37:18.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.045+0000 7fe91c897700 1 -- 172.21.15.8:0/407702509 learned_addr learned my addr 172.21.15.8:0/407702509 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:18.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.045+0000 7fe91d899700 1 --2- 172.21.15.8:0/407702509 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe918167060 0x7fe91815e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:18.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.045+0000 7fe91d098700 1 --2- 172.21.15.8:0/407702509 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe918166c90 0x7fe9180afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:18.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.045+0000 7fe91c897700 1 -- 172.21.15.8:0/407702509 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe918166c90 msgr2=0x7fe9180afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:18.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.045+0000 7fe91c897700 1 --2- 172.21.15.8:0/407702509 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe918166c90 0x7fe9180afa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:18.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.045+0000 7fe91c897700 1 -- 172.21.15.8:0/407702509 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe918167060 msgr2=0x7fe91815e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:18.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.045+0000 7fe91c897700 1 --2- 172.21.15.8:0/407702509 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe918167060 0x7fe91815e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:18.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.045+0000 7fe91c897700 1 -- 172.21.15.8:0/407702509 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe918169e30 con 0x7fe91816a630 2023-10-06T04:37:18.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.045+0000 7fe91d899700 1 --2- 172.21.15.8:0/407702509 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe918167060 0x7fe91815e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:18.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.045+0000 7fe91c897700 1 --2- 172.21.15.8:0/407702509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe91816a630 0x7fe9180aff90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe90c010d00 tx=0x7fe90c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:18.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.045+0000 7fe9157fa700 1 -- 172.21.15.8:0/407702509 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90c00ea50 con 0x7fe91816a630 2023-10-06T04:37:18.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.045+0000 7fe9157fa700 1 -- 172.21.15.8:0/407702509 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90c00ebb0 con 0x7fe91816a630 2023-10-06T04:37:18.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.045+0000 7fe91f2fc700 1 -- 172.21.15.8:0/407702509 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe91816a110 con 0x7fe91816a630 2023-10-06T04:37:18.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.045+0000 7fe9157fa700 1 -- 172.21.15.8:0/407702509 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90c014430 con 0x7fe91816a630 2023-10-06T04:37:18.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.045+0000 7fe91f2fc700 1 -- 172.21.15.8:0/407702509 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe91815ee70 con 0x7fe91816a630 2023-10-06T04:37:18.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.046+0000 7fe91f2fc700 1 -- 172.21.15.8:0/407702509 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe918071550 con 0x7fe91816a630 2023-10-06T04:37:18.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.047+0000 7fe9157fa700 1 -- 172.21.15.8:0/407702509 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe90c014820 con 0x7fe91816a630 2023-10-06T04:37:18.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.047+0000 7fe9157fa700 1 --2- 172.21.15.8:0/407702509 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe904066f30 0x7fe9040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:18.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.047+0000 7fe9157fa700 1 -- 172.21.15.8:0/407702509 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fe90c084fd0 con 0x7fe91816a630 2023-10-06T04:37:18.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.047+0000 7fe91d098700 1 --2- 172.21.15.8:0/407702509 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe904066f30 0x7fe9040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:18.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.048+0000 7fe91d098700 1 --2- 172.21.15.8:0/407702509 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe904066f30 0x7fe9040693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe91804d170 tx=0x7fe90801a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:18.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.051+0000 7fe9157fa700 1 -- 172.21.15.8:0/407702509 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe90c051fa0 con 0x7fe91816a630 2023-10-06T04:37:18.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.249+0000 7fe91f2fc700 1 -- 172.21.15.8:0/407702509 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9180cacd0 con 0x7fe91816a630 2023-10-06T04:37:18.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.250+0000 7fe9157fa700 1 -- 172.21.15.8:0/407702509 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+17036 (secure 0 0 0) 0x7fe90c006cb0 con 0x7fe91816a630 2023-10-06T04:37:18.252 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:18.252 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":37,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:37:16.931689+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:36:10.148177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:36:10.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:37:15.099258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T04:37:15.902657+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.555871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.490505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.504578+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.517217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:05.991135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.537329+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.543232+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.443715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:37:18.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.252+0000 7fe91f2fc700 1 -- 172.21.15.8:0/407702509 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe904066f30 msgr2=0x7fe9040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:18.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.252+0000 7fe91f2fc700 1 --2- 172.21.15.8:0/407702509 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe904066f30 0x7fe9040693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe91804d170 tx=0x7fe90801a000 comp rx=0 tx=0).stop 2023-10-06T04:37:18.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.252+0000 7fe91f2fc700 1 -- 172.21.15.8:0/407702509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe91816a630 msgr2=0x7fe9180aff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:18.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.252+0000 7fe91f2fc700 1 --2- 172.21.15.8:0/407702509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe91816a630 0x7fe9180aff90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe90c010d00 tx=0x7fe90c008040 comp rx=0 tx=0).stop 2023-10-06T04:37:18.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.252+0000 7fe91f2fc700 1 -- 172.21.15.8:0/407702509 shutdown_connections 2023-10-06T04:37:18.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.252+0000 7fe91f2fc700 1 --2- 172.21.15.8:0/407702509 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe904066f30 0x7fe9040693e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:18.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.252+0000 7fe91f2fc700 1 --2- 172.21.15.8:0/407702509 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe918167060 0x7fe91815e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:18.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.252+0000 7fe91f2fc700 1 --2- 172.21.15.8:0/407702509 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe918166c90 0x7fe9180afa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:18.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.252+0000 7fe91f2fc700 1 --2- 172.21.15.8:0/407702509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe91816a630 0x7fe9180aff90 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:18.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.252+0000 7fe91f2fc700 1 -- 172.21.15.8:0/407702509 >> 172.21.15.8:0/407702509 conn(0x7fe9180633d0 msgr2=0x7fe9180cefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:18.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.252+0000 7fe91f2fc700 1 -- 172.21.15.8:0/407702509 shutdown_connections 2023-10-06T04:37:18.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.252+0000 7fe91f2fc700 1 -- 172.21.15.8:0/407702509 wait complete. 2023-10-06T04:37:18.266 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T04:37:18.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.386+0000 7f9d88ce7700 1 Processor -- start 2023-10-06T04:37:18.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.387+0000 7f9d88ce7700 1 -- start start 2023-10-06T04:37:18.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.387+0000 7f9d88ce7700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9d84142cf0 0x7f9d840b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:18.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.387+0000 7f9d88ce7700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9d841430c0 0x7f9d840cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:18.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.387+0000 7f9d88ce7700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d840cf510 con 0x7f9d840cfee0 2023-10-06T04:37:18.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.387+0000 7f9d88ce7700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d840ce6a0 con 0x7f9d841430c0 2023-10-06T04:37:18.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.387+0000 7f9d88ce7700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d840ce900 con 0x7f9d84142cf0 2023-10-06T04:37:18.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.388+0000 7f9d81d9b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9d841430c0 0x7f9d840cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:18.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.388+0000 7f9d82d9d700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f9d840cfee0 0x7f9d840b3790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:40270/0 (socket says 172.21.15.8:40270) 2023-10-06T04:37:18.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.388+0000 7f9d82d9d700 1 -- 172.21.15.8:0/427795492 learned_addr learned my addr 172.21.15.8:0/427795492 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:18.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.388+0000 7f9d8259c700 1 --2- 172.21.15.8:0/427795492 >> v2:172.21.15.184:3300/0 conn(0x7f9d84142cf0 0x7f9d840b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:18.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.388+0000 7f9d81d9b700 1 -- 172.21.15.8:0/427795492 >> v2:172.21.15.184:3300/0 conn(0x7f9d84142cf0 msgr2=0x7f9d840b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:18.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.388+0000 7f9d81d9b700 1 --2- 172.21.15.8:0/427795492 >> v2:172.21.15.184:3300/0 conn(0x7f9d84142cf0 0x7f9d840b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:18.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.388+0000 7f9d81d9b700 1 -- 172.21.15.8:0/427795492 >> v1:172.21.15.8:6789/0 conn(0x7f9d840cfee0 legacy=0x7f9d840b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:18.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.388+0000 7f9d81d9b700 1 -- 172.21.15.8:0/427795492 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d840cebe0 con 0x7f9d841430c0 2023-10-06T04:37:18.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.388+0000 7f9d8259c700 1 --2- 172.21.15.8:0/427795492 >> v2:172.21.15.184:3300/0 conn(0x7f9d84142cf0 0x7f9d840b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:18.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.388+0000 7f9d8159a700 1 -- 172.21.15.8:0/427795492 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1928253481 0 0) 0x7f9d840cf510 con 0x7f9d840cfee0 2023-10-06T04:37:18.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.388+0000 7f9d81d9b700 1 --2- 172.21.15.8:0/427795492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d841430c0 0x7f9d840cf9a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9d84089240 tx=0x7f9d6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba74cbe52a1c2d4a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:18.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.388+0000 7f9d8159a700 1 -- 172.21.15.8:0/427795492 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c00b6b0 con 0x7f9d841430c0 2023-10-06T04:37:18.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.388+0000 7f9d8159a700 1 -- 172.21.15.8:0/427795492 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6c00b810 con 0x7f9d841430c0 2023-10-06T04:37:18.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.388+0000 7f9d8159a700 1 -- 172.21.15.8:0/427795492 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c00bbb0 con 0x7f9d841430c0 2023-10-06T04:37:18.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.389+0000 7f9d88ce7700 1 -- 172.21.15.8:0/427795492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d841430c0 msgr2=0x7f9d840cf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:18.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.389+0000 7f9d88ce7700 1 --2- 172.21.15.8:0/427795492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d841430c0 0x7f9d840cf9a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9d84089240 tx=0x7f9d6c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:18.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.389+0000 7f9d88ce7700 1 -- 172.21.15.8:0/427795492 shutdown_connections 2023-10-06T04:37:18.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.389+0000 7f9d88ce7700 1 --2- 172.21.15.8:0/427795492 >> v2:172.21.15.184:3300/0 conn(0x7f9d84142cf0 0x7f9d840b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:18.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.389+0000 7f9d88ce7700 1 --2- 172.21.15.8:0/427795492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d841430c0 0x7f9d840cf9a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:18.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.389+0000 7f9d88ce7700 1 -- 172.21.15.8:0/427795492 >> 172.21.15.8:0/427795492 conn(0x7f9d8406ed00 msgr2=0x7f9d8406f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:18.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.389+0000 7f9d88ce7700 1 -- 172.21.15.8:0/427795492 shutdown_connections 2023-10-06T04:37:18.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.389+0000 7f9d88ce7700 1 -- 172.21.15.8:0/427795492 wait complete. 2023-10-06T04:37:18.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.390+0000 7f9d88ce7700 1 Processor -- start 2023-10-06T04:37:18.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.390+0000 7f9d88ce7700 1 -- start start 2023-10-06T04:37:18.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.391+0000 7f9d88ce7700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d840cfee0 0x7f9d84158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.391+0000 7f9d88ce7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d84142cf0 0x7f9d84140df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.391+0000 7f9d88ce7700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d841430c0 0x7f9d840c51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.391+0000 7f9d88ce7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d84158d60 con 0x7f9d84142cf0 2023-10-06T04:37:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.391+0000 7f9d88ce7700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d84159200 con 0x7f9d840cfee0 2023-10-06T04:37:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.391+0000 7f9d88ce7700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8413faa0 con 0x7f9d841430c0 2023-10-06T04:37:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.391+0000 7f9d81d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d84142cf0 0x7f9d84140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.391+0000 7f9d81d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d84142cf0 0x7f9d84140df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35042/0 (socket says 172.21.15.8:35042) 2023-10-06T04:37:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.391+0000 7f9d81d9b700 1 -- 172.21.15.8:0/1740830653 learned_addr learned my addr 172.21.15.8:0/1740830653 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.391+0000 7f9d82d9d700 1 --2- 172.21.15.8:0/1740830653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d841430c0 0x7f9d840c51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.391+0000 7f9d8259c700 1 --2- 172.21.15.8:0/1740830653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d840cfee0 0x7f9d84158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:18.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.391+0000 7f9d81d9b700 1 -- 172.21.15.8:0/1740830653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d841430c0 msgr2=0x7f9d840c51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:18.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.391+0000 7f9d81d9b700 1 --2- 172.21.15.8:0/1740830653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d841430c0 0x7f9d840c51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:18.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.391+0000 7f9d81d9b700 1 -- 172.21.15.8:0/1740830653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d840cfee0 msgr2=0x7f9d84158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:18.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.391+0000 7f9d81d9b700 1 --2- 172.21.15.8:0/1740830653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d840cfee0 0x7f9d84158820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:18.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.391+0000 7f9d81d9b700 1 -- 172.21.15.8:0/1740830653 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d6c009420 con 0x7f9d84142cf0 2023-10-06T04:37:18.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.391+0000 7f9d8259c700 1 --2- 172.21.15.8:0/1740830653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d840cfee0 0x7f9d84158820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:18.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.391+0000 7f9d81d9b700 1 --2- 172.21.15.8:0/1740830653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d84142cf0 0x7f9d84140df0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9d84067f40 tx=0x7f9d6c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:18.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.391+0000 7f9d7a7fc700 1 -- 172.21.15.8:0/1740830653 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c00bb90 con 0x7f9d84142cf0 2023-10-06T04:37:18.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.391+0000 7f9d7a7fc700 1 -- 172.21.15.8:0/1740830653 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6c011420 con 0x7f9d84142cf0 2023-10-06T04:37:18.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.391+0000 7f9d88ce7700 1 -- 172.21.15.8:0/1740830653 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d8413fd80 con 0x7f9d84142cf0 2023-10-06T04:37:18.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.392+0000 7f9d7a7fc700 1 -- 172.21.15.8:0/1740830653 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c0117c0 con 0x7f9d84142cf0 2023-10-06T04:37:18.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.392+0000 7f9d88ce7700 1 -- 172.21.15.8:0/1740830653 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d8415b4a0 con 0x7f9d84142cf0 2023-10-06T04:37:18.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.393+0000 7f9d88ce7700 1 -- 172.21.15.8:0/1740830653 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d84071550 con 0x7f9d84142cf0 2023-10-06T04:37:18.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.393+0000 7f9d7a7fc700 1 -- 172.21.15.8:0/1740830653 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9d6c011bb0 con 0x7f9d84142cf0 2023-10-06T04:37:18.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.393+0000 7f9d7a7fc700 1 --2- 172.21.15.8:0/1740830653 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9d64066f30 0x7f9d640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:18.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.393+0000 7f9d7a7fc700 1 -- 172.21.15.8:0/1740830653 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9d6c086050 con 0x7f9d84142cf0 2023-10-06T04:37:18.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.393+0000 7f9d8259c700 1 --2- 172.21.15.8:0/1740830653 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9d64066f30 0x7f9d640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:18.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.394+0000 7f9d8259c700 1 --2- 172.21.15.8:0/1740830653 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9d64066f30 0x7f9d640693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9d840ccbc0 tx=0x7f9d7c009910 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:18.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.398+0000 7f9d7a7fc700 1 -- 172.21.15.8:0/1740830653 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d6c053020 con 0x7f9d84142cf0 2023-10-06T04:37:18.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:18.642+0000 7f9d88ce7700 1 -- 172.21.15.8:0/1740830653 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9d840ceec0 con 0x7f9d84142cf0 2023-10-06T04:37:19.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.564+0000 7f9d7a7fc700 1 -- 172.21.15.8:0/1740830653 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9d6c011e60 con 0x7f9d84142cf0 2023-10-06T04:37:19.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.567+0000 7f9d88ce7700 1 -- 172.21.15.8:0/1740830653 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9d64066f30 msgr2=0x7f9d640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:19.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.567+0000 7f9d88ce7700 1 --2- 172.21.15.8:0/1740830653 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9d64066f30 0x7f9d640693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9d840ccbc0 tx=0x7f9d7c009910 comp rx=0 tx=0).stop 2023-10-06T04:37:19.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.567+0000 7f9d88ce7700 1 -- 172.21.15.8:0/1740830653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d84142cf0 msgr2=0x7f9d84140df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:19.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.567+0000 7f9d88ce7700 1 --2- 172.21.15.8:0/1740830653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d84142cf0 0x7f9d84140df0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9d84067f40 tx=0x7f9d6c017000 comp rx=0 tx=0).stop 2023-10-06T04:37:19.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.567+0000 7f9d88ce7700 1 -- 172.21.15.8:0/1740830653 shutdown_connections 2023-10-06T04:37:19.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.567+0000 7f9d88ce7700 1 --2- 172.21.15.8:0/1740830653 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9d64066f30 0x7f9d640693e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:19.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.567+0000 7f9d88ce7700 1 --2- 172.21.15.8:0/1740830653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d841430c0 0x7f9d840c51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:19.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.567+0000 7f9d88ce7700 1 --2- 172.21.15.8:0/1740830653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d840cfee0 0x7f9d84158820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:19.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.567+0000 7f9d88ce7700 1 --2- 172.21.15.8:0/1740830653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d84142cf0 0x7f9d84140df0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:19.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.567+0000 7f9d88ce7700 1 -- 172.21.15.8:0/1740830653 >> 172.21.15.8:0/1740830653 conn(0x7f9d8406ed00 msgr2=0x7f9d840b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:19.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.567+0000 7f9d88ce7700 1 -- 172.21.15.8:0/1740830653 shutdown_connections 2023-10-06T04:37:19.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.567+0000 7f9d88ce7700 1 -- 172.21.15.8:0/1740830653 wait complete. 2023-10-06T04:37:19.583 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T04:37:19.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.708+0000 7fb7bb59e700 1 Processor -- start 2023-10-06T04:37:19.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.708+0000 7fb7bb59e700 1 -- start start 2023-10-06T04:37:19.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.709+0000 7fb7bb59e700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb7bc15d1a0 0x7fb7bc0ca930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:19.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.709+0000 7fb7bb59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7bc15d570 0x7fb7bc156a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:19.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.709+0000 7fb7bb59e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb7bc156f40 0x7fb7bc0cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:19.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.709+0000 7fb7bb59e700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7bc0afd20 con 0x7fb7bc15d1a0 2023-10-06T04:37:19.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.709+0000 7fb7bb59e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7bc157360 con 0x7fb7bc156f40 2023-10-06T04:37:19.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.709+0000 7fb7bb59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc0cae70 con 0x7fb7bc15d570 2023-10-06T04:37:19.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.710+0000 7fb7ba59c700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb7bc15d1a0 0x7fb7bc0ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:19.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.710+0000 7fb7ba59c700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb7bc15d1a0 0x7fb7bc0ca930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35050/0 (socket says 172.21.15.8:35050) 2023-10-06T04:37:19.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.710+0000 7fb7ba59c700 1 -- 172.21.15.8:0/3129187033 learned_addr learned my addr 172.21.15.8:0/3129187033 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:19.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.710+0000 7fb7b9d9b700 1 --2- 172.21.15.8:0/3129187033 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7bc15d570 0x7fb7bc156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:19.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.710+0000 7fb7bad9d700 1 --2- 172.21.15.8:0/3129187033 >> v2:172.21.15.184:3300/0 conn(0x7fb7bc156f40 0x7fb7bc0cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:19.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.710+0000 7fb7ba59c700 1 -- 172.21.15.8:0/3129187033 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7bc15d570 msgr2=0x7fb7bc156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:19.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.710+0000 7fb7ba59c700 1 --2- 172.21.15.8:0/3129187033 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7bc15d570 0x7fb7bc156a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:19.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.710+0000 7fb7ba59c700 1 -- 172.21.15.8:0/3129187033 >> v2:172.21.15.184:3300/0 conn(0x7fb7bc156f40 msgr2=0x7fb7bc0cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:19.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.710+0000 7fb7ba59c700 1 --2- 172.21.15.8:0/3129187033 >> v2:172.21.15.184:3300/0 conn(0x7fb7bc156f40 0x7fb7bc0cccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:19.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.710+0000 7fb7ba59c700 1 -- 172.21.15.8:0/3129187033 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7bc0cb1d0 con 0x7fb7bc15d1a0 2023-10-06T04:37:19.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.710+0000 7fb7ba59c700 1 --2- 172.21.15.8:0/3129187033 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7bc15d1a0 0x7fb7bc0ca930 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc0ca8a0 tx=0x7fb7b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c62b516a7332640c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:19.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.710+0000 7fb7b959a700 1 -- 172.21.15.8:0/3129187033 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b400b8f0 con 0x7fb7bc15d1a0 2023-10-06T04:37:19.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.710+0000 7fb7b959a700 1 -- 172.21.15.8:0/3129187033 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b400ba50 con 0x7fb7bc15d1a0 2023-10-06T04:37:19.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.710+0000 7fb7b959a700 1 -- 172.21.15.8:0/3129187033 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b400bdf0 con 0x7fb7bc15d1a0 2023-10-06T04:37:19.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.711+0000 7fb7bb59e700 1 -- 172.21.15.8:0/3129187033 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7bc15d1a0 msgr2=0x7fb7bc0ca930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:19.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.711+0000 7fb7bb59e700 1 --2- 172.21.15.8:0/3129187033 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7bc15d1a0 0x7fb7bc0ca930 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc0ca8a0 tx=0x7fb7b4009250 comp rx=0 tx=0).stop 2023-10-06T04:37:19.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.711+0000 7fb7bb59e700 1 -- 172.21.15.8:0/3129187033 shutdown_connections 2023-10-06T04:37:19.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.711+0000 7fb7bb59e700 1 --2- 172.21.15.8:0/3129187033 >> v2:172.21.15.184:3300/0 conn(0x7fb7bc156f40 0x7fb7bc0cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:19.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.711+0000 7fb7bb59e700 1 --2- 172.21.15.8:0/3129187033 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7bc15d1a0 0x7fb7bc0ca930 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:19.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.711+0000 7fb7bb59e700 1 --2- 172.21.15.8:0/3129187033 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7bc15d570 0x7fb7bc156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:19.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.711+0000 7fb7bb59e700 1 -- 172.21.15.8:0/3129187033 >> 172.21.15.8:0/3129187033 conn(0x7fb7bc069800 msgr2=0x7fb7bc069c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:19.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.711+0000 7fb7bb59e700 1 -- 172.21.15.8:0/3129187033 shutdown_connections 2023-10-06T04:37:19.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.711+0000 7fb7bb59e700 1 -- 172.21.15.8:0/3129187033 wait complete. 2023-10-06T04:37:19.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.712+0000 7fb7bb59e700 1 Processor -- start 2023-10-06T04:37:19.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.712+0000 7fb7bb59e700 1 -- start start 2023-10-06T04:37:19.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.713+0000 7fb7bb59e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7bc156f40 0x7fb7bc0cfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:19.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.713+0000 7fb7bb59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7bc15d1a0 0x7fb7bc16a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:19.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.713+0000 7fb7bb59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7bc15d570 0x7fb7bc148c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:19.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.713+0000 7fb7bb59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc16a5b0 con 0x7fb7bc15d1a0 2023-10-06T04:37:19.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.713+0000 7fb7bb59e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc0ceae0 con 0x7fb7bc156f40 2023-10-06T04:37:19.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.713+0000 7fb7bb59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc0cedc0 con 0x7fb7bc15d570 2023-10-06T04:37:19.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.713+0000 7fb7b9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7bc15d1a0 0x7fb7bc16a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:19.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.713+0000 7fb7b9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7bc15d1a0 0x7fb7bc16a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35058/0 (socket says 172.21.15.8:35058) 2023-10-06T04:37:19.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.713+0000 7fb7b9d9b700 1 -- 172.21.15.8:0/2697376439 learned_addr learned my addr 172.21.15.8:0/2697376439 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:19.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.713+0000 7fb7ba59c700 1 --2- 172.21.15.8:0/2697376439 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7bc156f40 0x7fb7bc0cfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:19.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.713+0000 7fb7bad9d700 1 --2- 172.21.15.8:0/2697376439 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7bc15d570 0x7fb7bc148c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:19.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.713+0000 7fb7b9d9b700 1 -- 172.21.15.8:0/2697376439 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7bc15d570 msgr2=0x7fb7bc148c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:19.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.713+0000 7fb7b9d9b700 1 --2- 172.21.15.8:0/2697376439 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7bc15d570 0x7fb7bc148c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:19.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.713+0000 7fb7b9d9b700 1 -- 172.21.15.8:0/2697376439 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7bc156f40 msgr2=0x7fb7bc0cfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:19.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.713+0000 7fb7b9d9b700 1 --2- 172.21.15.8:0/2697376439 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7bc156f40 0x7fb7bc0cfb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:19.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.713+0000 7fb7b9d9b700 1 -- 172.21.15.8:0/2697376439 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b40094f0 con 0x7fb7bc15d1a0 2023-10-06T04:37:19.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.713+0000 7fb7bad9d700 1 --2- 172.21.15.8:0/2697376439 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7bc15d570 0x7fb7bc148c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:19.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.713+0000 7fb7b9d9b700 1 --2- 172.21.15.8:0/2697376439 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7bc15d1a0 0x7fb7bc16a070 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb7a400d860 tx=0x7fb7a4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:19.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.713+0000 7fb7b27fc700 1 -- 172.21.15.8:0/2697376439 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a40125f0 con 0x7fb7bc15d1a0 2023-10-06T04:37:19.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.713+0000 7fb7b27fc700 1 -- 172.21.15.8:0/2697376439 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a4012750 con 0x7fb7bc15d1a0 2023-10-06T04:37:19.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.713+0000 7fb7bb59e700 1 -- 172.21.15.8:0/2697376439 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7bc0cf0a0 con 0x7fb7bc15d1a0 2023-10-06T04:37:19.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.713+0000 7fb7b27fc700 1 -- 172.21.15.8:0/2697376439 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4012b10 con 0x7fb7bc15d1a0 2023-10-06T04:37:19.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.713+0000 7fb7bb59e700 1 -- 172.21.15.8:0/2697376439 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7bc0cf660 con 0x7fb7bc15d1a0 2023-10-06T04:37:19.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.714+0000 7fb7bb59e700 1 -- 172.21.15.8:0/2697376439 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7bc0cf850 con 0x7fb7bc15d1a0 2023-10-06T04:37:19.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.715+0000 7fb7b27fc700 1 -- 172.21.15.8:0/2697376439 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb7a401e460 con 0x7fb7bc15d1a0 2023-10-06T04:37:19.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.715+0000 7fb7b27fc700 1 --2- 172.21.15.8:0/2697376439 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb79c066f30 0x7fb79c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:19.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.715+0000 7fb7b27fc700 1 -- 172.21.15.8:0/2697376439 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fb7a4084d70 con 0x7fb7bc15d1a0 2023-10-06T04:37:19.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.715+0000 7fb7ba59c700 1 --2- 172.21.15.8:0/2697376439 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb79c066f30 0x7fb79c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:19.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.716+0000 7fb7ba59c700 1 --2- 172.21.15.8:0/2697376439 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb79c066f30 0x7fb79c0693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc0ca8a0 tx=0x7fb7b4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:19.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.720+0000 7fb7b27fc700 1 -- 172.21.15.8:0/2697376439 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb7a4051d40 con 0x7fb7bc15d1a0 2023-10-06T04:37:19.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:19.962+0000 7fb7bb59e700 1 -- 172.21.15.8:0/2697376439 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb7bc04c380 con 0x7fb7bc15d1a0 2023-10-06T04:37:20.380 INFO:tasks.ceph.mds.a.smithi008.stderr:2023-10-06T04:37:20.379+0000 7f6d0b38a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T04:37:20.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.566+0000 7fb7b27fc700 1 -- 172.21.15.8:0/2697376439 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb7a4055360 con 0x7fb7bc15d1a0 2023-10-06T04:37:20.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.568+0000 7fb7bb59e700 1 -- 172.21.15.8:0/2697376439 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb79c066f30 msgr2=0x7fb79c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:20.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.568+0000 7fb7bb59e700 1 --2- 172.21.15.8:0/2697376439 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb79c066f30 0x7fb79c0693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc0ca8a0 tx=0x7fb7b4017000 comp rx=0 tx=0).stop 2023-10-06T04:37:20.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.568+0000 7fb7bb59e700 1 -- 172.21.15.8:0/2697376439 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7bc15d1a0 msgr2=0x7fb7bc16a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:20.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.568+0000 7fb7bb59e700 1 --2- 172.21.15.8:0/2697376439 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7bc15d1a0 0x7fb7bc16a070 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb7a400d860 tx=0x7fb7a4008040 comp rx=0 tx=0).stop 2023-10-06T04:37:20.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.568+0000 7fb7bb59e700 1 -- 172.21.15.8:0/2697376439 shutdown_connections 2023-10-06T04:37:20.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.568+0000 7fb7bb59e700 1 --2- 172.21.15.8:0/2697376439 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb79c066f30 0x7fb79c0693e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:20.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.568+0000 7fb7bb59e700 1 --2- 172.21.15.8:0/2697376439 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7bc15d570 0x7fb7bc148c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:20.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.568+0000 7fb7bb59e700 1 --2- 172.21.15.8:0/2697376439 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7bc156f40 0x7fb7bc0cfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:20.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.568+0000 7fb7bb59e700 1 --2- 172.21.15.8:0/2697376439 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7bc15d1a0 0x7fb7bc16a070 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:20.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.568+0000 7fb7bb59e700 1 -- 172.21.15.8:0/2697376439 >> 172.21.15.8:0/2697376439 conn(0x7fb7bc069800 msgr2=0x7fb7bc0c5090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:20.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.569+0000 7fb7bb59e700 1 -- 172.21.15.8:0/2697376439 shutdown_connections 2023-10-06T04:37:20.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.569+0000 7fb7bb59e700 1 -- 172.21.15.8:0/2697376439 wait complete. 2023-10-06T04:37:20.585 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:37:20.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.709+0000 7f3353fff700 1 Processor -- start 2023-10-06T04:37:20.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.709+0000 7f3353fff700 1 -- start start 2023-10-06T04:37:20.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.710+0000 7f3353fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f335415a7b0 0x7f3354153b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:20.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.710+0000 7f3353fff700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f335415d8e0 0x7f33540696c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:20.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.710+0000 7f3353fff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f335415d170 con 0x7f3354153740 2023-10-06T04:37:20.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.710+0000 7f3353fff700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33540ca990 con 0x7f335415d8e0 2023-10-06T04:37:20.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.710+0000 7f3353fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33540cac70 con 0x7f335415a7b0 2023-10-06T04:37:20.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.710+0000 7f33537fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f335415d8e0 0x7f33540696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:20.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.710+0000 7f33537fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f335415d8e0 0x7f33540696c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35068/0 (socket says 172.21.15.8:35068) 2023-10-06T04:37:20.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.710+0000 7f33537fe700 1 -- 172.21.15.8:0/528965803 learned_addr learned my addr 172.21.15.8:0/528965803 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:20.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.710+0000 7f33527fc700 1 --2- 172.21.15.8:0/528965803 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f335415a7b0 0x7f3354153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:20.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.710+0000 7f33537fe700 1 -- 172.21.15.8:0/528965803 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f335415a7b0 msgr2=0x7f3354153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:20.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.710+0000 7f33537fe700 1 --2- 172.21.15.8:0/528965803 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f335415a7b0 0x7f3354153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:20.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.710+0000 7f33537fe700 1 -- 172.21.15.8:0/528965803 >> v1:172.21.15.184:6789/0 conn(0x7f3354153740 legacy=0x7f33540cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:20.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.710+0000 7f33537fe700 1 -- 172.21.15.8:0/528965803 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33540caf50 con 0x7f335415d8e0 2023-10-06T04:37:20.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.711+0000 7f33537fe700 1 --2- 172.21.15.8:0/528965803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f335415d8e0 0x7f33540696c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f33440099b0 tx=0x7f3344009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14e55b3b68359a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:20.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.711+0000 7f3351ffb700 1 -- 172.21.15.8:0/528965803 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334400b860 con 0x7f335415d8e0 2023-10-06T04:37:20.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.711+0000 7f3351ffb700 1 -- 172.21.15.8:0/528965803 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334400b9c0 con 0x7f335415d8e0 2023-10-06T04:37:20.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.711+0000 7f3351ffb700 1 -- 172.21.15.8:0/528965803 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334400bd60 con 0x7f335415d8e0 2023-10-06T04:37:20.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.711+0000 7f3353fff700 1 -- 172.21.15.8:0/528965803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f335415d8e0 msgr2=0x7f33540696c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:20.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.711+0000 7f3353fff700 1 --2- 172.21.15.8:0/528965803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f335415d8e0 0x7f33540696c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f33440099b0 tx=0x7f3344009250 comp rx=0 tx=0).stop 2023-10-06T04:37:20.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.711+0000 7f3353fff700 1 -- 172.21.15.8:0/528965803 shutdown_connections 2023-10-06T04:37:20.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.711+0000 7f3353fff700 1 --2- 172.21.15.8:0/528965803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f335415d8e0 0x7f33540696c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:20.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.711+0000 7f3353fff700 1 --2- 172.21.15.8:0/528965803 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f335415a7b0 0x7f3354153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:20.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.711+0000 7f3353fff700 1 -- 172.21.15.8:0/528965803 >> 172.21.15.8:0/528965803 conn(0x7f33540d02b0 msgr2=0x7f33540d06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:20.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.711+0000 7f3353fff700 1 -- 172.21.15.8:0/528965803 shutdown_connections 2023-10-06T04:37:20.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.711+0000 7f3353fff700 1 -- 172.21.15.8:0/528965803 wait complete. 2023-10-06T04:37:20.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.712+0000 7f3353fff700 1 Processor -- start 2023-10-06T04:37:20.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.713+0000 7f3353fff700 1 -- start start 2023-10-06T04:37:20.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.713+0000 7f3353fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3354153740 0x7f33541523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:20.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.713+0000 7f3353fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f335415a7b0 0x7f33540b3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:20.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.713+0000 7f3353fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f335415d8e0 0x7f33540b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:20.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.713+0000 7f3353fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3354152900 con 0x7f335415a7b0 2023-10-06T04:37:20.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.713+0000 7f3353fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33540c8d00 con 0x7f3354153740 2023-10-06T04:37:20.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.713+0000 7f3353fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33540b4910 con 0x7f335415d8e0 2023-10-06T04:37:20.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.713+0000 7f33527fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f335415a7b0 0x7f33540b3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:20.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.713+0000 7f33527fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f335415a7b0 0x7f33540b3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35076/0 (socket says 172.21.15.8:35076) 2023-10-06T04:37:20.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.713+0000 7f33527fc700 1 -- 172.21.15.8:0/2588837877 learned_addr learned my addr 172.21.15.8:0/2588837877 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:20.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.714+0000 7f3352ffd700 1 --2- 172.21.15.8:0/2588837877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3354153740 0x7f33541523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:20.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.714+0000 7f33537fe700 1 --2- 172.21.15.8:0/2588837877 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f335415d8e0 0x7f33540b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:20.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.714+0000 7f33527fc700 1 -- 172.21.15.8:0/2588837877 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f335415d8e0 msgr2=0x7f33540b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:20.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.714+0000 7f33527fc700 1 --2- 172.21.15.8:0/2588837877 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f335415d8e0 0x7f33540b0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:20.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.714+0000 7f33527fc700 1 -- 172.21.15.8:0/2588837877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3354153740 msgr2=0x7f33541523c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:20.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.714+0000 7f33527fc700 1 --2- 172.21.15.8:0/2588837877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3354153740 0x7f33541523c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:20.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.714+0000 7f33527fc700 1 -- 172.21.15.8:0/2588837877 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33440094f0 con 0x7f335415a7b0 2023-10-06T04:37:20.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.714+0000 7f33527fc700 1 --2- 172.21.15.8:0/2588837877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f335415a7b0 0x7f33540b3ee0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f333c00d890 tx=0x7f333c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:20.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.714+0000 7f334affd700 1 -- 172.21.15.8:0/2588837877 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333c00b600 con 0x7f335415a7b0 2023-10-06T04:37:20.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.714+0000 7f334affd700 1 -- 172.21.15.8:0/2588837877 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333c00b760 con 0x7f335415a7b0 2023-10-06T04:37:20.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.714+0000 7f3353fff700 1 -- 172.21.15.8:0/2588837877 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33540c83d0 con 0x7f335415a7b0 2023-10-06T04:37:20.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.714+0000 7f334affd700 1 -- 172.21.15.8:0/2588837877 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333c00bae0 con 0x7f335415a7b0 2023-10-06T04:37:20.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.714+0000 7f3353fff700 1 -- 172.21.15.8:0/2588837877 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33540c8990 con 0x7f335415a7b0 2023-10-06T04:37:20.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.715+0000 7f3353fff700 1 -- 172.21.15.8:0/2588837877 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33540c8e70 con 0x7f335415a7b0 2023-10-06T04:37:20.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.715+0000 7f334affd700 1 -- 172.21.15.8:0/2588837877 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f333c01e460 con 0x7f335415a7b0 2023-10-06T04:37:20.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.716+0000 7f334affd700 1 --2- 172.21.15.8:0/2588837877 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3334066f30 0x7f33340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:20.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.716+0000 7f334affd700 1 -- 172.21.15.8:0/2588837877 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f333c084e90 con 0x7f335415a7b0 2023-10-06T04:37:20.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.716+0000 7f3352ffd700 1 --2- 172.21.15.8:0/2588837877 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3334066f30 0x7f33340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:20.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.716+0000 7f3352ffd700 1 --2- 172.21.15.8:0/2588837877 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3334066f30 0x7f33340693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f334c007fd0 tx=0x7f334c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:20.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.720+0000 7f334affd700 1 -- 172.21.15.8:0/2588837877 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f333c051e60 con 0x7f335415a7b0 2023-10-06T04:37:20.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.956+0000 7f3353fff700 1 -- 172.21.15.8:0/2588837877 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f335404c380 con 0x7f335415a7b0 2023-10-06T04:37:20.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.957+0000 7f334affd700 1 -- 172.21.15.8:0/2588837877 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4594 (secure 0 0 0) 0x7f333c055480 con 0x7f335415a7b0 2023-10-06T04:37:20.959 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:20.959 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4790,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/110277527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":110277527},{"type":"v1","addr":"172.21.15.184:6836","nonce":110277527}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":4793,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/4142299410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":4142299410},{"type":"v1","addr":"172.21.15.184:6837","nonce":4142299410}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5115,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/1697298369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1697298369},{"type":"v1","addr":"172.21.15.8:6834","nonce":1697298369}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:37:16.932006+0000","modified":"2023-10-06T04:37:20.564018+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5118},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5118":{"gid":5118,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.8:6835/3478733664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":3478733664},{"type":"v1","addr":"172.21.15.8:6835","nonce":3478733664}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:37:20.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.958+0000 7f3353fff700 1 -- 172.21.15.8:0/2588837877 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3334066f30 msgr2=0x7f33340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:20.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.958+0000 7f3353fff700 1 --2- 172.21.15.8:0/2588837877 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3334066f30 0x7f33340693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f334c007fd0 tx=0x7f334c009040 comp rx=0 tx=0).stop 2023-10-06T04:37:20.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.958+0000 7f3353fff700 1 -- 172.21.15.8:0/2588837877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f335415a7b0 msgr2=0x7f33540b3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:20.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.958+0000 7f3353fff700 1 --2- 172.21.15.8:0/2588837877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f335415a7b0 0x7f33540b3ee0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f333c00d890 tx=0x7f333c008040 comp rx=0 tx=0).stop 2023-10-06T04:37:20.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.958+0000 7f3353fff700 1 -- 172.21.15.8:0/2588837877 shutdown_connections 2023-10-06T04:37:20.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.958+0000 7f3353fff700 1 --2- 172.21.15.8:0/2588837877 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3334066f30 0x7f33340693e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:20.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.958+0000 7f3353fff700 1 --2- 172.21.15.8:0/2588837877 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f335415d8e0 0x7f33540b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:20.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.958+0000 7f3353fff700 1 --2- 172.21.15.8:0/2588837877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3354153740 0x7f33541523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:20.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.958+0000 7f3353fff700 1 --2- 172.21.15.8:0/2588837877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f335415a7b0 0x7f33540b3ee0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:20.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.958+0000 7f3353fff700 1 -- 172.21.15.8:0/2588837877 >> 172.21.15.8:0/2588837877 conn(0x7f33540d02b0 msgr2=0x7f33540ccc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:20.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.958+0000 7f3353fff700 1 -- 172.21.15.8:0/2588837877 shutdown_connections 2023-10-06T04:37:20.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:20.958+0000 7f3353fff700 1 -- 172.21.15.8:0/2588837877 wait complete. 2023-10-06T04:37:20.963 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 18 2023-10-06T04:37:20.972 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:37:21.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.089+0000 7fe24b2c1700 1 Processor -- start 2023-10-06T04:37:21.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.090+0000 7fe24b2c1700 1 -- start start 2023-10-06T04:37:21.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.090+0000 7fe24b2c1700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe2440c7630 0x7fe2440c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:21.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.090+0000 7fe24b2c1700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe244157540 con 0x7fe2440c99a0 2023-10-06T04:37:21.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.090+0000 7fe24b2c1700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2440c7f70 con 0x7fe244157170 2023-10-06T04:37:21.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.091+0000 7fe24b2c1700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2440c9e20 con 0x7fe2440c7630 2023-10-06T04:37:21.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.091+0000 7fe24885c700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe2440c99a0 0x7fe24415a4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:40280/0 (socket says 172.21.15.8:40280) 2023-10-06T04:37:21.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.091+0000 7fe24885c700 1 -- 172.21.15.8:0/2195608967 learned_addr learned my addr 172.21.15.8:0/2195608967 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:21.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.091+0000 7fe24985e700 1 --2- 172.21.15.8:0/2195608967 >> v2:172.21.15.8:3300/0 conn(0x7fe2440c7630 0x7fe2440c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:21.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.091+0000 7fe23bfff700 1 -- 172.21.15.8:0/2195608967 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2027863568 0 0) 0x7fe244157540 con 0x7fe2440c99a0 2023-10-06T04:37:21.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.091+0000 7fe23bfff700 1 -- 172.21.15.8:0/2195608967 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe230003570 con 0x7fe2440c99a0 2023-10-06T04:37:21.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.091+0000 7fe24985e700 1 -- 172.21.15.8:0/2195608967 >> v1:172.21.15.184:6789/0 conn(0x7fe244157170 legacy=0x7fe24415da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:21.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.091+0000 7fe24985e700 1 -- 172.21.15.8:0/2195608967 >> v1:172.21.15.8:6789/0 conn(0x7fe2440c99a0 legacy=0x7fe24415a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:21.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.091+0000 7fe24985e700 1 -- 172.21.15.8:0/2195608967 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2440ca030 con 0x7fe2440c7630 2023-10-06T04:37:21.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.091+0000 7fe24985e700 1 --2- 172.21.15.8:0/2195608967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2440c7630 0x7fe2440c7a30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe23c009e60 tx=0x7fe23c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f3f543a906a02c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:21.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.091+0000 7fe23bfff700 1 -- 172.21.15.8:0/2195608967 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c00e070 con 0x7fe2440c7630 2023-10-06T04:37:21.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.091+0000 7fe23bfff700 1 -- 172.21.15.8:0/2195608967 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23c00bb60 con 0x7fe2440c7630 2023-10-06T04:37:21.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.091+0000 7fe23bfff700 1 -- 172.21.15.8:0/2195608967 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c012430 con 0x7fe2440c7630 2023-10-06T04:37:21.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.092+0000 7fe24b2c1700 1 -- 172.21.15.8:0/2195608967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2440c7630 msgr2=0x7fe2440c7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:21.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.092+0000 7fe24b2c1700 1 --2- 172.21.15.8:0/2195608967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2440c7630 0x7fe2440c7a30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe23c009e60 tx=0x7fe23c009780 comp rx=0 tx=0).stop 2023-10-06T04:37:21.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.092+0000 7fe24b2c1700 1 -- 172.21.15.8:0/2195608967 shutdown_connections 2023-10-06T04:37:21.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.092+0000 7fe24b2c1700 1 --2- 172.21.15.8:0/2195608967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2440c7630 0x7fe2440c7a30 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:21.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.092+0000 7fe24b2c1700 1 -- 172.21.15.8:0/2195608967 >> 172.21.15.8:0/2195608967 conn(0x7fe2440686e0 msgr2=0x7fe244068ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:21.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.092+0000 7fe24b2c1700 1 -- 172.21.15.8:0/2195608967 shutdown_connections 2023-10-06T04:37:21.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.092+0000 7fe24b2c1700 1 -- 172.21.15.8:0/2195608967 wait complete. 2023-10-06T04:37:21.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.093+0000 7fe24b2c1700 1 Processor -- start 2023-10-06T04:37:21.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.093+0000 7fe24b2c1700 1 -- start start 2023-10-06T04:37:21.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.094+0000 7fe24b2c1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2440c7630 0x7fe2440c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:21.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.094+0000 7fe24b2c1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2440c99a0 0x7fe2440b2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:21.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.094+0000 7fe24b2c1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe244157170 0x7fe2440b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:21.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.094+0000 7fe24b2c1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2440c6040 con 0x7fe2440c99a0 2023-10-06T04:37:21.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.094+0000 7fe24b2c1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2440c5430 con 0x7fe244157170 2023-10-06T04:37:21.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.094+0000 7fe24b2c1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2440c5710 con 0x7fe2440c7630 2023-10-06T04:37:21.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.094+0000 7fe24885c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2440c99a0 0x7fe2440b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:21.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.094+0000 7fe24885c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2440c99a0 0x7fe2440b2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35102/0 (socket says 172.21.15.8:35102) 2023-10-06T04:37:21.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.094+0000 7fe24885c700 1 -- 172.21.15.8:0/1987575588 learned_addr learned my addr 172.21.15.8:0/1987575588 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:21.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.094+0000 7fe24905d700 1 --2- 172.21.15.8:0/1987575588 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2440c7630 0x7fe2440c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:21.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.094+0000 7fe24885c700 1 -- 172.21.15.8:0/1987575588 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2440c7630 msgr2=0x7fe2440c64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:21.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.094+0000 7fe24885c700 1 --2- 172.21.15.8:0/1987575588 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2440c7630 0x7fe2440c64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:21.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.094+0000 7fe24885c700 1 -- 172.21.15.8:0/1987575588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe244157170 msgr2=0x7fe2440b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:21.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.094+0000 7fe24885c700 1 --2- 172.21.15.8:0/1987575588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe244157170 0x7fe2440b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:21.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.094+0000 7fe24885c700 1 -- 172.21.15.8:0/1987575588 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe23c009a20 con 0x7fe2440c99a0 2023-10-06T04:37:21.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.095+0000 7fe24885c700 1 --2- 172.21.15.8:0/1987575588 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2440c99a0 0x7fe2440b2060 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe23400c7c0 tx=0x7fe234007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:21.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.095+0000 7fe2397fa700 1 -- 172.21.15.8:0/1987575588 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe234005b30 con 0x7fe2440c99a0 2023-10-06T04:37:21.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.095+0000 7fe2397fa700 1 -- 172.21.15.8:0/1987575588 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe234005cb0 con 0x7fe2440c99a0 2023-10-06T04:37:21.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.095+0000 7fe24b2c1700 1 -- 172.21.15.8:0/1987575588 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2440c59f0 con 0x7fe2440c99a0 2023-10-06T04:37:21.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.095+0000 7fe2397fa700 1 -- 172.21.15.8:0/1987575588 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe234007320 con 0x7fe2440c99a0 2023-10-06T04:37:21.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.095+0000 7fe24b2c1700 1 -- 172.21.15.8:0/1987575588 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2440c50e0 con 0x7fe2440c99a0 2023-10-06T04:37:21.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.096+0000 7fe24b2c1700 1 -- 172.21.15.8:0/1987575588 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe244071550 con 0x7fe2440c99a0 2023-10-06T04:37:21.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.096+0000 7fe2397fa700 1 -- 172.21.15.8:0/1987575588 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe23401b3b0 con 0x7fe2440c99a0 2023-10-06T04:37:21.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.096+0000 7fe2397fa700 1 --2- 172.21.15.8:0/1987575588 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe228066f30 0x7fe2280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:21.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.097+0000 7fe2397fa700 1 -- 172.21.15.8:0/1987575588 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fe234083cd0 con 0x7fe2440c99a0 2023-10-06T04:37:21.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.097+0000 7fe24905d700 1 --2- 172.21.15.8:0/1987575588 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe228066f30 0x7fe2280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:21.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.097+0000 7fe24905d700 1 --2- 172.21.15.8:0/1987575588 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe228066f30 0x7fe2280693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe2400039e0 tx=0x7fe240007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:21.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.101+0000 7fe2397fa700 1 -- 172.21.15.8:0/1987575588 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe234050ca0 con 0x7fe2440c99a0 2023-10-06T04:37:21.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.294+0000 7fe24b2c1700 1 -- 172.21.15.8:0/1987575588 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2440ca310 con 0x7fe2440c99a0 2023-10-06T04:37:21.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.295+0000 7fe2397fa700 1 -- 172.21.15.8:0/1987575588 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+17023 (secure 0 0 0) 0x7fe234017020 con 0x7fe2440c99a0 2023-10-06T04:37:21.297 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:21.297 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":38,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:37:18.525893+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:36:10.148177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:36:10.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:37:15.099258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T04:37:15.902657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.555871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.490505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.504578+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.517217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:05.991135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.537329+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.543232+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.443715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:37:21.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.297+0000 7fe24b2c1700 1 -- 172.21.15.8:0/1987575588 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe228066f30 msgr2=0x7fe2280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:21.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.297+0000 7fe24b2c1700 1 --2- 172.21.15.8:0/1987575588 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe228066f30 0x7fe2280693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe2400039e0 tx=0x7fe240007ec0 comp rx=0 tx=0).stop 2023-10-06T04:37:21.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.297+0000 7fe24b2c1700 1 -- 172.21.15.8:0/1987575588 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2440c99a0 msgr2=0x7fe2440b2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:21.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.297+0000 7fe24b2c1700 1 --2- 172.21.15.8:0/1987575588 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2440c99a0 0x7fe2440b2060 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe23400c7c0 tx=0x7fe234007e00 comp rx=0 tx=0).stop 2023-10-06T04:37:21.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.297+0000 7fe24b2c1700 1 -- 172.21.15.8:0/1987575588 shutdown_connections 2023-10-06T04:37:21.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.297+0000 7fe24b2c1700 1 --2- 172.21.15.8:0/1987575588 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe228066f30 0x7fe2280693e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:21.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.297+0000 7fe24b2c1700 1 --2- 172.21.15.8:0/1987575588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe244157170 0x7fe2440b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:21.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.297+0000 7fe24b2c1700 1 --2- 172.21.15.8:0/1987575588 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2440c7630 0x7fe2440c64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:21.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.297+0000 7fe24b2c1700 1 --2- 172.21.15.8:0/1987575588 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2440c99a0 0x7fe2440b2060 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:21.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.297+0000 7fe24b2c1700 1 -- 172.21.15.8:0/1987575588 >> 172.21.15.8:0/1987575588 conn(0x7fe2440686e0 msgr2=0x7fe24406adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:21.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.297+0000 7fe24b2c1700 1 -- 172.21.15.8:0/1987575588 shutdown_connections 2023-10-06T04:37:21.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.297+0000 7fe24b2c1700 1 -- 172.21.15.8:0/1987575588 wait complete. 2023-10-06T04:37:21.310 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T04:37:21.311 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:37:21.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.428+0000 7fe886a4e700 1 Processor -- start 2023-10-06T04:37:21.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.428+0000 7fe886a4e700 1 -- start start 2023-10-06T04:37:21.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.429+0000 7fe886a4e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8800d0aa0 0x7fe8801649b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:21.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.429+0000 7fe886a4e700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8800cc4c0 con 0x7fe8800cb360 2023-10-06T04:37:21.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.429+0000 7fe886a4e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8800cb8b0 con 0x7fe8800af680 2023-10-06T04:37:21.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.429+0000 7fe886a4e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe88015d460 con 0x7fe8800d0aa0 2023-10-06T04:37:21.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.429+0000 7fe87f7fe700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe8800cb360 0x7fe8800d0390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:40288/0 (socket says 172.21.15.8:40288) 2023-10-06T04:37:21.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.429+0000 7fe87f7fe700 1 -- 172.21.15.8:0/2594026189 learned_addr learned my addr 172.21.15.8:0/2594026189 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:21.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.429+0000 7fe884feb700 1 --2- 172.21.15.8:0/2594026189 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8800d0aa0 0x7fe8801649b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:21.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.429+0000 7fe87effd700 1 -- 172.21.15.8:0/2594026189 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1153565873 0 0) 0x7fe8800cb8b0 con 0x7fe8800af680 2023-10-06T04:37:21.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.429+0000 7fe87effd700 1 -- 172.21.15.8:0/2594026189 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe868003570 con 0x7fe8800af680 2023-10-06T04:37:21.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.429+0000 7fe87effd700 1 -- 172.21.15.8:0/2594026189 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1591482807 0 0) 0x7fe8800cc4c0 con 0x7fe8800cb360 2023-10-06T04:37:21.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.429+0000 7fe87effd700 1 -- 172.21.15.8:0/2594026189 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8800cb8b0 con 0x7fe8800cb360 2023-10-06T04:37:21.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.429+0000 7fe884feb700 1 -- 172.21.15.8:0/2594026189 >> v1:172.21.15.184:6789/0 conn(0x7fe8800af680 legacy=0x7fe88015e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:21.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.429+0000 7fe884feb700 1 -- 172.21.15.8:0/2594026189 >> v1:172.21.15.8:6789/0 conn(0x7fe8800cb360 legacy=0x7fe8800d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:21.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.429+0000 7fe884feb700 1 -- 172.21.15.8:0/2594026189 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8800cbb90 con 0x7fe8800d0aa0 2023-10-06T04:37:21.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.430+0000 7fe884feb700 1 --2- 172.21.15.8:0/2594026189 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8800d0aa0 0x7fe8801649b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe878009e90 tx=0x7fe878009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e6d89bef9274122 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:21.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.430+0000 7fe87effd700 1 -- 172.21.15.8:0/2594026189 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87800e070 con 0x7fe8800d0aa0 2023-10-06T04:37:21.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.430+0000 7fe87effd700 1 -- 172.21.15.8:0/2594026189 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87800bb80 con 0x7fe8800d0aa0 2023-10-06T04:37:21.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.430+0000 7fe87effd700 1 -- 172.21.15.8:0/2594026189 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe878012430 con 0x7fe8800d0aa0 2023-10-06T04:37:21.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.430+0000 7fe886a4e700 1 -- 172.21.15.8:0/2594026189 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8800d0aa0 msgr2=0x7fe8801649b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:21.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.430+0000 7fe886a4e700 1 --2- 172.21.15.8:0/2594026189 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8800d0aa0 0x7fe8801649b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe878009e90 tx=0x7fe878009780 comp rx=0 tx=0).stop 2023-10-06T04:37:21.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.430+0000 7fe886a4e700 1 -- 172.21.15.8:0/2594026189 shutdown_connections 2023-10-06T04:37:21.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.430+0000 7fe886a4e700 1 --2- 172.21.15.8:0/2594026189 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8800d0aa0 0x7fe8801649b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:21.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.430+0000 7fe886a4e700 1 -- 172.21.15.8:0/2594026189 >> 172.21.15.8:0/2594026189 conn(0x7fe8800633d0 msgr2=0x7fe8800637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:21.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.430+0000 7fe886a4e700 1 -- 172.21.15.8:0/2594026189 shutdown_connections 2023-10-06T04:37:21.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.430+0000 7fe886a4e700 1 -- 172.21.15.8:0/2594026189 wait complete. 2023-10-06T04:37:21.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.432+0000 7fe886a4e700 1 Processor -- start 2023-10-06T04:37:21.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.432+0000 7fe886a4e700 1 -- start start 2023-10-06T04:37:21.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.432+0000 7fe886a4e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8800af680 0x7fe8800b5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:21.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.432+0000 7fe886a4e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8800cb360 0x7fe880156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:21.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.432+0000 7fe886a4e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8800d0aa0 0x7fe8800c5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:21.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.432+0000 7fe886a4e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8800b5a80 con 0x7fe8800d0aa0 2023-10-06T04:37:21.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.432+0000 7fe886a4e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe880157170 con 0x7fe8800cb360 2023-10-06T04:37:21.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.432+0000 7fe886a4e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe880158a10 con 0x7fe8800af680 2023-10-06T04:37:21.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.433+0000 7fe884feb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8800d0aa0 0x7fe8800c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:21.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.433+0000 7fe884feb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8800d0aa0 0x7fe8800c5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35106/0 (socket says 172.21.15.8:35106) 2023-10-06T04:37:21.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.433+0000 7fe884feb700 1 -- 172.21.15.8:0/2120896358 learned_addr learned my addr 172.21.15.8:0/2120896358 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:21.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.433+0000 7fe87f7fe700 1 --2- 172.21.15.8:0/2120896358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8800cb360 0x7fe880156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:21.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.433+0000 7fe884feb700 1 -- 172.21.15.8:0/2120896358 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8800af680 msgr2=0x7fe8800b5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:21.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.433+0000 7fe884feb700 1 --2- 172.21.15.8:0/2120896358 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8800af680 0x7fe8800b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:21.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.433+0000 7fe884feb700 1 -- 172.21.15.8:0/2120896358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8800cb360 msgr2=0x7fe880156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:21.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.433+0000 7fe884feb700 1 --2- 172.21.15.8:0/2120896358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8800cb360 0x7fe880156c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:21.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.433+0000 7fe884feb700 1 -- 172.21.15.8:0/2120896358 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe878009a20 con 0x7fe8800d0aa0 2023-10-06T04:37:21.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.433+0000 7fe884feb700 1 --2- 172.21.15.8:0/2120896358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8800d0aa0 0x7fe8800c5330 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe880063f80 tx=0x7fe878019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:21.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.433+0000 7fe867fff700 1 -- 172.21.15.8:0/2120896358 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe878012e90 con 0x7fe8800d0aa0 2023-10-06T04:37:21.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.433+0000 7fe867fff700 1 -- 172.21.15.8:0/2120896358 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87801d630 con 0x7fe8800d0aa0 2023-10-06T04:37:21.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.433+0000 7fe886a4e700 1 -- 172.21.15.8:0/2120896358 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe880158cf0 con 0x7fe8800d0aa0 2023-10-06T04:37:21.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.433+0000 7fe867fff700 1 -- 172.21.15.8:0/2120896358 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87801d9d0 con 0x7fe8800d0aa0 2023-10-06T04:37:21.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.433+0000 7fe886a4e700 1 -- 172.21.15.8:0/2120896358 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8801592b0 con 0x7fe8800d0aa0 2023-10-06T04:37:21.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.434+0000 7fe886a4e700 1 -- 172.21.15.8:0/2120896358 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe880071550 con 0x7fe8800d0aa0 2023-10-06T04:37:21.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.435+0000 7fe867fff700 1 -- 172.21.15.8:0/2120896358 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe878024070 con 0x7fe8800d0aa0 2023-10-06T04:37:21.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.435+0000 7fe867fff700 1 --2- 172.21.15.8:0/2120896358 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe86c066f30 0x7fe86c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:21.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.435+0000 7fe867fff700 1 -- 172.21.15.8:0/2120896358 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fe8780870a0 con 0x7fe8800d0aa0 2023-10-06T04:37:21.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.435+0000 7fe87ffff700 1 --2- 172.21.15.8:0/2120896358 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe86c066f30 0x7fe86c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:21.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.436+0000 7fe87ffff700 1 --2- 172.21.15.8:0/2120896358 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe86c066f30 0x7fe86c0693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe874002630 tx=0x7fe8740079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:21.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.439+0000 7fe867fff700 1 -- 172.21.15.8:0/2120896358 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe878054070 con 0x7fe8800d0aa0 2023-10-06T04:37:21.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.629+0000 7fe886a4e700 1 -- 172.21.15.8:0/2120896358 --> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe8800b19c0 con 0x7fe86c066f30 2023-10-06T04:37:21.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.639+0000 7fe867fff700 1 -- 172.21.15.8:0/2120896358 <== mgr.4105 v2:172.21.15.184:6832/90283 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+312336 (secure 0 0 0) 0x7fe8800b19c0 con 0x7fe86c066f30 2023-10-06T04:37:21.645 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:21.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.643+0000 7fe886a4e700 1 -- 172.21.15.8:0/2120896358 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe86c066f30 msgr2=0x7fe86c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:21.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.643+0000 7fe886a4e700 1 --2- 172.21.15.8:0/2120896358 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe86c066f30 0x7fe86c0693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe874002630 tx=0x7fe8740079b0 comp rx=0 tx=0).stop 2023-10-06T04:37:21.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.643+0000 7fe886a4e700 1 -- 172.21.15.8:0/2120896358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8800d0aa0 msgr2=0x7fe8800c5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:21.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.643+0000 7fe886a4e700 1 --2- 172.21.15.8:0/2120896358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8800d0aa0 0x7fe8800c5330 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe880063f80 tx=0x7fe878019000 comp rx=0 tx=0).stop 2023-10-06T04:37:21.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.643+0000 7fe886a4e700 1 -- 172.21.15.8:0/2120896358 shutdown_connections 2023-10-06T04:37:21.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.643+0000 7fe886a4e700 1 --2- 172.21.15.8:0/2120896358 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe86c066f30 0x7fe86c0693e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:21.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.643+0000 7fe886a4e700 1 --2- 172.21.15.8:0/2120896358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8800d0aa0 0x7fe8800c5330 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:21.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.643+0000 7fe886a4e700 1 --2- 172.21.15.8:0/2120896358 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8800af680 0x7fe8800b5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:21.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.643+0000 7fe886a4e700 1 --2- 172.21.15.8:0/2120896358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8800cb360 0x7fe880156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:21.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.643+0000 7fe886a4e700 1 -- 172.21.15.8:0/2120896358 >> 172.21.15.8:0/2120896358 conn(0x7fe8800633d0 msgr2=0x7fe88015b270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:21.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.643+0000 7fe886a4e700 1 -- 172.21.15.8:0/2120896358 shutdown_connections 2023-10-06T04:37:21.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.643+0000 7fe886a4e700 1 -- 172.21.15.8:0/2120896358 wait complete. 2023-10-06T04:37:21.650 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-06T04:37:21.656 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-10-06T04:37:20.646185+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":201,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382904,"kb_used_data":4600,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591816,"statfs":{"total":773094113280,"available":770654019584,"internally_reserved":0,"allocated":4710400,"data_stored":2721083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.126167"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.542638+0000","last_change":"2023-10-06T04:37:17.540825+0000","last_active":"2023-10-06T04:37:17.542638+0000","last_peered":"2023-10-06T04:37:17.542638+0000","last_clean":"2023-10-06T04:37:17.542638+0000","last_became_active":"2023-10-06T04:37:17.540537+0000","last_became_peered":"2023-10-06T04:37:17.540537+0000","last_unstale":"2023-10-06T04:37:17.542638+0000","last_undegraded":"2023-10-06T04:37:17.542638+0000","last_fullsized":"2023-10-06T04:37:17.542638+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:27.083777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.554831+0000","last_change":"2023-10-06T04:37:17.550627+0000","last_active":"2023-10-06T04:37:17.554831+0000","last_peered":"2023-10-06T04:37:17.554831+0000","last_clean":"2023-10-06T04:37:17.554831+0000","last_became_active":"2023-10-06T04:37:17.550395+0000","last_became_peered":"2023-10-06T04:37:17.550395+0000","last_unstale":"2023-10-06T04:37:17.554831+0000","last_undegraded":"2023-10-06T04:37:17.554831+0000","last_fullsized":"2023-10-06T04:37:17.554831+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:49.714446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.544888+0000","last_change":"2023-10-06T04:37:17.541131+0000","last_active":"2023-10-06T04:37:17.544888+0000","last_peered":"2023-10-06T04:37:17.544888+0000","last_clean":"2023-10-06T04:37:17.544888+0000","last_became_active":"2023-10-06T04:37:17.540816+0000","last_became_peered":"2023-10-06T04:37:17.540816+0000","last_unstale":"2023-10-06T04:37:17.544888+0000","last_undegraded":"2023-10-06T04:37:17.544888+0000","last_fullsized":"2023-10-06T04:37:17.544888+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:32:45.542874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549771+0000","last_change":"2023-10-06T04:37:17.545649+0000","last_active":"2023-10-06T04:37:17.549771+0000","last_peered":"2023-10-06T04:37:17.549771+0000","last_clean":"2023-10-06T04:37:17.549771+0000","last_became_active":"2023-10-06T04:37:17.545155+0000","last_became_peered":"2023-10-06T04:37:17.545155+0000","last_unstale":"2023-10-06T04:37:17.549771+0000","last_undegraded":"2023-10-06T04:37:17.549771+0000","last_fullsized":"2023-10-06T04:37:17.549771+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:09.823506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549858+0000","last_change":"2023-10-06T04:37:17.545451+0000","last_active":"2023-10-06T04:37:17.549858+0000","last_peered":"2023-10-06T04:37:17.549858+0000","last_clean":"2023-10-06T04:37:17.549858+0000","last_became_active":"2023-10-06T04:37:17.545135+0000","last_became_peered":"2023-10-06T04:37:17.545135+0000","last_unstale":"2023-10-06T04:37:17.549858+0000","last_undegraded":"2023-10-06T04:37:17.549858+0000","last_fullsized":"2023-10-06T04:37:17.549858+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:44.628778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.551108+0000","last_change":"2023-10-06T04:37:17.545054+0000","last_active":"2023-10-06T04:37:17.551108+0000","last_peered":"2023-10-06T04:37:17.551108+0000","last_clean":"2023-10-06T04:37:17.551108+0000","last_became_active":"2023-10-06T04:37:17.544822+0000","last_became_peered":"2023-10-06T04:37:17.544822+0000","last_unstale":"2023-10-06T04:37:17.551108+0000","last_undegraded":"2023-10-06T04:37:17.551108+0000","last_fullsized":"2023-10-06T04:37:17.551108+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:28:51.824521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.552533+0000","last_change":"2023-10-06T04:37:17.548819+0000","last_active":"2023-10-06T04:37:17.552533+0000","last_peered":"2023-10-06T04:37:17.552533+0000","last_clean":"2023-10-06T04:37:17.552533+0000","last_became_active":"2023-10-06T04:37:17.548629+0000","last_became_peered":"2023-10-06T04:37:17.548629+0000","last_unstale":"2023-10-06T04:37:17.552533+0000","last_undegraded":"2023-10-06T04:37:17.552533+0000","last_fullsized":"2023-10-06T04:37:17.552533+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:04.973984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549869+0000","last_change":"2023-10-06T04:37:17.547124+0000","last_active":"2023-10-06T04:37:17.549869+0000","last_peered":"2023-10-06T04:37:17.549869+0000","last_clean":"2023-10-06T04:37:17.549869+0000","last_became_active":"2023-10-06T04:37:17.546879+0000","last_became_peered":"2023-10-06T04:37:17.546879+0000","last_unstale":"2023-10-06T04:37:17.549869+0000","last_undegraded":"2023-10-06T04:37:17.549869+0000","last_fullsized":"2023-10-06T04:37:17.549869+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:45.225371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.548635+0000","last_change":"2023-10-06T04:37:17.537910+0000","last_active":"2023-10-06T04:37:17.548635+0000","last_peered":"2023-10-06T04:37:17.548635+0000","last_clean":"2023-10-06T04:37:17.548635+0000","last_became_active":"2023-10-06T04:37:17.535864+0000","last_became_peered":"2023-10-06T04:37:17.535864+0000","last_unstale":"2023-10-06T04:37:17.548635+0000","last_undegraded":"2023-10-06T04:37:17.548635+0000","last_fullsized":"2023-10-06T04:37:17.548635+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:58.928454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549976+0000","last_change":"2023-10-06T04:37:17.548489+0000","last_active":"2023-10-06T04:37:17.549976+0000","last_peered":"2023-10-06T04:37:17.549976+0000","last_clean":"2023-10-06T04:37:17.549976+0000","last_became_active":"2023-10-06T04:37:17.547714+0000","last_became_peered":"2023-10-06T04:37:17.547714+0000","last_unstale":"2023-10-06T04:37:17.549976+0000","last_undegraded":"2023-10-06T04:37:17.549976+0000","last_fullsized":"2023-10-06T04:37:17.549976+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:56.687459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549670+0000","last_change":"2023-10-06T04:37:17.544501+0000","last_active":"2023-10-06T04:37:17.549670+0000","last_peered":"2023-10-06T04:37:17.549670+0000","last_clean":"2023-10-06T04:37:17.549670+0000","last_became_active":"2023-10-06T04:37:17.541822+0000","last_became_peered":"2023-10-06T04:37:17.541822+0000","last_unstale":"2023-10-06T04:37:17.549670+0000","last_undegraded":"2023-10-06T04:37:17.549670+0000","last_fullsized":"2023-10-06T04:37:17.549670+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:32:45.542874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549520+0000","last_change":"2023-10-06T04:37:17.545538+0000","last_active":"2023-10-06T04:37:17.549520+0000","last_peered":"2023-10-06T04:37:17.549520+0000","last_clean":"2023-10-06T04:37:17.549520+0000","last_became_active":"2023-10-06T04:37:17.545027+0000","last_became_peered":"2023-10-06T04:37:17.545027+0000","last_unstale":"2023-10-06T04:37:17.549520+0000","last_undegraded":"2023-10-06T04:37:17.549520+0000","last_fullsized":"2023-10-06T04:37:17.549520+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:23.847066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.548577+0000","last_change":"2023-10-06T04:37:17.541986+0000","last_active":"2023-10-06T04:37:17.548577+0000","last_peered":"2023-10-06T04:37:17.548577+0000","last_clean":"2023-10-06T04:37:17.548577+0000","last_became_active":"2023-10-06T04:37:17.541707+0000","last_became_peered":"2023-10-06T04:37:17.541707+0000","last_unstale":"2023-10-06T04:37:17.548577+0000","last_undegraded":"2023-10-06T04:37:17.548577+0000","last_fullsized":"2023-10-06T04:37:17.548577+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:25.707658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.540578+0000","last_change":"2023-10-06T04:37:17.536298+0000","last_active":"2023-10-06T04:37:17.540578+0000","last_peered":"2023-10-06T04:37:17.540578+0000","last_clean":"2023-10-06T04:37:17.540578+0000","last_became_active":"2023-10-06T04:37:17.535937+0000","last_became_peered":"2023-10-06T04:37:17.535937+0000","last_unstale":"2023-10-06T04:37:17.540578+0000","last_undegraded":"2023-10-06T04:37:17.540578+0000","last_fullsized":"2023-10-06T04:37:17.540578+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:01.324339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.548688+0000","last_change":"2023-10-06T04:37:17.538786+0000","last_active":"2023-10-06T04:37:17.548688+0000","last_peered":"2023-10-06T04:37:17.548688+0000","last_clean":"2023-10-06T04:37:17.548688+0000","last_became_active":"2023-10-06T04:37:17.538493+0000","last_became_peered":"2023-10-06T04:37:17.538493+0000","last_unstale":"2023-10-06T04:37:17.548688+0000","last_undegraded":"2023-10-06T04:37:17.548688+0000","last_fullsized":"2023-10-06T04:37:17.548688+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:09.823506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.558618+0000","last_change":"2023-10-06T04:37:17.552277+0000","last_active":"2023-10-06T04:37:17.558618+0000","last_peered":"2023-10-06T04:37:17.558618+0000","last_clean":"2023-10-06T04:37:17.558618+0000","last_became_active":"2023-10-06T04:37:17.552001+0000","last_became_peered":"2023-10-06T04:37:17.552001+0000","last_unstale":"2023-10-06T04:37:17.558618+0000","last_undegraded":"2023-10-06T04:37:17.558618+0000","last_fullsized":"2023-10-06T04:37:17.558618+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:41.211245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.553173+0000","last_change":"2023-10-06T04:37:17.547373+0000","last_active":"2023-10-06T04:37:17.553173+0000","last_peered":"2023-10-06T04:37:17.553173+0000","last_clean":"2023-10-06T04:37:17.553173+0000","last_became_active":"2023-10-06T04:37:17.547103+0000","last_became_peered":"2023-10-06T04:37:17.547103+0000","last_unstale":"2023-10-06T04:37:17.553173+0000","last_undegraded":"2023-10-06T04:37:17.553173+0000","last_fullsized":"2023-10-06T04:37:17.553173+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:09.823506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.558882+0000","last_change":"2023-10-06T04:37:17.554683+0000","last_active":"2023-10-06T04:37:17.558882+0000","last_peered":"2023-10-06T04:37:17.558882+0000","last_clean":"2023-10-06T04:37:17.558882+0000","last_became_active":"2023-10-06T04:37:17.554412+0000","last_became_peered":"2023-10-06T04:37:17.554412+0000","last_unstale":"2023-10-06T04:37:17.558882+0000","last_undegraded":"2023-10-06T04:37:17.558882+0000","last_fullsized":"2023-10-06T04:37:17.558882+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:56.687459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.557161+0000","last_change":"2023-10-06T04:37:17.551197+0000","last_active":"2023-10-06T04:37:17.557161+0000","last_peered":"2023-10-06T04:37:17.557161+0000","last_clean":"2023-10-06T04:37:17.557161+0000","last_became_active":"2023-10-06T04:37:17.550633+0000","last_became_peered":"2023-10-06T04:37:17.550633+0000","last_unstale":"2023-10-06T04:37:17.557161+0000","last_undegraded":"2023-10-06T04:37:17.557161+0000","last_fullsized":"2023-10-06T04:37:17.557161+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:25.707658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.548430+0000","last_change":"2023-10-06T04:37:17.541139+0000","last_active":"2023-10-06T04:37:17.548430+0000","last_peered":"2023-10-06T04:37:17.548430+0000","last_clean":"2023-10-06T04:37:17.548430+0000","last_became_active":"2023-10-06T04:37:17.540844+0000","last_became_peered":"2023-10-06T04:37:17.540844+0000","last_unstale":"2023-10-06T04:37:17.548430+0000","last_undegraded":"2023-10-06T04:37:17.548430+0000","last_fullsized":"2023-10-06T04:37:17.548430+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:40.800271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.551212+0000","last_change":"2023-10-06T04:37:17.546023+0000","last_active":"2023-10-06T04:37:17.551212+0000","last_peered":"2023-10-06T04:37:17.551212+0000","last_clean":"2023-10-06T04:37:17.551212+0000","last_became_active":"2023-10-06T04:37:17.545428+0000","last_became_peered":"2023-10-06T04:37:17.545428+0000","last_unstale":"2023-10-06T04:37:17.551212+0000","last_undegraded":"2023-10-06T04:37:17.551212+0000","last_fullsized":"2023-10-06T04:37:17.551212+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:52.574192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549881+0000","last_change":"2023-10-06T04:37:17.546918+0000","last_active":"2023-10-06T04:37:17.549881+0000","last_peered":"2023-10-06T04:37:17.549881+0000","last_clean":"2023-10-06T04:37:17.549881+0000","last_became_active":"2023-10-06T04:37:17.546562+0000","last_became_peered":"2023-10-06T04:37:17.546562+0000","last_unstale":"2023-10-06T04:37:17.549881+0000","last_undegraded":"2023-10-06T04:37:17.549881+0000","last_fullsized":"2023-10-06T04:37:17.549881+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:18.119835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.554166+0000","last_change":"2023-10-06T04:37:17.549490+0000","last_active":"2023-10-06T04:37:17.554166+0000","last_peered":"2023-10-06T04:37:17.554166+0000","last_clean":"2023-10-06T04:37:17.554166+0000","last_became_active":"2023-10-06T04:37:17.549294+0000","last_became_peered":"2023-10-06T04:37:17.549294+0000","last_unstale":"2023-10-06T04:37:17.554166+0000","last_undegraded":"2023-10-06T04:37:17.554166+0000","last_fullsized":"2023-10-06T04:37:17.554166+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:50.973957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.554092+0000","last_change":"2023-10-06T04:37:17.548512+0000","last_active":"2023-10-06T04:37:17.554092+0000","last_peered":"2023-10-06T04:37:17.554092+0000","last_clean":"2023-10-06T04:37:17.554092+0000","last_became_active":"2023-10-06T04:37:17.547910+0000","last_became_peered":"2023-10-06T04:37:17.547910+0000","last_unstale":"2023-10-06T04:37:17.554092+0000","last_undegraded":"2023-10-06T04:37:17.554092+0000","last_fullsized":"2023-10-06T04:37:17.554092+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:15:49.332577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.557220+0000","last_change":"2023-10-06T04:37:17.551312+0000","last_active":"2023-10-06T04:37:17.557220+0000","last_peered":"2023-10-06T04:37:17.557220+0000","last_clean":"2023-10-06T04:37:17.557220+0000","last_became_active":"2023-10-06T04:37:17.550973+0000","last_became_peered":"2023-10-06T04:37:17.550973+0000","last_unstale":"2023-10-06T04:37:17.557220+0000","last_undegraded":"2023-10-06T04:37:17.557220+0000","last_fullsized":"2023-10-06T04:37:17.557220+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:40.800271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.548607+0000","last_change":"2023-10-06T04:37:17.542441+0000","last_active":"2023-10-06T04:37:17.548607+0000","last_peered":"2023-10-06T04:37:17.548607+0000","last_clean":"2023-10-06T04:37:17.548607+0000","last_became_active":"2023-10-06T04:37:17.542184+0000","last_became_peered":"2023-10-06T04:37:17.542184+0000","last_unstale":"2023-10-06T04:37:17.548607+0000","last_undegraded":"2023-10-06T04:37:17.548607+0000","last_fullsized":"2023-10-06T04:37:17.548607+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:57.066657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.553074+0000","last_change":"2023-10-06T04:37:17.546567+0000","last_active":"2023-10-06T04:37:17.553074+0000","last_peered":"2023-10-06T04:37:17.553074+0000","last_clean":"2023-10-06T04:37:17.553074+0000","last_became_active":"2023-10-06T04:37:17.546294+0000","last_became_peered":"2023-10-06T04:37:17.546294+0000","last_unstale":"2023-10-06T04:37:17.553074+0000","last_undegraded":"2023-10-06T04:37:17.553074+0000","last_fullsized":"2023-10-06T04:37:17.553074+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:19.011564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549532+0000","last_change":"2023-10-06T04:37:17.545684+0000","last_active":"2023-10-06T04:37:17.549532+0000","last_peered":"2023-10-06T04:37:17.549532+0000","last_clean":"2023-10-06T04:37:17.549532+0000","last_became_active":"2023-10-06T04:37:17.545341+0000","last_became_peered":"2023-10-06T04:37:17.545341+0000","last_unstale":"2023-10-06T04:37:17.549532+0000","last_undegraded":"2023-10-06T04:37:17.549532+0000","last_fullsized":"2023-10-06T04:37:17.549532+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:04.973984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.557210+0000","last_change":"2023-10-06T04:37:17.551198+0000","last_active":"2023-10-06T04:37:17.557210+0000","last_peered":"2023-10-06T04:37:17.557210+0000","last_clean":"2023-10-06T04:37:17.557210+0000","last_became_active":"2023-10-06T04:37:17.550871+0000","last_became_peered":"2023-10-06T04:37:17.550871+0000","last_unstale":"2023-10-06T04:37:17.557210+0000","last_undegraded":"2023-10-06T04:37:17.557210+0000","last_fullsized":"2023-10-06T04:37:17.557210+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:43.463619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.545360+0000","last_change":"2023-10-06T04:37:17.544638+0000","last_active":"2023-10-06T04:37:17.545360+0000","last_peered":"2023-10-06T04:37:17.545360+0000","last_clean":"2023-10-06T04:37:17.545360+0000","last_became_active":"2023-10-06T04:37:17.544358+0000","last_became_peered":"2023-10-06T04:37:17.544358+0000","last_unstale":"2023-10-06T04:37:17.545360+0000","last_undegraded":"2023-10-06T04:37:17.545360+0000","last_fullsized":"2023-10-06T04:37:17.545360+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:16.140442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.552110+0000","last_change":"2023-10-06T04:37:17.547875+0000","last_active":"2023-10-06T04:37:17.552110+0000","last_peered":"2023-10-06T04:37:17.552110+0000","last_clean":"2023-10-06T04:37:17.552110+0000","last_became_active":"2023-10-06T04:37:17.547504+0000","last_became_peered":"2023-10-06T04:37:17.547504+0000","last_unstale":"2023-10-06T04:37:17.552110+0000","last_undegraded":"2023-10-06T04:37:17.552110+0000","last_fullsized":"2023-10-06T04:37:17.552110+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:37.661915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.539533+0000","last_change":"2023-10-06T04:37:17.535486+0000","last_active":"2023-10-06T04:37:17.539533+0000","last_peered":"2023-10-06T04:37:17.539533+0000","last_clean":"2023-10-06T04:37:17.539533+0000","last_became_active":"2023-10-06T04:37:17.535215+0000","last_became_peered":"2023-10-06T04:37:17.535215+0000","last_unstale":"2023-10-06T04:37:17.539533+0000","last_undegraded":"2023-10-06T04:37:17.539533+0000","last_fullsized":"2023-10-06T04:37:17.539533+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:01.221591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549842+0000","last_change":"2023-10-06T04:37:17.540682+0000","last_active":"2023-10-06T04:37:17.549842+0000","last_peered":"2023-10-06T04:37:17.549842+0000","last_clean":"2023-10-06T04:37:17.549842+0000","last_became_active":"2023-10-06T04:37:17.540340+0000","last_became_peered":"2023-10-06T04:37:17.540340+0000","last_unstale":"2023-10-06T04:37:17.549842+0000","last_undegraded":"2023-10-06T04:37:17.549842+0000","last_fullsized":"2023-10-06T04:37:17.549842+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:57.066657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"37'4","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.561055+0000","last_change":"2023-10-06T04:37:16.539316+0000","last_active":"2023-10-06T04:37:17.561055+0000","last_peered":"2023-10-06T04:37:17.561055+0000","last_clean":"2023-10-06T04:37:17.561055+0000","last_became_active":"2023-10-06T04:37:16.538848+0000","last_became_peered":"2023-10-06T04:37:16.538848+0000","last_unstale":"2023-10-06T04:37:17.561055+0000","last_undegraded":"2023-10-06T04:37:17.561055+0000","last_fullsized":"2023-10-06T04:37:17.561055+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:44:55.156828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.556909+0000","last_change":"2023-10-06T04:37:17.549963+0000","last_active":"2023-10-06T04:37:17.556909+0000","last_peered":"2023-10-06T04:37:17.556909+0000","last_clean":"2023-10-06T04:37:17.556909+0000","last_became_active":"2023-10-06T04:37:17.545289+0000","last_became_peered":"2023-10-06T04:37:17.545289+0000","last_unstale":"2023-10-06T04:37:17.556909+0000","last_undegraded":"2023-10-06T04:37:17.556909+0000","last_fullsized":"2023-10-06T04:37:17.556909+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:01.221591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"37'1","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.560432+0000","last_change":"2023-10-06T04:37:16.539806+0000","last_active":"2023-10-06T04:37:17.560432+0000","last_peered":"2023-10-06T04:37:17.560432+0000","last_clean":"2023-10-06T04:37:17.560432+0000","last_became_active":"2023-10-06T04:37:16.539514+0000","last_became_peered":"2023-10-06T04:37:16.539514+0000","last_unstale":"2023-10-06T04:37:17.560432+0000","last_undegraded":"2023-10-06T04:37:17.560432+0000","last_fullsized":"2023-10-06T04:37:17.560432+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:48.710239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.554119+0000","last_change":"2023-10-06T04:37:17.549931+0000","last_active":"2023-10-06T04:37:17.554119+0000","last_peered":"2023-10-06T04:37:17.554119+0000","last_clean":"2023-10-06T04:37:17.554119+0000","last_became_active":"2023-10-06T04:37:17.549668+0000","last_became_peered":"2023-10-06T04:37:17.549668+0000","last_unstale":"2023-10-06T04:37:17.554119+0000","last_undegraded":"2023-10-06T04:37:17.554119+0000","last_fullsized":"2023-10-06T04:37:17.554119+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:27.083777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.564010+0000","last_change":"2023-10-06T04:37:16.546111+0000","last_active":"2023-10-06T04:37:17.564010+0000","last_peered":"2023-10-06T04:37:17.564010+0000","last_clean":"2023-10-06T04:37:17.564010+0000","last_became_active":"2023-10-06T04:37:16.545811+0000","last_became_peered":"2023-10-06T04:37:16.545811+0000","last_unstale":"2023-10-06T04:37:17.564010+0000","last_undegraded":"2023-10-06T04:37:17.564010+0000","last_fullsized":"2023-10-06T04:37:17.564010+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:30.574778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549673+0000","last_change":"2023-10-06T04:37:17.546138+0000","last_active":"2023-10-06T04:37:17.549673+0000","last_peered":"2023-10-06T04:37:17.549673+0000","last_clean":"2023-10-06T04:37:17.549673+0000","last_became_active":"2023-10-06T04:37:17.545845+0000","last_became_peered":"2023-10-06T04:37:17.545845+0000","last_unstale":"2023-10-06T04:37:17.549673+0000","last_undegraded":"2023-10-06T04:37:17.549673+0000","last_fullsized":"2023-10-06T04:37:17.549673+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:25.707658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.560018+0000","last_change":"2023-10-06T04:37:16.545947+0000","last_active":"2023-10-06T04:37:17.560018+0000","last_peered":"2023-10-06T04:37:17.560018+0000","last_clean":"2023-10-06T04:37:17.560018+0000","last_became_active":"2023-10-06T04:37:16.545700+0000","last_became_peered":"2023-10-06T04:37:16.545700+0000","last_unstale":"2023-10-06T04:37:17.560018+0000","last_undegraded":"2023-10-06T04:37:17.560018+0000","last_fullsized":"2023-10-06T04:37:17.560018+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:56.062450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.545342+0000","last_change":"2023-10-06T04:37:17.543400+0000","last_active":"2023-10-06T04:37:17.545342+0000","last_peered":"2023-10-06T04:37:17.545342+0000","last_clean":"2023-10-06T04:37:17.545342+0000","last_became_active":"2023-10-06T04:37:17.543132+0000","last_became_peered":"2023-10-06T04:37:17.543132+0000","last_unstale":"2023-10-06T04:37:17.545342+0000","last_undegraded":"2023-10-06T04:37:17.545342+0000","last_fullsized":"2023-10-06T04:37:17.545342+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:50:28.268338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"37'1","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.561089+0000","last_change":"2023-10-06T04:37:16.541989+0000","last_active":"2023-10-06T04:37:17.561089+0000","last_peered":"2023-10-06T04:37:17.561089+0000","last_clean":"2023-10-06T04:37:17.561089+0000","last_became_active":"2023-10-06T04:37:16.541684+0000","last_became_peered":"2023-10-06T04:37:16.541684+0000","last_unstale":"2023-10-06T04:37:17.561089+0000","last_undegraded":"2023-10-06T04:37:17.561089+0000","last_fullsized":"2023-10-06T04:37:17.561089+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:13.019515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549769+0000","last_change":"2023-10-06T04:37:17.546677+0000","last_active":"2023-10-06T04:37:17.549769+0000","last_peered":"2023-10-06T04:37:17.549769+0000","last_clean":"2023-10-06T04:37:17.549769+0000","last_became_active":"2023-10-06T04:37:17.546151+0000","last_became_peered":"2023-10-06T04:37:17.546151+0000","last_unstale":"2023-10-06T04:37:17.549769+0000","last_undegraded":"2023-10-06T04:37:17.549769+0000","last_fullsized":"2023-10-06T04:37:17.549769+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:16.140442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"37'1","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.560653+0000","last_change":"2023-10-06T04:37:16.545939+0000","last_active":"2023-10-06T04:37:17.560653+0000","last_peered":"2023-10-06T04:37:17.560653+0000","last_clean":"2023-10-06T04:37:17.560653+0000","last_became_active":"2023-10-06T04:37:16.545722+0000","last_became_peered":"2023-10-06T04:37:16.545722+0000","last_unstale":"2023-10-06T04:37:17.560653+0000","last_undegraded":"2023-10-06T04:37:17.560653+0000","last_fullsized":"2023-10-06T04:37:17.560653+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:22.842860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549845+0000","last_change":"2023-10-06T04:37:17.547055+0000","last_active":"2023-10-06T04:37:17.549845+0000","last_peered":"2023-10-06T04:37:17.549845+0000","last_clean":"2023-10-06T04:37:17.549845+0000","last_became_active":"2023-10-06T04:37:17.546777+0000","last_became_peered":"2023-10-06T04:37:17.546777+0000","last_unstale":"2023-10-06T04:37:17.549845+0000","last_undegraded":"2023-10-06T04:37:17.549845+0000","last_fullsized":"2023-10-06T04:37:17.549845+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:28:51.824521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.541879+0000","last_change":"2023-10-06T04:37:16.544251+0000","last_active":"2023-10-06T04:37:17.541879+0000","last_peered":"2023-10-06T04:37:17.541879+0000","last_clean":"2023-10-06T04:37:17.541879+0000","last_became_active":"2023-10-06T04:37:16.543853+0000","last_became_peered":"2023-10-06T04:37:16.543853+0000","last_unstale":"2023-10-06T04:37:17.541879+0000","last_undegraded":"2023-10-06T04:37:17.541879+0000","last_fullsized":"2023-10-06T04:37:17.541879+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:00.217384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.557086+0000","last_change":"2023-10-06T04:37:17.550653+0000","last_active":"2023-10-06T04:37:17.557086+0000","last_peered":"2023-10-06T04:37:17.557086+0000","last_clean":"2023-10-06T04:37:17.557086+0000","last_became_active":"2023-10-06T04:37:17.550308+0000","last_became_peered":"2023-10-06T04:37:17.550308+0000","last_unstale":"2023-10-06T04:37:17.557086+0000","last_undegraded":"2023-10-06T04:37:17.557086+0000","last_fullsized":"2023-10-06T04:37:17.557086+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:06:24.079323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.534436+0000","last_change":"2023-10-06T04:37:16.539539+0000","last_active":"2023-10-06T04:37:17.534436+0000","last_peered":"2023-10-06T04:37:17.534436+0000","last_clean":"2023-10-06T04:37:17.534436+0000","last_became_active":"2023-10-06T04:37:16.536276+0000","last_became_peered":"2023-10-06T04:37:16.536276+0000","last_unstale":"2023-10-06T04:37:17.534436+0000","last_undegraded":"2023-10-06T04:37:17.534436+0000","last_fullsized":"2023-10-06T04:37:17.534436+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:23.725665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.554594+0000","last_change":"2023-10-06T04:37:17.547330+0000","last_active":"2023-10-06T04:37:17.554594+0000","last_peered":"2023-10-06T04:37:17.554594+0000","last_clean":"2023-10-06T04:37:17.554594+0000","last_became_active":"2023-10-06T04:37:17.547088+0000","last_became_peered":"2023-10-06T04:37:17.547088+0000","last_unstale":"2023-10-06T04:37:17.554594+0000","last_undegraded":"2023-10-06T04:37:17.554594+0000","last_fullsized":"2023-10-06T04:37:17.554594+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:12.970309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.534061+0000","last_change":"2023-10-06T04:37:16.543071+0000","last_active":"2023-10-06T04:37:17.534061+0000","last_peered":"2023-10-06T04:37:17.534061+0000","last_clean":"2023-10-06T04:37:17.534061+0000","last_became_active":"2023-10-06T04:37:16.542755+0000","last_became_peered":"2023-10-06T04:37:16.542755+0000","last_unstale":"2023-10-06T04:37:17.534061+0000","last_undegraded":"2023-10-06T04:37:17.534061+0000","last_fullsized":"2023-10-06T04:37:17.534061+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:03.969778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.552103+0000","last_change":"2023-10-06T04:37:17.546184+0000","last_active":"2023-10-06T04:37:17.552103+0000","last_peered":"2023-10-06T04:37:17.552103+0000","last_clean":"2023-10-06T04:37:17.552103+0000","last_became_active":"2023-10-06T04:37:17.545899+0000","last_became_peered":"2023-10-06T04:37:17.545899+0000","last_unstale":"2023-10-06T04:37:17.552103+0000","last_undegraded":"2023-10-06T04:37:17.552103+0000","last_fullsized":"2023-10-06T04:37:17.552103+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:35.648661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.531685+0000","last_change":"2023-10-06T04:37:16.539739+0000","last_active":"2023-10-06T04:37:17.531685+0000","last_peered":"2023-10-06T04:37:17.531685+0000","last_clean":"2023-10-06T04:37:17.531685+0000","last_became_active":"2023-10-06T04:37:16.539470+0000","last_became_peered":"2023-10-06T04:37:16.539470+0000","last_unstale":"2023-10-06T04:37:17.531685+0000","last_undegraded":"2023-10-06T04:37:17.531685+0000","last_fullsized":"2023-10-06T04:37:17.531685+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:23.078870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549594+0000","last_change":"2023-10-06T04:37:17.543287+0000","last_active":"2023-10-06T04:37:17.549594+0000","last_peered":"2023-10-06T04:37:17.549594+0000","last_clean":"2023-10-06T04:37:17.549594+0000","last_became_active":"2023-10-06T04:37:17.543018+0000","last_became_peered":"2023-10-06T04:37:17.543018+0000","last_unstale":"2023-10-06T04:37:17.549594+0000","last_undegraded":"2023-10-06T04:37:17.549594+0000","last_fullsized":"2023-10-06T04:37:17.549594+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:18.119835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"37'3","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.560164+0000","last_change":"2023-10-06T04:37:16.545863+0000","last_active":"2023-10-06T04:37:17.560164+0000","last_peered":"2023-10-06T04:37:17.560164+0000","last_clean":"2023-10-06T04:37:17.560164+0000","last_became_active":"2023-10-06T04:37:16.545563+0000","last_became_peered":"2023-10-06T04:37:16.545563+0000","last_unstale":"2023-10-06T04:37:17.560164+0000","last_undegraded":"2023-10-06T04:37:17.560164+0000","last_fullsized":"2023-10-06T04:37:17.560164+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:36.947789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.542752+0000","last_change":"2023-10-06T04:37:17.541763+0000","last_active":"2023-10-06T04:37:17.542752+0000","last_peered":"2023-10-06T04:37:17.542752+0000","last_clean":"2023-10-06T04:37:17.542752+0000","last_became_active":"2023-10-06T04:37:17.541287+0000","last_became_peered":"2023-10-06T04:37:17.541287+0000","last_unstale":"2023-10-06T04:37:17.542752+0000","last_undegraded":"2023-10-06T04:37:17.542752+0000","last_fullsized":"2023-10-06T04:37:17.542752+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:34.429052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"37'6","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.564486+0000","last_change":"2023-10-06T04:37:16.538841+0000","last_active":"2023-10-06T04:37:17.564486+0000","last_peered":"2023-10-06T04:37:17.564486+0000","last_clean":"2023-10-06T04:37:17.564486+0000","last_became_active":"2023-10-06T04:37:16.538555+0000","last_became_peered":"2023-10-06T04:37:16.538555+0000","last_unstale":"2023-10-06T04:37:17.564486+0000","last_undegraded":"2023-10-06T04:37:17.564486+0000","last_fullsized":"2023-10-06T04:37:17.564486+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:01:56.504476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.559583+0000","last_change":"2023-10-06T04:37:17.554238+0000","last_active":"2023-10-06T04:37:17.559583+0000","last_peered":"2023-10-06T04:37:17.559583+0000","last_clean":"2023-10-06T04:37:17.559583+0000","last_became_active":"2023-10-06T04:37:17.553995+0000","last_became_peered":"2023-10-06T04:37:17.553995+0000","last_unstale":"2023-10-06T04:37:17.559583+0000","last_undegraded":"2023-10-06T04:37:17.559583+0000","last_fullsized":"2023-10-06T04:37:17.559583+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:57.066657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.562257+0000","last_change":"2023-10-06T04:37:16.545424+0000","last_active":"2023-10-06T04:37:17.562257+0000","last_peered":"2023-10-06T04:37:17.562257+0000","last_clean":"2023-10-06T04:37:17.562257+0000","last_became_active":"2023-10-06T04:37:16.545158+0000","last_became_peered":"2023-10-06T04:37:16.545158+0000","last_unstale":"2023-10-06T04:37:17.562257+0000","last_undegraded":"2023-10-06T04:37:17.562257+0000","last_fullsized":"2023-10-06T04:37:17.562257+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:03.969778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549756+0000","last_change":"2023-10-06T04:37:17.543599+0000","last_active":"2023-10-06T04:37:17.549756+0000","last_peered":"2023-10-06T04:37:17.549756+0000","last_clean":"2023-10-06T04:37:17.549756+0000","last_became_active":"2023-10-06T04:37:17.543271+0000","last_became_peered":"2023-10-06T04:37:17.543271+0000","last_unstale":"2023-10-06T04:37:17.549756+0000","last_undegraded":"2023-10-06T04:37:17.549756+0000","last_fullsized":"2023-10-06T04:37:17.549756+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:37.661915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.540125+0000","last_change":"2023-10-06T04:37:16.541456+0000","last_active":"2023-10-06T04:37:17.540125+0000","last_peered":"2023-10-06T04:37:17.540125+0000","last_clean":"2023-10-06T04:37:17.540125+0000","last_became_active":"2023-10-06T04:37:16.541189+0000","last_became_peered":"2023-10-06T04:37:16.541189+0000","last_unstale":"2023-10-06T04:37:17.540125+0000","last_undegraded":"2023-10-06T04:37:17.540125+0000","last_fullsized":"2023-10-06T04:37:17.540125+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:23.078870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.548756+0000","last_change":"2023-10-06T04:37:17.541658+0000","last_active":"2023-10-06T04:37:17.548756+0000","last_peered":"2023-10-06T04:37:17.548756+0000","last_clean":"2023-10-06T04:37:17.548756+0000","last_became_active":"2023-10-06T04:37:17.541349+0000","last_became_peered":"2023-10-06T04:37:17.541349+0000","last_unstale":"2023-10-06T04:37:17.548756+0000","last_undegraded":"2023-10-06T04:37:17.548756+0000","last_fullsized":"2023-10-06T04:37:17.548756+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:56.687459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.537371+0000","last_change":"2023-10-06T04:37:16.545596+0000","last_active":"2023-10-06T04:37:17.537371+0000","last_peered":"2023-10-06T04:37:17.537371+0000","last_clean":"2023-10-06T04:37:17.537371+0000","last_became_active":"2023-10-06T04:37:16.545334+0000","last_became_peered":"2023-10-06T04:37:16.545334+0000","last_unstale":"2023-10-06T04:37:17.537371+0000","last_undegraded":"2023-10-06T04:37:17.537371+0000","last_fullsized":"2023-10-06T04:37:17.537371+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:26.079570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.556742+0000","last_change":"2023-10-06T04:37:17.552402+0000","last_active":"2023-10-06T04:37:17.556742+0000","last_peered":"2023-10-06T04:37:17.556742+0000","last_clean":"2023-10-06T04:37:17.556742+0000","last_became_active":"2023-10-06T04:37:17.552167+0000","last_became_peered":"2023-10-06T04:37:17.552167+0000","last_unstale":"2023-10-06T04:37:17.556742+0000","last_undegraded":"2023-10-06T04:37:17.556742+0000","last_fullsized":"2023-10-06T04:37:17.556742+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:14.023722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"37'8","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.564355+0000","last_change":"2023-10-06T04:37:16.545180+0000","last_active":"2023-10-06T04:37:17.564355+0000","last_peered":"2023-10-06T04:37:17.564355+0000","last_clean":"2023-10-06T04:37:17.564355+0000","last_became_active":"2023-10-06T04:37:16.544707+0000","last_became_peered":"2023-10-06T04:37:16.544707+0000","last_unstale":"2023-10-06T04:37:17.564355+0000","last_undegraded":"2023-10-06T04:37:17.564355+0000","last_fullsized":"2023-10-06T04:37:17.564355+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:49.969750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549763+0000","last_change":"2023-10-06T04:37:17.545469+0000","last_active":"2023-10-06T04:37:17.549763+0000","last_peered":"2023-10-06T04:37:17.549763+0000","last_clean":"2023-10-06T04:37:17.549763+0000","last_became_active":"2023-10-06T04:37:17.545212+0000","last_became_peered":"2023-10-06T04:37:17.545212+0000","last_unstale":"2023-10-06T04:37:17.549763+0000","last_undegraded":"2023-10-06T04:37:17.549763+0000","last_fullsized":"2023-10-06T04:37:17.549763+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:41.211245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"37'1","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.561399+0000","last_change":"2023-10-06T04:37:16.537956+0000","last_active":"2023-10-06T04:37:17.561399+0000","last_peered":"2023-10-06T04:37:17.561399+0000","last_clean":"2023-10-06T04:37:17.561399+0000","last_became_active":"2023-10-06T04:37:16.537733+0000","last_became_peered":"2023-10-06T04:37:16.537733+0000","last_unstale":"2023-10-06T04:37:17.561399+0000","last_undegraded":"2023-10-06T04:37:17.561399+0000","last_fullsized":"2023-10-06T04:37:17.561399+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:26:53.482793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549641+0000","last_change":"2023-10-06T04:37:17.540242+0000","last_active":"2023-10-06T04:37:17.549641+0000","last_peered":"2023-10-06T04:37:17.549641+0000","last_clean":"2023-10-06T04:37:17.549641+0000","last_became_active":"2023-10-06T04:37:17.539986+0000","last_became_peered":"2023-10-06T04:37:17.539986+0000","last_unstale":"2023-10-06T04:37:17.549641+0000","last_undegraded":"2023-10-06T04:37:17.549641+0000","last_fullsized":"2023-10-06T04:37:17.549641+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:50:28.268338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.564213+0000","last_change":"2023-10-06T04:37:16.541934+0000","last_active":"2023-10-06T04:37:17.564213+0000","last_peered":"2023-10-06T04:37:17.564213+0000","last_clean":"2023-10-06T04:37:17.564213+0000","last_became_active":"2023-10-06T04:37:16.539725+0000","last_became_peered":"2023-10-06T04:37:16.539725+0000","last_unstale":"2023-10-06T04:37:17.564213+0000","last_undegraded":"2023-10-06T04:37:17.564213+0000","last_fullsized":"2023-10-06T04:37:17.564213+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:44:55.156828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.556848+0000","last_change":"2023-10-06T04:37:17.550239+0000","last_active":"2023-10-06T04:37:17.556848+0000","last_peered":"2023-10-06T04:37:17.556848+0000","last_clean":"2023-10-06T04:37:17.556848+0000","last_became_active":"2023-10-06T04:37:17.549997+0000","last_became_peered":"2023-10-06T04:37:17.549997+0000","last_unstale":"2023-10-06T04:37:17.556848+0000","last_undegraded":"2023-10-06T04:37:17.556848+0000","last_fullsized":"2023-10-06T04:37:17.556848+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:24.083076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"37'1","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.564286+0000","last_change":"2023-10-06T04:37:16.544014+0000","last_active":"2023-10-06T04:37:17.564286+0000","last_peered":"2023-10-06T04:37:17.564286+0000","last_clean":"2023-10-06T04:37:17.564286+0000","last_became_active":"2023-10-06T04:37:16.543718+0000","last_became_peered":"2023-10-06T04:37:16.543718+0000","last_unstale":"2023-10-06T04:37:17.564286+0000","last_undegraded":"2023-10-06T04:37:17.564286+0000","last_fullsized":"2023-10-06T04:37:17.564286+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:39.796065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.558591+0000","last_change":"2023-10-06T04:37:17.551493+0000","last_active":"2023-10-06T04:37:17.558591+0000","last_peered":"2023-10-06T04:37:17.558591+0000","last_clean":"2023-10-06T04:37:17.558591+0000","last_became_active":"2023-10-06T04:37:17.550988+0000","last_became_peered":"2023-10-06T04:37:17.550988+0000","last_unstale":"2023-10-06T04:37:17.558591+0000","last_undegraded":"2023-10-06T04:37:17.558591+0000","last_fullsized":"2023-10-06T04:37:17.558591+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:33.731628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.533817+0000","last_change":"2023-10-06T04:37:16.537845+0000","last_active":"2023-10-06T04:37:17.533817+0000","last_peered":"2023-10-06T04:37:17.533817+0000","last_clean":"2023-10-06T04:37:17.533817+0000","last_became_active":"2023-10-06T04:37:16.537568+0000","last_became_peered":"2023-10-06T04:37:16.537568+0000","last_unstale":"2023-10-06T04:37:17.533817+0000","last_undegraded":"2023-10-06T04:37:17.533817+0000","last_fullsized":"2023-10-06T04:37:17.533817+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:43.624572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.548653+0000","last_change":"2023-10-06T04:37:17.538502+0000","last_active":"2023-10-06T04:37:17.548653+0000","last_peered":"2023-10-06T04:37:17.548653+0000","last_clean":"2023-10-06T04:37:17.548653+0000","last_became_active":"2023-10-06T04:37:17.538215+0000","last_became_peered":"2023-10-06T04:37:17.538215+0000","last_unstale":"2023-10-06T04:37:17.548653+0000","last_undegraded":"2023-10-06T04:37:17.548653+0000","last_fullsized":"2023-10-06T04:37:17.548653+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:45.225371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.563499+0000","last_change":"2023-10-06T04:37:16.540351+0000","last_active":"2023-10-06T04:37:17.563499+0000","last_peered":"2023-10-06T04:37:17.563499+0000","last_clean":"2023-10-06T04:37:17.563499+0000","last_became_active":"2023-10-06T04:37:16.539257+0000","last_became_peered":"2023-10-06T04:37:16.539257+0000","last_unstale":"2023-10-06T04:37:17.563499+0000","last_undegraded":"2023-10-06T04:37:17.563499+0000","last_fullsized":"2023-10-06T04:37:17.563499+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:33.424846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549765+0000","last_change":"2023-10-06T04:37:17.546443+0000","last_active":"2023-10-06T04:37:17.549765+0000","last_peered":"2023-10-06T04:37:17.549765+0000","last_clean":"2023-10-06T04:37:17.549765+0000","last_became_active":"2023-10-06T04:37:17.546233+0000","last_became_peered":"2023-10-06T04:37:17.546233+0000","last_unstale":"2023-10-06T04:37:17.549765+0000","last_undegraded":"2023-10-06T04:37:17.549765+0000","last_fullsized":"2023-10-06T04:37:17.549765+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:41.211245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.541489+0000","last_change":"2023-10-06T04:37:16.545188+0000","last_active":"2023-10-06T04:37:17.541489+0000","last_peered":"2023-10-06T04:37:17.541489+0000","last_clean":"2023-10-06T04:37:17.541489+0000","last_became_active":"2023-10-06T04:37:16.544735+0000","last_became_peered":"2023-10-06T04:37:16.544735+0000","last_unstale":"2023-10-06T04:37:17.541489+0000","last_undegraded":"2023-10-06T04:37:17.541489+0000","last_fullsized":"2023-10-06T04:37:17.541489+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:56.062450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549922+0000","last_change":"2023-10-06T04:37:17.544085+0000","last_active":"2023-10-06T04:37:17.549922+0000","last_peered":"2023-10-06T04:37:17.549922+0000","last_clean":"2023-10-06T04:37:17.549922+0000","last_became_active":"2023-10-06T04:37:17.543802+0000","last_became_peered":"2023-10-06T04:37:17.543802+0000","last_unstale":"2023-10-06T04:37:17.549922+0000","last_undegraded":"2023-10-06T04:37:17.549922+0000","last_fullsized":"2023-10-06T04:37:17.549922+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:31.578985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.530332+0000","last_change":"2023-10-06T04:37:16.539674+0000","last_active":"2023-10-06T04:37:17.530332+0000","last_peered":"2023-10-06T04:37:17.530332+0000","last_clean":"2023-10-06T04:37:17.530332+0000","last_became_active":"2023-10-06T04:37:16.539399+0000","last_became_peered":"2023-10-06T04:37:16.539399+0000","last_unstale":"2023-10-06T04:37:17.530332+0000","last_undegraded":"2023-10-06T04:37:17.530332+0000","last_fullsized":"2023-10-06T04:37:17.530332+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:36.947789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.539951+0000","last_change":"2023-10-06T04:37:17.536857+0000","last_active":"2023-10-06T04:37:17.539951+0000","last_peered":"2023-10-06T04:37:17.539951+0000","last_clean":"2023-10-06T04:37:17.539951+0000","last_became_active":"2023-10-06T04:37:17.536593+0000","last_became_peered":"2023-10-06T04:37:17.536593+0000","last_unstale":"2023-10-06T04:37:17.539951+0000","last_undegraded":"2023-10-06T04:37:17.539951+0000","last_fullsized":"2023-10-06T04:37:17.539951+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:37.253030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.536713+0000","last_change":"2023-10-06T04:37:16.541430+0000","last_active":"2023-10-06T04:37:17.536713+0000","last_peered":"2023-10-06T04:37:17.536713+0000","last_clean":"2023-10-06T04:37:17.536713+0000","last_became_active":"2023-10-06T04:37:16.541211+0000","last_became_peered":"2023-10-06T04:37:16.541211+0000","last_unstale":"2023-10-06T04:37:17.536713+0000","last_undegraded":"2023-10-06T04:37:17.536713+0000","last_fullsized":"2023-10-06T04:37:17.536713+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:15:48.328371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549503+0000","last_change":"2023-10-06T04:37:17.541674+0000","last_active":"2023-10-06T04:37:17.549503+0000","last_peered":"2023-10-06T04:37:17.549503+0000","last_clean":"2023-10-06T04:37:17.549503+0000","last_became_active":"2023-10-06T04:37:17.541397+0000","last_became_peered":"2023-10-06T04:37:17.541397+0000","last_unstale":"2023-10-06T04:37:17.549503+0000","last_undegraded":"2023-10-06T04:37:17.549503+0000","last_fullsized":"2023-10-06T04:37:17.549503+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:19.011564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.532055+0000","last_change":"2023-10-06T04:37:16.539297+0000","last_active":"2023-10-06T04:37:17.532055+0000","last_peered":"2023-10-06T04:37:17.532055+0000","last_clean":"2023-10-06T04:37:17.532055+0000","last_became_active":"2023-10-06T04:37:16.538921+0000","last_became_peered":"2023-10-06T04:37:16.538921+0000","last_unstale":"2023-10-06T04:37:17.532055+0000","last_undegraded":"2023-10-06T04:37:17.532055+0000","last_fullsized":"2023-10-06T04:37:17.532055+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:26.079570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.532959+0000","last_change":"2023-10-06T04:36:11.192215+0000","last_active":"2023-10-06T04:37:17.532959+0000","last_peered":"2023-10-06T04:37:17.532959+0000","last_clean":"2023-10-06T04:37:17.532959+0000","last_became_active":"2023-10-06T04:36:11.191953+0000","last_became_peered":"2023-10-06T04:36:11.191953+0000","last_unstale":"2023-10-06T04:37:17.532959+0000","last_undegraded":"2023-10-06T04:37:17.532959+0000","last_fullsized":"2023-10-06T04:37:17.532959+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:37.026121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.545848+0000","last_change":"2023-10-06T04:37:17.536572+0000","last_active":"2023-10-06T04:37:17.545848+0000","last_peered":"2023-10-06T04:37:17.545848+0000","last_clean":"2023-10-06T04:37:17.545848+0000","last_became_active":"2023-10-06T04:37:17.536250+0000","last_became_peered":"2023-10-06T04:37:17.536250+0000","last_unstale":"2023-10-06T04:37:17.545848+0000","last_undegraded":"2023-10-06T04:37:17.545848+0000","last_fullsized":"2023-10-06T04:37:17.545848+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:16.140442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.538072+0000","last_change":"2023-10-06T04:37:16.542301+0000","last_active":"2023-10-06T04:37:17.538072+0000","last_peered":"2023-10-06T04:37:17.538072+0000","last_clean":"2023-10-06T04:37:17.538072+0000","last_became_active":"2023-10-06T04:37:16.541967+0000","last_became_peered":"2023-10-06T04:37:16.541967+0000","last_unstale":"2023-10-06T04:37:17.538072+0000","last_undegraded":"2023-10-06T04:37:17.538072+0000","last_fullsized":"2023-10-06T04:37:17.538072+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:24.703451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.533920+0000","last_change":"2023-10-06T04:36:11.184555+0000","last_active":"2023-10-06T04:37:17.533920+0000","last_peered":"2023-10-06T04:37:17.533920+0000","last_clean":"2023-10-06T04:37:17.533920+0000","last_became_active":"2023-10-06T04:36:11.184229+0000","last_became_peered":"2023-10-06T04:36:11.184229+0000","last_unstale":"2023-10-06T04:37:17.533920+0000","last_undegraded":"2023-10-06T04:37:17.533920+0000","last_fullsized":"2023-10-06T04:37:17.533920+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:19.938716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.552210+0000","last_change":"2023-10-06T04:37:17.548551+0000","last_active":"2023-10-06T04:37:17.552210+0000","last_peered":"2023-10-06T04:37:17.552210+0000","last_clean":"2023-10-06T04:37:17.552210+0000","last_became_active":"2023-10-06T04:37:17.548252+0000","last_became_peered":"2023-10-06T04:37:17.548252+0000","last_unstale":"2023-10-06T04:37:17.552210+0000","last_undegraded":"2023-10-06T04:37:17.552210+0000","last_fullsized":"2023-10-06T04:37:17.552210+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:23.847066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.530972+0000","last_change":"2023-10-06T04:37:16.546270+0000","last_active":"2023-10-06T04:37:17.530972+0000","last_peered":"2023-10-06T04:37:17.530972+0000","last_clean":"2023-10-06T04:37:17.530972+0000","last_became_active":"2023-10-06T04:37:16.545969+0000","last_became_peered":"2023-10-06T04:37:16.545969+0000","last_unstale":"2023-10-06T04:37:17.530972+0000","last_undegraded":"2023-10-06T04:37:17.530972+0000","last_fullsized":"2023-10-06T04:37:17.530972+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:37.190837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.531623+0000","last_change":"2023-10-06T04:36:11.184460+0000","last_active":"2023-10-06T04:37:17.531623+0000","last_peered":"2023-10-06T04:37:17.531623+0000","last_clean":"2023-10-06T04:37:17.531623+0000","last_became_active":"2023-10-06T04:36:11.184119+0000","last_became_peered":"2023-10-06T04:36:11.184119+0000","last_unstale":"2023-10-06T04:37:17.531623+0000","last_undegraded":"2023-10-06T04:37:17.531623+0000","last_fullsized":"2023-10-06T04:37:17.531623+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:37.026121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":175,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.536882+0000","last_change":"2023-10-06T04:36:12.183155+0000","last_active":"2023-10-06T04:37:17.536882+0000","last_peered":"2023-10-06T04:37:17.536882+0000","last_clean":"2023-10-06T04:37:17.536882+0000","last_became_active":"2023-10-06T04:36:12.182903+0000","last_became_peered":"2023-10-06T04:36:12.182903+0000","last_unstale":"2023-10-06T04:37:17.536882+0000","last_undegraded":"2023-10-06T04:37:17.536882+0000","last_fullsized":"2023-10-06T04:37:17.536882+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:11.171104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:11.171104+0000","last_clean_scrub_stamp":"2023-10-06T04:36:11.171104+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:38:54.323364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.548273+0000","last_change":"2023-10-06T04:37:17.537793+0000","last_active":"2023-10-06T04:37:17.548273+0000","last_peered":"2023-10-06T04:37:17.548273+0000","last_clean":"2023-10-06T04:37:17.548273+0000","last_became_active":"2023-10-06T04:37:17.537503+0000","last_became_peered":"2023-10-06T04:37:17.537503+0000","last_unstale":"2023-10-06T04:37:17.548273+0000","last_undegraded":"2023-10-06T04:37:17.548273+0000","last_fullsized":"2023-10-06T04:37:17.548273+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:19.011564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.537750+0000","last_change":"2023-10-06T04:37:16.545879+0000","last_active":"2023-10-06T04:37:17.537750+0000","last_peered":"2023-10-06T04:37:17.537750+0000","last_clean":"2023-10-06T04:37:17.537750+0000","last_became_active":"2023-10-06T04:37:16.545603+0000","last_became_peered":"2023-10-06T04:37:16.545603+0000","last_unstale":"2023-10-06T04:37:17.537750+0000","last_undegraded":"2023-10-06T04:37:17.537750+0000","last_fullsized":"2023-10-06T04:37:17.537750+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:40.207039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.540168+0000","last_change":"2023-10-06T04:36:11.193056+0000","last_active":"2023-10-06T04:37:17.540168+0000","last_peered":"2023-10-06T04:37:17.540168+0000","last_clean":"2023-10-06T04:37:17.540168+0000","last_became_active":"2023-10-06T04:36:11.192712+0000","last_became_peered":"2023-10-06T04:36:11.192712+0000","last_unstale":"2023-10-06T04:37:17.540168+0000","last_undegraded":"2023-10-06T04:37:17.540168+0000","last_fullsized":"2023-10-06T04:37:17.540168+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:00.008654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549941+0000","last_change":"2023-10-06T04:37:17.547978+0000","last_active":"2023-10-06T04:37:17.549941+0000","last_peered":"2023-10-06T04:37:17.549941+0000","last_clean":"2023-10-06T04:37:17.549941+0000","last_became_active":"2023-10-06T04:37:17.547342+0000","last_became_peered":"2023-10-06T04:37:17.547342+0000","last_unstale":"2023-10-06T04:37:17.549941+0000","last_undegraded":"2023-10-06T04:37:17.549941+0000","last_fullsized":"2023-10-06T04:37:17.549941+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:12.970309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.561292+0000","last_change":"2023-10-06T04:37:16.544363+0000","last_active":"2023-10-06T04:37:17.561292+0000","last_peered":"2023-10-06T04:37:17.561292+0000","last_clean":"2023-10-06T04:37:17.561292+0000","last_became_active":"2023-10-06T04:37:16.544100+0000","last_became_peered":"2023-10-06T04:37:16.544100+0000","last_unstale":"2023-10-06T04:37:17.561292+0000","last_undegraded":"2023-10-06T04:37:17.561292+0000","last_fullsized":"2023-10-06T04:37:17.561292+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:24.703451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.536800+0000","last_change":"2023-10-06T04:36:11.192701+0000","last_active":"2023-10-06T04:37:17.536800+0000","last_peered":"2023-10-06T04:37:17.536800+0000","last_clean":"2023-10-06T04:37:17.536800+0000","last_became_active":"2023-10-06T04:36:11.192335+0000","last_became_peered":"2023-10-06T04:36:11.192335+0000","last_unstale":"2023-10-06T04:37:17.536800+0000","last_undegraded":"2023-10-06T04:37:17.536800+0000","last_fullsized":"2023-10-06T04:37:17.536800+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:18.643570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.558650+0000","last_change":"2023-10-06T04:37:17.551353+0000","last_active":"2023-10-06T04:37:17.558650+0000","last_peered":"2023-10-06T04:37:17.558650+0000","last_clean":"2023-10-06T04:37:17.558650+0000","last_became_active":"2023-10-06T04:37:17.550655+0000","last_became_peered":"2023-10-06T04:37:17.550655+0000","last_unstale":"2023-10-06T04:37:17.558650+0000","last_undegraded":"2023-10-06T04:37:17.558650+0000","last_fullsized":"2023-10-06T04:37:17.558650+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:37.951996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T04:37:19.533140+0000","last_change":"2023-10-06T04:37:16.541672+0000","last_active":"2023-10-06T04:37:19.533140+0000","last_peered":"2023-10-06T04:37:19.533140+0000","last_clean":"2023-10-06T04:37:19.533140+0000","last_became_active":"2023-10-06T04:37:16.541369+0000","last_became_peered":"2023-10-06T04:37:16.541369+0000","last_unstale":"2023-10-06T04:37:19.533140+0000","last_undegraded":"2023-10-06T04:37:19.533140+0000","last_fullsized":"2023-10-06T04:37:19.533140+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:34.644455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.541962+0000","last_change":"2023-10-06T04:36:11.193497+0000","last_active":"2023-10-06T04:37:17.541962+0000","last_peered":"2023-10-06T04:37:17.541962+0000","last_clean":"2023-10-06T04:37:17.541962+0000","last_became_active":"2023-10-06T04:36:11.193215+0000","last_became_peered":"2023-10-06T04:36:11.193215+0000","last_unstale":"2023-10-06T04:37:17.541962+0000","last_undegraded":"2023-10-06T04:37:17.541962+0000","last_fullsized":"2023-10-06T04:37:17.541962+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:07.497987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.554313+0000","last_change":"2023-10-06T04:37:17.548282+0000","last_active":"2023-10-06T04:37:17.554313+0000","last_peered":"2023-10-06T04:37:17.554313+0000","last_clean":"2023-10-06T04:37:17.554313+0000","last_became_active":"2023-10-06T04:37:17.548037+0000","last_became_peered":"2023-10-06T04:37:17.548037+0000","last_unstale":"2023-10-06T04:37:17.554313+0000","last_undegraded":"2023-10-06T04:37:17.554313+0000","last_fullsized":"2023-10-06T04:37:17.554313+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:44:56.161035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.531161+0000","last_change":"2023-10-06T04:37:16.539573+0000","last_active":"2023-10-06T04:37:17.531161+0000","last_peered":"2023-10-06T04:37:17.531161+0000","last_clean":"2023-10-06T04:37:17.531161+0000","last_became_active":"2023-10-06T04:37:16.539271+0000","last_became_peered":"2023-10-06T04:37:16.539271+0000","last_unstale":"2023-10-06T04:37:17.531161+0000","last_undegraded":"2023-10-06T04:37:17.531161+0000","last_fullsized":"2023-10-06T04:37:17.531161+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:06:23.075116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":25,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.541426+0000","last_change":"2023-10-06T04:36:11.193111+0000","last_active":"2023-10-06T04:37:17.541426+0000","last_peered":"2023-10-06T04:37:17.541426+0000","last_clean":"2023-10-06T04:37:17.541426+0000","last_became_active":"2023-10-06T04:36:11.192836+0000","last_became_peered":"2023-10-06T04:36:11.192836+0000","last_unstale":"2023-10-06T04:37:17.541426+0000","last_undegraded":"2023-10-06T04:37:17.541426+0000","last_fullsized":"2023-10-06T04:37:17.541426+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:19.938716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.553107+0000","last_change":"2023-10-06T04:37:17.546750+0000","last_active":"2023-10-06T04:37:17.553107+0000","last_peered":"2023-10-06T04:37:17.553107+0000","last_clean":"2023-10-06T04:37:17.553107+0000","last_became_active":"2023-10-06T04:37:17.546467+0000","last_became_peered":"2023-10-06T04:37:17.546467+0000","last_unstale":"2023-10-06T04:37:17.553107+0000","last_undegraded":"2023-10-06T04:37:17.553107+0000","last_fullsized":"2023-10-06T04:37:17.553107+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:58.928454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.534634+0000","last_change":"2023-10-06T04:37:16.544678+0000","last_active":"2023-10-06T04:37:17.534634+0000","last_peered":"2023-10-06T04:37:17.534634+0000","last_clean":"2023-10-06T04:37:17.534634+0000","last_became_active":"2023-10-06T04:37:16.541041+0000","last_became_peered":"2023-10-06T04:37:16.541041+0000","last_unstale":"2023-10-06T04:37:17.534634+0000","last_undegraded":"2023-10-06T04:37:17.534634+0000","last_fullsized":"2023-10-06T04:37:17.534634+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:15:48.328371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":25,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.541438+0000","last_change":"2023-10-06T04:36:11.182804+0000","last_active":"2023-10-06T04:37:17.541438+0000","last_peered":"2023-10-06T04:37:17.541438+0000","last_clean":"2023-10-06T04:37:17.541438+0000","last_became_active":"2023-10-06T04:36:11.182575+0000","last_became_peered":"2023-10-06T04:36:11.182575+0000","last_unstale":"2023-10-06T04:37:17.541438+0000","last_undegraded":"2023-10-06T04:37:17.541438+0000","last_fullsized":"2023-10-06T04:37:17.541438+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:07.497987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298300,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073540,"statfs":{"total":96636764160,"available":96331304960,"internally_reserved":0,"allocated":1036288,"data_stored":785402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.372}]},{"osd":1,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.29199999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.52800000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.56000000000000005}]},{"osd":4,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.51900000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.40799999999999997}]},{"osd":6,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.49399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297724,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074116,"statfs":{"total":96636764160,"available":96331894784,"internally_reserved":0,"allocated":446464,"data_stored":195588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.437},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":10.045999999999999,"5min":10.045999999999999,"15min":10.045999999999999},"last":0.57599999999999996}]},{"osd":1,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":10.125999999999999,"5min":10.125999999999999,"15min":10.125999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.54600000000000004}]},{"osd":2,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.503},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":10.238,"5min":10.238,"15min":10.238},"last":0.41699999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":4.4870000000000001,"5min":4.4870000000000001,"15min":4.4870000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":10.393000000000001,"5min":10.393000000000001,"15min":10.393000000000001},"last":0.60899999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.625}]},{"osd":5,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.64900000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.63800000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298288,"kb_used_data":1000,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073552,"statfs":{"total":96636764160,"available":96331317248,"internally_reserved":0,"allocated":1024000,"data_stored":778421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.23100000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.309}]},{"osd":2,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.28799999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.38200000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.52500000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.497},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.51300000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.53700000000000003}]},{"osd":7,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.55100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":425984,"data_stored":187039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.443,"5min":0.443,"15min":0.443},"last":0.25900000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.313}]},{"osd":3,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.377}]},{"osd":4,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.42599999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.49199999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.55100000000000005}]},{"osd":7,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.623},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.45900000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":450560,"data_stored":195524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.46500000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.495},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.505}]},{"osd":3,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.52000000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.57299999999999995}]},{"osd":5,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.72399999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.70199999999999996}]},{"osd":7,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.66200000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297724,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074116,"statfs":{"total":96636764160,"available":96331894784,"internally_reserved":0,"allocated":446464,"data_stored":194576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.246},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.442,"5min":0.442,"15min":0.442},"last":0.33700000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.436,"5min":0.436,"15min":0.436},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.40200000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.36399999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.1070000000000002,"5min":2.1070000000000002,"15min":2.1070000000000002},"last":0.627}]},{"osd":5,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.66400000000000003}]},{"osd":6,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.751}]},{"osd":7,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.69599999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":450560,"data_stored":196480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":4.2919999999999998,"5min":4.2919999999999998,"15min":4.2919999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.69499999999999995}]},{"osd":1,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":4.3520000000000003,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":0.61399999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.66800000000000004}]},{"osd":3,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.67800000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.55900000000000005}]},{"osd":6,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.58499999999999996}]},{"osd":7,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.501},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.48499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297708,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074132,"statfs":{"total":96636764160,"available":96331911168,"internally_reserved":0,"allocated":430080,"data_stored":188053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":1.071},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":2.0310000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":3.6949999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":3.5499999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":1.994},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":2.1640000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":2.2290000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.92200000000000004}]},{"osd":6,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":1.7010000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.88500000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":2.1190000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:37:21.673 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:37:21.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.814+0000 7f6ee9995700 1 Processor -- start 2023-10-06T04:37:21.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.814+0000 7f6ee9995700 1 -- start start 2023-10-06T04:37:21.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.815+0000 7f6ee9995700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ee406be60 0x7f6ee41620a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:21.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.815+0000 7f6ee9995700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee40ccca0 con 0x7f6ee40cc830 2023-10-06T04:37:21.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.815+0000 7f6ee9995700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee40cd790 con 0x7f6ee4140c30 2023-10-06T04:37:21.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.815+0000 7f6ee9995700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee40b11d0 con 0x7f6ee406be60 2023-10-06T04:37:21.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.815+0000 7f6ee27fc700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f6ee40cc830 0x7f6ee406b750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:40290/0 (socket says 172.21.15.8:40290) 2023-10-06T04:37:21.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.815+0000 7f6ee27fc700 1 -- 172.21.15.8:0/473571054 learned_addr learned my addr 172.21.15.8:0/473571054 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:21.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.816+0000 7f6ee37fe700 1 --2- 172.21.15.8:0/473571054 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ee406be60 0x7f6ee41620a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:21.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.816+0000 7f6ee1ffb700 1 -- 172.21.15.8:0/473571054 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322438139 0 0) 0x7f6ee40ccca0 con 0x7f6ee40cc830 2023-10-06T04:37:21.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.816+0000 7f6ee1ffb700 1 -- 172.21.15.8:0/473571054 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ed0003570 con 0x7f6ee40cc830 2023-10-06T04:37:21.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.816+0000 7f6ee1ffb700 1 -- 172.21.15.8:0/473571054 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3423798491 0 0) 0x7f6ee40cd790 con 0x7f6ee4140c30 2023-10-06T04:37:21.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.816+0000 7f6ee1ffb700 1 -- 172.21.15.8:0/473571054 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ee40ccca0 con 0x7f6ee4140c30 2023-10-06T04:37:21.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.816+0000 7f6ee37fe700 1 -- 172.21.15.8:0/473571054 >> v1:172.21.15.184:6789/0 conn(0x7f6ee4140c30 legacy=0x7f6ee40c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:21.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.816+0000 7f6ee37fe700 1 -- 172.21.15.8:0/473571054 >> v1:172.21.15.8:6789/0 conn(0x7f6ee40cc830 legacy=0x7f6ee406b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:21.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.816+0000 7f6ee1ffb700 1 -- 172.21.15.8:0/473571054 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2128365773 0 0) 0x7f6ed0003570 con 0x7f6ee40cc830 2023-10-06T04:37:21.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.816+0000 7f6ee37fe700 1 -- 172.21.15.8:0/473571054 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee40ccef0 con 0x7f6ee406be60 2023-10-06T04:37:21.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.816+0000 7f6ee37fe700 1 --2- 172.21.15.8:0/473571054 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ee406be60 0x7f6ee41620a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4009e90 tx=0x7f6ed4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=603fec3b885e66ac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:21.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.816+0000 7f6ee1ffb700 1 -- 172.21.15.8:0/473571054 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed400e070 con 0x7f6ee406be60 2023-10-06T04:37:21.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.816+0000 7f6ee1ffb700 1 -- 172.21.15.8:0/473571054 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed400b870 con 0x7f6ee406be60 2023-10-06T04:37:21.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.816+0000 7f6ee1ffb700 1 -- 172.21.15.8:0/473571054 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc001470 con 0x7f6ee406be60 2023-10-06T04:37:21.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.817+0000 7f6ee9995700 1 -- 172.21.15.8:0/473571054 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ee406be60 msgr2=0x7f6ee41620a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:21.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.817+0000 7f6ee9995700 1 --2- 172.21.15.8:0/473571054 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ee406be60 0x7f6ee41620a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4009e90 tx=0x7f6ed4009780 comp rx=0 tx=0).stop 2023-10-06T04:37:21.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.817+0000 7f6ee9995700 1 -- 172.21.15.8:0/473571054 shutdown_connections 2023-10-06T04:37:21.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.817+0000 7f6ee9995700 1 --2- 172.21.15.8:0/473571054 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ee406be60 0x7f6ee41620a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:21.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.817+0000 7f6ee9995700 1 -- 172.21.15.8:0/473571054 >> 172.21.15.8:0/473571054 conn(0x7f6ee40ce250 msgr2=0x7f6ee40ce650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:21.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.817+0000 7f6ee9995700 1 -- 172.21.15.8:0/473571054 shutdown_connections 2023-10-06T04:37:21.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.817+0000 7f6ee9995700 1 -- 172.21.15.8:0/473571054 wait complete. 2023-10-06T04:37:21.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.818+0000 7f6ee9995700 1 Processor -- start 2023-10-06T04:37:21.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.818+0000 7f6ee9995700 1 -- start start 2023-10-06T04:37:21.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.819+0000 7f6ee9995700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ee406be60 0x7f6ee412f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:21.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.819+0000 7f6ee9995700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ee40cc830 0x7f6ee4166830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:21.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.819+0000 7f6ee9995700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ee4140c30 0x7f6ee415d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:21.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.819+0000 7f6ee9995700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee415bbf0 con 0x7f6ee406be60 2023-10-06T04:37:21.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.819+0000 7f6ee9995700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee4166d70 con 0x7f6ee40cc830 2023-10-06T04:37:21.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.819+0000 7f6ee9995700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee415b2e0 con 0x7f6ee4140c30 2023-10-06T04:37:21.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.819+0000 7f6ee2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ee406be60 0x7f6ee412f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:21.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.819+0000 7f6ee2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ee406be60 0x7f6ee412f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35118/0 (socket says 172.21.15.8:35118) 2023-10-06T04:37:21.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.819+0000 7f6ee2ffd700 1 -- 172.21.15.8:0/84747396 learned_addr learned my addr 172.21.15.8:0/84747396 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:21.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.819+0000 7f6ee27fc700 1 --2- 172.21.15.8:0/84747396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ee40cc830 0x7f6ee4166830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:21.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.819+0000 7f6ee37fe700 1 --2- 172.21.15.8:0/84747396 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ee4140c30 0x7f6ee415d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:21.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.819+0000 7f6ee2ffd700 1 -- 172.21.15.8:0/84747396 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ee4140c30 msgr2=0x7f6ee415d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:21.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.819+0000 7f6ee2ffd700 1 --2- 172.21.15.8:0/84747396 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ee4140c30 0x7f6ee415d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:21.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.819+0000 7f6ee2ffd700 1 -- 172.21.15.8:0/84747396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ee40cc830 msgr2=0x7f6ee4166830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:21.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.819+0000 7f6ee2ffd700 1 --2- 172.21.15.8:0/84747396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ee40cc830 0x7f6ee4166830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:21.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.819+0000 7f6ee2ffd700 1 -- 172.21.15.8:0/84747396 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed4009a20 con 0x7f6ee406be60 2023-10-06T04:37:21.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.820+0000 7f6ee2ffd700 1 --2- 172.21.15.8:0/84747396 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ee406be60 0x7f6ee412f5e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6edc00c820 tx=0x7f6edc007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:21.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.820+0000 7f6edaffd700 1 -- 172.21.15.8:0/84747396 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6edc001530 con 0x7f6ee406be60 2023-10-06T04:37:21.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.820+0000 7f6edaffd700 1 -- 172.21.15.8:0/84747396 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6edc001690 con 0x7f6ee406be60 2023-10-06T04:37:21.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.820+0000 7f6edaffd700 1 -- 172.21.15.8:0/84747396 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6edc001a50 con 0x7f6ee406be60 2023-10-06T04:37:21.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.820+0000 7f6ee9995700 1 -- 172.21.15.8:0/84747396 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee415dc00 con 0x7f6ee406be60 2023-10-06T04:37:21.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.820+0000 7f6ee9995700 1 -- 172.21.15.8:0/84747396 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee415b810 con 0x7f6ee406be60 2023-10-06T04:37:21.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.821+0000 7f6ee9995700 1 -- 172.21.15.8:0/84747396 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee4157720 con 0x7f6ee406be60 2023-10-06T04:37:21.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.821+0000 7f6edaffd700 1 -- 172.21.15.8:0/84747396 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6edc01b3b0 con 0x7f6ee406be60 2023-10-06T04:37:21.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.822+0000 7f6edaffd700 1 --2- 172.21.15.8:0/84747396 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6ec4066f30 0x7f6ec40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:21.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.822+0000 7f6edaffd700 1 -- 172.21.15.8:0/84747396 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6edc083fc0 con 0x7f6ee406be60 2023-10-06T04:37:21.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.822+0000 7f6ee27fc700 1 --2- 172.21.15.8:0/84747396 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6ec4066f30 0x7f6ec40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:21.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.822+0000 7f6ee27fc700 1 --2- 172.21.15.8:0/84747396 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6ec4066f30 0x7f6ec40693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6ee415d170 tx=0x7f6ecc000bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:21.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:21.826+0000 7f6edaffd700 1 -- 172.21.15.8:0/84747396 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6edc050ef0 con 0x7f6ee406be60 2023-10-06T04:37:22.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.015+0000 7f6ee9995700 1 -- 172.21.15.8:0/84747396 --> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6ee4071550 con 0x7f6ec4066f30 2023-10-06T04:37:22.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.023+0000 7f6edaffd700 1 -- 172.21.15.8:0/84747396 <== mgr.4105 v2:172.21.15.184:6832/90283 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+312336 (secure 0 0 0) 0x7f6ee4071550 con 0x7f6ec4066f30 2023-10-06T04:37:22.029 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:22.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.027+0000 7f6ee9995700 1 -- 172.21.15.8:0/84747396 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6ec4066f30 msgr2=0x7f6ec40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:22.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.027+0000 7f6ee9995700 1 --2- 172.21.15.8:0/84747396 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6ec4066f30 0x7f6ec40693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6ee415d170 tx=0x7f6ecc000bc0 comp rx=0 tx=0).stop 2023-10-06T04:37:22.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.027+0000 7f6ee9995700 1 -- 172.21.15.8:0/84747396 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ee406be60 msgr2=0x7f6ee412f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:22.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.027+0000 7f6ee9995700 1 --2- 172.21.15.8:0/84747396 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ee406be60 0x7f6ee412f5e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6edc00c820 tx=0x7f6edc007e00 comp rx=0 tx=0).stop 2023-10-06T04:37:22.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.027+0000 7f6ee9995700 1 -- 172.21.15.8:0/84747396 shutdown_connections 2023-10-06T04:37:22.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.027+0000 7f6ee9995700 1 --2- 172.21.15.8:0/84747396 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6ec4066f30 0x7f6ec40693e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:22.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.027+0000 7f6ee9995700 1 --2- 172.21.15.8:0/84747396 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ee4140c30 0x7f6ee415d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:22.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.027+0000 7f6ee9995700 1 --2- 172.21.15.8:0/84747396 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ee406be60 0x7f6ee412f5e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:22.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.027+0000 7f6ee9995700 1 --2- 172.21.15.8:0/84747396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ee40cc830 0x7f6ee4166830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:22.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.027+0000 7f6ee9995700 1 -- 172.21.15.8:0/84747396 >> 172.21.15.8:0/84747396 conn(0x7f6ee40ce250 msgr2=0x7f6ee40b1900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:22.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.027+0000 7f6ee9995700 1 -- 172.21.15.8:0/84747396 shutdown_connections 2023-10-06T04:37:22.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.027+0000 7f6ee9995700 1 -- 172.21.15.8:0/84747396 wait complete. 2023-10-06T04:37:22.033 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-06T04:37:22.040 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-10-06T04:37:20.646185+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":201,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382904,"kb_used_data":4600,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591816,"statfs":{"total":773094113280,"available":770654019584,"internally_reserved":0,"allocated":4710400,"data_stored":2721083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.126167"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.542638+0000","last_change":"2023-10-06T04:37:17.540825+0000","last_active":"2023-10-06T04:37:17.542638+0000","last_peered":"2023-10-06T04:37:17.542638+0000","last_clean":"2023-10-06T04:37:17.542638+0000","last_became_active":"2023-10-06T04:37:17.540537+0000","last_became_peered":"2023-10-06T04:37:17.540537+0000","last_unstale":"2023-10-06T04:37:17.542638+0000","last_undegraded":"2023-10-06T04:37:17.542638+0000","last_fullsized":"2023-10-06T04:37:17.542638+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:27.083777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.554831+0000","last_change":"2023-10-06T04:37:17.550627+0000","last_active":"2023-10-06T04:37:17.554831+0000","last_peered":"2023-10-06T04:37:17.554831+0000","last_clean":"2023-10-06T04:37:17.554831+0000","last_became_active":"2023-10-06T04:37:17.550395+0000","last_became_peered":"2023-10-06T04:37:17.550395+0000","last_unstale":"2023-10-06T04:37:17.554831+0000","last_undegraded":"2023-10-06T04:37:17.554831+0000","last_fullsized":"2023-10-06T04:37:17.554831+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:49.714446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.544888+0000","last_change":"2023-10-06T04:37:17.541131+0000","last_active":"2023-10-06T04:37:17.544888+0000","last_peered":"2023-10-06T04:37:17.544888+0000","last_clean":"2023-10-06T04:37:17.544888+0000","last_became_active":"2023-10-06T04:37:17.540816+0000","last_became_peered":"2023-10-06T04:37:17.540816+0000","last_unstale":"2023-10-06T04:37:17.544888+0000","last_undegraded":"2023-10-06T04:37:17.544888+0000","last_fullsized":"2023-10-06T04:37:17.544888+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:32:45.542874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549771+0000","last_change":"2023-10-06T04:37:17.545649+0000","last_active":"2023-10-06T04:37:17.549771+0000","last_peered":"2023-10-06T04:37:17.549771+0000","last_clean":"2023-10-06T04:37:17.549771+0000","last_became_active":"2023-10-06T04:37:17.545155+0000","last_became_peered":"2023-10-06T04:37:17.545155+0000","last_unstale":"2023-10-06T04:37:17.549771+0000","last_undegraded":"2023-10-06T04:37:17.549771+0000","last_fullsized":"2023-10-06T04:37:17.549771+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:09.823506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549858+0000","last_change":"2023-10-06T04:37:17.545451+0000","last_active":"2023-10-06T04:37:17.549858+0000","last_peered":"2023-10-06T04:37:17.549858+0000","last_clean":"2023-10-06T04:37:17.549858+0000","last_became_active":"2023-10-06T04:37:17.545135+0000","last_became_peered":"2023-10-06T04:37:17.545135+0000","last_unstale":"2023-10-06T04:37:17.549858+0000","last_undegraded":"2023-10-06T04:37:17.549858+0000","last_fullsized":"2023-10-06T04:37:17.549858+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:44.628778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.551108+0000","last_change":"2023-10-06T04:37:17.545054+0000","last_active":"2023-10-06T04:37:17.551108+0000","last_peered":"2023-10-06T04:37:17.551108+0000","last_clean":"2023-10-06T04:37:17.551108+0000","last_became_active":"2023-10-06T04:37:17.544822+0000","last_became_peered":"2023-10-06T04:37:17.544822+0000","last_unstale":"2023-10-06T04:37:17.551108+0000","last_undegraded":"2023-10-06T04:37:17.551108+0000","last_fullsized":"2023-10-06T04:37:17.551108+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:28:51.824521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.552533+0000","last_change":"2023-10-06T04:37:17.548819+0000","last_active":"2023-10-06T04:37:17.552533+0000","last_peered":"2023-10-06T04:37:17.552533+0000","last_clean":"2023-10-06T04:37:17.552533+0000","last_became_active":"2023-10-06T04:37:17.548629+0000","last_became_peered":"2023-10-06T04:37:17.548629+0000","last_unstale":"2023-10-06T04:37:17.552533+0000","last_undegraded":"2023-10-06T04:37:17.552533+0000","last_fullsized":"2023-10-06T04:37:17.552533+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:04.973984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549869+0000","last_change":"2023-10-06T04:37:17.547124+0000","last_active":"2023-10-06T04:37:17.549869+0000","last_peered":"2023-10-06T04:37:17.549869+0000","last_clean":"2023-10-06T04:37:17.549869+0000","last_became_active":"2023-10-06T04:37:17.546879+0000","last_became_peered":"2023-10-06T04:37:17.546879+0000","last_unstale":"2023-10-06T04:37:17.549869+0000","last_undegraded":"2023-10-06T04:37:17.549869+0000","last_fullsized":"2023-10-06T04:37:17.549869+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:45.225371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.548635+0000","last_change":"2023-10-06T04:37:17.537910+0000","last_active":"2023-10-06T04:37:17.548635+0000","last_peered":"2023-10-06T04:37:17.548635+0000","last_clean":"2023-10-06T04:37:17.548635+0000","last_became_active":"2023-10-06T04:37:17.535864+0000","last_became_peered":"2023-10-06T04:37:17.535864+0000","last_unstale":"2023-10-06T04:37:17.548635+0000","last_undegraded":"2023-10-06T04:37:17.548635+0000","last_fullsized":"2023-10-06T04:37:17.548635+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:58.928454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549976+0000","last_change":"2023-10-06T04:37:17.548489+0000","last_active":"2023-10-06T04:37:17.549976+0000","last_peered":"2023-10-06T04:37:17.549976+0000","last_clean":"2023-10-06T04:37:17.549976+0000","last_became_active":"2023-10-06T04:37:17.547714+0000","last_became_peered":"2023-10-06T04:37:17.547714+0000","last_unstale":"2023-10-06T04:37:17.549976+0000","last_undegraded":"2023-10-06T04:37:17.549976+0000","last_fullsized":"2023-10-06T04:37:17.549976+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:56.687459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549670+0000","last_change":"2023-10-06T04:37:17.544501+0000","last_active":"2023-10-06T04:37:17.549670+0000","last_peered":"2023-10-06T04:37:17.549670+0000","last_clean":"2023-10-06T04:37:17.549670+0000","last_became_active":"2023-10-06T04:37:17.541822+0000","last_became_peered":"2023-10-06T04:37:17.541822+0000","last_unstale":"2023-10-06T04:37:17.549670+0000","last_undegraded":"2023-10-06T04:37:17.549670+0000","last_fullsized":"2023-10-06T04:37:17.549670+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:32:45.542874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549520+0000","last_change":"2023-10-06T04:37:17.545538+0000","last_active":"2023-10-06T04:37:17.549520+0000","last_peered":"2023-10-06T04:37:17.549520+0000","last_clean":"2023-10-06T04:37:17.549520+0000","last_became_active":"2023-10-06T04:37:17.545027+0000","last_became_peered":"2023-10-06T04:37:17.545027+0000","last_unstale":"2023-10-06T04:37:17.549520+0000","last_undegraded":"2023-10-06T04:37:17.549520+0000","last_fullsized":"2023-10-06T04:37:17.549520+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:23.847066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.548577+0000","last_change":"2023-10-06T04:37:17.541986+0000","last_active":"2023-10-06T04:37:17.548577+0000","last_peered":"2023-10-06T04:37:17.548577+0000","last_clean":"2023-10-06T04:37:17.548577+0000","last_became_active":"2023-10-06T04:37:17.541707+0000","last_became_peered":"2023-10-06T04:37:17.541707+0000","last_unstale":"2023-10-06T04:37:17.548577+0000","last_undegraded":"2023-10-06T04:37:17.548577+0000","last_fullsized":"2023-10-06T04:37:17.548577+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:25.707658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.540578+0000","last_change":"2023-10-06T04:37:17.536298+0000","last_active":"2023-10-06T04:37:17.540578+0000","last_peered":"2023-10-06T04:37:17.540578+0000","last_clean":"2023-10-06T04:37:17.540578+0000","last_became_active":"2023-10-06T04:37:17.535937+0000","last_became_peered":"2023-10-06T04:37:17.535937+0000","last_unstale":"2023-10-06T04:37:17.540578+0000","last_undegraded":"2023-10-06T04:37:17.540578+0000","last_fullsized":"2023-10-06T04:37:17.540578+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:01.324339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.548688+0000","last_change":"2023-10-06T04:37:17.538786+0000","last_active":"2023-10-06T04:37:17.548688+0000","last_peered":"2023-10-06T04:37:17.548688+0000","last_clean":"2023-10-06T04:37:17.548688+0000","last_became_active":"2023-10-06T04:37:17.538493+0000","last_became_peered":"2023-10-06T04:37:17.538493+0000","last_unstale":"2023-10-06T04:37:17.548688+0000","last_undegraded":"2023-10-06T04:37:17.548688+0000","last_fullsized":"2023-10-06T04:37:17.548688+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:09.823506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.558618+0000","last_change":"2023-10-06T04:37:17.552277+0000","last_active":"2023-10-06T04:37:17.558618+0000","last_peered":"2023-10-06T04:37:17.558618+0000","last_clean":"2023-10-06T04:37:17.558618+0000","last_became_active":"2023-10-06T04:37:17.552001+0000","last_became_peered":"2023-10-06T04:37:17.552001+0000","last_unstale":"2023-10-06T04:37:17.558618+0000","last_undegraded":"2023-10-06T04:37:17.558618+0000","last_fullsized":"2023-10-06T04:37:17.558618+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:41.211245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.553173+0000","last_change":"2023-10-06T04:37:17.547373+0000","last_active":"2023-10-06T04:37:17.553173+0000","last_peered":"2023-10-06T04:37:17.553173+0000","last_clean":"2023-10-06T04:37:17.553173+0000","last_became_active":"2023-10-06T04:37:17.547103+0000","last_became_peered":"2023-10-06T04:37:17.547103+0000","last_unstale":"2023-10-06T04:37:17.553173+0000","last_undegraded":"2023-10-06T04:37:17.553173+0000","last_fullsized":"2023-10-06T04:37:17.553173+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:09.823506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.558882+0000","last_change":"2023-10-06T04:37:17.554683+0000","last_active":"2023-10-06T04:37:17.558882+0000","last_peered":"2023-10-06T04:37:17.558882+0000","last_clean":"2023-10-06T04:37:17.558882+0000","last_became_active":"2023-10-06T04:37:17.554412+0000","last_became_peered":"2023-10-06T04:37:17.554412+0000","last_unstale":"2023-10-06T04:37:17.558882+0000","last_undegraded":"2023-10-06T04:37:17.558882+0000","last_fullsized":"2023-10-06T04:37:17.558882+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:56.687459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.557161+0000","last_change":"2023-10-06T04:37:17.551197+0000","last_active":"2023-10-06T04:37:17.557161+0000","last_peered":"2023-10-06T04:37:17.557161+0000","last_clean":"2023-10-06T04:37:17.557161+0000","last_became_active":"2023-10-06T04:37:17.550633+0000","last_became_peered":"2023-10-06T04:37:17.550633+0000","last_unstale":"2023-10-06T04:37:17.557161+0000","last_undegraded":"2023-10-06T04:37:17.557161+0000","last_fullsized":"2023-10-06T04:37:17.557161+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:25.707658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.548430+0000","last_change":"2023-10-06T04:37:17.541139+0000","last_active":"2023-10-06T04:37:17.548430+0000","last_peered":"2023-10-06T04:37:17.548430+0000","last_clean":"2023-10-06T04:37:17.548430+0000","last_became_active":"2023-10-06T04:37:17.540844+0000","last_became_peered":"2023-10-06T04:37:17.540844+0000","last_unstale":"2023-10-06T04:37:17.548430+0000","last_undegraded":"2023-10-06T04:37:17.548430+0000","last_fullsized":"2023-10-06T04:37:17.548430+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:40.800271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.551212+0000","last_change":"2023-10-06T04:37:17.546023+0000","last_active":"2023-10-06T04:37:17.551212+0000","last_peered":"2023-10-06T04:37:17.551212+0000","last_clean":"2023-10-06T04:37:17.551212+0000","last_became_active":"2023-10-06T04:37:17.545428+0000","last_became_peered":"2023-10-06T04:37:17.545428+0000","last_unstale":"2023-10-06T04:37:17.551212+0000","last_undegraded":"2023-10-06T04:37:17.551212+0000","last_fullsized":"2023-10-06T04:37:17.551212+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:52.574192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549881+0000","last_change":"2023-10-06T04:37:17.546918+0000","last_active":"2023-10-06T04:37:17.549881+0000","last_peered":"2023-10-06T04:37:17.549881+0000","last_clean":"2023-10-06T04:37:17.549881+0000","last_became_active":"2023-10-06T04:37:17.546562+0000","last_became_peered":"2023-10-06T04:37:17.546562+0000","last_unstale":"2023-10-06T04:37:17.549881+0000","last_undegraded":"2023-10-06T04:37:17.549881+0000","last_fullsized":"2023-10-06T04:37:17.549881+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:18.119835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.554166+0000","last_change":"2023-10-06T04:37:17.549490+0000","last_active":"2023-10-06T04:37:17.554166+0000","last_peered":"2023-10-06T04:37:17.554166+0000","last_clean":"2023-10-06T04:37:17.554166+0000","last_became_active":"2023-10-06T04:37:17.549294+0000","last_became_peered":"2023-10-06T04:37:17.549294+0000","last_unstale":"2023-10-06T04:37:17.554166+0000","last_undegraded":"2023-10-06T04:37:17.554166+0000","last_fullsized":"2023-10-06T04:37:17.554166+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:50.973957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.554092+0000","last_change":"2023-10-06T04:37:17.548512+0000","last_active":"2023-10-06T04:37:17.554092+0000","last_peered":"2023-10-06T04:37:17.554092+0000","last_clean":"2023-10-06T04:37:17.554092+0000","last_became_active":"2023-10-06T04:37:17.547910+0000","last_became_peered":"2023-10-06T04:37:17.547910+0000","last_unstale":"2023-10-06T04:37:17.554092+0000","last_undegraded":"2023-10-06T04:37:17.554092+0000","last_fullsized":"2023-10-06T04:37:17.554092+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:15:49.332577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.557220+0000","last_change":"2023-10-06T04:37:17.551312+0000","last_active":"2023-10-06T04:37:17.557220+0000","last_peered":"2023-10-06T04:37:17.557220+0000","last_clean":"2023-10-06T04:37:17.557220+0000","last_became_active":"2023-10-06T04:37:17.550973+0000","last_became_peered":"2023-10-06T04:37:17.550973+0000","last_unstale":"2023-10-06T04:37:17.557220+0000","last_undegraded":"2023-10-06T04:37:17.557220+0000","last_fullsized":"2023-10-06T04:37:17.557220+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:40.800271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.548607+0000","last_change":"2023-10-06T04:37:17.542441+0000","last_active":"2023-10-06T04:37:17.548607+0000","last_peered":"2023-10-06T04:37:17.548607+0000","last_clean":"2023-10-06T04:37:17.548607+0000","last_became_active":"2023-10-06T04:37:17.542184+0000","last_became_peered":"2023-10-06T04:37:17.542184+0000","last_unstale":"2023-10-06T04:37:17.548607+0000","last_undegraded":"2023-10-06T04:37:17.548607+0000","last_fullsized":"2023-10-06T04:37:17.548607+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:57.066657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.553074+0000","last_change":"2023-10-06T04:37:17.546567+0000","last_active":"2023-10-06T04:37:17.553074+0000","last_peered":"2023-10-06T04:37:17.553074+0000","last_clean":"2023-10-06T04:37:17.553074+0000","last_became_active":"2023-10-06T04:37:17.546294+0000","last_became_peered":"2023-10-06T04:37:17.546294+0000","last_unstale":"2023-10-06T04:37:17.553074+0000","last_undegraded":"2023-10-06T04:37:17.553074+0000","last_fullsized":"2023-10-06T04:37:17.553074+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:19.011564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549532+0000","last_change":"2023-10-06T04:37:17.545684+0000","last_active":"2023-10-06T04:37:17.549532+0000","last_peered":"2023-10-06T04:37:17.549532+0000","last_clean":"2023-10-06T04:37:17.549532+0000","last_became_active":"2023-10-06T04:37:17.545341+0000","last_became_peered":"2023-10-06T04:37:17.545341+0000","last_unstale":"2023-10-06T04:37:17.549532+0000","last_undegraded":"2023-10-06T04:37:17.549532+0000","last_fullsized":"2023-10-06T04:37:17.549532+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:04.973984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.557210+0000","last_change":"2023-10-06T04:37:17.551198+0000","last_active":"2023-10-06T04:37:17.557210+0000","last_peered":"2023-10-06T04:37:17.557210+0000","last_clean":"2023-10-06T04:37:17.557210+0000","last_became_active":"2023-10-06T04:37:17.550871+0000","last_became_peered":"2023-10-06T04:37:17.550871+0000","last_unstale":"2023-10-06T04:37:17.557210+0000","last_undegraded":"2023-10-06T04:37:17.557210+0000","last_fullsized":"2023-10-06T04:37:17.557210+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:43.463619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.545360+0000","last_change":"2023-10-06T04:37:17.544638+0000","last_active":"2023-10-06T04:37:17.545360+0000","last_peered":"2023-10-06T04:37:17.545360+0000","last_clean":"2023-10-06T04:37:17.545360+0000","last_became_active":"2023-10-06T04:37:17.544358+0000","last_became_peered":"2023-10-06T04:37:17.544358+0000","last_unstale":"2023-10-06T04:37:17.545360+0000","last_undegraded":"2023-10-06T04:37:17.545360+0000","last_fullsized":"2023-10-06T04:37:17.545360+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:16.140442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.552110+0000","last_change":"2023-10-06T04:37:17.547875+0000","last_active":"2023-10-06T04:37:17.552110+0000","last_peered":"2023-10-06T04:37:17.552110+0000","last_clean":"2023-10-06T04:37:17.552110+0000","last_became_active":"2023-10-06T04:37:17.547504+0000","last_became_peered":"2023-10-06T04:37:17.547504+0000","last_unstale":"2023-10-06T04:37:17.552110+0000","last_undegraded":"2023-10-06T04:37:17.552110+0000","last_fullsized":"2023-10-06T04:37:17.552110+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:37.661915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.539533+0000","last_change":"2023-10-06T04:37:17.535486+0000","last_active":"2023-10-06T04:37:17.539533+0000","last_peered":"2023-10-06T04:37:17.539533+0000","last_clean":"2023-10-06T04:37:17.539533+0000","last_became_active":"2023-10-06T04:37:17.535215+0000","last_became_peered":"2023-10-06T04:37:17.535215+0000","last_unstale":"2023-10-06T04:37:17.539533+0000","last_undegraded":"2023-10-06T04:37:17.539533+0000","last_fullsized":"2023-10-06T04:37:17.539533+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:01.221591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549842+0000","last_change":"2023-10-06T04:37:17.540682+0000","last_active":"2023-10-06T04:37:17.549842+0000","last_peered":"2023-10-06T04:37:17.549842+0000","last_clean":"2023-10-06T04:37:17.549842+0000","last_became_active":"2023-10-06T04:37:17.540340+0000","last_became_peered":"2023-10-06T04:37:17.540340+0000","last_unstale":"2023-10-06T04:37:17.549842+0000","last_undegraded":"2023-10-06T04:37:17.549842+0000","last_fullsized":"2023-10-06T04:37:17.549842+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:57.066657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"37'4","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.561055+0000","last_change":"2023-10-06T04:37:16.539316+0000","last_active":"2023-10-06T04:37:17.561055+0000","last_peered":"2023-10-06T04:37:17.561055+0000","last_clean":"2023-10-06T04:37:17.561055+0000","last_became_active":"2023-10-06T04:37:16.538848+0000","last_became_peered":"2023-10-06T04:37:16.538848+0000","last_unstale":"2023-10-06T04:37:17.561055+0000","last_undegraded":"2023-10-06T04:37:17.561055+0000","last_fullsized":"2023-10-06T04:37:17.561055+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:44:55.156828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.556909+0000","last_change":"2023-10-06T04:37:17.549963+0000","last_active":"2023-10-06T04:37:17.556909+0000","last_peered":"2023-10-06T04:37:17.556909+0000","last_clean":"2023-10-06T04:37:17.556909+0000","last_became_active":"2023-10-06T04:37:17.545289+0000","last_became_peered":"2023-10-06T04:37:17.545289+0000","last_unstale":"2023-10-06T04:37:17.556909+0000","last_undegraded":"2023-10-06T04:37:17.556909+0000","last_fullsized":"2023-10-06T04:37:17.556909+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:01.221591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"37'1","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.560432+0000","last_change":"2023-10-06T04:37:16.539806+0000","last_active":"2023-10-06T04:37:17.560432+0000","last_peered":"2023-10-06T04:37:17.560432+0000","last_clean":"2023-10-06T04:37:17.560432+0000","last_became_active":"2023-10-06T04:37:16.539514+0000","last_became_peered":"2023-10-06T04:37:16.539514+0000","last_unstale":"2023-10-06T04:37:17.560432+0000","last_undegraded":"2023-10-06T04:37:17.560432+0000","last_fullsized":"2023-10-06T04:37:17.560432+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:48.710239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.554119+0000","last_change":"2023-10-06T04:37:17.549931+0000","last_active":"2023-10-06T04:37:17.554119+0000","last_peered":"2023-10-06T04:37:17.554119+0000","last_clean":"2023-10-06T04:37:17.554119+0000","last_became_active":"2023-10-06T04:37:17.549668+0000","last_became_peered":"2023-10-06T04:37:17.549668+0000","last_unstale":"2023-10-06T04:37:17.554119+0000","last_undegraded":"2023-10-06T04:37:17.554119+0000","last_fullsized":"2023-10-06T04:37:17.554119+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:27.083777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.564010+0000","last_change":"2023-10-06T04:37:16.546111+0000","last_active":"2023-10-06T04:37:17.564010+0000","last_peered":"2023-10-06T04:37:17.564010+0000","last_clean":"2023-10-06T04:37:17.564010+0000","last_became_active":"2023-10-06T04:37:16.545811+0000","last_became_peered":"2023-10-06T04:37:16.545811+0000","last_unstale":"2023-10-06T04:37:17.564010+0000","last_undegraded":"2023-10-06T04:37:17.564010+0000","last_fullsized":"2023-10-06T04:37:17.564010+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:30.574778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549673+0000","last_change":"2023-10-06T04:37:17.546138+0000","last_active":"2023-10-06T04:37:17.549673+0000","last_peered":"2023-10-06T04:37:17.549673+0000","last_clean":"2023-10-06T04:37:17.549673+0000","last_became_active":"2023-10-06T04:37:17.545845+0000","last_became_peered":"2023-10-06T04:37:17.545845+0000","last_unstale":"2023-10-06T04:37:17.549673+0000","last_undegraded":"2023-10-06T04:37:17.549673+0000","last_fullsized":"2023-10-06T04:37:17.549673+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:25.707658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.560018+0000","last_change":"2023-10-06T04:37:16.545947+0000","last_active":"2023-10-06T04:37:17.560018+0000","last_peered":"2023-10-06T04:37:17.560018+0000","last_clean":"2023-10-06T04:37:17.560018+0000","last_became_active":"2023-10-06T04:37:16.545700+0000","last_became_peered":"2023-10-06T04:37:16.545700+0000","last_unstale":"2023-10-06T04:37:17.560018+0000","last_undegraded":"2023-10-06T04:37:17.560018+0000","last_fullsized":"2023-10-06T04:37:17.560018+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:56.062450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.545342+0000","last_change":"2023-10-06T04:37:17.543400+0000","last_active":"2023-10-06T04:37:17.545342+0000","last_peered":"2023-10-06T04:37:17.545342+0000","last_clean":"2023-10-06T04:37:17.545342+0000","last_became_active":"2023-10-06T04:37:17.543132+0000","last_became_peered":"2023-10-06T04:37:17.543132+0000","last_unstale":"2023-10-06T04:37:17.545342+0000","last_undegraded":"2023-10-06T04:37:17.545342+0000","last_fullsized":"2023-10-06T04:37:17.545342+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:50:28.268338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"37'1","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.561089+0000","last_change":"2023-10-06T04:37:16.541989+0000","last_active":"2023-10-06T04:37:17.561089+0000","last_peered":"2023-10-06T04:37:17.561089+0000","last_clean":"2023-10-06T04:37:17.561089+0000","last_became_active":"2023-10-06T04:37:16.541684+0000","last_became_peered":"2023-10-06T04:37:16.541684+0000","last_unstale":"2023-10-06T04:37:17.561089+0000","last_undegraded":"2023-10-06T04:37:17.561089+0000","last_fullsized":"2023-10-06T04:37:17.561089+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:13.019515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549769+0000","last_change":"2023-10-06T04:37:17.546677+0000","last_active":"2023-10-06T04:37:17.549769+0000","last_peered":"2023-10-06T04:37:17.549769+0000","last_clean":"2023-10-06T04:37:17.549769+0000","last_became_active":"2023-10-06T04:37:17.546151+0000","last_became_peered":"2023-10-06T04:37:17.546151+0000","last_unstale":"2023-10-06T04:37:17.549769+0000","last_undegraded":"2023-10-06T04:37:17.549769+0000","last_fullsized":"2023-10-06T04:37:17.549769+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:16.140442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"37'1","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.560653+0000","last_change":"2023-10-06T04:37:16.545939+0000","last_active":"2023-10-06T04:37:17.560653+0000","last_peered":"2023-10-06T04:37:17.560653+0000","last_clean":"2023-10-06T04:37:17.560653+0000","last_became_active":"2023-10-06T04:37:16.545722+0000","last_became_peered":"2023-10-06T04:37:16.545722+0000","last_unstale":"2023-10-06T04:37:17.560653+0000","last_undegraded":"2023-10-06T04:37:17.560653+0000","last_fullsized":"2023-10-06T04:37:17.560653+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:22.842860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549845+0000","last_change":"2023-10-06T04:37:17.547055+0000","last_active":"2023-10-06T04:37:17.549845+0000","last_peered":"2023-10-06T04:37:17.549845+0000","last_clean":"2023-10-06T04:37:17.549845+0000","last_became_active":"2023-10-06T04:37:17.546777+0000","last_became_peered":"2023-10-06T04:37:17.546777+0000","last_unstale":"2023-10-06T04:37:17.549845+0000","last_undegraded":"2023-10-06T04:37:17.549845+0000","last_fullsized":"2023-10-06T04:37:17.549845+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:28:51.824521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.541879+0000","last_change":"2023-10-06T04:37:16.544251+0000","last_active":"2023-10-06T04:37:17.541879+0000","last_peered":"2023-10-06T04:37:17.541879+0000","last_clean":"2023-10-06T04:37:17.541879+0000","last_became_active":"2023-10-06T04:37:16.543853+0000","last_became_peered":"2023-10-06T04:37:16.543853+0000","last_unstale":"2023-10-06T04:37:17.541879+0000","last_undegraded":"2023-10-06T04:37:17.541879+0000","last_fullsized":"2023-10-06T04:37:17.541879+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:00.217384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.557086+0000","last_change":"2023-10-06T04:37:17.550653+0000","last_active":"2023-10-06T04:37:17.557086+0000","last_peered":"2023-10-06T04:37:17.557086+0000","last_clean":"2023-10-06T04:37:17.557086+0000","last_became_active":"2023-10-06T04:37:17.550308+0000","last_became_peered":"2023-10-06T04:37:17.550308+0000","last_unstale":"2023-10-06T04:37:17.557086+0000","last_undegraded":"2023-10-06T04:37:17.557086+0000","last_fullsized":"2023-10-06T04:37:17.557086+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:06:24.079323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.534436+0000","last_change":"2023-10-06T04:37:16.539539+0000","last_active":"2023-10-06T04:37:17.534436+0000","last_peered":"2023-10-06T04:37:17.534436+0000","last_clean":"2023-10-06T04:37:17.534436+0000","last_became_active":"2023-10-06T04:37:16.536276+0000","last_became_peered":"2023-10-06T04:37:16.536276+0000","last_unstale":"2023-10-06T04:37:17.534436+0000","last_undegraded":"2023-10-06T04:37:17.534436+0000","last_fullsized":"2023-10-06T04:37:17.534436+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:23.725665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.554594+0000","last_change":"2023-10-06T04:37:17.547330+0000","last_active":"2023-10-06T04:37:17.554594+0000","last_peered":"2023-10-06T04:37:17.554594+0000","last_clean":"2023-10-06T04:37:17.554594+0000","last_became_active":"2023-10-06T04:37:17.547088+0000","last_became_peered":"2023-10-06T04:37:17.547088+0000","last_unstale":"2023-10-06T04:37:17.554594+0000","last_undegraded":"2023-10-06T04:37:17.554594+0000","last_fullsized":"2023-10-06T04:37:17.554594+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:12.970309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.534061+0000","last_change":"2023-10-06T04:37:16.543071+0000","last_active":"2023-10-06T04:37:17.534061+0000","last_peered":"2023-10-06T04:37:17.534061+0000","last_clean":"2023-10-06T04:37:17.534061+0000","last_became_active":"2023-10-06T04:37:16.542755+0000","last_became_peered":"2023-10-06T04:37:16.542755+0000","last_unstale":"2023-10-06T04:37:17.534061+0000","last_undegraded":"2023-10-06T04:37:17.534061+0000","last_fullsized":"2023-10-06T04:37:17.534061+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:03.969778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.552103+0000","last_change":"2023-10-06T04:37:17.546184+0000","last_active":"2023-10-06T04:37:17.552103+0000","last_peered":"2023-10-06T04:37:17.552103+0000","last_clean":"2023-10-06T04:37:17.552103+0000","last_became_active":"2023-10-06T04:37:17.545899+0000","last_became_peered":"2023-10-06T04:37:17.545899+0000","last_unstale":"2023-10-06T04:37:17.552103+0000","last_undegraded":"2023-10-06T04:37:17.552103+0000","last_fullsized":"2023-10-06T04:37:17.552103+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:35.648661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.531685+0000","last_change":"2023-10-06T04:37:16.539739+0000","last_active":"2023-10-06T04:37:17.531685+0000","last_peered":"2023-10-06T04:37:17.531685+0000","last_clean":"2023-10-06T04:37:17.531685+0000","last_became_active":"2023-10-06T04:37:16.539470+0000","last_became_peered":"2023-10-06T04:37:16.539470+0000","last_unstale":"2023-10-06T04:37:17.531685+0000","last_undegraded":"2023-10-06T04:37:17.531685+0000","last_fullsized":"2023-10-06T04:37:17.531685+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:23.078870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549594+0000","last_change":"2023-10-06T04:37:17.543287+0000","last_active":"2023-10-06T04:37:17.549594+0000","last_peered":"2023-10-06T04:37:17.549594+0000","last_clean":"2023-10-06T04:37:17.549594+0000","last_became_active":"2023-10-06T04:37:17.543018+0000","last_became_peered":"2023-10-06T04:37:17.543018+0000","last_unstale":"2023-10-06T04:37:17.549594+0000","last_undegraded":"2023-10-06T04:37:17.549594+0000","last_fullsized":"2023-10-06T04:37:17.549594+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:18.119835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"37'3","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.560164+0000","last_change":"2023-10-06T04:37:16.545863+0000","last_active":"2023-10-06T04:37:17.560164+0000","last_peered":"2023-10-06T04:37:17.560164+0000","last_clean":"2023-10-06T04:37:17.560164+0000","last_became_active":"2023-10-06T04:37:16.545563+0000","last_became_peered":"2023-10-06T04:37:16.545563+0000","last_unstale":"2023-10-06T04:37:17.560164+0000","last_undegraded":"2023-10-06T04:37:17.560164+0000","last_fullsized":"2023-10-06T04:37:17.560164+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:36.947789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.542752+0000","last_change":"2023-10-06T04:37:17.541763+0000","last_active":"2023-10-06T04:37:17.542752+0000","last_peered":"2023-10-06T04:37:17.542752+0000","last_clean":"2023-10-06T04:37:17.542752+0000","last_became_active":"2023-10-06T04:37:17.541287+0000","last_became_peered":"2023-10-06T04:37:17.541287+0000","last_unstale":"2023-10-06T04:37:17.542752+0000","last_undegraded":"2023-10-06T04:37:17.542752+0000","last_fullsized":"2023-10-06T04:37:17.542752+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:34.429052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"37'6","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.564486+0000","last_change":"2023-10-06T04:37:16.538841+0000","last_active":"2023-10-06T04:37:17.564486+0000","last_peered":"2023-10-06T04:37:17.564486+0000","last_clean":"2023-10-06T04:37:17.564486+0000","last_became_active":"2023-10-06T04:37:16.538555+0000","last_became_peered":"2023-10-06T04:37:16.538555+0000","last_unstale":"2023-10-06T04:37:17.564486+0000","last_undegraded":"2023-10-06T04:37:17.564486+0000","last_fullsized":"2023-10-06T04:37:17.564486+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:01:56.504476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.559583+0000","last_change":"2023-10-06T04:37:17.554238+0000","last_active":"2023-10-06T04:37:17.559583+0000","last_peered":"2023-10-06T04:37:17.559583+0000","last_clean":"2023-10-06T04:37:17.559583+0000","last_became_active":"2023-10-06T04:37:17.553995+0000","last_became_peered":"2023-10-06T04:37:17.553995+0000","last_unstale":"2023-10-06T04:37:17.559583+0000","last_undegraded":"2023-10-06T04:37:17.559583+0000","last_fullsized":"2023-10-06T04:37:17.559583+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:57.066657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.562257+0000","last_change":"2023-10-06T04:37:16.545424+0000","last_active":"2023-10-06T04:37:17.562257+0000","last_peered":"2023-10-06T04:37:17.562257+0000","last_clean":"2023-10-06T04:37:17.562257+0000","last_became_active":"2023-10-06T04:37:16.545158+0000","last_became_peered":"2023-10-06T04:37:16.545158+0000","last_unstale":"2023-10-06T04:37:17.562257+0000","last_undegraded":"2023-10-06T04:37:17.562257+0000","last_fullsized":"2023-10-06T04:37:17.562257+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:03.969778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549756+0000","last_change":"2023-10-06T04:37:17.543599+0000","last_active":"2023-10-06T04:37:17.549756+0000","last_peered":"2023-10-06T04:37:17.549756+0000","last_clean":"2023-10-06T04:37:17.549756+0000","last_became_active":"2023-10-06T04:37:17.543271+0000","last_became_peered":"2023-10-06T04:37:17.543271+0000","last_unstale":"2023-10-06T04:37:17.549756+0000","last_undegraded":"2023-10-06T04:37:17.549756+0000","last_fullsized":"2023-10-06T04:37:17.549756+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:37.661915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.540125+0000","last_change":"2023-10-06T04:37:16.541456+0000","last_active":"2023-10-06T04:37:17.540125+0000","last_peered":"2023-10-06T04:37:17.540125+0000","last_clean":"2023-10-06T04:37:17.540125+0000","last_became_active":"2023-10-06T04:37:16.541189+0000","last_became_peered":"2023-10-06T04:37:16.541189+0000","last_unstale":"2023-10-06T04:37:17.540125+0000","last_undegraded":"2023-10-06T04:37:17.540125+0000","last_fullsized":"2023-10-06T04:37:17.540125+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:23.078870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.548756+0000","last_change":"2023-10-06T04:37:17.541658+0000","last_active":"2023-10-06T04:37:17.548756+0000","last_peered":"2023-10-06T04:37:17.548756+0000","last_clean":"2023-10-06T04:37:17.548756+0000","last_became_active":"2023-10-06T04:37:17.541349+0000","last_became_peered":"2023-10-06T04:37:17.541349+0000","last_unstale":"2023-10-06T04:37:17.548756+0000","last_undegraded":"2023-10-06T04:37:17.548756+0000","last_fullsized":"2023-10-06T04:37:17.548756+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:56.687459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.537371+0000","last_change":"2023-10-06T04:37:16.545596+0000","last_active":"2023-10-06T04:37:17.537371+0000","last_peered":"2023-10-06T04:37:17.537371+0000","last_clean":"2023-10-06T04:37:17.537371+0000","last_became_active":"2023-10-06T04:37:16.545334+0000","last_became_peered":"2023-10-06T04:37:16.545334+0000","last_unstale":"2023-10-06T04:37:17.537371+0000","last_undegraded":"2023-10-06T04:37:17.537371+0000","last_fullsized":"2023-10-06T04:37:17.537371+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:26.079570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.556742+0000","last_change":"2023-10-06T04:37:17.552402+0000","last_active":"2023-10-06T04:37:17.556742+0000","last_peered":"2023-10-06T04:37:17.556742+0000","last_clean":"2023-10-06T04:37:17.556742+0000","last_became_active":"2023-10-06T04:37:17.552167+0000","last_became_peered":"2023-10-06T04:37:17.552167+0000","last_unstale":"2023-10-06T04:37:17.556742+0000","last_undegraded":"2023-10-06T04:37:17.556742+0000","last_fullsized":"2023-10-06T04:37:17.556742+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:14.023722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"37'8","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.564355+0000","last_change":"2023-10-06T04:37:16.545180+0000","last_active":"2023-10-06T04:37:17.564355+0000","last_peered":"2023-10-06T04:37:17.564355+0000","last_clean":"2023-10-06T04:37:17.564355+0000","last_became_active":"2023-10-06T04:37:16.544707+0000","last_became_peered":"2023-10-06T04:37:16.544707+0000","last_unstale":"2023-10-06T04:37:17.564355+0000","last_undegraded":"2023-10-06T04:37:17.564355+0000","last_fullsized":"2023-10-06T04:37:17.564355+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:49.969750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549763+0000","last_change":"2023-10-06T04:37:17.545469+0000","last_active":"2023-10-06T04:37:17.549763+0000","last_peered":"2023-10-06T04:37:17.549763+0000","last_clean":"2023-10-06T04:37:17.549763+0000","last_became_active":"2023-10-06T04:37:17.545212+0000","last_became_peered":"2023-10-06T04:37:17.545212+0000","last_unstale":"2023-10-06T04:37:17.549763+0000","last_undegraded":"2023-10-06T04:37:17.549763+0000","last_fullsized":"2023-10-06T04:37:17.549763+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:41.211245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"37'1","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.561399+0000","last_change":"2023-10-06T04:37:16.537956+0000","last_active":"2023-10-06T04:37:17.561399+0000","last_peered":"2023-10-06T04:37:17.561399+0000","last_clean":"2023-10-06T04:37:17.561399+0000","last_became_active":"2023-10-06T04:37:16.537733+0000","last_became_peered":"2023-10-06T04:37:16.537733+0000","last_unstale":"2023-10-06T04:37:17.561399+0000","last_undegraded":"2023-10-06T04:37:17.561399+0000","last_fullsized":"2023-10-06T04:37:17.561399+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:26:53.482793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549641+0000","last_change":"2023-10-06T04:37:17.540242+0000","last_active":"2023-10-06T04:37:17.549641+0000","last_peered":"2023-10-06T04:37:17.549641+0000","last_clean":"2023-10-06T04:37:17.549641+0000","last_became_active":"2023-10-06T04:37:17.539986+0000","last_became_peered":"2023-10-06T04:37:17.539986+0000","last_unstale":"2023-10-06T04:37:17.549641+0000","last_undegraded":"2023-10-06T04:37:17.549641+0000","last_fullsized":"2023-10-06T04:37:17.549641+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:50:28.268338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.564213+0000","last_change":"2023-10-06T04:37:16.541934+0000","last_active":"2023-10-06T04:37:17.564213+0000","last_peered":"2023-10-06T04:37:17.564213+0000","last_clean":"2023-10-06T04:37:17.564213+0000","last_became_active":"2023-10-06T04:37:16.539725+0000","last_became_peered":"2023-10-06T04:37:16.539725+0000","last_unstale":"2023-10-06T04:37:17.564213+0000","last_undegraded":"2023-10-06T04:37:17.564213+0000","last_fullsized":"2023-10-06T04:37:17.564213+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:44:55.156828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.556848+0000","last_change":"2023-10-06T04:37:17.550239+0000","last_active":"2023-10-06T04:37:17.556848+0000","last_peered":"2023-10-06T04:37:17.556848+0000","last_clean":"2023-10-06T04:37:17.556848+0000","last_became_active":"2023-10-06T04:37:17.549997+0000","last_became_peered":"2023-10-06T04:37:17.549997+0000","last_unstale":"2023-10-06T04:37:17.556848+0000","last_undegraded":"2023-10-06T04:37:17.556848+0000","last_fullsized":"2023-10-06T04:37:17.556848+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:24.083076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"37'1","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.564286+0000","last_change":"2023-10-06T04:37:16.544014+0000","last_active":"2023-10-06T04:37:17.564286+0000","last_peered":"2023-10-06T04:37:17.564286+0000","last_clean":"2023-10-06T04:37:17.564286+0000","last_became_active":"2023-10-06T04:37:16.543718+0000","last_became_peered":"2023-10-06T04:37:16.543718+0000","last_unstale":"2023-10-06T04:37:17.564286+0000","last_undegraded":"2023-10-06T04:37:17.564286+0000","last_fullsized":"2023-10-06T04:37:17.564286+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:39.796065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.558591+0000","last_change":"2023-10-06T04:37:17.551493+0000","last_active":"2023-10-06T04:37:17.558591+0000","last_peered":"2023-10-06T04:37:17.558591+0000","last_clean":"2023-10-06T04:37:17.558591+0000","last_became_active":"2023-10-06T04:37:17.550988+0000","last_became_peered":"2023-10-06T04:37:17.550988+0000","last_unstale":"2023-10-06T04:37:17.558591+0000","last_undegraded":"2023-10-06T04:37:17.558591+0000","last_fullsized":"2023-10-06T04:37:17.558591+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:33.731628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.533817+0000","last_change":"2023-10-06T04:37:16.537845+0000","last_active":"2023-10-06T04:37:17.533817+0000","last_peered":"2023-10-06T04:37:17.533817+0000","last_clean":"2023-10-06T04:37:17.533817+0000","last_became_active":"2023-10-06T04:37:16.537568+0000","last_became_peered":"2023-10-06T04:37:16.537568+0000","last_unstale":"2023-10-06T04:37:17.533817+0000","last_undegraded":"2023-10-06T04:37:17.533817+0000","last_fullsized":"2023-10-06T04:37:17.533817+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:43.624572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.548653+0000","last_change":"2023-10-06T04:37:17.538502+0000","last_active":"2023-10-06T04:37:17.548653+0000","last_peered":"2023-10-06T04:37:17.548653+0000","last_clean":"2023-10-06T04:37:17.548653+0000","last_became_active":"2023-10-06T04:37:17.538215+0000","last_became_peered":"2023-10-06T04:37:17.538215+0000","last_unstale":"2023-10-06T04:37:17.548653+0000","last_undegraded":"2023-10-06T04:37:17.548653+0000","last_fullsized":"2023-10-06T04:37:17.548653+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:45.225371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.563499+0000","last_change":"2023-10-06T04:37:16.540351+0000","last_active":"2023-10-06T04:37:17.563499+0000","last_peered":"2023-10-06T04:37:17.563499+0000","last_clean":"2023-10-06T04:37:17.563499+0000","last_became_active":"2023-10-06T04:37:16.539257+0000","last_became_peered":"2023-10-06T04:37:16.539257+0000","last_unstale":"2023-10-06T04:37:17.563499+0000","last_undegraded":"2023-10-06T04:37:17.563499+0000","last_fullsized":"2023-10-06T04:37:17.563499+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:33.424846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549765+0000","last_change":"2023-10-06T04:37:17.546443+0000","last_active":"2023-10-06T04:37:17.549765+0000","last_peered":"2023-10-06T04:37:17.549765+0000","last_clean":"2023-10-06T04:37:17.549765+0000","last_became_active":"2023-10-06T04:37:17.546233+0000","last_became_peered":"2023-10-06T04:37:17.546233+0000","last_unstale":"2023-10-06T04:37:17.549765+0000","last_undegraded":"2023-10-06T04:37:17.549765+0000","last_fullsized":"2023-10-06T04:37:17.549765+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:41.211245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.541489+0000","last_change":"2023-10-06T04:37:16.545188+0000","last_active":"2023-10-06T04:37:17.541489+0000","last_peered":"2023-10-06T04:37:17.541489+0000","last_clean":"2023-10-06T04:37:17.541489+0000","last_became_active":"2023-10-06T04:37:16.544735+0000","last_became_peered":"2023-10-06T04:37:16.544735+0000","last_unstale":"2023-10-06T04:37:17.541489+0000","last_undegraded":"2023-10-06T04:37:17.541489+0000","last_fullsized":"2023-10-06T04:37:17.541489+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:56.062450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549922+0000","last_change":"2023-10-06T04:37:17.544085+0000","last_active":"2023-10-06T04:37:17.549922+0000","last_peered":"2023-10-06T04:37:17.549922+0000","last_clean":"2023-10-06T04:37:17.549922+0000","last_became_active":"2023-10-06T04:37:17.543802+0000","last_became_peered":"2023-10-06T04:37:17.543802+0000","last_unstale":"2023-10-06T04:37:17.549922+0000","last_undegraded":"2023-10-06T04:37:17.549922+0000","last_fullsized":"2023-10-06T04:37:17.549922+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:31.578985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.530332+0000","last_change":"2023-10-06T04:37:16.539674+0000","last_active":"2023-10-06T04:37:17.530332+0000","last_peered":"2023-10-06T04:37:17.530332+0000","last_clean":"2023-10-06T04:37:17.530332+0000","last_became_active":"2023-10-06T04:37:16.539399+0000","last_became_peered":"2023-10-06T04:37:16.539399+0000","last_unstale":"2023-10-06T04:37:17.530332+0000","last_undegraded":"2023-10-06T04:37:17.530332+0000","last_fullsized":"2023-10-06T04:37:17.530332+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:36.947789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.539951+0000","last_change":"2023-10-06T04:37:17.536857+0000","last_active":"2023-10-06T04:37:17.539951+0000","last_peered":"2023-10-06T04:37:17.539951+0000","last_clean":"2023-10-06T04:37:17.539951+0000","last_became_active":"2023-10-06T04:37:17.536593+0000","last_became_peered":"2023-10-06T04:37:17.536593+0000","last_unstale":"2023-10-06T04:37:17.539951+0000","last_undegraded":"2023-10-06T04:37:17.539951+0000","last_fullsized":"2023-10-06T04:37:17.539951+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:37.253030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.536713+0000","last_change":"2023-10-06T04:37:16.541430+0000","last_active":"2023-10-06T04:37:17.536713+0000","last_peered":"2023-10-06T04:37:17.536713+0000","last_clean":"2023-10-06T04:37:17.536713+0000","last_became_active":"2023-10-06T04:37:16.541211+0000","last_became_peered":"2023-10-06T04:37:16.541211+0000","last_unstale":"2023-10-06T04:37:17.536713+0000","last_undegraded":"2023-10-06T04:37:17.536713+0000","last_fullsized":"2023-10-06T04:37:17.536713+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:15:48.328371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549503+0000","last_change":"2023-10-06T04:37:17.541674+0000","last_active":"2023-10-06T04:37:17.549503+0000","last_peered":"2023-10-06T04:37:17.549503+0000","last_clean":"2023-10-06T04:37:17.549503+0000","last_became_active":"2023-10-06T04:37:17.541397+0000","last_became_peered":"2023-10-06T04:37:17.541397+0000","last_unstale":"2023-10-06T04:37:17.549503+0000","last_undegraded":"2023-10-06T04:37:17.549503+0000","last_fullsized":"2023-10-06T04:37:17.549503+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:19.011564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.532055+0000","last_change":"2023-10-06T04:37:16.539297+0000","last_active":"2023-10-06T04:37:17.532055+0000","last_peered":"2023-10-06T04:37:17.532055+0000","last_clean":"2023-10-06T04:37:17.532055+0000","last_became_active":"2023-10-06T04:37:16.538921+0000","last_became_peered":"2023-10-06T04:37:16.538921+0000","last_unstale":"2023-10-06T04:37:17.532055+0000","last_undegraded":"2023-10-06T04:37:17.532055+0000","last_fullsized":"2023-10-06T04:37:17.532055+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:26.079570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.532959+0000","last_change":"2023-10-06T04:36:11.192215+0000","last_active":"2023-10-06T04:37:17.532959+0000","last_peered":"2023-10-06T04:37:17.532959+0000","last_clean":"2023-10-06T04:37:17.532959+0000","last_became_active":"2023-10-06T04:36:11.191953+0000","last_became_peered":"2023-10-06T04:36:11.191953+0000","last_unstale":"2023-10-06T04:37:17.532959+0000","last_undegraded":"2023-10-06T04:37:17.532959+0000","last_fullsized":"2023-10-06T04:37:17.532959+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:37.026121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.545848+0000","last_change":"2023-10-06T04:37:17.536572+0000","last_active":"2023-10-06T04:37:17.545848+0000","last_peered":"2023-10-06T04:37:17.545848+0000","last_clean":"2023-10-06T04:37:17.545848+0000","last_became_active":"2023-10-06T04:37:17.536250+0000","last_became_peered":"2023-10-06T04:37:17.536250+0000","last_unstale":"2023-10-06T04:37:17.545848+0000","last_undegraded":"2023-10-06T04:37:17.545848+0000","last_fullsized":"2023-10-06T04:37:17.545848+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:16.140442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.538072+0000","last_change":"2023-10-06T04:37:16.542301+0000","last_active":"2023-10-06T04:37:17.538072+0000","last_peered":"2023-10-06T04:37:17.538072+0000","last_clean":"2023-10-06T04:37:17.538072+0000","last_became_active":"2023-10-06T04:37:16.541967+0000","last_became_peered":"2023-10-06T04:37:16.541967+0000","last_unstale":"2023-10-06T04:37:17.538072+0000","last_undegraded":"2023-10-06T04:37:17.538072+0000","last_fullsized":"2023-10-06T04:37:17.538072+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:24.703451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.533920+0000","last_change":"2023-10-06T04:36:11.184555+0000","last_active":"2023-10-06T04:37:17.533920+0000","last_peered":"2023-10-06T04:37:17.533920+0000","last_clean":"2023-10-06T04:37:17.533920+0000","last_became_active":"2023-10-06T04:36:11.184229+0000","last_became_peered":"2023-10-06T04:36:11.184229+0000","last_unstale":"2023-10-06T04:37:17.533920+0000","last_undegraded":"2023-10-06T04:37:17.533920+0000","last_fullsized":"2023-10-06T04:37:17.533920+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:19.938716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.552210+0000","last_change":"2023-10-06T04:37:17.548551+0000","last_active":"2023-10-06T04:37:17.552210+0000","last_peered":"2023-10-06T04:37:17.552210+0000","last_clean":"2023-10-06T04:37:17.552210+0000","last_became_active":"2023-10-06T04:37:17.548252+0000","last_became_peered":"2023-10-06T04:37:17.548252+0000","last_unstale":"2023-10-06T04:37:17.552210+0000","last_undegraded":"2023-10-06T04:37:17.552210+0000","last_fullsized":"2023-10-06T04:37:17.552210+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:23.847066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.530972+0000","last_change":"2023-10-06T04:37:16.546270+0000","last_active":"2023-10-06T04:37:17.530972+0000","last_peered":"2023-10-06T04:37:17.530972+0000","last_clean":"2023-10-06T04:37:17.530972+0000","last_became_active":"2023-10-06T04:37:16.545969+0000","last_became_peered":"2023-10-06T04:37:16.545969+0000","last_unstale":"2023-10-06T04:37:17.530972+0000","last_undegraded":"2023-10-06T04:37:17.530972+0000","last_fullsized":"2023-10-06T04:37:17.530972+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:37.190837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.531623+0000","last_change":"2023-10-06T04:36:11.184460+0000","last_active":"2023-10-06T04:37:17.531623+0000","last_peered":"2023-10-06T04:37:17.531623+0000","last_clean":"2023-10-06T04:37:17.531623+0000","last_became_active":"2023-10-06T04:36:11.184119+0000","last_became_peered":"2023-10-06T04:36:11.184119+0000","last_unstale":"2023-10-06T04:37:17.531623+0000","last_undegraded":"2023-10-06T04:37:17.531623+0000","last_fullsized":"2023-10-06T04:37:17.531623+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:37.026121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":175,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.536882+0000","last_change":"2023-10-06T04:36:12.183155+0000","last_active":"2023-10-06T04:37:17.536882+0000","last_peered":"2023-10-06T04:37:17.536882+0000","last_clean":"2023-10-06T04:37:17.536882+0000","last_became_active":"2023-10-06T04:36:12.182903+0000","last_became_peered":"2023-10-06T04:36:12.182903+0000","last_unstale":"2023-10-06T04:37:17.536882+0000","last_undegraded":"2023-10-06T04:37:17.536882+0000","last_fullsized":"2023-10-06T04:37:17.536882+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:11.171104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:11.171104+0000","last_clean_scrub_stamp":"2023-10-06T04:36:11.171104+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:38:54.323364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.548273+0000","last_change":"2023-10-06T04:37:17.537793+0000","last_active":"2023-10-06T04:37:17.548273+0000","last_peered":"2023-10-06T04:37:17.548273+0000","last_clean":"2023-10-06T04:37:17.548273+0000","last_became_active":"2023-10-06T04:37:17.537503+0000","last_became_peered":"2023-10-06T04:37:17.537503+0000","last_unstale":"2023-10-06T04:37:17.548273+0000","last_undegraded":"2023-10-06T04:37:17.548273+0000","last_fullsized":"2023-10-06T04:37:17.548273+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:19.011564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.537750+0000","last_change":"2023-10-06T04:37:16.545879+0000","last_active":"2023-10-06T04:37:17.537750+0000","last_peered":"2023-10-06T04:37:17.537750+0000","last_clean":"2023-10-06T04:37:17.537750+0000","last_became_active":"2023-10-06T04:37:16.545603+0000","last_became_peered":"2023-10-06T04:37:16.545603+0000","last_unstale":"2023-10-06T04:37:17.537750+0000","last_undegraded":"2023-10-06T04:37:17.537750+0000","last_fullsized":"2023-10-06T04:37:17.537750+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:40.207039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.540168+0000","last_change":"2023-10-06T04:36:11.193056+0000","last_active":"2023-10-06T04:37:17.540168+0000","last_peered":"2023-10-06T04:37:17.540168+0000","last_clean":"2023-10-06T04:37:17.540168+0000","last_became_active":"2023-10-06T04:36:11.192712+0000","last_became_peered":"2023-10-06T04:36:11.192712+0000","last_unstale":"2023-10-06T04:37:17.540168+0000","last_undegraded":"2023-10-06T04:37:17.540168+0000","last_fullsized":"2023-10-06T04:37:17.540168+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:00.008654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.549941+0000","last_change":"2023-10-06T04:37:17.547978+0000","last_active":"2023-10-06T04:37:17.549941+0000","last_peered":"2023-10-06T04:37:17.549941+0000","last_clean":"2023-10-06T04:37:17.549941+0000","last_became_active":"2023-10-06T04:37:17.547342+0000","last_became_peered":"2023-10-06T04:37:17.547342+0000","last_unstale":"2023-10-06T04:37:17.549941+0000","last_undegraded":"2023-10-06T04:37:17.549941+0000","last_fullsized":"2023-10-06T04:37:17.549941+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:12.970309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.561292+0000","last_change":"2023-10-06T04:37:16.544363+0000","last_active":"2023-10-06T04:37:17.561292+0000","last_peered":"2023-10-06T04:37:17.561292+0000","last_clean":"2023-10-06T04:37:17.561292+0000","last_became_active":"2023-10-06T04:37:16.544100+0000","last_became_peered":"2023-10-06T04:37:16.544100+0000","last_unstale":"2023-10-06T04:37:17.561292+0000","last_undegraded":"2023-10-06T04:37:17.561292+0000","last_fullsized":"2023-10-06T04:37:17.561292+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:24.703451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.536800+0000","last_change":"2023-10-06T04:36:11.192701+0000","last_active":"2023-10-06T04:37:17.536800+0000","last_peered":"2023-10-06T04:37:17.536800+0000","last_clean":"2023-10-06T04:37:17.536800+0000","last_became_active":"2023-10-06T04:36:11.192335+0000","last_became_peered":"2023-10-06T04:36:11.192335+0000","last_unstale":"2023-10-06T04:37:17.536800+0000","last_undegraded":"2023-10-06T04:37:17.536800+0000","last_fullsized":"2023-10-06T04:37:17.536800+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:18.643570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.558650+0000","last_change":"2023-10-06T04:37:17.551353+0000","last_active":"2023-10-06T04:37:17.558650+0000","last_peered":"2023-10-06T04:37:17.558650+0000","last_clean":"2023-10-06T04:37:17.558650+0000","last_became_active":"2023-10-06T04:37:17.550655+0000","last_became_peered":"2023-10-06T04:37:17.550655+0000","last_unstale":"2023-10-06T04:37:17.558650+0000","last_undegraded":"2023-10-06T04:37:17.558650+0000","last_fullsized":"2023-10-06T04:37:17.558650+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:37.951996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T04:37:19.533140+0000","last_change":"2023-10-06T04:37:16.541672+0000","last_active":"2023-10-06T04:37:19.533140+0000","last_peered":"2023-10-06T04:37:19.533140+0000","last_clean":"2023-10-06T04:37:19.533140+0000","last_became_active":"2023-10-06T04:37:16.541369+0000","last_became_peered":"2023-10-06T04:37:16.541369+0000","last_unstale":"2023-10-06T04:37:19.533140+0000","last_undegraded":"2023-10-06T04:37:19.533140+0000","last_fullsized":"2023-10-06T04:37:19.533140+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:34.644455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.541962+0000","last_change":"2023-10-06T04:36:11.193497+0000","last_active":"2023-10-06T04:37:17.541962+0000","last_peered":"2023-10-06T04:37:17.541962+0000","last_clean":"2023-10-06T04:37:17.541962+0000","last_became_active":"2023-10-06T04:36:11.193215+0000","last_became_peered":"2023-10-06T04:36:11.193215+0000","last_unstale":"2023-10-06T04:37:17.541962+0000","last_undegraded":"2023-10-06T04:37:17.541962+0000","last_fullsized":"2023-10-06T04:37:17.541962+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:07.497987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.554313+0000","last_change":"2023-10-06T04:37:17.548282+0000","last_active":"2023-10-06T04:37:17.554313+0000","last_peered":"2023-10-06T04:37:17.554313+0000","last_clean":"2023-10-06T04:37:17.554313+0000","last_became_active":"2023-10-06T04:37:17.548037+0000","last_became_peered":"2023-10-06T04:37:17.548037+0000","last_unstale":"2023-10-06T04:37:17.554313+0000","last_undegraded":"2023-10-06T04:37:17.554313+0000","last_fullsized":"2023-10-06T04:37:17.554313+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:44:56.161035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.531161+0000","last_change":"2023-10-06T04:37:16.539573+0000","last_active":"2023-10-06T04:37:17.531161+0000","last_peered":"2023-10-06T04:37:17.531161+0000","last_clean":"2023-10-06T04:37:17.531161+0000","last_became_active":"2023-10-06T04:37:16.539271+0000","last_became_peered":"2023-10-06T04:37:16.539271+0000","last_unstale":"2023-10-06T04:37:17.531161+0000","last_undegraded":"2023-10-06T04:37:17.531161+0000","last_fullsized":"2023-10-06T04:37:17.531161+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:06:23.075116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":25,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.541426+0000","last_change":"2023-10-06T04:36:11.193111+0000","last_active":"2023-10-06T04:37:17.541426+0000","last_peered":"2023-10-06T04:37:17.541426+0000","last_clean":"2023-10-06T04:37:17.541426+0000","last_became_active":"2023-10-06T04:36:11.192836+0000","last_became_peered":"2023-10-06T04:36:11.192836+0000","last_unstale":"2023-10-06T04:37:17.541426+0000","last_undegraded":"2023-10-06T04:37:17.541426+0000","last_fullsized":"2023-10-06T04:37:17.541426+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:19.938716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.553107+0000","last_change":"2023-10-06T04:37:17.546750+0000","last_active":"2023-10-06T04:37:17.553107+0000","last_peered":"2023-10-06T04:37:17.553107+0000","last_clean":"2023-10-06T04:37:17.553107+0000","last_became_active":"2023-10-06T04:37:17.546467+0000","last_became_peered":"2023-10-06T04:37:17.546467+0000","last_unstale":"2023-10-06T04:37:17.553107+0000","last_undegraded":"2023-10-06T04:37:17.553107+0000","last_fullsized":"2023-10-06T04:37:17.553107+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:58.928454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.534634+0000","last_change":"2023-10-06T04:37:16.544678+0000","last_active":"2023-10-06T04:37:17.534634+0000","last_peered":"2023-10-06T04:37:17.534634+0000","last_clean":"2023-10-06T04:37:17.534634+0000","last_became_active":"2023-10-06T04:37:16.541041+0000","last_became_peered":"2023-10-06T04:37:16.541041+0000","last_unstale":"2023-10-06T04:37:17.534634+0000","last_undegraded":"2023-10-06T04:37:17.534634+0000","last_fullsized":"2023-10-06T04:37:17.534634+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:15:48.328371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":25,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:37:17.541438+0000","last_change":"2023-10-06T04:36:11.182804+0000","last_active":"2023-10-06T04:37:17.541438+0000","last_peered":"2023-10-06T04:37:17.541438+0000","last_clean":"2023-10-06T04:37:17.541438+0000","last_became_active":"2023-10-06T04:36:11.182575+0000","last_became_peered":"2023-10-06T04:36:11.182575+0000","last_unstale":"2023-10-06T04:37:17.541438+0000","last_undegraded":"2023-10-06T04:37:17.541438+0000","last_fullsized":"2023-10-06T04:37:17.541438+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:07.497987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298300,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073540,"statfs":{"total":96636764160,"available":96331304960,"internally_reserved":0,"allocated":1036288,"data_stored":785402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.372}]},{"osd":1,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.29199999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.52800000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.56000000000000005}]},{"osd":4,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.51900000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.40799999999999997}]},{"osd":6,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.49399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297724,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074116,"statfs":{"total":96636764160,"available":96331894784,"internally_reserved":0,"allocated":446464,"data_stored":195588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.437},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":10.045999999999999,"5min":10.045999999999999,"15min":10.045999999999999},"last":0.57599999999999996}]},{"osd":1,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":10.125999999999999,"5min":10.125999999999999,"15min":10.125999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.54600000000000004}]},{"osd":2,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.503},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":10.238,"5min":10.238,"15min":10.238},"last":0.41699999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":4.4870000000000001,"5min":4.4870000000000001,"15min":4.4870000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":10.393000000000001,"5min":10.393000000000001,"15min":10.393000000000001},"last":0.60899999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.625}]},{"osd":5,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.64900000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.63800000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298288,"kb_used_data":1000,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073552,"statfs":{"total":96636764160,"available":96331317248,"internally_reserved":0,"allocated":1024000,"data_stored":778421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.23100000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.309}]},{"osd":2,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.28799999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.38200000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.52500000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.497},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.51300000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.53700000000000003}]},{"osd":7,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.55100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":425984,"data_stored":187039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.443,"5min":0.443,"15min":0.443},"last":0.25900000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.313}]},{"osd":3,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.377}]},{"osd":4,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.42599999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.49199999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.55100000000000005}]},{"osd":7,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.623},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.45900000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":450560,"data_stored":195524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.46500000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.495},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.505}]},{"osd":3,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.52000000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.57299999999999995}]},{"osd":5,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.72399999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.70199999999999996}]},{"osd":7,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.66200000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297724,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074116,"statfs":{"total":96636764160,"available":96331894784,"internally_reserved":0,"allocated":446464,"data_stored":194576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.246},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.442,"5min":0.442,"15min":0.442},"last":0.33700000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.436,"5min":0.436,"15min":0.436},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.40200000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.36399999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.1070000000000002,"5min":2.1070000000000002,"15min":2.1070000000000002},"last":0.627}]},{"osd":5,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.66400000000000003}]},{"osd":6,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.751}]},{"osd":7,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.69599999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":450560,"data_stored":196480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":4.2919999999999998,"5min":4.2919999999999998,"15min":4.2919999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.69499999999999995}]},{"osd":1,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":4.3520000000000003,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":0.61399999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.66800000000000004}]},{"osd":3,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.67800000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.55900000000000005}]},{"osd":6,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.58499999999999996}]},{"osd":7,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.501},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.48499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297708,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074132,"statfs":{"total":96636764160,"available":96331911168,"internally_reserved":0,"allocated":430080,"data_stored":188053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":1.071},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":2.0310000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":3.6949999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":3.5499999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":1.994},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":2.1640000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":2.2290000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.92200000000000004}]},{"osd":6,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":1.7010000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.88500000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":2.1190000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:37:22.047 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T04:37:22.048 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T04:37:22.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.206+0000 7f96d288a700 1 Processor -- start 2023-10-06T04:37:22.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.206+0000 7f96d288a700 1 -- start start 2023-10-06T04:37:22.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.207+0000 7f96d288a700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f96cc1430c0 0x7f96cc0cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:22.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.207+0000 7f96d288a700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96cc0cf510 con 0x7f96cc142cf0 2023-10-06T04:37:22.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.207+0000 7f96d288a700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96cc0ce6a0 con 0x7f96cc0cfee0 2023-10-06T04:37:22.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.207+0000 7f96d288a700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96cc0ce900 con 0x7f96cc1430c0 2023-10-06T04:37:22.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.207+0000 7f96cbfff700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f96cc142cf0 0x7f96cc0b5cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:40300/0 (socket says 172.21.15.8:40300) 2023-10-06T04:37:22.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.207+0000 7f96cbfff700 1 -- 172.21.15.8:0/3220828262 learned_addr learned my addr 172.21.15.8:0/3220828262 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:22.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.207+0000 7f96cb7fe700 1 --2- 172.21.15.8:0/3220828262 >> v2:172.21.15.184:3300/0 conn(0x7f96cc1430c0 0x7f96cc0cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:22.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.208+0000 7f96caffd700 1 -- 172.21.15.8:0/3220828262 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1877574317 0 0) 0x7f96cc0cf510 con 0x7f96cc142cf0 2023-10-06T04:37:22.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.208+0000 7f96caffd700 1 -- 172.21.15.8:0/3220828262 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96b4003570 con 0x7f96cc142cf0 2023-10-06T04:37:22.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.208+0000 7f96caffd700 1 -- 172.21.15.8:0/3220828262 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1946652324 0 0) 0x7f96b4003570 con 0x7f96cc142cf0 2023-10-06T04:37:22.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.208+0000 7f96caffd700 1 -- 172.21.15.8:0/3220828262 >> v2:172.21.15.184:3300/0 conn(0x7f96cc1430c0 msgr2=0x7f96cc0cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:22.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.208+0000 7f96caffd700 1 --2- 172.21.15.8:0/3220828262 >> v2:172.21.15.184:3300/0 conn(0x7f96cc1430c0 0x7f96cc0cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:22.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.208+0000 7f96caffd700 1 -- 172.21.15.8:0/3220828262 >> v1:172.21.15.184:6789/0 conn(0x7f96cc0cfee0 legacy=0x7f96cc0b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:22.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.208+0000 7f96caffd700 1 -- 172.21.15.8:0/3220828262 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96cc0cebe0 con 0x7f96cc142cf0 2023-10-06T04:37:22.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.208+0000 7f96caffd700 1 -- 172.21.15.8:0/3220828262 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7f96bc001470 con 0x7f96cc142cf0 2023-10-06T04:37:22.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.208+0000 7f96caffd700 1 -- 172.21.15.8:0/3220828262 >> v1:172.21.15.8:6789/0 conn(0x7f96cc142cf0 legacy=0x7f96cc0b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:22.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.208+0000 7f96caffd700 1 --2- 172.21.15.8:0/3220828262 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96b4003a60 0x7f96b4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:22.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.208+0000 7f96caffd700 1 --2- 172.21.15.8:0/3220828262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96b4004810 0x7f96b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:22.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.208+0000 7f96caffd700 1 --2- 172.21.15.8:0/3220828262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96b40051c0 0x7f96b400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:22.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.208+0000 7f96caffd700 1 -- 172.21.15.8:0/3220828262 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc0ce900 con 0x7f96b4004810 2023-10-06T04:37:22.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.208+0000 7f96caffd700 1 -- 172.21.15.8:0/3220828262 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b400c160 con 0x7f96b40051c0 2023-10-06T04:37:22.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.208+0000 7f96caffd700 1 -- 172.21.15.8:0/3220828262 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b400c320 con 0x7f96b4003a60 2023-10-06T04:37:22.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.208+0000 7f96cb7fe700 1 --2- 172.21.15.8:0/3220828262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96b4004810 0x7f96b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:22.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.208+0000 7f96cbfff700 1 --2- 172.21.15.8:0/3220828262 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96b4003a60 0x7f96b4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:22.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.208+0000 7f96d0e27700 1 --2- 172.21.15.8:0/3220828262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96b40051c0 0x7f96b400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:22.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.208+0000 7f96cb7fe700 1 -- 172.21.15.8:0/3220828262 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96b4003a60 msgr2=0x7f96b4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:22.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.208+0000 7f96cb7fe700 1 --2- 172.21.15.8:0/3220828262 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96b4003a60 0x7f96b4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:22.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.208+0000 7f96cb7fe700 1 -- 172.21.15.8:0/3220828262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96b40051c0 msgr2=0x7f96b400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:22.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.208+0000 7f96cb7fe700 1 --2- 172.21.15.8:0/3220828262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96b40051c0 0x7f96b400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:22.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.208+0000 7f96cb7fe700 1 -- 172.21.15.8:0/3220828262 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b4003570 con 0x7f96b4004810 2023-10-06T04:37:22.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.208+0000 7f96d0e27700 1 -- 172.21.15.8:0/3220828262 reap_dead start 2023-10-06T04:37:22.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.208+0000 7f96cbfff700 1 --2- 172.21.15.8:0/3220828262 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96b4003a60 0x7f96b4003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:22.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.208+0000 7f96cb7fe700 1 --2- 172.21.15.8:0/3220828262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96b4004810 0x7f96b4004c80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f96c0009c00 tx=0x7f96c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1bb9da7a1ed7c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:22.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.209+0000 7f96caffd700 1 -- 172.21.15.8:0/3220828262 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c000e710 con 0x7f96b4004810 2023-10-06T04:37:22.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.209+0000 7f96caffd700 1 -- 172.21.15.8:0/3220828262 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c000e870 con 0x7f96b4004810 2023-10-06T04:37:22.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.209+0000 7f96caffd700 1 -- 172.21.15.8:0/3220828262 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c000ec30 con 0x7f96b4004810 2023-10-06T04:37:22.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.209+0000 7f96d288a700 1 -- 172.21.15.8:0/3220828262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96b4004810 msgr2=0x7f96b4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:22.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.209+0000 7f96d288a700 1 --2- 172.21.15.8:0/3220828262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96b4004810 0x7f96b4004c80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f96c0009c00 tx=0x7f96c00091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:22.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.209+0000 7f96d288a700 1 -- 172.21.15.8:0/3220828262 shutdown_connections 2023-10-06T04:37:22.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.209+0000 7f96d288a700 1 --2- 172.21.15.8:0/3220828262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96b4004810 0x7f96b4004c80 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:22.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.209+0000 7f96d288a700 1 -- 172.21.15.8:0/3220828262 >> 172.21.15.8:0/3220828262 conn(0x7f96cc06ed00 msgr2=0x7f96cc06f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:22.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.209+0000 7f96d288a700 1 -- 172.21.15.8:0/3220828262 shutdown_connections 2023-10-06T04:37:22.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.209+0000 7f96d288a700 1 -- 172.21.15.8:0/3220828262 wait complete. 2023-10-06T04:37:22.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.210+0000 7f96d288a700 1 Processor -- start 2023-10-06T04:37:22.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.210+0000 7f96d288a700 1 -- start start 2023-10-06T04:37:22.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.211+0000 7f96d288a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96b4004810 0x7f96cc16c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:22.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.211+0000 7f96d288a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96cc0a9a60 0x7f96cc0a9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:22.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.211+0000 7f96d288a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96cc0b3f30 0x7f96cc0b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:22.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.211+0000 7f96d288a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc0b4910 con 0x7f96cc0a9a60 2023-10-06T04:37:22.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.211+0000 7f96d288a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc0aa410 con 0x7f96b4004810 2023-10-06T04:37:22.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.211+0000 7f96d288a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc15b110 con 0x7f96cc0b3f30 2023-10-06T04:37:22.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.211+0000 7f96cb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96cc0a9a60 0x7f96cc0a9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:22.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.211+0000 7f96cb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96cc0a9a60 0x7f96cc0a9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35144/0 (socket says 172.21.15.8:35144) 2023-10-06T04:37:22.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.211+0000 7f96cbfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96b4004810 0x7f96cc16c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:22.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.211+0000 7f96cb7fe700 1 -- 172.21.15.8:0/2907997028 learned_addr learned my addr 172.21.15.8:0/2907997028 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:22.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.211+0000 7f96d0e27700 1 --2- 172.21.15.8:0/2907997028 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96cc0b3f30 0x7f96cc0b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:22.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.212+0000 7f96cb7fe700 1 -- 172.21.15.8:0/2907997028 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96cc0b3f30 msgr2=0x7f96cc0b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:22.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.212+0000 7f96cb7fe700 1 --2- 172.21.15.8:0/2907997028 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96cc0b3f30 0x7f96cc0b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:22.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.212+0000 7f96cb7fe700 1 -- 172.21.15.8:0/2907997028 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96b4004810 msgr2=0x7f96cc16c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:22.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.212+0000 7f96cb7fe700 1 --2- 172.21.15.8:0/2907997028 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96b4004810 0x7f96cc16c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:22.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.212+0000 7f96cb7fe700 1 -- 172.21.15.8:0/2907997028 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96cc0a71d0 con 0x7f96cc0a9a60 2023-10-06T04:37:22.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.212+0000 7f96cbfff700 1 --2- 172.21.15.8:0/2907997028 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96b4004810 0x7f96cc16c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:22.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.212+0000 7f96cb7fe700 1 --2- 172.21.15.8:0/2907997028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96cc0a9a60 0x7f96cc0a9ed0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f96c000e4b0 tx=0x7f96c001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:22.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.212+0000 7f96b3fff700 1 -- 172.21.15.8:0/2907997028 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c0022070 con 0x7f96cc0a9a60 2023-10-06T04:37:22.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.212+0000 7f96b3fff700 1 -- 172.21.15.8:0/2907997028 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c000e9e0 con 0x7f96cc0a9a60 2023-10-06T04:37:22.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.212+0000 7f96b3fff700 1 -- 172.21.15.8:0/2907997028 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c001c450 con 0x7f96cc0a9a60 2023-10-06T04:37:22.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.212+0000 7f96d288a700 1 -- 172.21.15.8:0/2907997028 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96cc16ce80 con 0x7f96cc0a9a60 2023-10-06T04:37:22.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.212+0000 7f96d288a700 1 -- 172.21.15.8:0/2907997028 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96cc15a7e0 con 0x7f96cc0a9a60 2023-10-06T04:37:22.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.213+0000 7f96d288a700 1 -- 172.21.15.8:0/2907997028 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96cc15b280 con 0x7f96cc0a9a60 2023-10-06T04:37:22.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.213+0000 7f96b3fff700 1 -- 172.21.15.8:0/2907997028 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f96c001c8a0 con 0x7f96cc0a9a60 2023-10-06T04:37:22.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.214+0000 7f96b3fff700 1 --2- 172.21.15.8:0/2907997028 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f96b8066f30 0x7f96b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:22.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.214+0000 7f96b3fff700 1 -- 172.21.15.8:0/2907997028 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f96c0085f90 con 0x7f96cc0a9a60 2023-10-06T04:37:22.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.214+0000 7f96cbfff700 1 --2- 172.21.15.8:0/2907997028 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f96b8066f30 0x7f96b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:22.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.214+0000 7f96cbfff700 1 --2- 172.21.15.8:0/2907997028 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f96b8066f30 0x7f96b80693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f96bc000e10 tx=0x7f96bc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:22.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.218+0000 7f96b3fff700 1 -- 172.21.15.8:0/2907997028 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f96c00b75a0 con 0x7f96cc0a9a60 2023-10-06T04:37:22.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.493+0000 7f96d288a700 1 -- 172.21.15.8:0/2907997028 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f96cc071550 con 0x7f96cc0a9a60 2023-10-06T04:37:22.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.497+0000 7f96b3fff700 1 -- 172.21.15.8:0/2907997028 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f96c00170e0 con 0x7f96cc0a9a60 2023-10-06T04:37:22.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.499+0000 7f96d288a700 1 -- 172.21.15.8:0/2907997028 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f96b8066f30 msgr2=0x7f96b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:22.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.499+0000 7f96d288a700 1 --2- 172.21.15.8:0/2907997028 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f96b8066f30 0x7f96b80693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f96bc000e10 tx=0x7f96bc009040 comp rx=0 tx=0).stop 2023-10-06T04:37:22.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.499+0000 7f96d288a700 1 -- 172.21.15.8:0/2907997028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96cc0a9a60 msgr2=0x7f96cc0a9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:22.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.499+0000 7f96d288a700 1 --2- 172.21.15.8:0/2907997028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96cc0a9a60 0x7f96cc0a9ed0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f96c000e4b0 tx=0x7f96c001a000 comp rx=0 tx=0).stop 2023-10-06T04:37:22.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.499+0000 7f96d288a700 1 -- 172.21.15.8:0/2907997028 shutdown_connections 2023-10-06T04:37:22.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.499+0000 7f96d288a700 1 --2- 172.21.15.8:0/2907997028 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f96b8066f30 0x7f96b80693e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:22.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.499+0000 7f96d288a700 1 --2- 172.21.15.8:0/2907997028 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96cc0b3f30 0x7f96cc0b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:22.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.499+0000 7f96d288a700 1 --2- 172.21.15.8:0/2907997028 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96b4004810 0x7f96cc16c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:22.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.499+0000 7f96d288a700 1 --2- 172.21.15.8:0/2907997028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96cc0a9a60 0x7f96cc0a9ed0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:22.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.499+0000 7f96d288a700 1 -- 172.21.15.8:0/2907997028 >> 172.21.15.8:0/2907997028 conn(0x7f96cc06ed00 msgr2=0x7f96cc1581d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:22.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.499+0000 7f96d288a700 1 -- 172.21.15.8:0/2907997028 shutdown_connections 2023-10-06T04:37:22.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.499+0000 7f96d288a700 1 -- 172.21.15.8:0/2907997028 wait complete. 2023-10-06T04:37:22.502 INFO:teuthology.orchestra.run.smithi008.stderr:updated caps for client.0 2023-10-06T04:37:22.512 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:37:22.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.632+0000 7ff48daf8700 1 Processor -- start 2023-10-06T04:37:22.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.632+0000 7ff48daf8700 1 -- start start 2023-10-06T04:37:22.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.633+0000 7ff48daf8700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff4880cb360 0x7ff4880d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:22.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.633+0000 7ff48daf8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4880d08d0 0x7ff4880cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:22.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.633+0000 7ff48daf8700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4880cc4c0 con 0x7ff4880af680 2023-10-06T04:37:22.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.633+0000 7ff48daf8700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff48815d460 con 0x7ff4880cb360 2023-10-06T04:37:22.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.633+0000 7ff48daf8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4880d0d20 con 0x7ff4880d08d0 2023-10-06T04:37:22.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.633+0000 7ff486ffd700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff4880cb360 0x7ff4880d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:22.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.633+0000 7ff486ffd700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff4880cb360 0x7ff4880d0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35146/0 (socket says 172.21.15.8:35146) 2023-10-06T04:37:22.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.633+0000 7ff486ffd700 1 -- 172.21.15.8:0/3759013409 learned_addr learned my addr 172.21.15.8:0/3759013409 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:22.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.633+0000 7ff487fff700 1 --2- 172.21.15.8:0/3759013409 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4880d08d0 0x7ff4880cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:22.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.633+0000 7ff486ffd700 1 -- 172.21.15.8:0/3759013409 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4880d08d0 msgr2=0x7ff4880cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:22.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.633+0000 7ff486ffd700 1 --2- 172.21.15.8:0/3759013409 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4880d08d0 0x7ff4880cc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:22.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.633+0000 7ff486ffd700 1 -- 172.21.15.8:0/3759013409 >> v1:172.21.15.184:6789/0 conn(0x7ff4880af680 legacy=0x7ff48815e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:22.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.633+0000 7ff486ffd700 1 -- 172.21.15.8:0/3759013409 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4880cb8b0 con 0x7ff4880cb360 2023-10-06T04:37:22.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.633+0000 7ff486ffd700 1 --2- 172.21.15.8:0/3759013409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4880cb360 0x7ff4880d0390 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff4780099b0 tx=0x7ff478009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e58ff5428621aa55 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:22.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.633+0000 7ff4867fc700 1 -- 172.21.15.8:0/3759013409 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47800b860 con 0x7ff4880cb360 2023-10-06T04:37:22.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.633+0000 7ff4867fc700 1 -- 172.21.15.8:0/3759013409 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47800b9c0 con 0x7ff4880cb360 2023-10-06T04:37:22.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.633+0000 7ff4867fc700 1 -- 172.21.15.8:0/3759013409 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47800bd60 con 0x7ff4880cb360 2023-10-06T04:37:22.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.634+0000 7ff48daf8700 1 -- 172.21.15.8:0/3759013409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4880cb360 msgr2=0x7ff4880d0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:22.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.634+0000 7ff48daf8700 1 --2- 172.21.15.8:0/3759013409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4880cb360 0x7ff4880d0390 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff4780099b0 tx=0x7ff478009250 comp rx=0 tx=0).stop 2023-10-06T04:37:22.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.634+0000 7ff48daf8700 1 -- 172.21.15.8:0/3759013409 shutdown_connections 2023-10-06T04:37:22.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.634+0000 7ff48daf8700 1 --2- 172.21.15.8:0/3759013409 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4880d08d0 0x7ff4880cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:22.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.634+0000 7ff48daf8700 1 --2- 172.21.15.8:0/3759013409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4880cb360 0x7ff4880d0390 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:22.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.634+0000 7ff48daf8700 1 -- 172.21.15.8:0/3759013409 >> 172.21.15.8:0/3759013409 conn(0x7ff4880633d0 msgr2=0x7ff4880637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:22.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.634+0000 7ff48daf8700 1 -- 172.21.15.8:0/3759013409 shutdown_connections 2023-10-06T04:37:22.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.634+0000 7ff48daf8700 1 -- 172.21.15.8:0/3759013409 wait complete. 2023-10-06T04:37:22.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.635+0000 7ff48daf8700 1 Processor -- start 2023-10-06T04:37:22.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.635+0000 7ff48daf8700 1 -- start start 2023-10-06T04:37:22.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.636+0000 7ff48daf8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4880af680 0x7ff4880a7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:22.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.636+0000 7ff48daf8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4880cb360 0x7ff4880c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:22.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.636+0000 7ff48daf8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4880d08d0 0x7ff48816deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:22.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.636+0000 7ff48daf8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48816e3f0 con 0x7ff4880cb360 2023-10-06T04:37:22.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.636+0000 7ff48daf8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4880c3d50 con 0x7ff4880af680 2023-10-06T04:37:22.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.636+0000 7ff48daf8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4880c4310 con 0x7ff4880d08d0 2023-10-06T04:37:22.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.636+0000 7ff486ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4880cb360 0x7ff4880c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:22.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.636+0000 7ff486ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4880cb360 0x7ff4880c47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35162/0 (socket says 172.21.15.8:35162) 2023-10-06T04:37:22.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.636+0000 7ff486ffd700 1 -- 172.21.15.8:0/4112482114 learned_addr learned my addr 172.21.15.8:0/4112482114 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:22.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.636+0000 7ff487fff700 1 --2- 172.21.15.8:0/4112482114 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4880d08d0 0x7ff48816deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:22.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.636+0000 7ff4877fe700 1 --2- 172.21.15.8:0/4112482114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4880af680 0x7ff4880a7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:22.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.636+0000 7ff486ffd700 1 -- 172.21.15.8:0/4112482114 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4880d08d0 msgr2=0x7ff48816deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:22.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.636+0000 7ff486ffd700 1 --2- 172.21.15.8:0/4112482114 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4880d08d0 0x7ff48816deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:22.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.636+0000 7ff486ffd700 1 -- 172.21.15.8:0/4112482114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4880af680 msgr2=0x7ff4880a7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:22.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.636+0000 7ff486ffd700 1 --2- 172.21.15.8:0/4112482114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4880af680 0x7ff4880a7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:22.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.636+0000 7ff486ffd700 1 -- 172.21.15.8:0/4112482114 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4780094f0 con 0x7ff4880cb360 2023-10-06T04:37:22.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.636+0000 7ff486ffd700 1 --2- 172.21.15.8:0/4112482114 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4880cb360 0x7ff4880c47a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff478006fd0 tx=0x7ff478017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:22.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.637+0000 7ff46f7fe700 1 -- 172.21.15.8:0/4112482114 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff478011e00 con 0x7ff4880cb360 2023-10-06T04:37:22.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.637+0000 7ff46f7fe700 1 -- 172.21.15.8:0/4112482114 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff478024440 con 0x7ff4880cb360 2023-10-06T04:37:22.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.637+0000 7ff48daf8700 1 -- 172.21.15.8:0/4112482114 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4880a7fd0 con 0x7ff4880cb360 2023-10-06T04:37:22.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.637+0000 7ff46f7fe700 1 -- 172.21.15.8:0/4112482114 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff478024800 con 0x7ff4880cb360 2023-10-06T04:37:22.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.637+0000 7ff48daf8700 1 -- 172.21.15.8:0/4112482114 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4880c3fa0 con 0x7ff4880cb360 2023-10-06T04:37:22.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.638+0000 7ff48daf8700 1 -- 172.21.15.8:0/4112482114 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff488071550 con 0x7ff4880cb360 2023-10-06T04:37:22.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.638+0000 7ff46f7fe700 1 -- 172.21.15.8:0/4112482114 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff47801a420 con 0x7ff4880cb360 2023-10-06T04:37:22.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.638+0000 7ff46f7fe700 1 --2- 172.21.15.8:0/4112482114 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff474066f30 0x7ff4740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:22.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.638+0000 7ff46f7fe700 1 -- 172.21.15.8:0/4112482114 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff4780866b0 con 0x7ff4880cb360 2023-10-06T04:37:22.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.639+0000 7ff4877fe700 1 --2- 172.21.15.8:0/4112482114 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff474066f30 0x7ff4740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:22.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.639+0000 7ff4877fe700 1 --2- 172.21.15.8:0/4112482114 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff474066f30 0x7ff4740693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff47c003a80 tx=0x7ff47c007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:22.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.643+0000 7ff46f7fe700 1 -- 172.21.15.8:0/4112482114 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff478053680 con 0x7ff4880cb360 2023-10-06T04:37:22.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.881+0000 7ff48daf8700 1 -- 172.21.15.8:0/4112482114 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4880c4450 con 0x7ff4880cb360 2023-10-06T04:37:22.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.881+0000 7ff46f7fe700 1 -- 172.21.15.8:0/4112482114 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4594 (secure 0 0 0) 0x7ff478056ca0 con 0x7ff4880cb360 2023-10-06T04:37:22.883 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:22.883 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4790,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/110277527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":110277527},{"type":"v1","addr":"172.21.15.184:6836","nonce":110277527}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":4793,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/4142299410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":4142299410},{"type":"v1","addr":"172.21.15.184:6837","nonce":4142299410}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5115,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/1697298369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1697298369},{"type":"v1","addr":"172.21.15.8:6834","nonce":1697298369}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:37:16.932006+0000","modified":"2023-10-06T04:37:20.564018+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5118},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5118":{"gid":5118,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.8:6835/3478733664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":3478733664},{"type":"v1","addr":"172.21.15.8:6835","nonce":3478733664}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:37:22.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.883+0000 7ff48daf8700 1 -- 172.21.15.8:0/4112482114 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff474066f30 msgr2=0x7ff4740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:22.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.883+0000 7ff48daf8700 1 --2- 172.21.15.8:0/4112482114 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff474066f30 0x7ff4740693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff47c003a80 tx=0x7ff47c007ec0 comp rx=0 tx=0).stop 2023-10-06T04:37:22.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.883+0000 7ff48daf8700 1 -- 172.21.15.8:0/4112482114 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4880cb360 msgr2=0x7ff4880c47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:22.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.883+0000 7ff48daf8700 1 --2- 172.21.15.8:0/4112482114 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4880cb360 0x7ff4880c47a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff478006fd0 tx=0x7ff478017000 comp rx=0 tx=0).stop 2023-10-06T04:37:22.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.883+0000 7ff48daf8700 1 -- 172.21.15.8:0/4112482114 shutdown_connections 2023-10-06T04:37:22.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.883+0000 7ff48daf8700 1 --2- 172.21.15.8:0/4112482114 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff474066f30 0x7ff4740693e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:22.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.883+0000 7ff48daf8700 1 --2- 172.21.15.8:0/4112482114 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4880d08d0 0x7ff48816deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:22.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.883+0000 7ff48daf8700 1 --2- 172.21.15.8:0/4112482114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4880af680 0x7ff4880a7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:22.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.883+0000 7ff48daf8700 1 --2- 172.21.15.8:0/4112482114 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4880cb360 0x7ff4880c47a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:22.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.883+0000 7ff48daf8700 1 -- 172.21.15.8:0/4112482114 >> 172.21.15.8:0/4112482114 conn(0x7ff4880633d0 msgr2=0x7ff4880b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:22.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.883+0000 7ff48daf8700 1 -- 172.21.15.8:0/4112482114 shutdown_connections 2023-10-06T04:37:22.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:22.883+0000 7ff48daf8700 1 -- 172.21.15.8:0/4112482114 wait complete. 2023-10-06T04:37:22.886 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 18 2023-10-06T04:37:23.301 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T04:37:16.932006+0000', 'modified': '2023-10-06T04:37:20.564018+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5118}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5118': {'gid': 5118, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.8:6835/3478733664', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6833', 'nonce': 3478733664}, {'type': 'v1', 'addr': '172.21.15.8:6835', 'nonce': 3478733664}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T04:37:23.301 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T04:37:23.301 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T04:37:23.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.425+0000 7f9d3ca5e700 1 Processor -- start 2023-10-06T04:37:23.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.425+0000 7f9d3ca5e700 1 -- start start 2023-10-06T04:37:23.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.426+0000 7f9d3ca5e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9d380cd060 0x7f9d3815e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:23.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.426+0000 7f9d3ca5e700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9d380cd430 0x7f9d380b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:23.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.426+0000 7f9d3ca5e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d380af6c0 con 0x7f9d380afff0 2023-10-06T04:37:23.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.426+0000 7f9d3ca5e700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d380b2d70 con 0x7f9d380cd430 2023-10-06T04:37:23.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.426+0000 7f9d3ca5e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d380b0430 con 0x7f9d380cd060 2023-10-06T04:37:23.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.426+0000 7f9d35d9b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9d380cd430 0x7f9d380b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:23.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.426+0000 7f9d35d9b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9d380cd430 0x7f9d380b23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35178/0 (socket says 172.21.15.8:35178) 2023-10-06T04:37:23.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.426+0000 7f9d35d9b700 1 -- 172.21.15.8:0/1025153139 learned_addr learned my addr 172.21.15.8:0/1025153139 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:23.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.427+0000 7f9d3659c700 1 --2- 172.21.15.8:0/1025153139 >> v2:172.21.15.184:3300/0 conn(0x7f9d380cd060 0x7f9d3815e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:23.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.427+0000 7f9d35d9b700 1 -- 172.21.15.8:0/1025153139 >> v2:172.21.15.184:3300/0 conn(0x7f9d380cd060 msgr2=0x7f9d3815e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:23.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.427+0000 7f9d35d9b700 1 --2- 172.21.15.8:0/1025153139 >> v2:172.21.15.184:3300/0 conn(0x7f9d380cd060 0x7f9d3815e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.427+0000 7f9d35d9b700 1 -- 172.21.15.8:0/1025153139 >> v1:172.21.15.184:6789/0 conn(0x7f9d380afff0 legacy=0x7f9d38159060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:23.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.427+0000 7f9d35d9b700 1 -- 172.21.15.8:0/1025153139 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d380b2a90 con 0x7f9d380cd430 2023-10-06T04:37:23.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.427+0000 7f9d3659c700 1 --2- 172.21.15.8:0/1025153139 >> v2:172.21.15.184:3300/0 conn(0x7f9d380cd060 0x7f9d3815e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:23.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.427+0000 7f9d35d9b700 1 --2- 172.21.15.8:0/1025153139 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d380cd430 0x7f9d380b23f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9d38089030 tx=0x7f9d20009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb20eafcefc63145 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:23.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.427+0000 7f9d3559a700 1 -- 172.21.15.8:0/1025153139 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d20005c10 con 0x7f9d380cd430 2023-10-06T04:37:23.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.427+0000 7f9d3559a700 1 -- 172.21.15.8:0/1025153139 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d20005d70 con 0x7f9d380cd430 2023-10-06T04:37:23.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.427+0000 7f9d3559a700 1 -- 172.21.15.8:0/1025153139 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2000b880 con 0x7f9d380cd430 2023-10-06T04:37:23.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.428+0000 7f9d3ca5e700 1 -- 172.21.15.8:0/1025153139 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d380cd430 msgr2=0x7f9d380b23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:23.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.428+0000 7f9d3ca5e700 1 --2- 172.21.15.8:0/1025153139 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d380cd430 0x7f9d380b23f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9d38089030 tx=0x7f9d20009220 comp rx=0 tx=0).stop 2023-10-06T04:37:23.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.428+0000 7f9d3ca5e700 1 -- 172.21.15.8:0/1025153139 shutdown_connections 2023-10-06T04:37:23.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.428+0000 7f9d3ca5e700 1 --2- 172.21.15.8:0/1025153139 >> v2:172.21.15.184:3300/0 conn(0x7f9d380cd060 0x7f9d3815e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.428+0000 7f9d3ca5e700 1 --2- 172.21.15.8:0/1025153139 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d380cd430 0x7f9d380b23f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.428+0000 7f9d3ca5e700 1 -- 172.21.15.8:0/1025153139 >> 172.21.15.8:0/1025153139 conn(0x7f9d3806ed00 msgr2=0x7f9d3806f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:23.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.428+0000 7f9d3ca5e700 1 -- 172.21.15.8:0/1025153139 shutdown_connections 2023-10-06T04:37:23.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.428+0000 7f9d3ca5e700 1 -- 172.21.15.8:0/1025153139 wait complete. 2023-10-06T04:37:23.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.429+0000 7f9d3ca5e700 1 Processor -- start 2023-10-06T04:37:23.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.429+0000 7f9d3ca5e700 1 -- start start 2023-10-06T04:37:23.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.430+0000 7f9d3ca5e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d380afff0 0x7f9d38159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:23.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.430+0000 7f9d3ca5e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d380cd060 0x7f9d380c4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:23.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.430+0000 7f9d3ca5e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d380cd430 0x7f9d380c5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:23.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.430+0000 7f9d3ca5e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d380c7c10 con 0x7f9d380cd060 2023-10-06T04:37:23.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.430+0000 7f9d3ca5e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3816abe0 con 0x7f9d380cd430 2023-10-06T04:37:23.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.430+0000 7f9d3ca5e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d380c75c0 con 0x7f9d380afff0 2023-10-06T04:37:23.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.430+0000 7f9d35d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d380cd060 0x7f9d380c4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:23.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.430+0000 7f9d35d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d380cd060 0x7f9d380c4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35194/0 (socket says 172.21.15.8:35194) 2023-10-06T04:37:23.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.430+0000 7f9d35d9b700 1 -- 172.21.15.8:0/676178559 learned_addr learned my addr 172.21.15.8:0/676178559 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:23.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.430+0000 7f9d35d9b700 1 -- 172.21.15.8:0/676178559 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d380afff0 msgr2=0x7f9d38159bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:23.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.430+0000 7f9d35d9b700 1 --2- 172.21.15.8:0/676178559 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d380afff0 0x7f9d38159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.430+0000 7f9d35d9b700 1 -- 172.21.15.8:0/676178559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d380cd430 msgr2=0x7f9d380c5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:23.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.430+0000 7f9d36d9d700 1 --2- 172.21.15.8:0/676178559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d380cd430 0x7f9d380c5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:23.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.430+0000 7f9d35d9b700 1 --2- 172.21.15.8:0/676178559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d380cd430 0x7f9d380c5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.430+0000 7f9d35d9b700 1 -- 172.21.15.8:0/676178559 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d20009480 con 0x7f9d380cd060 2023-10-06T04:37:23.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.430+0000 7f9d36d9d700 1 --2- 172.21.15.8:0/676178559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d380cd430 0x7f9d380c5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:23.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.430+0000 7f9d35d9b700 1 --2- 172.21.15.8:0/676178559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d380cd060 0x7f9d380c4dd0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9d38089410 tx=0x7f9d20016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:23.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.430+0000 7f9d2e7fc700 1 -- 172.21.15.8:0/676178559 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d200118e0 con 0x7f9d380cd060 2023-10-06T04:37:23.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.430+0000 7f9d2e7fc700 1 -- 172.21.15.8:0/676178559 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d20020070 con 0x7f9d380cd060 2023-10-06T04:37:23.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.430+0000 7f9d3ca5e700 1 -- 172.21.15.8:0/676178559 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d380c78a0 con 0x7f9d380cd060 2023-10-06T04:37:23.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.430+0000 7f9d2e7fc700 1 -- 172.21.15.8:0/676178559 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d20011cb0 con 0x7f9d380cd060 2023-10-06T04:37:23.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.430+0000 7f9d3ca5e700 1 -- 172.21.15.8:0/676178559 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d380c80a0 con 0x7f9d380cd060 2023-10-06T04:37:23.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.432+0000 7f9d2e7fc700 1 -- 172.21.15.8:0/676178559 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9d20022030 con 0x7f9d380cd060 2023-10-06T04:37:23.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.432+0000 7f9d2e7fc700 1 --2- 172.21.15.8:0/676178559 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9d18066f30 0x7f9d180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:23.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.432+0000 7f9d2e7fc700 1 -- 172.21.15.8:0/676178559 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9d200864b0 con 0x7f9d380cd060 2023-10-06T04:37:23.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.433+0000 7f9d3659c700 1 --2- 172.21.15.8:0/676178559 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9d18066f30 0x7f9d180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:23.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.433+0000 7f9d3659c700 1 --2- 172.21.15.8:0/676178559 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9d18066f30 0x7f9d180693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9d300094d0 tx=0x7f9d300096b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:23.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.434+0000 7f9d45d56b80 1 Processor -- start 2023-10-06T04:37:23.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.434+0000 7f9d45d56b80 1 -- start start 2023-10-06T04:37:23.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.435+0000 7f9d45d56b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a14420ca90 0x55a14420ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:23.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.435+0000 7f9d45d56b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a1441c89a0 0x55a1441c5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:23.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.435+0000 7f9d45d56b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1441c6bd0 0x55a1441c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:23.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.435+0000 7f9d45d56b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a144145c80 con 0x55a1441c89a0 2023-10-06T04:37:23.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.435+0000 7f9d45d56b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a14411ca70 con 0x55a1441c6bd0 2023-10-06T04:37:23.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.435+0000 7f9d45d56b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a14411a270 con 0x55a14420ca90 2023-10-06T04:37:23.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.435+0000 7f9d35d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a1441c89a0 0x55a1441c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:23.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.435+0000 7f9d35d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a1441c89a0 0x55a1441c5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35210/0 (socket says 172.21.15.8:35210) 2023-10-06T04:37:23.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.435+0000 7f9d35d9b700 1 -- 172.21.15.8:0/3869561202 learned_addr learned my addr 172.21.15.8:0/3869561202 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:23.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.435+0000 7f9d36d9d700 1 --2- 172.21.15.8:0/3869561202 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1441c6bd0 0x55a1441c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:23.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.435+0000 7f9d3659c700 1 --2- 172.21.15.8:0/3869561202 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a14420ca90 0x55a14420ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:23.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.436+0000 7f9d35d9b700 1 -- 172.21.15.8:0/3869561202 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a14420ca90 msgr2=0x55a14420ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:23.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.436+0000 7f9d35d9b700 1 --2- 172.21.15.8:0/3869561202 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a14420ca90 0x55a14420ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.436+0000 7f9d35d9b700 1 -- 172.21.15.8:0/3869561202 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1441c6bd0 msgr2=0x55a1441c5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:23.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.436+0000 7f9d35d9b700 1 --2- 172.21.15.8:0/3869561202 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1441c6bd0 0x55a1441c5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.436+0000 7f9d35d9b700 1 -- 172.21.15.8:0/3869561202 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a143fb0270 con 0x55a1441c89a0 2023-10-06T04:37:23.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.436+0000 7f9d36d9d700 1 --2- 172.21.15.8:0/3869561202 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1441c6bd0 0x55a1441c5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:23.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.436+0000 7f9d3659c700 1 --2- 172.21.15.8:0/3869561202 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a14420ca90 0x55a14420ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:23.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.436+0000 7f9d35d9b700 1 --2- 172.21.15.8:0/3869561202 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a1441c89a0 0x55a1441c5580 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9d200535a0 tx=0x7f9d200845f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b62ea2f686f5428 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:23.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.436+0000 7f9d177fe700 1 -- 172.21.15.8:0/3869561202 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2005a2f0 con 0x55a1441c89a0 2023-10-06T04:37:23.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.436+0000 7f9d177fe700 1 -- 172.21.15.8:0/3869561202 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d2005e040 con 0x55a1441c89a0 2023-10-06T04:37:23.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.436+0000 7f9d177fe700 1 -- 172.21.15.8:0/3869561202 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d20011e10 con 0x55a1441c89a0 2023-10-06T04:37:23.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.436+0000 7f9d45d56b80 1 -- 172.21.15.8:0/3869561202 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a1441c89a0 msgr2=0x55a1441c5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:23.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.436+0000 7f9d45d56b80 1 --2- 172.21.15.8:0/3869561202 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a1441c89a0 0x55a1441c5580 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9d200535a0 tx=0x7f9d200845f0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.437+0000 7f9d45d56b80 1 -- 172.21.15.8:0/3869561202 shutdown_connections 2023-10-06T04:37:23.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.437+0000 7f9d45d56b80 1 --2- 172.21.15.8:0/3869561202 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1441c6bd0 0x55a1441c5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.437+0000 7f9d45d56b80 1 --2- 172.21.15.8:0/3869561202 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a14420ca90 0x55a14420ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.437+0000 7f9d45d56b80 1 --2- 172.21.15.8:0/3869561202 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a1441c89a0 0x55a1441c5580 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.437+0000 7f9d45d56b80 1 -- 172.21.15.8:0/3869561202 >> 172.21.15.8:0/3869561202 conn(0x55a1441c7070 msgr2=0x55a1441c7440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:23.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.437+0000 7f9d45d56b80 1 -- 172.21.15.8:0/3869561202 shutdown_connections 2023-10-06T04:37:23.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.437+0000 7f9d45d56b80 1 -- 172.21.15.8:0/3869561202 wait complete. 2023-10-06T04:37:23.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.437+0000 7f9d45d56b80 1 -- start start 2023-10-06T04:37:23.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.437+0000 7f9d45d56b80 1 Processor -- start 2023-10-06T04:37:23.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.438+0000 7f9d45d56b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a1441c6bd0 0x55a1441ede90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:23.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.438+0000 7f9d45d56b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a1441c89a0 0x55a1441f1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:23.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.438+0000 7f9d45d56b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a14420ca90 0x55a1442059f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:23.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.438+0000 7f9d45d56b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a144116060 con 0x55a1441c89a0 2023-10-06T04:37:23.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.438+0000 7f9d45d56b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1440c1890 con 0x55a14420ca90 2023-10-06T04:37:23.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.438+0000 7f9d45d56b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a1440dcea0 con 0x55a1441c6bd0 2023-10-06T04:37:23.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.438+0000 7f9d45d56b80 10 client.0 _ll_register_callbacks cb 0x55a143fb2f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:37:23.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.438+0000 7f9d35d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a1441c89a0 0x55a1441f1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:23.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.438+0000 7f9d35d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a1441c89a0 0x55a1441f1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35212/0 (socket says 172.21.15.8:35212) 2023-10-06T04:37:23.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.438+0000 7f9d35d9b700 1 -- 172.21.15.8:0/1028540543 learned_addr learned my addr 172.21.15.8:0/1028540543 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:23.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.439+0000 7f9d3659c700 1 --2- 172.21.15.8:0/1028540543 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a1441c6bd0 0x55a1441ede90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:23.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.439+0000 7f9d36d9d700 1 --2- 172.21.15.8:0/1028540543 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a14420ca90 0x55a1442059f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:23.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.439+0000 7f9d35d9b700 1 -- 172.21.15.8:0/1028540543 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a1441c6bd0 msgr2=0x55a1441ede90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:23.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.439+0000 7f9d35d9b700 1 --2- 172.21.15.8:0/1028540543 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a1441c6bd0 0x55a1441ede90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.439+0000 7f9d35d9b700 1 -- 172.21.15.8:0/1028540543 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a14420ca90 msgr2=0x55a1442059f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:23.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.439+0000 7f9d35d9b700 1 --2- 172.21.15.8:0/1028540543 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a14420ca90 0x55a1442059f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.439+0000 7f9d35d9b700 1 -- 172.21.15.8:0/1028540543 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d380c80a0 con 0x55a1441c89a0 2023-10-06T04:37:23.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.439+0000 7f9d35d9b700 1 --2- 172.21.15.8:0/1028540543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a1441c89a0 0x55a1441f1f60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9d20057950 tx=0x7f9d2006a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985fca5f9041c5f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:23.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.439+0000 7f9d14ff9700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T04:37:23.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.439+0000 7f9d14ff9700 1 -- 172.21.15.8:0/1028540543 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d20011e10 con 0x55a1441c89a0 2023-10-06T04:37:23.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.439+0000 7f9d45d56b80 1 -- 172.21.15.8:0/1028540543 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a1441ba690 con 0x55a1441c89a0 2023-10-06T04:37:23.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.439+0000 7f9d14ff9700 1 -- 172.21.15.8:0/1028540543 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9d200860c0 con 0x55a1441c89a0 2023-10-06T04:37:23.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.439+0000 7f9d14ff9700 1 -- 172.21.15.8:0/1028540543 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d2001a5a0 con 0x55a1441c89a0 2023-10-06T04:37:23.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.439+0000 7f9d45d56b80 10 client.5289 fetch_fsmap learned FSMap version 18 2023-10-06T04:37:23.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.439+0000 7f9d45d56b80 1 -- 172.21.15.8:0/1028540543 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55a143f52fe0 con 0x55a1441c89a0 2023-10-06T04:37:23.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.439+0000 7f9d14ff9700 1 -- 172.21.15.8:0/1028540543 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a1441ba690 con 0x55a1441c89a0 2023-10-06T04:37:23.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.439+0000 7f9d14ff9700 1 -- 172.21.15.8:0/1028540543 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 18) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9d20084250 con 0x55a1441c89a0 2023-10-06T04:37:23.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.439+0000 7f9d45d56b80 10 client.5289 fetch_fsmap finished waiting for FSMap version 18 2023-10-06T04:37:23.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.439+0000 7f9d45d56b80 10 client.5289 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T04:37:23.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.439+0000 7f9d45d56b80 20 client.5289 populate_metadata read hostname 'smithi008' 2023-10-06T04:37:23.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.439+0000 7f9d45d56b80 1 --2- 172.21.15.8:0/1028540543 >> [v2:172.21.15.8:6833/3478733664,v1:172.21.15.8:6835/3478733664] conn(0x55a14421f040 0x55a14421f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:23.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.439+0000 7f9d45d56b80 4 client.5289 mds_command: new command op to 5118 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T04:37:23.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.439+0000 7f9d45d56b80 1 -- 172.21.15.8:0/1028540543 --> [v2:172.21.15.8:6833/3478733664,v1:172.21.15.8:6835/3478733664] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a1441975c0 con 0x55a14421f040 2023-10-06T04:37:23.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.440+0000 7f9d3659c700 1 --2- 172.21.15.8:0/1028540543 >> [v2:172.21.15.8:6833/3478733664,v1:172.21.15.8:6835/3478733664] conn(0x55a14421f040 0x55a14421f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:23.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.440+0000 7f9d3659c700 1 --2- 172.21.15.8:0/1028540543 >> [v2:172.21.15.8:6833/3478733664,v1:172.21.15.8:6835/3478733664] conn(0x55a14421f040 0x55a14421f410 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48533ca00016b709 server_cookie=d4c7caaa3e793f89 in_seq=0 out_seq=0 2023-10-06T04:37:23.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.440+0000 7f9d14ff9700 10 client.5289 ms_handle_connect on v2:172.21.15.8:6833/3478733664 2023-10-06T04:37:23.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.440+0000 7f9d14ff9700 1 -- 172.21.15.8:0/1028540543 <== mds.0 v2:172.21.15.8:6833/3478733664 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55a1441975c0 con 0x55a14421f040 2023-10-06T04:37:23.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.440+0000 7f9d14ff9700 10 client.5289 handle_command_reply: tid=0 2023-10-06T04:37:23.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.441+0000 7f9d45d56b80 1 client.5289 shutdown 2023-10-06T04:37:23.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.441+0000 7f9d45d56b80 1 -- 172.21.15.8:0/1028540543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a1441c89a0 msgr2=0x55a1441f1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:23.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.441+0000 7f9d45d56b80 1 --2- 172.21.15.8:0/1028540543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a1441c89a0 0x55a1441f1f60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9d20057950 tx=0x7f9d2006a000 comp rx=0 tx=0).stop 2023-10-06T04:37:23.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.441+0000 7f9d45d56b80 1 -- 172.21.15.8:0/1028540543 shutdown_connections 2023-10-06T04:37:23.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.441+0000 7f9d45d56b80 1 --2- 172.21.15.8:0/1028540543 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a14420ca90 0x55a1442059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.441+0000 7f9d45d56b80 1 --2- 172.21.15.8:0/1028540543 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a1441c6bd0 0x55a1441ede90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.441+0000 7f9d45d56b80 1 --2- 172.21.15.8:0/1028540543 >> [v2:172.21.15.8:6833/3478733664,v1:172.21.15.8:6835/3478733664] conn(0x55a14421f040 0x55a14421f410 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.441+0000 7f9d45d56b80 1 --2- 172.21.15.8:0/1028540543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a1441c89a0 0x55a1441f1f60 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.441+0000 7f9d14ff9700 0 client.5289 ms_handle_reset on v2:172.21.15.8:6833/3478733664 2023-10-06T04:37:23.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.441+0000 7f9d45d56b80 1 -- 172.21.15.8:0/1028540543 >> 172.21.15.8:0/1028540543 conn(0x55a1441c7070 msgr2=0x55a1441c26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:23.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.441+0000 7f9d45d56b80 1 -- 172.21.15.8:0/1028540543 shutdown_connections 2023-10-06T04:37:23.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.441+0000 7f9d45d56b80 1 -- 172.21.15.8:0/1028540543 wait complete. 2023-10-06T04:37:23.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.441+0000 7f9d45d56b80 20 client.5289 trim_cache size 0 max 16384 2023-10-06T04:37:23.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.458+0000 7f9d45d56b80 1 Processor -- start 2023-10-06T04:37:23.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.458+0000 7f9d45d56b80 1 -- start start 2023-10-06T04:37:23.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.458+0000 7f9d45d56b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a1441c6bd0 0x55a1441c1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:23.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.458+0000 7f9d45d56b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a1441c89a0 0x55a1441c5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:23.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.458+0000 7f9d45d56b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a14420ca90 0x55a1441c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:23.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.458+0000 7f9d45d56b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a143f98e30 con 0x55a1441c6bd0 2023-10-06T04:37:23.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.458+0000 7f9d45d56b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1441f2730 con 0x55a14420ca90 2023-10-06T04:37:23.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.458+0000 7f9d45d56b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a1441c00c0 con 0x55a1441c89a0 2023-10-06T04:37:23.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.459+0000 7f9d3659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a1441c6bd0 0x55a1441c1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:23.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.459+0000 7f9d3659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a1441c6bd0 0x55a1441c1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35228/0 (socket says 172.21.15.8:35228) 2023-10-06T04:37:23.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.459+0000 7f9d3659c700 1 -- 172.21.15.8:0/1778366012 learned_addr learned my addr 172.21.15.8:0/1778366012 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:23.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.459+0000 7f9d3659c700 1 -- 172.21.15.8:0/1778366012 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a1441c89a0 msgr2=0x55a1441c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:23.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.459+0000 7f9d3659c700 1 --2- 172.21.15.8:0/1778366012 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a1441c89a0 0x55a1441c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.459+0000 7f9d3659c700 1 -- 172.21.15.8:0/1778366012 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a14420ca90 msgr2=0x55a1441c5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:23.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.459+0000 7f9d3659c700 1 --2- 172.21.15.8:0/1778366012 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a14420ca90 0x55a1441c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.459+0000 7f9d3659c700 1 -- 172.21.15.8:0/1778366012 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1440e4780 con 0x55a1441c6bd0 2023-10-06T04:37:23.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.459+0000 7f9d3659c700 1 --2- 172.21.15.8:0/1778366012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a1441c6bd0 0x55a1441c1ac0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9d30009a20 tx=0x7f9d30012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=164b675887ae819a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:23.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.459+0000 7f9d17fff700 1 -- 172.21.15.8:0/1778366012 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d300234b0 con 0x55a1441c6bd0 2023-10-06T04:37:23.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.459+0000 7f9d17fff700 1 -- 172.21.15.8:0/1778366012 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d30027070 con 0x55a1441c6bd0 2023-10-06T04:37:23.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.459+0000 7f9d17fff700 1 -- 172.21.15.8:0/1778366012 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d30023610 con 0x55a1441c6bd0 2023-10-06T04:37:23.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.460+0000 7f9d45d56b80 1 -- 172.21.15.8:0/1778366012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a1441c6bd0 msgr2=0x55a1441c1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:23.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.460+0000 7f9d45d56b80 1 --2- 172.21.15.8:0/1778366012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a1441c6bd0 0x55a1441c1ac0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9d30009a20 tx=0x7f9d30012000 comp rx=0 tx=0).stop 2023-10-06T04:37:23.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.460+0000 7f9d45d56b80 1 -- 172.21.15.8:0/1778366012 shutdown_connections 2023-10-06T04:37:23.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.460+0000 7f9d45d56b80 1 --2- 172.21.15.8:0/1778366012 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a14420ca90 0x55a1441c5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.460+0000 7f9d45d56b80 1 --2- 172.21.15.8:0/1778366012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a1441c6bd0 0x55a1441c1ac0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.460+0000 7f9d45d56b80 1 --2- 172.21.15.8:0/1778366012 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a1441c89a0 0x55a1441c5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.460+0000 7f9d45d56b80 1 -- 172.21.15.8:0/1778366012 >> 172.21.15.8:0/1778366012 conn(0x55a1441c7070 msgr2=0x55a1441c7540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:23.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.460+0000 7f9d45d56b80 1 -- 172.21.15.8:0/1778366012 shutdown_connections 2023-10-06T04:37:23.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.460+0000 7f9d45d56b80 1 -- 172.21.15.8:0/1778366012 wait complete. 2023-10-06T04:37:23.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.460+0000 7f9d45d56b80 1 -- start start 2023-10-06T04:37:23.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.460+0000 7f9d45d56b80 1 Processor -- start 2023-10-06T04:37:23.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.461+0000 7f9d45d56b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1441c6bd0 0x55a144264a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:23.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.461+0000 7f9d45d56b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a1441c89a0 0x55a1441ee370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:23.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.461+0000 7f9d45d56b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a14420ca90 0x55a1441c1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:23.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.461+0000 7f9d45d56b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a144202260 con 0x55a1441c89a0 2023-10-06T04:37:23.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.461+0000 7f9d45d56b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1441eebe0 con 0x55a1441c6bd0 2023-10-06T04:37:23.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.461+0000 7f9d45d56b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a1441eeec0 con 0x55a14420ca90 2023-10-06T04:37:23.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.461+0000 7f9d45d56b80 10 client.0 _ll_register_callbacks cb 0x55a143fb2f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:37:23.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.461+0000 7f9d35d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a1441c89a0 0x55a1441ee370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:23.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.461+0000 7f9d35d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a1441c89a0 0x55a1441ee370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35244/0 (socket says 172.21.15.8:35244) 2023-10-06T04:37:23.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.461+0000 7f9d35d9b700 1 -- 172.21.15.8:0/1551846556 learned_addr learned my addr 172.21.15.8:0/1551846556 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:23.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.461+0000 7f9d3659c700 1 --2- 172.21.15.8:0/1551846556 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1441c6bd0 0x55a144264a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:23.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.461+0000 7f9d36d9d700 1 --2- 172.21.15.8:0/1551846556 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a14420ca90 0x55a1441c1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:23.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.462+0000 7f9d35d9b700 1 -- 172.21.15.8:0/1551846556 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a14420ca90 msgr2=0x55a1441c1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:23.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.462+0000 7f9d35d9b700 1 --2- 172.21.15.8:0/1551846556 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a14420ca90 0x55a1441c1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.462+0000 7f9d35d9b700 1 -- 172.21.15.8:0/1551846556 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1441c6bd0 msgr2=0x55a144264a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:23.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.462+0000 7f9d35d9b700 1 --2- 172.21.15.8:0/1551846556 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1441c6bd0 0x55a144264a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.462+0000 7f9d35d9b700 1 -- 172.21.15.8:0/1551846556 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d30017600 con 0x55a1441c89a0 2023-10-06T04:37:23.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.462+0000 7f9d35d9b700 1 --2- 172.21.15.8:0/1551846556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a1441c89a0 0x55a1441ee370 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9d200535a0 tx=0x7f9d20071070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1284c7a74c8cc1a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:23.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.462+0000 7f9d14ff9700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T04:37:23.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.462+0000 7f9d14ff9700 1 -- 172.21.15.8:0/1551846556 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2001a5a0 con 0x55a1441c89a0 2023-10-06T04:37:23.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.462+0000 7f9d14ff9700 1 -- 172.21.15.8:0/1551846556 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9d20011e10 con 0x55a1441c89a0 2023-10-06T04:37:23.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.462+0000 7f9d45d56b80 1 -- 172.21.15.8:0/1551846556 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9d2005e040 con 0x55a1441c89a0 2023-10-06T04:37:23.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.462+0000 7f9d14ff9700 1 -- 172.21.15.8:0/1551846556 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d2005a2f0 con 0x55a1441c89a0 2023-10-06T04:37:23.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.462+0000 7f9d45d56b80 10 client.5295 fetch_fsmap learned FSMap version 18 2023-10-06T04:37:23.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.462+0000 7f9d45d56b80 1 -- 172.21.15.8:0/1551846556 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55a1440cb470 con 0x55a1441c89a0 2023-10-06T04:37:23.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.462+0000 7f9d14ff9700 1 -- 172.21.15.8:0/1551846556 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d2005e040 con 0x55a1441c89a0 2023-10-06T04:37:23.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.462+0000 7f9d14ff9700 1 -- 172.21.15.8:0/1551846556 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 18) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9d2005dbb0 con 0x55a1441c89a0 2023-10-06T04:37:23.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.462+0000 7f9d45d56b80 10 client.5295 fetch_fsmap finished waiting for FSMap version 18 2023-10-06T04:37:23.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.462+0000 7f9d45d56b80 10 client.5295 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T04:37:23.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.462+0000 7f9d45d56b80 20 client.5295 populate_metadata read hostname 'smithi008' 2023-10-06T04:37:23.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.462+0000 7f9d45d56b80 1 --2- 172.21.15.8:0/1551846556 >> [v2:172.21.15.8:6833/3478733664,v1:172.21.15.8:6835/3478733664] conn(0x55a1441c0740 0x55a1441c0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:23.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.462+0000 7f9d45d56b80 4 client.5295 mds_command: new command op to 5118 tid=0[{"prefix": "status"}] 2023-10-06T04:37:23.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.462+0000 7f9d45d56b80 1 -- 172.21.15.8:0/1551846556 --> [v2:172.21.15.8:6833/3478733664,v1:172.21.15.8:6835/3478733664] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a1440b8e00 con 0x55a1441c0740 2023-10-06T04:37:23.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.462+0000 7f9d3659c700 1 --2- 172.21.15.8:0/1551846556 >> [v2:172.21.15.8:6833/3478733664,v1:172.21.15.8:6835/3478733664] conn(0x55a1441c0740 0x55a1441c0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:23.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.463+0000 7f9d14ff9700 10 client.5295 ms_handle_connect on v2:172.21.15.8:6833/3478733664 2023-10-06T04:37:23.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.463+0000 7f9d3659c700 1 --2- 172.21.15.8:0/1551846556 >> [v2:172.21.15.8:6833/3478733664,v1:172.21.15.8:6835/3478733664] conn(0x55a1441c0740 0x55a1441c0b10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cde237c145ef4476 server_cookie=6dc465be3ad75bc2 in_seq=0 out_seq=0 2023-10-06T04:37:23.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.463+0000 7f9d14ff9700 1 -- 172.21.15.8:0/1551846556 <== mds.0 v2:172.21.15.8:6833/3478733664 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55a1440b8e00 con 0x55a1441c0740 2023-10-06T04:37:23.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.463+0000 7f9d14ff9700 10 client.5295 handle_command_reply: tid=0 2023-10-06T04:37:23.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.463+0000 7f9d45d56b80 1 client.5295 shutdown 2023-10-06T04:37:23.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.463+0000 7f9d45d56b80 1 -- 172.21.15.8:0/1551846556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a1441c89a0 msgr2=0x55a1441ee370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:23.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.463+0000 7f9d45d56b80 1 --2- 172.21.15.8:0/1551846556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a1441c89a0 0x55a1441ee370 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9d200535a0 tx=0x7f9d20071070 comp rx=0 tx=0).stop 2023-10-06T04:37:23.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.463+0000 7f9d45d56b80 1 -- 172.21.15.8:0/1551846556 shutdown_connections 2023-10-06T04:37:23.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.463+0000 7f9d45d56b80 1 --2- 172.21.15.8:0/1551846556 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a14420ca90 0x55a1441c1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.463+0000 7f9d45d56b80 1 --2- 172.21.15.8:0/1551846556 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1441c6bd0 0x55a144264a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.463+0000 7f9d45d56b80 1 --2- 172.21.15.8:0/1551846556 >> [v2:172.21.15.8:6833/3478733664,v1:172.21.15.8:6835/3478733664] conn(0x55a1441c0740 0x55a1441c0b10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.463+0000 7f9d45d56b80 1 --2- 172.21.15.8:0/1551846556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a1441c89a0 0x55a1441ee370 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.463+0000 7f9d14ff9700 0 client.5295 ms_handle_reset on v2:172.21.15.8:6833/3478733664 2023-10-06T04:37:23.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.463+0000 7f9d45d56b80 1 -- 172.21.15.8:0/1551846556 >> 172.21.15.8:0/1551846556 conn(0x55a1441c7070 msgr2=0x55a14420a850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:23.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.463+0000 7f9d45d56b80 1 -- 172.21.15.8:0/1551846556 shutdown_connections 2023-10-06T04:37:23.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.463+0000 7f9d45d56b80 1 -- 172.21.15.8:0/1551846556 wait complete. 2023-10-06T04:37:23.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.463+0000 7f9d45d56b80 20 client.5295 trim_cache size 0 max 16384 2023-10-06T04:37:23.485 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T04:37:23.485 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "c030d94d-df8f-49bb-8df7-07e9e557d96b", 2023-10-06T04:37:23.485 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 0, 2023-10-06T04:37:23.485 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 5118, 2023-10-06T04:37:23.485 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-10-06T04:37:23.485 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-10-06T04:37:23.485 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-10-06T04:37:23.485 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 5.9228114539999996, 2023-10-06T04:37:23.485 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 18, 2023-10-06T04:37:23.486 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 38, 2023-10-06T04:37:23.486 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 38, 2023-10-06T04:37:23.486 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 13.934859064999999 2023-10-06T04:37:23.486 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T04:37:23.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.464+0000 7f9d3ca5e700 1 -- 172.21.15.8:0/676178559 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9d18066f30 msgr2=0x7f9d180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:23.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.464+0000 7f9d3ca5e700 1 --2- 172.21.15.8:0/676178559 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9d18066f30 0x7f9d180693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9d300094d0 tx=0x7f9d300096b0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.464+0000 7f9d3ca5e700 1 -- 172.21.15.8:0/676178559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d380cd060 msgr2=0x7f9d380c4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:23.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.464+0000 7f9d3ca5e700 1 --2- 172.21.15.8:0/676178559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d380cd060 0x7f9d380c4dd0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9d38089410 tx=0x7f9d20016000 comp rx=0 tx=0).stop 2023-10-06T04:37:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.464+0000 7f9d3ca5e700 1 -- 172.21.15.8:0/676178559 shutdown_connections 2023-10-06T04:37:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.464+0000 7f9d3ca5e700 1 --2- 172.21.15.8:0/676178559 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9d18066f30 0x7f9d180693e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.464+0000 7f9d3ca5e700 1 --2- 172.21.15.8:0/676178559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d380cd430 0x7f9d380c5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.464+0000 7f9d3ca5e700 1 --2- 172.21.15.8:0/676178559 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d380afff0 0x7f9d38159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.464+0000 7f9d3ca5e700 1 --2- 172.21.15.8:0/676178559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d380cd060 0x7f9d380c4dd0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.464+0000 7f9d3ca5e700 1 -- 172.21.15.8:0/676178559 >> 172.21.15.8:0/676178559 conn(0x7f9d3806ed00 msgr2=0x7f9d380cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.464+0000 7f9d3ca5e700 1 -- 172.21.15.8:0/676178559 shutdown_connections 2023-10-06T04:37:23.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.464+0000 7f9d3ca5e700 1 -- 172.21.15.8:0/676178559 wait complete. 2023-10-06T04:37:23.490 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:37:23.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.609+0000 7fa9dade9700 1 Processor -- start 2023-10-06T04:37:23.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.609+0000 7fa9dade9700 1 -- start start 2023-10-06T04:37:23.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.609+0000 7fa9dade9700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9d4142c30 0x7fa9d406c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:23.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.609+0000 7fa9dade9700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa9d40686e0 0x7fa9d4069e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:23.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.609+0000 7fa9dade9700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d40699f0 con 0x7fa9d406a3c0 2023-10-06T04:37:23.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.609+0000 7fa9dade9700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9d4068b50 con 0x7fa9d40686e0 2023-10-06T04:37:23.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.609+0000 7fa9dade9700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d4068de0 con 0x7fa9d4142c30 2023-10-06T04:37:23.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.610+0000 7fa9d3fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa9d40686e0 0x7fa9d4069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:23.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.610+0000 7fa9d8b85700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9d4142c30 0x7fa9d406c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:23.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.610+0000 7fa9d9386700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fa9d406a3c0 0x7fa9d4159c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.8:40130/0 (socket says 172.21.15.8:40130) 2023-10-06T04:37:23.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.610+0000 7fa9d9386700 1 -- 172.21.15.8:0/2989105816 learned_addr learned my addr 172.21.15.8:0/2989105816 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:23.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.610+0000 7fa9d37fe700 1 -- 172.21.15.8:0/2989105816 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 374226699 0 0) 0x7fa9d40699f0 con 0x7fa9d406a3c0 2023-10-06T04:37:23.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.610+0000 7fa9d37fe700 1 -- 172.21.15.8:0/2989105816 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9c0003570 con 0x7fa9d406a3c0 2023-10-06T04:37:23.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.610+0000 7fa9d8b85700 1 -- 172.21.15.8:0/2989105816 >> v2:172.21.15.184:3300/0 conn(0x7fa9d40686e0 msgr2=0x7fa9d4069e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:23.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.610+0000 7fa9d8b85700 1 --2- 172.21.15.8:0/2989105816 >> v2:172.21.15.184:3300/0 conn(0x7fa9d40686e0 0x7fa9d4069e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.610+0000 7fa9d8b85700 1 -- 172.21.15.8:0/2989105816 >> v1:172.21.15.184:6789/0 conn(0x7fa9d406a3c0 legacy=0x7fa9d4159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:23.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.610+0000 7fa9d8b85700 1 -- 172.21.15.8:0/2989105816 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d40690c0 con 0x7fa9d4142c30 2023-10-06T04:37:23.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.610+0000 7fa9d3fff700 1 --2- 172.21.15.8:0/2989105816 >> v2:172.21.15.184:3300/0 conn(0x7fa9d40686e0 0x7fa9d4069e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:37:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.610+0000 7fa9d8b85700 1 --2- 172.21.15.8:0/2989105816 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9d4142c30 0x7fa9d406c3e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc009e60 tx=0x7fa9cc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed02d32774e2052b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.610+0000 7fa9d37fe700 1 -- 172.21.15.8:0/2989105816 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc00e070 con 0x7fa9d4142c30 2023-10-06T04:37:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.611+0000 7fa9d37fe700 1 -- 172.21.15.8:0/2989105816 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9cc00bab0 con 0x7fa9d4142c30 2023-10-06T04:37:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.611+0000 7fa9d37fe700 1 -- 172.21.15.8:0/2989105816 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc00be70 con 0x7fa9d4142c30 2023-10-06T04:37:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.611+0000 7fa9dade9700 1 -- 172.21.15.8:0/2989105816 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9d4142c30 msgr2=0x7fa9d406c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.611+0000 7fa9dade9700 1 --2- 172.21.15.8:0/2989105816 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9d4142c30 0x7fa9d406c3e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc009e60 tx=0x7fa9cc009780 comp rx=0 tx=0).stop 2023-10-06T04:37:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.611+0000 7fa9dade9700 1 -- 172.21.15.8:0/2989105816 shutdown_connections 2023-10-06T04:37:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.611+0000 7fa9dade9700 1 --2- 172.21.15.8:0/2989105816 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9d4142c30 0x7fa9d406c3e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.611+0000 7fa9dade9700 1 --2- 172.21.15.8:0/2989105816 >> v2:172.21.15.184:3300/0 conn(0x7fa9d40686e0 0x7fa9d4069e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.611+0000 7fa9dade9700 1 -- 172.21.15.8:0/2989105816 >> 172.21.15.8:0/2989105816 conn(0x7fa9d40675d0 msgr2=0x7fa9d40679d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:23.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.611+0000 7fa9dade9700 1 -- 172.21.15.8:0/2989105816 shutdown_connections 2023-10-06T04:37:23.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.611+0000 7fa9dade9700 1 -- 172.21.15.8:0/2989105816 wait complete. 2023-10-06T04:37:23.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.612+0000 7fa9dade9700 1 Processor -- start 2023-10-06T04:37:23.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.612+0000 7fa9dade9700 1 -- start start 2023-10-06T04:37:23.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.613+0000 7fa9dade9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9d40686e0 0x7fa9d4139660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:23.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.613+0000 7fa9dade9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9d406a3c0 0x7fa9d4169f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:23.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.613+0000 7fa9dade9700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9d4142c30 0x7fa9d40ae990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:23.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.613+0000 7fa9dade9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d413a600 con 0x7fa9d40686e0 2023-10-06T04:37:23.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.613+0000 7fa9dade9700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d416a480 con 0x7fa9d406a3c0 2023-10-06T04:37:23.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.613+0000 7fa9dade9700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d4139d60 con 0x7fa9d4142c30 2023-10-06T04:37:23.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.613+0000 7fa9d8b85700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9d40686e0 0x7fa9d4139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:23.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.613+0000 7fa9d8b85700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9d40686e0 0x7fa9d4139660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35254/0 (socket says 172.21.15.8:35254) 2023-10-06T04:37:23.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.613+0000 7fa9d8b85700 1 -- 172.21.15.8:0/4046912437 learned_addr learned my addr 172.21.15.8:0/4046912437 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:23.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.613+0000 7fa9d3fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9d406a3c0 0x7fa9d4169f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:23.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.613+0000 7fa9d9386700 1 --2- 172.21.15.8:0/4046912437 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9d4142c30 0x7fa9d40ae990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:23.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.614+0000 7fa9d8b85700 1 -- 172.21.15.8:0/4046912437 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9d4142c30 msgr2=0x7fa9d40ae990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:23.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.614+0000 7fa9d8b85700 1 --2- 172.21.15.8:0/4046912437 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9d4142c30 0x7fa9d40ae990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.614+0000 7fa9d8b85700 1 -- 172.21.15.8:0/4046912437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9d406a3c0 msgr2=0x7fa9d4169f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:23.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.614+0000 7fa9d8b85700 1 --2- 172.21.15.8:0/4046912437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9d406a3c0 0x7fa9d4169f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.614+0000 7fa9d8b85700 1 -- 172.21.15.8:0/4046912437 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c4009420 con 0x7fa9d40686e0 2023-10-06T04:37:23.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.614+0000 7fa9d8b85700 1 --2- 172.21.15.8:0/4046912437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9d40686e0 0x7fa9d4139660 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4068f20 tx=0x7fa9cc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:23.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.614+0000 7fa9d0ff9700 1 -- 172.21.15.8:0/4046912437 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc012b60 con 0x7fa9d40686e0 2023-10-06T04:37:23.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.614+0000 7fa9d0ff9700 1 -- 172.21.15.8:0/4046912437 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9cc012ce0 con 0x7fa9d40686e0 2023-10-06T04:37:23.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.614+0000 7fa9dade9700 1 -- 172.21.15.8:0/4046912437 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9cc009a20 con 0x7fa9d40686e0 2023-10-06T04:37:23.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.614+0000 7fa9d0ff9700 1 -- 172.21.15.8:0/4046912437 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc0276c0 con 0x7fa9d40686e0 2023-10-06T04:37:23.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.614+0000 7fa9dade9700 1 -- 172.21.15.8:0/4046912437 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d413a320 con 0x7fa9d40686e0 2023-10-06T04:37:23.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.615+0000 7fa9dade9700 1 -- 172.21.15.8:0/4046912437 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d4071550 con 0x7fa9d40686e0 2023-10-06T04:37:23.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.615+0000 7fa9d0ff9700 1 -- 172.21.15.8:0/4046912437 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa9cc024070 con 0x7fa9d40686e0 2023-10-06T04:37:23.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.616+0000 7fa9d0ff9700 1 --2- 172.21.15.8:0/4046912437 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa9b4066f30 0x7fa9b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:23.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.616+0000 7fa9d0ff9700 1 -- 172.21.15.8:0/4046912437 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa9cc086d80 con 0x7fa9d40686e0 2023-10-06T04:37:23.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.616+0000 7fa9d3fff700 1 --2- 172.21.15.8:0/4046912437 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa9b4066f30 0x7fa9b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:23.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.616+0000 7fa9d3fff700 1 --2- 172.21.15.8:0/4046912437 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa9b4066f30 0x7fa9b40693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa9d41591a0 tx=0x7fa9c40091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:23.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.620+0000 7fa9d0ff9700 1 -- 172.21.15.8:0/4046912437 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa9cc053cb0 con 0x7fa9d40686e0 2023-10-06T04:37:23.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.861+0000 7fa9dade9700 1 -- 172.21.15.8:0/4046912437 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa9d40adf40 con 0x7fa9d40686e0 2023-10-06T04:37:23.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.862+0000 7fa9d0ff9700 1 -- 172.21.15.8:0/4046912437 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa9cc02c070 con 0x7fa9d40686e0 2023-10-06T04:37:23.863 INFO:teuthology.orchestra.run.smithi008.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T04:37:23.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.864+0000 7fa9dade9700 1 -- 172.21.15.8:0/4046912437 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa9b4066f30 msgr2=0x7fa9b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:23.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.864+0000 7fa9dade9700 1 --2- 172.21.15.8:0/4046912437 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa9b4066f30 0x7fa9b40693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa9d41591a0 tx=0x7fa9c40091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.864+0000 7fa9dade9700 1 -- 172.21.15.8:0/4046912437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9d40686e0 msgr2=0x7fa9d4139660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:23.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.864+0000 7fa9dade9700 1 --2- 172.21.15.8:0/4046912437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9d40686e0 0x7fa9d4139660 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4068f20 tx=0x7fa9cc019000 comp rx=0 tx=0).stop 2023-10-06T04:37:23.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.864+0000 7fa9dade9700 1 -- 172.21.15.8:0/4046912437 shutdown_connections 2023-10-06T04:37:23.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.864+0000 7fa9dade9700 1 --2- 172.21.15.8:0/4046912437 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa9b4066f30 0x7fa9b40693e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.864+0000 7fa9dade9700 1 --2- 172.21.15.8:0/4046912437 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9d4142c30 0x7fa9d40ae990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.864+0000 7fa9dade9700 1 --2- 172.21.15.8:0/4046912437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9d40686e0 0x7fa9d4139660 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.864+0000 7fa9dade9700 1 --2- 172.21.15.8:0/4046912437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9d406a3c0 0x7fa9d4169f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:23.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.864+0000 7fa9dade9700 1 -- 172.21.15.8:0/4046912437 >> 172.21.15.8:0/4046912437 conn(0x7fa9d40675d0 msgr2=0x7fa9d40afbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:23.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.864+0000 7fa9dade9700 1 -- 172.21.15.8:0/4046912437 shutdown_connections 2023-10-06T04:37:23.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:23.864+0000 7fa9dade9700 1 -- 172.21.15.8:0/4046912437 wait complete. 2023-10-06T04:37:23.877 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T04:37:23.878 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:37:23.878 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi008.front.sepia.ceph.com 2023-10-06T04:37:23.878 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T04:37:23.878 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T04:37:23.878 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T04:37:23.878 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T04:37:23.878 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:37:23.878 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:37:23.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:37:23.879 DEBUG:teuthology.orchestra.run.smithi008:> ip addr 2023-10-06T04:37:23.894 INFO:teuthology.orchestra.run.smithi008.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:37:23.894 INFO:teuthology.orchestra.run.smithi008.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:37:23.894 INFO:teuthology.orchestra.run.smithi008.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:37:23.894 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:37:23.895 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 ::1/128 scope host 2023-10-06T04:37:23.895 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:37:23.895 INFO:teuthology.orchestra.run.smithi008.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:37:23.895 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2e brd ff:ff:ff:ff:ff:ff 2023-10-06T04:37:23.895 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f0 2023-10-06T04:37:23.895 INFO:teuthology.orchestra.run.smithi008.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:37:23.895 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2f brd ff:ff:ff:ff:ff:ff 2023-10-06T04:37:23.895 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f1 2023-10-06T04:37:23.895 INFO:teuthology.orchestra.run.smithi008.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:37:23.895 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:fe brd ff:ff:ff:ff:ff:ff 2023-10-06T04:37:23.895 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f0 2023-10-06T04:37:23.895 INFO:teuthology.orchestra.run.smithi008.stdout: inet 172.21.15.8/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T04:37:23.896 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft 42436sec preferred_lft 42436sec 2023-10-06T04:37:23.896 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::ae1f:6bff:fef8:25fe/64 scope link 2023-10-06T04:37:23.896 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:37:23.896 INFO:teuthology.orchestra.run.smithi008.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:37:23.896 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:ff brd ff:ff:ff:ff:ff:ff 2023-10-06T04:37:23.896 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f1 2023-10-06T04:37:23.896 INFO:teuthology.orchestra.run.smithi008.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:37:23.896 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 2e:0e:f6:ba:f1:d2 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:37:23.896 INFO:teuthology.orchestra.run.smithi008.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T04:37:23.896 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:37:23.897 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::2096:16ff:fef6:bb26/64 scope link 2023-10-06T04:37:23.897 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:37:23.897 INFO:teuthology.orchestra.run.smithi008.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:37:23.897 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 3e:b3:ce:23:96:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T04:37:23.897 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::3cb3:ceff:fe23:965e/64 scope link 2023-10-06T04:37:23.897 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:37:23.897 INFO:teuthology.orchestra.run.smithi008.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:37:23.897 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 2e:0e:f6:ba:f1:d2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T04:37:23.897 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::2c0e:f6ff:feba:f1d2/64 scope link 2023-10-06T04:37:23.897 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:37:23.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:37:23.898 DEBUG:teuthology.orchestra.run.smithi008:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:37:23.958 INFO:teuthology.orchestra.run.smithi008.stdout:1 2023-10-06T04:37:23.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:37:23.960 DEBUG:teuthology.orchestra.run.smithi008:> route 2023-10-06T04:37:24.016 INFO:teuthology.orchestra.run.smithi008.stdout:Kernel IP routing table 2023-10-06T04:37:24.016 INFO:teuthology.orchestra.run.smithi008.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:37:24.016 INFO:teuthology.orchestra.run.smithi008.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T04:37:24.017 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T04:37:24.017 INFO:teuthology.orchestra.run.smithi008.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:37:24.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:37:24.017 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-10-06T04:37:24.017 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-10-06T04:37:24.017 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T04:37:24.017 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T04:37:24.017 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T04:37:24.018 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-10-06T04:37:24.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:37:24.118 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2023-10-06T04:37:24.133 INFO:teuthology.orchestra.run.smithi008.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T04:37:24.133 INFO:teuthology.orchestra.run.smithi008.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T04:37:24.133 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:37:24.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:37:24.134 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set brx.0 up 2023-10-06T04:37:24.199 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:37:24.199 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T04:37:24.254 INFO:teuthology.orchestra.run.smithi008.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:37:24.254 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:37:24.255 DEBUG:teuthology.orchestra.run.smithi008:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T04:37:24.309 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T04:37:24.309 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:37:24.309 DEBUG:teuthology.orchestra.run.smithi008:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:37:24.390 INFO:teuthology.orchestra.run.smithi008.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:37:24.390 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T04:37:24.409 INFO:teuthology.orchestra.run.smithi008.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:37:24.409 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T04:37:24.409 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: resolved to: "172.21.15.8:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-10-06T04:37:24.409 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: trying mount with new device syntax: 0@c030d94d-df8f-49bb-8df7-07e9e557d96b.cephfs=/ 2023-10-06T04:37:24.409 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.8:3300/172.21.15.184:3300/172.21.15.184:3301" will pass to kernel 2023-10-06T04:37:24.409 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T04:37:24.409 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T04:37:24.410 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:37:24.431 INFO:teuthology.orchestra.run.smithi008.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:37:24.431 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T04:37:24.431 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: resolved to: "172.21.15.8:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-10-06T04:37:24.431 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: trying mount with new device syntax: 0@c030d94d-df8f-49bb-8df7-07e9e557d96b.cephfs=/ 2023-10-06T04:37:24.431 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.8:3300/172.21.15.184:3300/172.21.15.184:3301" will pass to kernel 2023-10-06T04:37:24.431 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T04:37:24.431 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T04:37:24.432 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:37:24.432 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: resolved to: "172.21.15.8:6789,172.21.15.184:6789,172.21.15.184:6790" 2023-10-06T04:37:24.432 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.8:6789,172.21.15.184:6789,172.21.15.184:6790:/ 2023-10-06T04:37:24.432 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=c030d94d-df8f-49bb-8df7-07e9e557d96b" will pass to kernel 2023-10-06T04:37:24.434 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T04:37:24.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:37:24.434 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T04:37:24.500 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:37:24.500 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2023-10-06T04:37:24.561 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:37:24.561 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=subdir/sixmegs bs=1M conv=fdatasync count=6 seek=0) 2023-10-06T04:37:24.665 INFO:teuthology.orchestra.run.smithi008.stderr:6+0 records in 2023-10-06T04:37:24.666 INFO:teuthology.orchestra.run.smithi008.stderr:6+0 records out 2023-10-06T04:37:24.666 INFO:teuthology.orchestra.run.smithi008.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0485567 s, 130 MB/s 2023-10-06T04:37:24.667 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:37:24.668 DEBUG:teuthology.orchestra.run.smithi008:> import os 2023-10-06T04:37:24.668 DEBUG:teuthology.orchestra.run.smithi008:> import stat 2023-10-06T04:37:24.668 DEBUG:teuthology.orchestra.run.smithi008:> import json 2023-10-06T04:37:24.668 DEBUG:teuthology.orchestra.run.smithi008:> import sys 2023-10-06T04:37:24.668 DEBUG:teuthology.orchestra.run.smithi008:> 2023-10-06T04:37:24.668 DEBUG:teuthology.orchestra.run.smithi008:> try: 2023-10-06T04:37:24.668 DEBUG:teuthology.orchestra.run.smithi008:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2023-10-06T04:37:24.668 DEBUG:teuthology.orchestra.run.smithi008:> except OSError as e: 2023-10-06T04:37:24.668 DEBUG:teuthology.orchestra.run.smithi008:> sys.exit(e.errno) 2023-10-06T04:37:24.668 DEBUG:teuthology.orchestra.run.smithi008:> 2023-10-06T04:37:24.668 DEBUG:teuthology.orchestra.run.smithi008:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2023-10-06T04:37:24.669 DEBUG:teuthology.orchestra.run.smithi008:> print(json.dumps( 2023-10-06T04:37:24.669 DEBUG:teuthology.orchestra.run.smithi008:> dict([(a, getattr(s, a)) for a in attrs]), 2023-10-06T04:37:24.669 DEBUG:teuthology.orchestra.run.smithi008:> indent=2)) 2023-10-06T04:37:24.669 DEBUG:teuthology.orchestra.run.smithi008:> ' 2023-10-06T04:37:24.739 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T04:37:24.739 INFO:teuthology.orchestra.run.smithi008.stdout: "st_mode": 33204, 2023-10-06T04:37:24.739 INFO:teuthology.orchestra.run.smithi008.stdout: "st_ino": 1099511627777, 2023-10-06T04:37:24.739 INFO:teuthology.orchestra.run.smithi008.stdout: "st_dev": 46, 2023-10-06T04:37:24.739 INFO:teuthology.orchestra.run.smithi008.stdout: "st_nlink": 1, 2023-10-06T04:37:24.739 INFO:teuthology.orchestra.run.smithi008.stdout: "st_uid": 1000, 2023-10-06T04:37:24.739 INFO:teuthology.orchestra.run.smithi008.stdout: "st_gid": 1275, 2023-10-06T04:37:24.739 INFO:teuthology.orchestra.run.smithi008.stdout: "st_size": 6291456, 2023-10-06T04:37:24.739 INFO:teuthology.orchestra.run.smithi008.stdout: "st_atime": 1696567044.615333, 2023-10-06T04:37:24.740 INFO:teuthology.orchestra.run.smithi008.stdout: "st_mtime": 1696567044.6453328, 2023-10-06T04:37:24.740 INFO:teuthology.orchestra.run.smithi008.stdout: "st_ctime": 1696567044.6453328 2023-10-06T04:37:24.740 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T04:37:24.924 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T04:37:24.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:37:24.925 DEBUG:teuthology.orchestra.run.smithi008:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T04:37:25.032 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi008.front.sepia.ceph.com 2023-10-06T04:37:25.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:37:25.032 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T04:37:25.060 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:37:25.117 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:37:25.146 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:37:25.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.218+0000 7fce17305700 1 Processor -- start 2023-10-06T04:37:25.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.219+0000 7fce17305700 1 -- start start 2023-10-06T04:37:25.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.219+0000 7fce17305700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fce1006c3e0 0x7fce100686e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:25.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.219+0000 7fce17305700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce100699f0 con 0x7fce10142c30 2023-10-06T04:37:25.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.219+0000 7fce17305700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce10068de0 con 0x7fce10159c60 2023-10-06T04:37:25.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.219+0000 7fce17305700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce1006c880 con 0x7fce1006c3e0 2023-10-06T04:37:25.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.220+0000 7fce148a0700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fce1006c3e0 0x7fce100686e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:25.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.220+0000 7fce150a1700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fce10142c30 0x7fce10069e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46110/0 (socket says 172.21.15.8:46110) 2023-10-06T04:37:25.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.220+0000 7fce150a1700 1 -- 172.21.15.8:0/2973385228 learned_addr learned my addr 172.21.15.8:0/2973385228 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:25.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.220+0000 7fce148a0700 1 -- 172.21.15.8:0/2973385228 >> v1:172.21.15.184:6789/0 conn(0x7fce10159c60 legacy=0x7fce100b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:25.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.220+0000 7fce148a0700 1 -- 172.21.15.8:0/2973385228 >> v1:172.21.15.8:6789/0 conn(0x7fce10142c30 legacy=0x7fce10069e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:25.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.220+0000 7fce148a0700 1 -- 172.21.15.8:0/2973385228 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce100690c0 con 0x7fce1006c3e0 2023-10-06T04:37:25.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.220+0000 7fce0ffff700 1 -- 172.21.15.8:0/2973385228 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3554568255 0 0) 0x7fce100699f0 con 0x7fce10142c30 2023-10-06T04:37:25.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.220+0000 7fce148a0700 1 --2- 172.21.15.8:0/2973385228 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce1006c3e0 0x7fce100686e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fce040098e0 tx=0x7fce040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea654b4b16d2e73f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:25.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.220+0000 7fce0ffff700 1 -- 172.21.15.8:0/2973385228 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce04009e80 con 0x7fce1006c3e0 2023-10-06T04:37:25.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.220+0000 7fce0ffff700 1 -- 172.21.15.8:0/2973385228 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0400b860 con 0x7fce1006c3e0 2023-10-06T04:37:25.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.220+0000 7fce0ffff700 1 -- 172.21.15.8:0/2973385228 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0400bbe0 con 0x7fce1006c3e0 2023-10-06T04:37:25.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.221+0000 7fce17305700 1 -- 172.21.15.8:0/2973385228 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce1006c3e0 msgr2=0x7fce100686e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:25.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.221+0000 7fce17305700 1 --2- 172.21.15.8:0/2973385228 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce1006c3e0 0x7fce100686e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fce040098e0 tx=0x7fce040091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:25.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.221+0000 7fce17305700 1 -- 172.21.15.8:0/2973385228 shutdown_connections 2023-10-06T04:37:25.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.221+0000 7fce17305700 1 --2- 172.21.15.8:0/2973385228 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce1006c3e0 0x7fce100686e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:25.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.221+0000 7fce17305700 1 -- 172.21.15.8:0/2973385228 >> 172.21.15.8:0/2973385228 conn(0x7fce100675d0 msgr2=0x7fce100679d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:25.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.221+0000 7fce17305700 1 -- 172.21.15.8:0/2973385228 shutdown_connections 2023-10-06T04:37:25.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.221+0000 7fce17305700 1 -- 172.21.15.8:0/2973385228 wait complete. 2023-10-06T04:37:25.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.222+0000 7fce17305700 1 Processor -- start 2023-10-06T04:37:25.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.222+0000 7fce17305700 1 -- start start 2023-10-06T04:37:25.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.223+0000 7fce17305700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce1006c3e0 0x7fce1013b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:25.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.223+0000 7fce17305700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce10142c30 0x7fce1013e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:25.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.223+0000 7fce17305700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce10159c60 0x7fce1013e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:25.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.223+0000 7fce17305700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce100c91e0 con 0x7fce1006c3e0 2023-10-06T04:37:25.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.223+0000 7fce17305700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce100c9a80 con 0x7fce10159c60 2023-10-06T04:37:25.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.223+0000 7fce17305700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce1016df00 con 0x7fce10142c30 2023-10-06T04:37:25.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.223+0000 7fce150a1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce1006c3e0 0x7fce1013b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:25.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.223+0000 7fce150a1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce1006c3e0 0x7fce1013b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33152/0 (socket says 172.21.15.8:33152) 2023-10-06T04:37:25.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.223+0000 7fce150a1700 1 -- 172.21.15.8:0/2310295467 learned_addr learned my addr 172.21.15.8:0/2310295467 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:25.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.223+0000 7fce158a2700 1 --2- 172.21.15.8:0/2310295467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce10159c60 0x7fce1013e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:25.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.223+0000 7fce148a0700 1 --2- 172.21.15.8:0/2310295467 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce10142c30 0x7fce1013e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:25.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.223+0000 7fce150a1700 1 -- 172.21.15.8:0/2310295467 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce10142c30 msgr2=0x7fce1013e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:25.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.223+0000 7fce150a1700 1 --2- 172.21.15.8:0/2310295467 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce10142c30 0x7fce1013e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:25.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.223+0000 7fce150a1700 1 -- 172.21.15.8:0/2310295467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce10159c60 msgr2=0x7fce1013e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:25.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.223+0000 7fce150a1700 1 --2- 172.21.15.8:0/2310295467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce10159c60 0x7fce1013e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:25.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.223+0000 7fce150a1700 1 -- 172.21.15.8:0/2310295467 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce04009420 con 0x7fce1006c3e0 2023-10-06T04:37:25.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.223+0000 7fce158a2700 1 --2- 172.21.15.8:0/2310295467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce10159c60 0x7fce1013e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:25.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.223+0000 7fce150a1700 1 --2- 172.21.15.8:0/2310295467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce1006c3e0 0x7fce1013b110 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fce0000ccc0 tx=0x7fce00001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:25.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.224+0000 7fce0d7fa700 1 -- 172.21.15.8:0/2310295467 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0000ab70 con 0x7fce1006c3e0 2023-10-06T04:37:25.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.224+0000 7fce0d7fa700 1 -- 172.21.15.8:0/2310295467 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0000acd0 con 0x7fce1006c3e0 2023-10-06T04:37:25.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.224+0000 7fce0d7fa700 1 -- 172.21.15.8:0/2310295467 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce00007340 con 0x7fce1006c3e0 2023-10-06T04:37:25.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.224+0000 7fce17305700 1 -- 172.21.15.8:0/2310295467 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce100c9430 con 0x7fce1006c3e0 2023-10-06T04:37:25.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.224+0000 7fce17305700 1 -- 172.21.15.8:0/2310295467 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce1013b650 con 0x7fce1006c3e0 2023-10-06T04:37:25.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.225+0000 7fce17305700 1 -- 172.21.15.8:0/2310295467 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce10071550 con 0x7fce1006c3e0 2023-10-06T04:37:25.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.225+0000 7fce0d7fa700 1 -- 172.21.15.8:0/2310295467 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fce00007770 con 0x7fce1006c3e0 2023-10-06T04:37:25.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.226+0000 7fce0d7fa700 1 --2- 172.21.15.8:0/2310295467 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fcdfc066f30 0x7fcdfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:25.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.226+0000 7fce0d7fa700 1 -- 172.21.15.8:0/2310295467 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fce00084c80 con 0x7fce1006c3e0 2023-10-06T04:37:25.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.226+0000 7fce148a0700 1 --2- 172.21.15.8:0/2310295467 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fcdfc066f30 0x7fcdfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:25.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.226+0000 7fce148a0700 1 --2- 172.21.15.8:0/2310295467 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fcdfc066f30 0x7fcdfc0693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fce1013f370 tx=0x7fce04017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:25.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.230+0000 7fce0d7fa700 1 -- 172.21.15.8:0/2310295467 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce00051cd0 con 0x7fce1006c3e0 2023-10-06T04:37:25.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.470+0000 7fce17305700 1 -- 172.21.15.8:0/2310295467 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce100cd660 con 0x7fce1006c3e0 2023-10-06T04:37:25.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.471+0000 7fce0d7fa700 1 -- 172.21.15.8:0/2310295467 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4594 (secure 0 0 0) 0x7fce000552f0 con 0x7fce1006c3e0 2023-10-06T04:37:25.472 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:25.472 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4790,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/110277527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":110277527},{"type":"v1","addr":"172.21.15.184:6836","nonce":110277527}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":4793,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/4142299410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":4142299410},{"type":"v1","addr":"172.21.15.184:6837","nonce":4142299410}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5115,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/1697298369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1697298369},{"type":"v1","addr":"172.21.15.8:6834","nonce":1697298369}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:37:16.932006+0000","modified":"2023-10-06T04:37:20.564018+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5118},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5118":{"gid":5118,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.8:6835/3478733664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":3478733664},{"type":"v1","addr":"172.21.15.8:6835","nonce":3478733664}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:37:25.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.473+0000 7fce17305700 1 -- 172.21.15.8:0/2310295467 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fcdfc066f30 msgr2=0x7fcdfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:25.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.473+0000 7fce17305700 1 --2- 172.21.15.8:0/2310295467 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fcdfc066f30 0x7fcdfc0693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fce1013f370 tx=0x7fce04017000 comp rx=0 tx=0).stop 2023-10-06T04:37:25.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.473+0000 7fce17305700 1 -- 172.21.15.8:0/2310295467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce1006c3e0 msgr2=0x7fce1013b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:25.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.473+0000 7fce17305700 1 --2- 172.21.15.8:0/2310295467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce1006c3e0 0x7fce1013b110 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fce0000ccc0 tx=0x7fce00001a80 comp rx=0 tx=0).stop 2023-10-06T04:37:25.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.473+0000 7fce17305700 1 -- 172.21.15.8:0/2310295467 shutdown_connections 2023-10-06T04:37:25.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.473+0000 7fce17305700 1 --2- 172.21.15.8:0/2310295467 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fcdfc066f30 0x7fcdfc0693e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:25.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.473+0000 7fce17305700 1 --2- 172.21.15.8:0/2310295467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce10159c60 0x7fce1013e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:25.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.473+0000 7fce17305700 1 --2- 172.21.15.8:0/2310295467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce1006c3e0 0x7fce1013b110 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:25.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.473+0000 7fce17305700 1 --2- 172.21.15.8:0/2310295467 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce10142c30 0x7fce1013e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:25.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.473+0000 7fce17305700 1 -- 172.21.15.8:0/2310295467 >> 172.21.15.8:0/2310295467 conn(0x7fce100675d0 msgr2=0x7fce100af720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:25.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.473+0000 7fce17305700 1 -- 172.21.15.8:0/2310295467 shutdown_connections 2023-10-06T04:37:25.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.473+0000 7fce17305700 1 -- 172.21.15.8:0/2310295467 wait complete. 2023-10-06T04:37:25.476 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 18 2023-10-06T04:37:25.486 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2023-10-06T04:37:25.674 INFO:teuthology.orchestra.run.smithi008.stdout:{"message":"","return_code":0} 2023-10-06T04:37:25.674 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-10-06T04:37:25.675 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T04:37:25.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.793+0000 7fe0388ef700 1 Processor -- start 2023-10-06T04:37:25.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.793+0000 7fe0388ef700 1 -- start start 2023-10-06T04:37:25.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.794+0000 7fe0388ef700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe0340af410 0x7fe0340cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:25.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.794+0000 7fe0388ef700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe0340cd4c0 0x7fe0340ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:25.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.794+0000 7fe0388ef700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe03415ddd0 con 0x7fe0340af7e0 2023-10-06T04:37:25.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.794+0000 7fe0388ef700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0340cd8b0 con 0x7fe0340cd4c0 2023-10-06T04:37:25.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.794+0000 7fe0388ef700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe03415e260 con 0x7fe0340af410 2023-10-06T04:37:25.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.794+0000 7fe032d9d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe0340cd4c0 0x7fe0340ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:25.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.794+0000 7fe032d9d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe0340cd4c0 0x7fe0340ce4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33168/0 (socket says 172.21.15.8:33168) 2023-10-06T04:37:25.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.794+0000 7fe032d9d700 1 -- 172.21.15.8:0/991433955 learned_addr learned my addr 172.21.15.8:0/991433955 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:25.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.794+0000 7fe03259c700 1 --2- 172.21.15.8:0/991433955 >> v2:172.21.15.184:3300/0 conn(0x7fe0340af410 0x7fe0340cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:25.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.794+0000 7fe032d9d700 1 -- 172.21.15.8:0/991433955 >> v2:172.21.15.184:3300/0 conn(0x7fe0340af410 msgr2=0x7fe0340cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:25.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.794+0000 7fe032d9d700 1 --2- 172.21.15.8:0/991433955 >> v2:172.21.15.184:3300/0 conn(0x7fe0340af410 0x7fe0340cb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:25.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.794+0000 7fe032d9d700 1 -- 172.21.15.8:0/991433955 >> v1:172.21.15.184:6789/0 conn(0x7fe0340af7e0 legacy=0x7fe0340ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:25.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.794+0000 7fe032d9d700 1 -- 172.21.15.8:0/991433955 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe03415d4a0 con 0x7fe0340cd4c0 2023-10-06T04:37:25.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.794+0000 7fe032d9d700 1 --2- 172.21.15.8:0/991433955 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0340cd4c0 0x7fe0340ce4e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe0340694e0 tx=0x7fe02c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ea4d402b4254024 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:25.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.794+0000 7fe03159a700 1 -- 172.21.15.8:0/991433955 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c00e070 con 0x7fe0340cd4c0 2023-10-06T04:37:25.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.794+0000 7fe03159a700 1 -- 172.21.15.8:0/991433955 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02c00ba20 con 0x7fe0340cd4c0 2023-10-06T04:37:25.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.794+0000 7fe03159a700 1 -- 172.21.15.8:0/991433955 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c0092e0 con 0x7fe0340cd4c0 2023-10-06T04:37:25.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.795+0000 7fe0388ef700 1 -- 172.21.15.8:0/991433955 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0340cd4c0 msgr2=0x7fe0340ce4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:25.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.795+0000 7fe0388ef700 1 --2- 172.21.15.8:0/991433955 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0340cd4c0 0x7fe0340ce4e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe0340694e0 tx=0x7fe02c009840 comp rx=0 tx=0).stop 2023-10-06T04:37:25.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.795+0000 7fe0388ef700 1 -- 172.21.15.8:0/991433955 shutdown_connections 2023-10-06T04:37:25.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.795+0000 7fe0388ef700 1 --2- 172.21.15.8:0/991433955 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0340cd4c0 0x7fe0340ce4e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:25.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.795+0000 7fe0388ef700 1 --2- 172.21.15.8:0/991433955 >> v2:172.21.15.184:3300/0 conn(0x7fe0340af410 0x7fe0340cb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:25.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.795+0000 7fe0388ef700 1 -- 172.21.15.8:0/991433955 >> 172.21.15.8:0/991433955 conn(0x7fe034069890 msgr2=0x7fe034069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:25.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.795+0000 7fe0388ef700 1 -- 172.21.15.8:0/991433955 shutdown_connections 2023-10-06T04:37:25.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.795+0000 7fe0388ef700 1 -- 172.21.15.8:0/991433955 wait complete. 2023-10-06T04:37:25.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.796+0000 7fe0388ef700 1 Processor -- start 2023-10-06T04:37:25.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.796+0000 7fe0388ef700 1 -- start start 2023-10-06T04:37:25.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.797+0000 7fe0388ef700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0340af410 0x7fe03414d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:25.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.797+0000 7fe0388ef700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0340af7e0 0x7fe03414efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:25.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.797+0000 7fe0388ef700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0340cd4c0 0x7fe0340b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:25.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.797+0000 7fe0388ef700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0341518b0 con 0x7fe0340cd4c0 2023-10-06T04:37:25.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.797+0000 7fe0388ef700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03414f920 con 0x7fe0340af410 2023-10-06T04:37:25.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.797+0000 7fe0388ef700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03414fc00 con 0x7fe0340af7e0 2023-10-06T04:37:25.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.797+0000 7fe032d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0340cd4c0 0x7fe0340b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:25.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.797+0000 7fe032d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0340cd4c0 0x7fe0340b38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33170/0 (socket says 172.21.15.8:33170) 2023-10-06T04:37:25.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.797+0000 7fe032d9d700 1 -- 172.21.15.8:0/3155167040 learned_addr learned my addr 172.21.15.8:0/3155167040 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:25.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.797+0000 7fe03259c700 1 --2- 172.21.15.8:0/3155167040 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0340af410 0x7fe03414d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:25.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.797+0000 7fe031d9b700 1 --2- 172.21.15.8:0/3155167040 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0340af7e0 0x7fe03414efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:25.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.797+0000 7fe032d9d700 1 -- 172.21.15.8:0/3155167040 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0340af7e0 msgr2=0x7fe03414efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:25.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.797+0000 7fe032d9d700 1 --2- 172.21.15.8:0/3155167040 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0340af7e0 0x7fe03414efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:25.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.797+0000 7fe032d9d700 1 -- 172.21.15.8:0/3155167040 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0340af410 msgr2=0x7fe03414d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:25.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.797+0000 7fe032d9d700 1 --2- 172.21.15.8:0/3155167040 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0340af410 0x7fe03414d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:25.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.797+0000 7fe032d9d700 1 -- 172.21.15.8:0/3155167040 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe02c009ae0 con 0x7fe0340cd4c0 2023-10-06T04:37:25.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.797+0000 7fe031d9b700 1 --2- 172.21.15.8:0/3155167040 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0340af7e0 0x7fe03414efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:25.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.797+0000 7fe032d9d700 1 --2- 172.21.15.8:0/3155167040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0340cd4c0 0x7fe0340b38e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe0340891d0 tx=0x7fe02c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:25.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.798+0000 7fe0227fc700 1 -- 172.21.15.8:0/3155167040 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c008c30 con 0x7fe0340cd4c0 2023-10-06T04:37:25.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.798+0000 7fe0227fc700 1 -- 172.21.15.8:0/3155167040 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02c008d90 con 0x7fe0340cd4c0 2023-10-06T04:37:25.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.798+0000 7fe0388ef700 1 -- 172.21.15.8:0/3155167040 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe03414fee0 con 0x7fe0340cd4c0 2023-10-06T04:37:25.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.798+0000 7fe0227fc700 1 -- 172.21.15.8:0/3155167040 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c01c660 con 0x7fe0340cd4c0 2023-10-06T04:37:25.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.798+0000 7fe0388ef700 1 -- 172.21.15.8:0/3155167040 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe03414f520 con 0x7fe0340cd4c0 2023-10-06T04:37:25.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.799+0000 7fe0388ef700 1 -- 172.21.15.8:0/3155167040 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe034151680 con 0x7fe0340cd4c0 2023-10-06T04:37:25.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.799+0000 7fe0227fc700 1 -- 172.21.15.8:0/3155167040 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe02c003040 con 0x7fe0340cd4c0 2023-10-06T04:37:25.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.799+0000 7fe0227fc700 1 --2- 172.21.15.8:0/3155167040 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe014066f30 0x7fe0140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:25.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.799+0000 7fe0227fc700 1 -- 172.21.15.8:0/3155167040 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fe02c085ed0 con 0x7fe0340cd4c0 2023-10-06T04:37:25.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.800+0000 7fe03259c700 1 --2- 172.21.15.8:0/3155167040 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe014066f30 0x7fe0140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:25.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.800+0000 7fe03259c700 1 --2- 172.21.15.8:0/3155167040 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe014066f30 0x7fe0140693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe024009db0 tx=0x7fe0240091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:25.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:25.804+0000 7fe0227fc700 1 -- 172.21.15.8:0/3155167040 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe034151680 con 0x7fe0340cd4c0 2023-10-06T04:37:26.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.043+0000 7fe0388ef700 1 -- 172.21.15.8:0/3155167040 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe034151680 con 0x7fe0340cd4c0 2023-10-06T04:37:26.045 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-06T04:37:26.043+0000 7f590ad7d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T04:37:26.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.047+0000 7fe0227fc700 1 -- 172.21.15.8:0/3155167040 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe034151680 con 0x7fe0340cd4c0 2023-10-06T04:37:26.050 INFO:tasks.ceph.mds.a.smithi008.stderr: -2812> 2023-10-06T04:37:20.379+0000 7f6d0b38a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T04:37:26.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.049+0000 7fe0388ef700 1 -- 172.21.15.8:0/3155167040 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe014066f30 msgr2=0x7fe0140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:26.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.049+0000 7fe0388ef700 1 --2- 172.21.15.8:0/3155167040 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe014066f30 0x7fe0140693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe024009db0 tx=0x7fe0240091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.049+0000 7fe0388ef700 1 -- 172.21.15.8:0/3155167040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0340cd4c0 msgr2=0x7fe0340b38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:26.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.049+0000 7fe0388ef700 1 --2- 172.21.15.8:0/3155167040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0340cd4c0 0x7fe0340b38e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe0340891d0 tx=0x7fe02c018000 comp rx=0 tx=0).stop 2023-10-06T04:37:26.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.049+0000 7fe0388ef700 1 -- 172.21.15.8:0/3155167040 shutdown_connections 2023-10-06T04:37:26.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.049+0000 7fe0388ef700 1 --2- 172.21.15.8:0/3155167040 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe014066f30 0x7fe0140693e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.049+0000 7fe0388ef700 1 --2- 172.21.15.8:0/3155167040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0340cd4c0 0x7fe0340b38e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.049+0000 7fe0388ef700 1 --2- 172.21.15.8:0/3155167040 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0340af410 0x7fe03414d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.049+0000 7fe0388ef700 1 --2- 172.21.15.8:0/3155167040 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0340af7e0 0x7fe03414efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.049+0000 7fe0388ef700 1 -- 172.21.15.8:0/3155167040 >> 172.21.15.8:0/3155167040 conn(0x7fe034069890 msgr2=0x7fe034068470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:26.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.050+0000 7fe0388ef700 1 -- 172.21.15.8:0/3155167040 shutdown_connections 2023-10-06T04:37:26.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.050+0000 7fe0388ef700 1 -- 172.21.15.8:0/3155167040 wait complete. 2023-10-06T04:37:26.052 INFO:teuthology.orchestra.run.smithi008.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T04:37:26.065 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T04:37:26.067 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T04:37:26.075 INFO:tasks.ceph.mds.a.smithi008.stdout:starting mds.a at 2023-10-06T04:37:26.110 INFO:teuthology.orchestra.run.smithi008.stdout:[global] 2023-10-06T04:37:26.110 INFO:teuthology.orchestra.run.smithi008.stdout: chdir = "" 2023-10-06T04:37:26.110 INFO:teuthology.orchestra.run.smithi008.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T04:37:26.110 INFO:teuthology.orchestra.run.smithi008.stdout: auth supported = cephx 2023-10-06T04:37:26.110 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.110 INFO:teuthology.orchestra.run.smithi008.stdout: filestore xattr use omap = true 2023-10-06T04:37:26.111 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.111 INFO:teuthology.orchestra.run.smithi008.stdout: mon clock drift allowed = 1.000 2023-10-06T04:37:26.111 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.111 INFO:teuthology.orchestra.run.smithi008.stdout: osd crush chooseleaf type = 0 2023-10-06T04:37:26.111 INFO:teuthology.orchestra.run.smithi008.stdout: auth debug = true 2023-10-06T04:37:26.111 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.111 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on old message = true 2023-10-06T04:37:26.111 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on bug = true 2023-10-06T04:37:26.111 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.112 INFO:teuthology.orchestra.run.smithi008.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T04:37:26.112 INFO:teuthology.orchestra.run.smithi008.stdout: mon pg warn max object skew = 0 2023-10-06T04:37:26.112 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.112 INFO:teuthology.orchestra.run.smithi008.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T04:37:26.112 INFO:teuthology.orchestra.run.smithi008.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T04:37:26.112 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.112 INFO:teuthology.orchestra.run.smithi008.stdout: osd pool default size = 2 2023-10-06T04:37:26.112 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.112 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd allow primary affinity = true 2023-10-06T04:37:26.112 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd allow pg remap = true 2023-10-06T04:37:26.113 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on legacy crush tunables = false 2023-10-06T04:37:26.113 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on crush straw calc version zero = false 2023-10-06T04:37:26.113 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on no sortbitwise = false 2023-10-06T04:37:26.113 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on osd down out interval zero = false 2023-10-06T04:37:26.113 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on too few osds = false 2023-10-06T04:37:26.113 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T04:37:26.113 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T04:37:26.113 INFO:teuthology.orchestra.run.smithi008.stdout: mon_allow_pool_size_one = true 2023-10-06T04:37:26.113 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.113 INFO:teuthology.orchestra.run.smithi008.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T04:37:26.114 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.114 INFO:teuthology.orchestra.run.smithi008.stdout: osd default data pool replay window = 5 2023-10-06T04:37:26.114 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.114 INFO:teuthology.orchestra.run.smithi008.stdout: mon allow pool delete = true 2023-10-06T04:37:26.114 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.114 INFO:teuthology.orchestra.run.smithi008.stdout: mon cluster log file level = debug 2023-10-06T04:37:26.114 INFO:teuthology.orchestra.run.smithi008.stdout: debug asserts on shutdown = true 2023-10-06T04:37:26.114 INFO:teuthology.orchestra.run.smithi008.stdout: mon health detail to clog = false 2023-10-06T04:37:26.114 INFO:teuthology.orchestra.run.smithi008.stdout: mon host = "172.21.15.8,172.21.15.184,[v2:172.21.15.184:3301,v1:172.21.15.184:6790]" 2023-10-06T04:37:26.115 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on skipped message = False 2023-10-06T04:37:26.115 INFO:teuthology.orchestra.run.smithi008.stdout: fsid = c030d94d-df8f-49bb-8df7-07e9e557d96b 2023-10-06T04:37:26.115 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.115 INFO:teuthology.orchestra.run.smithi008.stdout:[osd] 2023-10-06T04:37:26.115 INFO:teuthology.orchestra.run.smithi008.stdout: osd journal size = 100 2023-10-06T04:37:26.115 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.115 INFO:teuthology.orchestra.run.smithi008.stdout: osd scrub load threshold = 5.0 2023-10-06T04:37:26.115 INFO:teuthology.orchestra.run.smithi008.stdout: osd scrub max interval = 600 2023-10-06T04:37:26.115 INFO:teuthology.orchestra.run.smithi008.stdout: osd mclock profile = high_recovery_ops 2023-10-06T04:37:26.115 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.116 INFO:teuthology.orchestra.run.smithi008.stdout: osd recover clone overlap = true 2023-10-06T04:37:26.116 INFO:teuthology.orchestra.run.smithi008.stdout: osd recovery max chunk = 1048576 2023-10-06T04:37:26.116 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.116 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug shutdown = true 2023-10-06T04:37:26.116 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug op order = true 2023-10-06T04:37:26.116 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug verify stray on activate = true 2023-10-06T04:37:26.116 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.116 INFO:teuthology.orchestra.run.smithi008.stdout: osd open classes on start = true 2023-10-06T04:37:26.116 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug pg log writeout = true 2023-10-06T04:37:26.117 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.117 INFO:teuthology.orchestra.run.smithi008.stdout: osd deep scrub update digest min age = 30 2023-10-06T04:37:26.117 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.117 INFO:teuthology.orchestra.run.smithi008.stdout: osd map max advance = 10 2023-10-06T04:37:26.117 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.117 INFO:teuthology.orchestra.run.smithi008.stdout: journal zero on create = true 2023-10-06T04:37:26.117 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.117 INFO:teuthology.orchestra.run.smithi008.stdout: filestore ondisk finisher threads = 3 2023-10-06T04:37:26.117 INFO:teuthology.orchestra.run.smithi008.stdout: filestore apply finisher threads = 3 2023-10-06T04:37:26.117 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.117 INFO:teuthology.orchestra.run.smithi008.stdout: bdev debug aio = true 2023-10-06T04:37:26.118 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug misdirected ops = true 2023-10-06T04:37:26.118 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore block size = 96636764160 2023-10-06T04:37:26.118 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore fsck on mount = True 2023-10-06T04:37:26.118 INFO:teuthology.orchestra.run.smithi008.stdout: debug bluefs = 20 2023-10-06T04:37:26.118 INFO:teuthology.orchestra.run.smithi008.stdout: debug bluestore = 20 2023-10-06T04:37:26.118 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-10-06T04:37:26.118 INFO:teuthology.orchestra.run.smithi008.stdout: debug osd = 20 2023-10-06T04:37:26.118 INFO:teuthology.orchestra.run.smithi008.stdout: debug rocksdb = 10 2023-10-06T04:37:26.118 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T04:37:26.119 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd full ratio = 0.9 2023-10-06T04:37:26.119 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd nearfull ratio = 0.8 2023-10-06T04:37:26.119 INFO:teuthology.orchestra.run.smithi008.stdout: osd failsafe full ratio = 0.95 2023-10-06T04:37:26.119 INFO:teuthology.orchestra.run.smithi008.stdout: osd objectstore = bluestore 2023-10-06T04:37:26.119 INFO:teuthology.orchestra.run.smithi008.stdout: osd op complaint time = 180 2023-10-06T04:37:26.119 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.119 INFO:teuthology.orchestra.run.smithi008.stdout:[mgr] 2023-10-06T04:37:26.119 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-10-06T04:37:26.119 INFO:teuthology.orchestra.run.smithi008.stdout: debug mgr = 20 2023-10-06T04:37:26.120 INFO:teuthology.orchestra.run.smithi008.stdout: debug mon = 20 2023-10-06T04:37:26.120 INFO:teuthology.orchestra.run.smithi008.stdout: debug auth = 20 2023-10-06T04:37:26.120 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min pgs per osd = 4 2023-10-06T04:37:26.120 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min bytes per osd = 10 2023-10-06T04:37:26.120 INFO:teuthology.orchestra.run.smithi008.stdout: mgr/telemetry/nag = false 2023-10-06T04:37:26.120 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.120 INFO:teuthology.orchestra.run.smithi008.stdout:[mon] 2023-10-06T04:37:26.120 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-10-06T04:37:26.120 INFO:teuthology.orchestra.run.smithi008.stdout: debug mon = 20 2023-10-06T04:37:26.120 INFO:teuthology.orchestra.run.smithi008.stdout: debug paxos = 20 2023-10-06T04:37:26.121 INFO:teuthology.orchestra.run.smithi008.stdout: debug auth = 20 2023-10-06T04:37:26.121 INFO:teuthology.orchestra.run.smithi008.stdout: mon data avail warn = 5 2023-10-06T04:37:26.121 INFO:teuthology.orchestra.run.smithi008.stdout: mon mgr mkfs grace = 240 2023-10-06T04:37:26.121 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min pgs per osd = 4 2023-10-06T04:37:26.121 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd reporter subtree level = osd 2023-10-06T04:37:26.121 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd prime pg temp = true 2023-10-06T04:37:26.121 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min bytes per osd = 10 2023-10-06T04:37:26.121 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.121 INFO:teuthology.orchestra.run.smithi008.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T04:37:26.122 INFO:teuthology.orchestra.run.smithi008.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T04:37:26.122 INFO:teuthology.orchestra.run.smithi008.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T04:37:26.122 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.122 INFO:teuthology.orchestra.run.smithi008.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T04:37:26.122 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T04:37:26.122 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T04:37:26.122 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.122 INFO:teuthology.orchestra.run.smithi008.stdout: # 1m isn't quite enough 2023-10-06T04:37:26.122 INFO:teuthology.orchestra.run.smithi008.stdout: mon_down_mkfs_grace = 2m 2023-10-06T04:37:26.122 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.123 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_filestore_osds = false 2023-10-06T04:37:26.123 INFO:teuthology.orchestra.run.smithi008.stdout: mon op complaint time = 120 2023-10-06T04:37:26.123 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.123 INFO:teuthology.orchestra.run.smithi008.stdout:[client] 2023-10-06T04:37:26.123 INFO:teuthology.orchestra.run.smithi008.stdout: rgw cache enabled = true 2023-10-06T04:37:26.123 INFO:teuthology.orchestra.run.smithi008.stdout: rgw enable ops log = true 2023-10-06T04:37:26.123 INFO:teuthology.orchestra.run.smithi008.stdout: rgw enable usage log = true 2023-10-06T04:37:26.123 INFO:teuthology.orchestra.run.smithi008.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T04:37:26.123 INFO:teuthology.orchestra.run.smithi008.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T04:37:26.124 INFO:teuthology.orchestra.run.smithi008.stdout: client mount timeout = 600 2023-10-06T04:37:26.124 INFO:teuthology.orchestra.run.smithi008.stdout: debug client = 20 2023-10-06T04:37:26.124 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-10-06T04:37:26.124 INFO:teuthology.orchestra.run.smithi008.stdout: pid file = "" 2023-10-06T04:37:26.124 INFO:teuthology.orchestra.run.smithi008.stdout: rados mon op timeout = 900 2023-10-06T04:37:26.124 INFO:teuthology.orchestra.run.smithi008.stdout: rados osd op timeout = 900 2023-10-06T04:37:26.124 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.a] 2023-10-06T04:37:26.124 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.b] 2023-10-06T04:37:26.124 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.c] 2023-10-06T04:37:26.124 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.a] 2023-10-06T04:37:26.125 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.c] 2023-10-06T04:37:26.125 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.b] 2023-10-06T04:37:26.125 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.d] 2023-10-06T04:37:26.125 INFO:teuthology.orchestra.run.smithi008.stdout:[mds] 2023-10-06T04:37:26.125 INFO:teuthology.orchestra.run.smithi008.stdout: debug mds = 20 2023-10-06T04:37:26.125 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-10-06T04:37:26.125 INFO:teuthology.orchestra.run.smithi008.stdout: mds debug frag = True 2023-10-06T04:37:26.125 INFO:teuthology.orchestra.run.smithi008.stdout: mds debug scatterstat = True 2023-10-06T04:37:26.125 INFO:teuthology.orchestra.run.smithi008.stdout: mds op complaint time = 180 2023-10-06T04:37:26.125 INFO:teuthology.orchestra.run.smithi008.stdout: mds verify scatter = False 2023-10-06T04:37:26.126 INFO:teuthology.orchestra.run.smithi008.stdout: osd op complaint time = 180 2023-10-06T04:37:26.126 INFO:teuthology.orchestra.run.smithi008.stdout: rados mon op timeout = 900 2023-10-06T04:37:26.126 INFO:teuthology.orchestra.run.smithi008.stdout: rados osd op timeout = 900 2023-10-06T04:37:26.126 INFO:teuthology.orchestra.run.smithi184.stdout:[global] 2023-10-06T04:37:26.127 INFO:teuthology.orchestra.run.smithi184.stdout: chdir = "" 2023-10-06T04:37:26.127 INFO:teuthology.orchestra.run.smithi184.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T04:37:26.127 INFO:teuthology.orchestra.run.smithi184.stdout: auth supported = cephx 2023-10-06T04:37:26.127 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.127 INFO:teuthology.orchestra.run.smithi184.stdout: filestore xattr use omap = true 2023-10-06T04:37:26.127 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.127 INFO:teuthology.orchestra.run.smithi184.stdout: mon clock drift allowed = 1.000 2023-10-06T04:37:26.127 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.127 INFO:teuthology.orchestra.run.smithi184.stdout: osd crush chooseleaf type = 0 2023-10-06T04:37:26.128 INFO:teuthology.orchestra.run.smithi184.stdout: auth debug = true 2023-10-06T04:37:26.128 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.128 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on old message = true 2023-10-06T04:37:26.128 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on bug = true 2023-10-06T04:37:26.128 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.128 INFO:teuthology.orchestra.run.smithi184.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T04:37:26.128 INFO:teuthology.orchestra.run.smithi184.stdout: mon pg warn max object skew = 0 2023-10-06T04:37:26.128 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.128 INFO:teuthology.orchestra.run.smithi184.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T04:37:26.128 INFO:teuthology.orchestra.run.smithi184.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T04:37:26.129 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.129 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default size = 2 2023-10-06T04:37:26.129 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.129 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow primary affinity = true 2023-10-06T04:37:26.129 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow pg remap = true 2023-10-06T04:37:26.129 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on legacy crush tunables = false 2023-10-06T04:37:26.129 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on crush straw calc version zero = false 2023-10-06T04:37:26.129 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on no sortbitwise = false 2023-10-06T04:37:26.129 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on osd down out interval zero = false 2023-10-06T04:37:26.129 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on too few osds = false 2023-10-06T04:37:26.130 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T04:37:26.130 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T04:37:26.130 INFO:teuthology.orchestra.run.smithi184.stdout: mon_allow_pool_size_one = true 2023-10-06T04:37:26.130 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.130 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T04:37:26.130 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.130 INFO:teuthology.orchestra.run.smithi184.stdout: osd default data pool replay window = 5 2023-10-06T04:37:26.130 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.130 INFO:teuthology.orchestra.run.smithi184.stdout: mon allow pool delete = true 2023-10-06T04:37:26.131 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.131 INFO:teuthology.orchestra.run.smithi184.stdout: mon cluster log file level = debug 2023-10-06T04:37:26.131 INFO:teuthology.orchestra.run.smithi184.stdout: debug asserts on shutdown = true 2023-10-06T04:37:26.131 INFO:teuthology.orchestra.run.smithi184.stdout: mon health detail to clog = false 2023-10-06T04:37:26.131 INFO:teuthology.orchestra.run.smithi184.stdout: mon host = "172.21.15.8,172.21.15.184,[v2:172.21.15.184:3301,v1:172.21.15.184:6790]" 2023-10-06T04:37:26.131 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on skipped message = False 2023-10-06T04:37:26.131 INFO:teuthology.orchestra.run.smithi184.stdout: fsid = c030d94d-df8f-49bb-8df7-07e9e557d96b 2023-10-06T04:37:26.131 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.131 INFO:teuthology.orchestra.run.smithi184.stdout:[osd] 2023-10-06T04:37:26.131 INFO:teuthology.orchestra.run.smithi184.stdout: osd journal size = 100 2023-10-06T04:37:26.131 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.132 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub load threshold = 5.0 2023-10-06T04:37:26.132 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub max interval = 600 2023-10-06T04:37:26.132 INFO:teuthology.orchestra.run.smithi184.stdout: osd mclock profile = high_recovery_ops 2023-10-06T04:37:26.132 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.132 INFO:teuthology.orchestra.run.smithi184.stdout: osd recover clone overlap = true 2023-10-06T04:37:26.132 INFO:teuthology.orchestra.run.smithi184.stdout: osd recovery max chunk = 1048576 2023-10-06T04:37:26.132 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.132 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug shutdown = true 2023-10-06T04:37:26.132 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug op order = true 2023-10-06T04:37:26.132 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug verify stray on activate = true 2023-10-06T04:37:26.132 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.133 INFO:teuthology.orchestra.run.smithi184.stdout: osd open classes on start = true 2023-10-06T04:37:26.133 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug pg log writeout = true 2023-10-06T04:37:26.133 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.133 INFO:teuthology.orchestra.run.smithi184.stdout: osd deep scrub update digest min age = 30 2023-10-06T04:37:26.133 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.133 INFO:teuthology.orchestra.run.smithi184.stdout: osd map max advance = 10 2023-10-06T04:37:26.133 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.133 INFO:teuthology.orchestra.run.smithi184.stdout: journal zero on create = true 2023-10-06T04:37:26.133 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.134 INFO:teuthology.orchestra.run.smithi184.stdout: filestore ondisk finisher threads = 3 2023-10-06T04:37:26.134 INFO:teuthology.orchestra.run.smithi184.stdout: filestore apply finisher threads = 3 2023-10-06T04:37:26.134 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.134 INFO:teuthology.orchestra.run.smithi184.stdout: bdev debug aio = true 2023-10-06T04:37:26.134 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug misdirected ops = true 2023-10-06T04:37:26.134 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore block size = 96636764160 2023-10-06T04:37:26.134 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore fsck on mount = True 2023-10-06T04:37:26.134 INFO:teuthology.orchestra.run.smithi184.stdout: debug bluefs = 20 2023-10-06T04:37:26.134 INFO:teuthology.orchestra.run.smithi184.stdout: debug bluestore = 20 2023-10-06T04:37:26.135 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-10-06T04:37:26.135 INFO:teuthology.orchestra.run.smithi184.stdout: debug osd = 20 2023-10-06T04:37:26.135 INFO:teuthology.orchestra.run.smithi184.stdout: debug rocksdb = 10 2023-10-06T04:37:26.135 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T04:37:26.135 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd full ratio = 0.9 2023-10-06T04:37:26.135 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd nearfull ratio = 0.8 2023-10-06T04:37:26.135 INFO:teuthology.orchestra.run.smithi184.stdout: osd failsafe full ratio = 0.95 2023-10-06T04:37:26.135 INFO:teuthology.orchestra.run.smithi184.stdout: osd objectstore = bluestore 2023-10-06T04:37:26.135 INFO:teuthology.orchestra.run.smithi184.stdout: osd op complaint time = 180 2023-10-06T04:37:26.135 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.136 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr] 2023-10-06T04:37:26.136 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-10-06T04:37:26.136 INFO:teuthology.orchestra.run.smithi184.stdout: debug mgr = 20 2023-10-06T04:37:26.136 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2023-10-06T04:37:26.136 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2023-10-06T04:37:26.136 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2023-10-06T04:37:26.136 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2023-10-06T04:37:26.136 INFO:teuthology.orchestra.run.smithi184.stdout: mgr/telemetry/nag = false 2023-10-06T04:37:26.136 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.136 INFO:teuthology.orchestra.run.smithi184.stdout:[mon] 2023-10-06T04:37:26.136 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-10-06T04:37:26.137 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2023-10-06T04:37:26.137 INFO:teuthology.orchestra.run.smithi184.stdout: debug paxos = 20 2023-10-06T04:37:26.137 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2023-10-06T04:37:26.137 INFO:teuthology.orchestra.run.smithi184.stdout: mon data avail warn = 5 2023-10-06T04:37:26.137 INFO:teuthology.orchestra.run.smithi184.stdout: mon mgr mkfs grace = 240 2023-10-06T04:37:26.137 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2023-10-06T04:37:26.137 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd reporter subtree level = osd 2023-10-06T04:37:26.137 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd prime pg temp = true 2023-10-06T04:37:26.137 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2023-10-06T04:37:26.138 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.138 INFO:teuthology.orchestra.run.smithi184.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T04:37:26.138 INFO:teuthology.orchestra.run.smithi184.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T04:37:26.138 INFO:teuthology.orchestra.run.smithi184.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T04:37:26.138 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.138 INFO:teuthology.orchestra.run.smithi184.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T04:37:26.138 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T04:37:26.138 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T04:37:26.138 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.138 INFO:teuthology.orchestra.run.smithi184.stdout: # 1m isn't quite enough 2023-10-06T04:37:26.138 INFO:teuthology.orchestra.run.smithi184.stdout: mon_down_mkfs_grace = 2m 2023-10-06T04:37:26.139 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.139 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_filestore_osds = false 2023-10-06T04:37:26.139 INFO:teuthology.orchestra.run.smithi184.stdout: mon op complaint time = 120 2023-10-06T04:37:26.139 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.139 INFO:teuthology.orchestra.run.smithi184.stdout:[client] 2023-10-06T04:37:26.139 INFO:teuthology.orchestra.run.smithi184.stdout: rgw cache enabled = true 2023-10-06T04:37:26.139 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable ops log = true 2023-10-06T04:37:26.139 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable usage log = true 2023-10-06T04:37:26.139 INFO:teuthology.orchestra.run.smithi184.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T04:37:26.140 INFO:teuthology.orchestra.run.smithi184.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T04:37:26.140 INFO:teuthology.orchestra.run.smithi184.stdout: client mount timeout = 600 2023-10-06T04:37:26.140 INFO:teuthology.orchestra.run.smithi184.stdout: debug client = 20 2023-10-06T04:37:26.140 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-10-06T04:37:26.140 INFO:teuthology.orchestra.run.smithi184.stdout: pid file = "" 2023-10-06T04:37:26.140 INFO:teuthology.orchestra.run.smithi184.stdout: rados mon op timeout = 900 2023-10-06T04:37:26.140 INFO:teuthology.orchestra.run.smithi184.stdout: rados osd op timeout = 900 2023-10-06T04:37:26.140 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.a] 2023-10-06T04:37:26.140 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.b] 2023-10-06T04:37:26.140 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.c] 2023-10-06T04:37:26.141 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.a] 2023-10-06T04:37:26.141 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.c] 2023-10-06T04:37:26.141 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.b] 2023-10-06T04:37:26.141 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.d] 2023-10-06T04:37:26.141 INFO:teuthology.orchestra.run.smithi184.stdout:[mds] 2023-10-06T04:37:26.141 INFO:teuthology.orchestra.run.smithi184.stdout: debug mds = 20 2023-10-06T04:37:26.141 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-10-06T04:37:26.141 INFO:teuthology.orchestra.run.smithi184.stdout: mds debug frag = True 2023-10-06T04:37:26.141 INFO:teuthology.orchestra.run.smithi184.stdout: mds debug scatterstat = True 2023-10-06T04:37:26.142 INFO:teuthology.orchestra.run.smithi184.stdout: mds op complaint time = 180 2023-10-06T04:37:26.142 INFO:teuthology.orchestra.run.smithi184.stdout: mds verify scatter = False 2023-10-06T04:37:26.142 INFO:teuthology.orchestra.run.smithi184.stdout: osd op complaint time = 180 2023-10-06T04:37:26.142 INFO:teuthology.orchestra.run.smithi184.stdout: rados mon op timeout = 900 2023-10-06T04:37:26.142 INFO:teuthology.orchestra.run.smithi184.stdout: rados osd op timeout = 900 2023-10-06T04:37:26.144 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T04:37:26.185 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T04:37:26.227 INFO:teuthology.orchestra.run.smithi008.stdout:[global] 2023-10-06T04:37:26.227 INFO:teuthology.orchestra.run.smithi008.stdout: chdir = "" 2023-10-06T04:37:26.227 INFO:teuthology.orchestra.run.smithi008.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T04:37:26.228 INFO:teuthology.orchestra.run.smithi008.stdout: auth supported = cephx 2023-10-06T04:37:26.228 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.228 INFO:teuthology.orchestra.run.smithi008.stdout: filestore xattr use omap = true 2023-10-06T04:37:26.228 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.228 INFO:teuthology.orchestra.run.smithi008.stdout: mon clock drift allowed = 1.000 2023-10-06T04:37:26.228 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.228 INFO:teuthology.orchestra.run.smithi008.stdout: osd crush chooseleaf type = 0 2023-10-06T04:37:26.228 INFO:teuthology.orchestra.run.smithi008.stdout: auth debug = true 2023-10-06T04:37:26.228 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.228 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on old message = true 2023-10-06T04:37:26.229 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on bug = true 2023-10-06T04:37:26.229 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.229 INFO:teuthology.orchestra.run.smithi008.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T04:37:26.229 INFO:teuthology.orchestra.run.smithi008.stdout: mon pg warn max object skew = 0 2023-10-06T04:37:26.229 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.229 INFO:teuthology.orchestra.run.smithi008.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T04:37:26.229 INFO:teuthology.orchestra.run.smithi008.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T04:37:26.229 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.229 INFO:teuthology.orchestra.run.smithi008.stdout: osd pool default size = 2 2023-10-06T04:37:26.229 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.230 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd allow primary affinity = true 2023-10-06T04:37:26.230 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd allow pg remap = true 2023-10-06T04:37:26.230 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on legacy crush tunables = false 2023-10-06T04:37:26.230 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on crush straw calc version zero = false 2023-10-06T04:37:26.230 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on no sortbitwise = false 2023-10-06T04:37:26.230 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on osd down out interval zero = false 2023-10-06T04:37:26.230 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on too few osds = false 2023-10-06T04:37:26.230 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T04:37:26.230 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T04:37:26.231 INFO:teuthology.orchestra.run.smithi008.stdout: mon_allow_pool_size_one = true 2023-10-06T04:37:26.231 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.231 INFO:teuthology.orchestra.run.smithi008.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T04:37:26.231 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.231 INFO:teuthology.orchestra.run.smithi008.stdout: osd default data pool replay window = 5 2023-10-06T04:37:26.231 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.231 INFO:teuthology.orchestra.run.smithi008.stdout: mon allow pool delete = true 2023-10-06T04:37:26.231 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.231 INFO:teuthology.orchestra.run.smithi008.stdout: mon cluster log file level = debug 2023-10-06T04:37:26.231 INFO:teuthology.orchestra.run.smithi008.stdout: debug asserts on shutdown = true 2023-10-06T04:37:26.231 INFO:teuthology.orchestra.run.smithi008.stdout: mon health detail to clog = false 2023-10-06T04:37:26.232 INFO:teuthology.orchestra.run.smithi008.stdout: mon host = "172.21.15.8,172.21.15.184,[v2:172.21.15.184:3301,v1:172.21.15.184:6790]" 2023-10-06T04:37:26.232 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on skipped message = False 2023-10-06T04:37:26.232 INFO:teuthology.orchestra.run.smithi008.stdout: fsid = c030d94d-df8f-49bb-8df7-07e9e557d96b 2023-10-06T04:37:26.232 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.232 INFO:teuthology.orchestra.run.smithi008.stdout:[osd] 2023-10-06T04:37:26.232 INFO:teuthology.orchestra.run.smithi008.stdout: osd journal size = 100 2023-10-06T04:37:26.232 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.232 INFO:teuthology.orchestra.run.smithi008.stdout: osd scrub load threshold = 5.0 2023-10-06T04:37:26.232 INFO:teuthology.orchestra.run.smithi008.stdout: osd scrub max interval = 600 2023-10-06T04:37:26.232 INFO:teuthology.orchestra.run.smithi008.stdout: osd mclock profile = high_recovery_ops 2023-10-06T04:37:26.232 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.233 INFO:teuthology.orchestra.run.smithi008.stdout: osd recover clone overlap = true 2023-10-06T04:37:26.233 INFO:teuthology.orchestra.run.smithi008.stdout: osd recovery max chunk = 1048576 2023-10-06T04:37:26.233 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.233 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug shutdown = true 2023-10-06T04:37:26.233 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug op order = true 2023-10-06T04:37:26.233 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug verify stray on activate = true 2023-10-06T04:37:26.233 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.233 INFO:teuthology.orchestra.run.smithi008.stdout: osd open classes on start = true 2023-10-06T04:37:26.233 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug pg log writeout = true 2023-10-06T04:37:26.233 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.233 INFO:teuthology.orchestra.run.smithi008.stdout: osd deep scrub update digest min age = 30 2023-10-06T04:37:26.234 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.234 INFO:teuthology.orchestra.run.smithi008.stdout: osd map max advance = 10 2023-10-06T04:37:26.234 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.234 INFO:teuthology.orchestra.run.smithi008.stdout: journal zero on create = true 2023-10-06T04:37:26.234 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.234 INFO:teuthology.orchestra.run.smithi008.stdout: filestore ondisk finisher threads = 3 2023-10-06T04:37:26.234 INFO:teuthology.orchestra.run.smithi008.stdout: filestore apply finisher threads = 3 2023-10-06T04:37:26.234 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.234 INFO:teuthology.orchestra.run.smithi008.stdout: bdev debug aio = true 2023-10-06T04:37:26.234 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug misdirected ops = true 2023-10-06T04:37:26.235 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore block size = 96636764160 2023-10-06T04:37:26.235 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore fsck on mount = True 2023-10-06T04:37:26.235 INFO:teuthology.orchestra.run.smithi008.stdout: debug bluefs = 20 2023-10-06T04:37:26.235 INFO:teuthology.orchestra.run.smithi008.stdout: debug bluestore = 20 2023-10-06T04:37:26.235 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-10-06T04:37:26.235 INFO:teuthology.orchestra.run.smithi008.stdout: debug osd = 20 2023-10-06T04:37:26.235 INFO:teuthology.orchestra.run.smithi008.stdout: debug rocksdb = 10 2023-10-06T04:37:26.235 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T04:37:26.235 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd full ratio = 0.9 2023-10-06T04:37:26.235 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd nearfull ratio = 0.8 2023-10-06T04:37:26.235 INFO:teuthology.orchestra.run.smithi008.stdout: osd failsafe full ratio = 0.95 2023-10-06T04:37:26.236 INFO:teuthology.orchestra.run.smithi008.stdout: osd objectstore = bluestore 2023-10-06T04:37:26.236 INFO:teuthology.orchestra.run.smithi008.stdout: osd op complaint time = 180 2023-10-06T04:37:26.236 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.236 INFO:teuthology.orchestra.run.smithi008.stdout:[mgr] 2023-10-06T04:37:26.236 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-10-06T04:37:26.236 INFO:teuthology.orchestra.run.smithi008.stdout: debug mgr = 20 2023-10-06T04:37:26.236 INFO:teuthology.orchestra.run.smithi008.stdout: debug mon = 20 2023-10-06T04:37:26.236 INFO:teuthology.orchestra.run.smithi008.stdout: debug auth = 20 2023-10-06T04:37:26.236 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min pgs per osd = 4 2023-10-06T04:37:26.236 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min bytes per osd = 10 2023-10-06T04:37:26.236 INFO:teuthology.orchestra.run.smithi008.stdout: mgr/telemetry/nag = false 2023-10-06T04:37:26.236 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.237 INFO:teuthology.orchestra.run.smithi008.stdout:[mon] 2023-10-06T04:37:26.237 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-10-06T04:37:26.237 INFO:teuthology.orchestra.run.smithi008.stdout: debug mon = 20 2023-10-06T04:37:26.237 INFO:teuthology.orchestra.run.smithi008.stdout: debug paxos = 20 2023-10-06T04:37:26.237 INFO:teuthology.orchestra.run.smithi008.stdout: debug auth = 20 2023-10-06T04:37:26.237 INFO:teuthology.orchestra.run.smithi008.stdout: mon data avail warn = 5 2023-10-06T04:37:26.237 INFO:teuthology.orchestra.run.smithi008.stdout: mon mgr mkfs grace = 240 2023-10-06T04:37:26.237 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min pgs per osd = 4 2023-10-06T04:37:26.237 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd reporter subtree level = osd 2023-10-06T04:37:26.238 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd prime pg temp = true 2023-10-06T04:37:26.238 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min bytes per osd = 10 2023-10-06T04:37:26.238 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.238 INFO:teuthology.orchestra.run.smithi008.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T04:37:26.238 INFO:teuthology.orchestra.run.smithi008.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T04:37:26.238 INFO:teuthology.orchestra.run.smithi008.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T04:37:26.238 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.238 INFO:teuthology.orchestra.run.smithi008.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T04:37:26.238 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T04:37:26.239 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T04:37:26.239 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.239 INFO:teuthology.orchestra.run.smithi008.stdout: # 1m isn't quite enough 2023-10-06T04:37:26.239 INFO:teuthology.orchestra.run.smithi008.stdout: mon_down_mkfs_grace = 2m 2023-10-06T04:37:26.239 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.239 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_filestore_osds = false 2023-10-06T04:37:26.239 INFO:teuthology.orchestra.run.smithi008.stdout: mon op complaint time = 120 2023-10-06T04:37:26.239 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.239 INFO:teuthology.orchestra.run.smithi008.stdout:[client] 2023-10-06T04:37:26.239 INFO:teuthology.orchestra.run.smithi008.stdout: rgw cache enabled = true 2023-10-06T04:37:26.240 INFO:teuthology.orchestra.run.smithi008.stdout: rgw enable ops log = true 2023-10-06T04:37:26.240 INFO:teuthology.orchestra.run.smithi008.stdout: rgw enable usage log = true 2023-10-06T04:37:26.240 INFO:teuthology.orchestra.run.smithi008.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T04:37:26.240 INFO:teuthology.orchestra.run.smithi008.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T04:37:26.240 INFO:teuthology.orchestra.run.smithi008.stdout: client mount timeout = 600 2023-10-06T04:37:26.240 INFO:teuthology.orchestra.run.smithi008.stdout: debug client = 20 2023-10-06T04:37:26.240 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-10-06T04:37:26.240 INFO:teuthology.orchestra.run.smithi008.stdout: pid file = "" 2023-10-06T04:37:26.240 INFO:teuthology.orchestra.run.smithi008.stdout: rados mon op timeout = 900 2023-10-06T04:37:26.240 INFO:teuthology.orchestra.run.smithi008.stdout: rados osd op timeout = 900 2023-10-06T04:37:26.240 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.a] 2023-10-06T04:37:26.241 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.b] 2023-10-06T04:37:26.241 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.c] 2023-10-06T04:37:26.241 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.a] 2023-10-06T04:37:26.241 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.c] 2023-10-06T04:37:26.241 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.b] 2023-10-06T04:37:26.241 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.d] 2023-10-06T04:37:26.241 INFO:teuthology.orchestra.run.smithi008.stdout:[mds] 2023-10-06T04:37:26.241 INFO:teuthology.orchestra.run.smithi008.stdout: debug mds = 20 2023-10-06T04:37:26.241 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-10-06T04:37:26.241 INFO:teuthology.orchestra.run.smithi008.stdout: mds debug frag = True 2023-10-06T04:37:26.242 INFO:teuthology.orchestra.run.smithi008.stdout: mds debug scatterstat = False 2023-10-06T04:37:26.242 INFO:teuthology.orchestra.run.smithi008.stdout: mds op complaint time = 180 2023-10-06T04:37:26.242 INFO:teuthology.orchestra.run.smithi008.stdout: mds verify scatter = False 2023-10-06T04:37:26.242 INFO:teuthology.orchestra.run.smithi008.stdout: osd op complaint time = 180 2023-10-06T04:37:26.242 INFO:teuthology.orchestra.run.smithi008.stdout: rados mon op timeout = 900 2023-10-06T04:37:26.242 INFO:teuthology.orchestra.run.smithi008.stdout: rados osd op timeout = 900 2023-10-06T04:37:26.244 INFO:teuthology.orchestra.run.smithi184.stdout:[global] 2023-10-06T04:37:26.244 INFO:teuthology.orchestra.run.smithi184.stdout: chdir = "" 2023-10-06T04:37:26.244 INFO:teuthology.orchestra.run.smithi184.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T04:37:26.244 INFO:teuthology.orchestra.run.smithi184.stdout: auth supported = cephx 2023-10-06T04:37:26.244 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.244 INFO:teuthology.orchestra.run.smithi184.stdout: filestore xattr use omap = true 2023-10-06T04:37:26.244 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.245 INFO:teuthology.orchestra.run.smithi184.stdout: mon clock drift allowed = 1.000 2023-10-06T04:37:26.245 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.245 INFO:teuthology.orchestra.run.smithi184.stdout: osd crush chooseleaf type = 0 2023-10-06T04:37:26.245 INFO:teuthology.orchestra.run.smithi184.stdout: auth debug = true 2023-10-06T04:37:26.245 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.245 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on old message = true 2023-10-06T04:37:26.245 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on bug = true 2023-10-06T04:37:26.245 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.245 INFO:teuthology.orchestra.run.smithi184.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T04:37:26.246 INFO:teuthology.orchestra.run.smithi184.stdout: mon pg warn max object skew = 0 2023-10-06T04:37:26.246 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.246 INFO:teuthology.orchestra.run.smithi184.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T04:37:26.246 INFO:teuthology.orchestra.run.smithi184.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T04:37:26.246 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.246 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default size = 2 2023-10-06T04:37:26.246 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.246 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow primary affinity = true 2023-10-06T04:37:26.246 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow pg remap = true 2023-10-06T04:37:26.247 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on legacy crush tunables = false 2023-10-06T04:37:26.247 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on crush straw calc version zero = false 2023-10-06T04:37:26.247 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on no sortbitwise = false 2023-10-06T04:37:26.247 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on osd down out interval zero = false 2023-10-06T04:37:26.247 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on too few osds = false 2023-10-06T04:37:26.247 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T04:37:26.247 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T04:37:26.247 INFO:teuthology.orchestra.run.smithi184.stdout: mon_allow_pool_size_one = true 2023-10-06T04:37:26.247 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.248 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T04:37:26.248 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.248 INFO:teuthology.orchestra.run.smithi184.stdout: osd default data pool replay window = 5 2023-10-06T04:37:26.248 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.248 INFO:teuthology.orchestra.run.smithi184.stdout: mon allow pool delete = true 2023-10-06T04:37:26.248 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.248 INFO:teuthology.orchestra.run.smithi184.stdout: mon cluster log file level = debug 2023-10-06T04:37:26.248 INFO:teuthology.orchestra.run.smithi184.stdout: debug asserts on shutdown = true 2023-10-06T04:37:26.248 INFO:teuthology.orchestra.run.smithi184.stdout: mon health detail to clog = false 2023-10-06T04:37:26.248 INFO:teuthology.orchestra.run.smithi184.stdout: mon host = "172.21.15.8,172.21.15.184,[v2:172.21.15.184:3301,v1:172.21.15.184:6790]" 2023-10-06T04:37:26.249 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on skipped message = False 2023-10-06T04:37:26.249 INFO:teuthology.orchestra.run.smithi184.stdout: fsid = c030d94d-df8f-49bb-8df7-07e9e557d96b 2023-10-06T04:37:26.249 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.249 INFO:teuthology.orchestra.run.smithi184.stdout:[osd] 2023-10-06T04:37:26.249 INFO:teuthology.orchestra.run.smithi184.stdout: osd journal size = 100 2023-10-06T04:37:26.249 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.249 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub load threshold = 5.0 2023-10-06T04:37:26.249 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub max interval = 600 2023-10-06T04:37:26.249 INFO:teuthology.orchestra.run.smithi184.stdout: osd mclock profile = high_recovery_ops 2023-10-06T04:37:26.249 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.250 INFO:teuthology.orchestra.run.smithi184.stdout: osd recover clone overlap = true 2023-10-06T04:37:26.250 INFO:teuthology.orchestra.run.smithi184.stdout: osd recovery max chunk = 1048576 2023-10-06T04:37:26.250 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.250 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug shutdown = true 2023-10-06T04:37:26.250 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug op order = true 2023-10-06T04:37:26.250 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug verify stray on activate = true 2023-10-06T04:37:26.250 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.250 INFO:teuthology.orchestra.run.smithi184.stdout: osd open classes on start = true 2023-10-06T04:37:26.250 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug pg log writeout = true 2023-10-06T04:37:26.251 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.251 INFO:teuthology.orchestra.run.smithi184.stdout: osd deep scrub update digest min age = 30 2023-10-06T04:37:26.251 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.251 INFO:teuthology.orchestra.run.smithi184.stdout: osd map max advance = 10 2023-10-06T04:37:26.251 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.251 INFO:teuthology.orchestra.run.smithi184.stdout: journal zero on create = true 2023-10-06T04:37:26.251 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.251 INFO:teuthology.orchestra.run.smithi184.stdout: filestore ondisk finisher threads = 3 2023-10-06T04:37:26.251 INFO:teuthology.orchestra.run.smithi184.stdout: filestore apply finisher threads = 3 2023-10-06T04:37:26.251 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.252 INFO:teuthology.orchestra.run.smithi184.stdout: bdev debug aio = true 2023-10-06T04:37:26.252 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug misdirected ops = true 2023-10-06T04:37:26.252 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore block size = 96636764160 2023-10-06T04:37:26.252 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore fsck on mount = True 2023-10-06T04:37:26.252 INFO:teuthology.orchestra.run.smithi184.stdout: debug bluefs = 20 2023-10-06T04:37:26.252 INFO:teuthology.orchestra.run.smithi184.stdout: debug bluestore = 20 2023-10-06T04:37:26.252 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-10-06T04:37:26.252 INFO:teuthology.orchestra.run.smithi184.stdout: debug osd = 20 2023-10-06T04:37:26.252 INFO:teuthology.orchestra.run.smithi184.stdout: debug rocksdb = 10 2023-10-06T04:37:26.253 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T04:37:26.253 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd full ratio = 0.9 2023-10-06T04:37:26.253 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd nearfull ratio = 0.8 2023-10-06T04:37:26.253 INFO:teuthology.orchestra.run.smithi184.stdout: osd failsafe full ratio = 0.95 2023-10-06T04:37:26.253 INFO:teuthology.orchestra.run.smithi184.stdout: osd objectstore = bluestore 2023-10-06T04:37:26.253 INFO:teuthology.orchestra.run.smithi184.stdout: osd op complaint time = 180 2023-10-06T04:37:26.253 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.253 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr] 2023-10-06T04:37:26.253 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-10-06T04:37:26.254 INFO:teuthology.orchestra.run.smithi184.stdout: debug mgr = 20 2023-10-06T04:37:26.254 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2023-10-06T04:37:26.254 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2023-10-06T04:37:26.254 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2023-10-06T04:37:26.254 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2023-10-06T04:37:26.254 INFO:teuthology.orchestra.run.smithi184.stdout: mgr/telemetry/nag = false 2023-10-06T04:37:26.254 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.254 INFO:teuthology.orchestra.run.smithi184.stdout:[mon] 2023-10-06T04:37:26.255 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-10-06T04:37:26.255 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2023-10-06T04:37:26.255 INFO:teuthology.orchestra.run.smithi184.stdout: debug paxos = 20 2023-10-06T04:37:26.255 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2023-10-06T04:37:26.255 INFO:teuthology.orchestra.run.smithi184.stdout: mon data avail warn = 5 2023-10-06T04:37:26.255 INFO:teuthology.orchestra.run.smithi184.stdout: mon mgr mkfs grace = 240 2023-10-06T04:37:26.255 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2023-10-06T04:37:26.255 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd reporter subtree level = osd 2023-10-06T04:37:26.255 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd prime pg temp = true 2023-10-06T04:37:26.255 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2023-10-06T04:37:26.256 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.256 INFO:teuthology.orchestra.run.smithi184.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T04:37:26.256 INFO:teuthology.orchestra.run.smithi184.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T04:37:26.256 INFO:teuthology.orchestra.run.smithi184.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T04:37:26.256 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.256 INFO:teuthology.orchestra.run.smithi184.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T04:37:26.256 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T04:37:26.256 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T04:37:26.256 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.256 INFO:teuthology.orchestra.run.smithi184.stdout: # 1m isn't quite enough 2023-10-06T04:37:26.257 INFO:teuthology.orchestra.run.smithi184.stdout: mon_down_mkfs_grace = 2m 2023-10-06T04:37:26.257 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.257 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_filestore_osds = false 2023-10-06T04:37:26.257 INFO:teuthology.orchestra.run.smithi184.stdout: mon op complaint time = 120 2023-10-06T04:37:26.257 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-06T04:37:26.257 INFO:teuthology.orchestra.run.smithi184.stdout:[client] 2023-10-06T04:37:26.257 INFO:teuthology.orchestra.run.smithi184.stdout: rgw cache enabled = true 2023-10-06T04:37:26.257 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable ops log = true 2023-10-06T04:37:26.257 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable usage log = true 2023-10-06T04:37:26.257 INFO:teuthology.orchestra.run.smithi184.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T04:37:26.258 INFO:teuthology.orchestra.run.smithi184.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T04:37:26.258 INFO:teuthology.orchestra.run.smithi184.stdout: client mount timeout = 600 2023-10-06T04:37:26.258 INFO:teuthology.orchestra.run.smithi184.stdout: debug client = 20 2023-10-06T04:37:26.258 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-10-06T04:37:26.258 INFO:teuthology.orchestra.run.smithi184.stdout: pid file = "" 2023-10-06T04:37:26.258 INFO:teuthology.orchestra.run.smithi184.stdout: rados mon op timeout = 900 2023-10-06T04:37:26.258 INFO:teuthology.orchestra.run.smithi184.stdout: rados osd op timeout = 900 2023-10-06T04:37:26.258 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.a] 2023-10-06T04:37:26.258 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.b] 2023-10-06T04:37:26.258 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.c] 2023-10-06T04:37:26.259 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.a] 2023-10-06T04:37:26.259 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.c] 2023-10-06T04:37:26.259 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.b] 2023-10-06T04:37:26.259 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.d] 2023-10-06T04:37:26.259 INFO:teuthology.orchestra.run.smithi184.stdout:[mds] 2023-10-06T04:37:26.259 INFO:teuthology.orchestra.run.smithi184.stdout: debug mds = 20 2023-10-06T04:37:26.259 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-10-06T04:37:26.259 INFO:teuthology.orchestra.run.smithi184.stdout: mds debug frag = True 2023-10-06T04:37:26.259 INFO:teuthology.orchestra.run.smithi184.stdout: mds debug scatterstat = False 2023-10-06T04:37:26.259 INFO:teuthology.orchestra.run.smithi184.stdout: mds op complaint time = 180 2023-10-06T04:37:26.260 INFO:teuthology.orchestra.run.smithi184.stdout: mds verify scatter = False 2023-10-06T04:37:26.260 INFO:teuthology.orchestra.run.smithi184.stdout: osd op complaint time = 180 2023-10-06T04:37:26.260 INFO:teuthology.orchestra.run.smithi184.stdout: rados mon op timeout = 900 2023-10-06T04:37:26.260 INFO:teuthology.orchestra.run.smithi184.stdout: rados osd op timeout = 900 2023-10-06T04:37:26.261 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T04:37:26.261 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T04:37:26.261 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T04:37:26.261 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:37:26.261 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T04:37:26.262 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T04:37:26.262 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T04:37:26.262 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:37:26.262 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T04:37:26.263 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T04:37:26.263 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T04:37:26.263 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:37:26.263 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T04:37:26.263 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T04:37:26.264 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T04:37:26.264 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:37:26.272 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T04:37:26.272 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T04:37:26.273 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T04:37:26.273 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T04:37:26.294 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T04:37:26.294 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T04:37:26.295 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T04:37:26.295 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T04:37:26.315 INFO:tasks.ceph.mds.b:Started 2023-10-06T04:37:26.315 DEBUG:teuthology.parallel:result is None 2023-10-06T04:37:26.316 INFO:tasks.ceph.mds.d:Started 2023-10-06T04:37:26.316 DEBUG:teuthology.parallel:result is None 2023-10-06T04:37:26.336 INFO:tasks.ceph.mds.a:Started 2023-10-06T04:37:26.337 DEBUG:teuthology.parallel:result is None 2023-10-06T04:37:26.337 INFO:tasks.ceph.mds.c:Started 2023-10-06T04:37:26.337 DEBUG:teuthology.parallel:result is None 2023-10-06T04:37:26.338 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph purge cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T04:37:26.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.374+0000 7f4c74fe1000 1 Processor -- start 2023-10-06T04:37:26.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.374+0000 7f4c74fe1000 1 -- start start 2023-10-06T04:37:26.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.374+0000 7f4c74fe1000 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56408bbf8230 0x56408bc9b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:26.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.374+0000 7f4c74fe1000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56408bbf9130 0x56408bbc9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:26.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.374+0000 7f4c74fe1000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56408bc9bc10 0x56408bc0d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:26.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.374+0000 7f4c74fe1000 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56408bb13980 con 0x56408bbf8230 2023-10-06T04:37:26.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.374+0000 7f4c74fe1000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56408bb13620 con 0x56408bbf9130 2023-10-06T04:37:26.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.374+0000 7f4c74fe1000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x56408bb0a400 con 0x56408bc9bc10 2023-10-06T04:37:26.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.374+0000 7f4c6e21c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56408bbf8230 0x56408bc9b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:26.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.375+0000 7f4c6e21c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56408bbf8230 0x56408bc9b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33214/0 (socket says 172.21.15.8:33214) 2023-10-06T04:37:26.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.375+0000 7f4c6e21c700 1 -- 172.21.15.8:0/2352172396 learned_addr learned my addr 172.21.15.8:0/2352172396 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:26.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.375+0000 7f4c6da1b700 1 --2- 172.21.15.8:0/2352172396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56408bbf9130 0x56408bbc9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:26.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.375+0000 7f4c6ea1d700 1 --2- 172.21.15.8:0/2352172396 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56408bc9bc10 0x56408bc0d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:26.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.375+0000 7f4c6e21c700 1 -- 172.21.15.8:0/2352172396 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56408bc9bc10 msgr2=0x56408bc0d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:26.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.375+0000 7f4c6e21c700 1 --2- 172.21.15.8:0/2352172396 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56408bc9bc10 0x56408bc0d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.375+0000 7f4c6e21c700 1 -- 172.21.15.8:0/2352172396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56408bbf9130 msgr2=0x56408bbc9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:26.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.375+0000 7f4c6e21c700 1 --2- 172.21.15.8:0/2352172396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56408bbf9130 0x56408bbc9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.375+0000 7f4c6e21c700 1 -- 172.21.15.8:0/2352172396 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c60005cf0 con 0x56408bbf8230 2023-10-06T04:37:26.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.375+0000 7f4c6da1b700 1 --2- 172.21.15.8:0/2352172396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56408bbf9130 0x56408bbc9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:37:26.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.375+0000 7f4c6e21c700 1 --2- 172.21.15.8:0/2352172396 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56408bbf8230 0x56408bc9b040 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4c600099e0 tx=0x7f4c6000c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e17535d429ec69 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:26.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.375+0000 7f4c6ca19700 1 -- 172.21.15.8:0/2352172396 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6000f040 con 0x56408bbf8230 2023-10-06T04:37:26.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.375+0000 7f4c6ca19700 1 -- 172.21.15.8:0/2352172396 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c60008880 con 0x56408bbf8230 2023-10-06T04:37:26.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.375+0000 7f4c6ca19700 1 -- 172.21.15.8:0/2352172396 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c60008c00 con 0x56408bbf8230 2023-10-06T04:37:26.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.376+0000 7f4c74fe1000 1 -- 172.21.15.8:0/2352172396 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56408bbf8230 msgr2=0x56408bc9b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:26.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.376+0000 7f4c74fe1000 1 --2- 172.21.15.8:0/2352172396 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56408bbf8230 0x56408bc9b040 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4c600099e0 tx=0x7f4c6000c040 comp rx=0 tx=0).stop 2023-10-06T04:37:26.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.376+0000 7f4c74fe1000 1 -- 172.21.15.8:0/2352172396 shutdown_connections 2023-10-06T04:37:26.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.376+0000 7f4c74fe1000 1 --2- 172.21.15.8:0/2352172396 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56408bc9bc10 0x56408bc0d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.376+0000 7f4c74fe1000 1 --2- 172.21.15.8:0/2352172396 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56408bbf8230 0x56408bc9b040 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.376+0000 7f4c74fe1000 1 --2- 172.21.15.8:0/2352172396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56408bbf9130 0x56408bbc9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.376+0000 7f4c74fe1000 1 -- 172.21.15.8:0/2352172396 >> 172.21.15.8:0/2352172396 conn(0x56408bbc94f0 msgr2=0x56408bc9a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:26.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.376+0000 7f4c74fe1000 1 -- 172.21.15.8:0/2352172396 shutdown_connections 2023-10-06T04:37:26.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.376+0000 7f4c74fe1000 1 -- 172.21.15.8:0/2352172396 wait complete. 2023-10-06T04:37:26.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.377+0000 7f4c74fe1000 1 Processor -- start 2023-10-06T04:37:26.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.377+0000 7f4c74fe1000 1 -- start start 2023-10-06T04:37:26.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.377+0000 7f4c74fe1000 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56408bbf8230 0x56408bbf2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:26.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.377+0000 7f4c74fe1000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56408bbf9130 0x56408bc9a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:26.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.377+0000 7f4c74fe1000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56408bc9bc10 0x56408bbeb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:26.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.377+0000 7f4c74fe1000 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56408bbf6400 con 0x56408bbf8230 2023-10-06T04:37:26.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.377+0000 7f4c74fe1000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56408bbf2750 con 0x56408bbf9130 2023-10-06T04:37:26.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.377+0000 7f4c74fe1000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x56408bc9db10 con 0x56408bc9bc10 2023-10-06T04:37:26.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.377+0000 7f4c6e21c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56408bbf8230 0x56408bbf2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:26.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.377+0000 7f4c6e21c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56408bbf8230 0x56408bbf2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33226/0 (socket says 172.21.15.8:33226) 2023-10-06T04:37:26.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.377+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 learned_addr learned my addr 172.21.15.8:0/1345683355 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:26.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.378+0000 7f4c6ea1d700 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56408bc9bc10 0x56408bbeb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:26.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.378+0000 7f4c6da1b700 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56408bbf9130 0x56408bc9a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:26.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.378+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56408bc9bc10 msgr2=0x56408bbeb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:26.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.378+0000 7f4c6e21c700 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56408bc9bc10 0x56408bbeb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.378+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56408bbf9130 msgr2=0x56408bc9a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:26.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.378+0000 7f4c6e21c700 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56408bbf9130 0x56408bc9a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.378+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c6400a040 con 0x56408bbf8230 2023-10-06T04:37:26.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.378+0000 7f4c6e21c700 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56408bbf8230 0x56408bbf2040 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4c60008ff0 tx=0x7f4c60017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:26.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.378+0000 7f4c5effd700 1 -- 172.21.15.8:0/1345683355 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6000f070 con 0x56408bbf8230 2023-10-06T04:37:26.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.378+0000 7f4c5effd700 1 -- 172.21.15.8:0/1345683355 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c600089f0 con 0x56408bbf8230 2023-10-06T04:37:26.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.378+0000 7f4c5effd700 1 -- 172.21.15.8:0/1345683355 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6001d620 con 0x56408bbf8230 2023-10-06T04:37:26.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.378+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c600095e0 con 0x56408bbf8230 2023-10-06T04:37:26.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.378+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c6800a180 con 0x56408bbf8230 2023-10-06T04:37:26.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.380+0000 7f4c5effd700 1 -- 172.21.15.8:0/1345683355 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4c6001da50 con 0x56408bbf8230 2023-10-06T04:37:26.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.380+0000 7f4c5effd700 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4c50065890 0x7f4c50067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:26.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.380+0000 7f4c5effd700 1 -- 172.21.15.8:0/1345683355 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f4c600851b0 con 0x56408bbf8230 2023-10-06T04:37:26.385 INFO:teuthology.orchestra.run.smithi008.stdout:Warning: using slow linear search 2023-10-06T04:37:26.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.380+0000 7f4c6da1b700 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4c50065890 0x7f4c50067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:26.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.380+0000 7f4c74fe1000 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x56408bc9ad30 0x56408bc9e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:26.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.380+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:1 6.0 6:00000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e39) v8 -- 0x56408bbeb9e0 con 0x56408bc9ad30 2023-10-06T04:37:26.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.381+0000 7f4c6ea1d700 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x56408bc9ad30 0x56408bc9e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:26.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.381+0000 7f4c6ea1d700 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x56408bc9ad30 0x56408bc9e790 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:26.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.381+0000 7f4c6da1b700 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4c50065890 0x7f4c50067d40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4c6400f840 tx=0x7f4c64000bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:26.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.383+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 <== osd.0 v2:172.21.15.8:6808/90668 1 ==== osd_op_reply(1 [pgnls start_epoch 39 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c6800e7e0 con 0x56408bc9ad30 2023-10-06T04:37:26.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.383+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:2 6.10 6:08000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e39) v8 -- 0x56408bbeb9e0 con 0x56408bc9ad30 2023-10-06T04:37:26.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.384+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 <== osd.0 v2:172.21.15.8:6808/90668 2 ==== osd_op_reply(2 [pgnls start_epoch 39 out=177b] v38'10 uv10 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x7f4c6800e7e0 con 0x56408bc9ad30 2023-10-06T04:37:26.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.384+0000 7f4c6ea1d700 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] conn(0x7f4c68010030 0x7f4c68010910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:26.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.384+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:3 6.8 6:10000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e39) v8 -- 0x56408bbeb9e0 con 0x7f4c68010030 2023-10-06T04:37:26.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.384+0000 7f4c6e21c700 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] conn(0x7f4c68010030 0x7f4c68010910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:26.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.385+0000 7f4c6e21c700 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] conn(0x7f4c68010030 0x7f4c68010910 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:26.388 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-10-06T04:37:26.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.387+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 <== osd.7 v2:172.21.15.184:6808/90869 1 ==== osd_op_reply(3 [pgnls start_epoch 39 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c60054190 con 0x7f4c68010030 2023-10-06T04:37:26.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.387+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:4 6.18 6:18000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e39) v8 -- 0x56408bbeb9e0 con 0x56408bc9ad30 2023-10-06T04:37:26.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.388+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 <== osd.0 v2:172.21.15.8:6808/90668 3 ==== osd_op_reply(4 [pgnls start_epoch 39 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c6800e7e0 con 0x56408bc9ad30 2023-10-06T04:37:26.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.388+0000 7f4c6ea1d700 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] conn(0x7f4c6801cc30 0x7f4c6801a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:26.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.388+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] -- osd_op(unknown.0.0:5 6.4 6:20000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e39) v8 -- 0x7f4c68029040 con 0x7f4c6801cc30 2023-10-06T04:37:26.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.388+0000 7f4c6da1b700 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] conn(0x7f4c6801cc30 0x7f4c6801a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:26.390 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2023-10-06T04:37:26.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.388+0000 7f4c6da1b700 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] conn(0x7f4c6801cc30 0x7f4c6801a8c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:26.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.391+0000 7f4c6da1b700 1 -- 172.21.15.8:0/1345683355 <== osd.1 v2:172.21.15.8:6816/90669 1 ==== osd_op_reply(5 [pgnls start_epoch 39 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c64017040 con 0x7f4c6801cc30 2023-10-06T04:37:26.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.391+0000 7f4c6da1b700 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] conn(0x7f4c64012940 0x7f4c6401e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:26.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.391+0000 7f4c6da1b700 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] -- osd_op(unknown.0.0:6 6.14 6:28000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e39) v8 -- 0x7f4c68029040 con 0x7f4c64012940 2023-10-06T04:37:26.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.391+0000 7f4c6ea1d700 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] conn(0x7f4c64012940 0x7f4c6401e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:26.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.391+0000 7f4c6ea1d700 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] conn(0x7f4c64012940 0x7f4c6401e3c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:26.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.394+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 <== osd.2 v2:172.21.15.8:6800/90670 1 ==== osd_op_reply(6 [pgnls start_epoch 39 out=149b] v38'19 uv19 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x7f4c6800e7e0 con 0x7f4c64012940 2023-10-06T04:37:26.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.394+0000 7f4c6ea1d700 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x7f4c6800f3a0 0x7f4c6800f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:26.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.394+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:7 6.c 6:30000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e39) v8 -- 0x7f4c68029040 con 0x7f4c6800f3a0 2023-10-06T04:37:26.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.394+0000 7f4c6e21c700 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x7f4c6800f3a0 0x7f4c6800f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:26.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.395+0000 7f4c6e21c700 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x7f4c6800f3a0 0x7f4c6800f810 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:26.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.395+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 <== osd.3 v2:172.21.15.8:6823/90671 1 ==== osd_op_reply(7 [pgnls start_epoch 39 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c60054190 con 0x7f4c6800f3a0 2023-10-06T04:37:26.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.395+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:8 6.1c 6:38000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e39) v8 -- 0x7f4c68029040 con 0x7f4c68010030 2023-10-06T04:37:26.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.395+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 <== osd.7 v2:172.21.15.184:6808/90869 2 ==== osd_op_reply(8 [pgnls start_epoch 39 out=73b] v37'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f4c60054190 con 0x7f4c68010030 2023-10-06T04:37:26.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.395+0000 7f4c6e21c700 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x7f4c60026030 0x7f4c60056780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:26.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.395+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:9 6.2 6:40000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e39) v8 -- 0x7f4c68029040 con 0x7f4c60026030 2023-10-06T04:37:26.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.396+0000 7f4c6da1b700 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x7f4c60026030 0x7f4c60056780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:26.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.396+0000 7f4c6da1b700 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x7f4c60026030 0x7f4c60056780 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:26.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.396+0000 7f4c6da1b700 1 -- 172.21.15.8:0/1345683355 <== osd.4 v2:172.21.15.184:6800/90868 1 ==== osd_op_reply(9 [pgnls start_epoch 39 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c64017040 con 0x7f4c60026030 2023-10-06T04:37:26.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.396+0000 7f4c6da1b700 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:10 6.12 6:48000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e39) v8 -- 0x7f4c68029040 con 0x7f4c68010030 2023-10-06T04:37:26.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.397+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 <== osd.7 v2:172.21.15.184:6808/90869 3 ==== osd_op_reply(10 [pgnls start_epoch 39 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c60054190 con 0x7f4c68010030 2023-10-06T04:37:26.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.397+0000 7f4c6e21c700 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] conn(0x7f4c6001d040 0x7f4c60054450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:26.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.397+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:11 6.a 6:50000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e39) v8 -- 0x7f4c68029040 con 0x7f4c6001d040 2023-10-06T04:37:26.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.397+0000 7f4c6ea1d700 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] conn(0x7f4c6001d040 0x7f4c60054450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:26.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.397+0000 7f4c6ea1d700 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] conn(0x7f4c6001d040 0x7f4c60054450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:26.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.399+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 <== osd.5 v2:172.21.15.184:6824/90894 1 ==== osd_op_reply(11 [pgnls start_epoch 39 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c6800e7e0 con 0x7f4c6001d040 2023-10-06T04:37:26.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.399+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:12 6.1a 6:58000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e39) v8 -- 0x7f4c68029040 con 0x7f4c60026030 2023-10-06T04:37:26.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.399+0000 7f4c6da1b700 1 -- 172.21.15.8:0/1345683355 <== osd.4 v2:172.21.15.184:6800/90868 2 ==== osd_op_reply(12 [pgnls start_epoch 39 out=49b] v37'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c64017040 con 0x7f4c60026030 2023-10-06T04:37:26.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.399+0000 7f4c6da1b700 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:13 6.6 6:60000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e39) v8 -- 0x7f4c68029040 con 0x7f4c6800f3a0 2023-10-06T04:37:26.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.400+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 <== osd.3 v2:172.21.15.8:6823/90671 2 ==== osd_op_reply(13 [pgnls start_epoch 39 out=77b] v38'2 uv2 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x7f4c60054190 con 0x7f4c6800f3a0 2023-10-06T04:37:26.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.400+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:14 6.16 6:68000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e39) v8 -- 0x7f4c68029040 con 0x56408bc9ad30 2023-10-06T04:37:26.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.400+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 <== osd.0 v2:172.21.15.8:6808/90668 4 ==== osd_op_reply(14 [pgnls start_epoch 39 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c68043040 con 0x56408bc9ad30 2023-10-06T04:37:26.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.400+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:15 6.e 6:70000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e39) v8 -- 0x7f4c68029040 con 0x7f4c60026030 2023-10-06T04:37:26.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.400+0000 7f4c6da1b700 1 -- 172.21.15.8:0/1345683355 <== osd.4 v2:172.21.15.184:6800/90868 3 ==== osd_op_reply(15 [pgnls start_epoch 39 out=73b] v37'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f4c64017040 con 0x7f4c60026030 2023-10-06T04:37:26.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.400+0000 7f4c6da1b700 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:16 6.1e 6:78000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e39) v8 -- 0x7f4c68029040 con 0x7f4c60026030 2023-10-06T04:37:26.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.401+0000 7f4c6da1b700 1 -- 172.21.15.8:0/1345683355 <== osd.4 v2:172.21.15.184:6800/90868 4 ==== osd_op_reply(16 [pgnls start_epoch 39 out=49b] v37'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c64017040 con 0x7f4c60026030 2023-10-06T04:37:26.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.401+0000 7f4c6da1b700 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] -- osd_op(unknown.0.0:17 6.1 6:80000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e39) v8 -- 0x7f4c68029040 con 0x7f4c6801cc30 2023-10-06T04:37:26.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.401+0000 7f4c6da1b700 1 -- 172.21.15.8:0/1345683355 <== osd.1 v2:172.21.15.8:6816/90669 2 ==== osd_op_reply(17 [pgnls start_epoch 39 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c64017040 con 0x7f4c6801cc30 2023-10-06T04:37:26.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.401+0000 7f4c6da1b700 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:18 6.11 6:88000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e39) v8 -- 0x7f4c68029040 con 0x7f4c6800f3a0 2023-10-06T04:37:26.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.401+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 <== osd.3 v2:172.21.15.8:6823/90671 3 ==== osd_op_reply(18 [pgnls start_epoch 39 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c60054190 con 0x7f4c6800f3a0 2023-10-06T04:37:26.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.401+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:19 6.9 6:90000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e39) v8 -- 0x7f4c68029040 con 0x56408bc9ad30 2023-10-06T04:37:26.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.402+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 <== osd.0 v2:172.21.15.8:6808/90668 5 ==== osd_op_reply(19 [pgnls start_epoch 39 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c68043040 con 0x56408bc9ad30 2023-10-06T04:37:26.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.402+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:20 6.19 6:98000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e39) v8 -- 0x7f4c68029040 con 0x7f4c6001d040 2023-10-06T04:37:26.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.402+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 <== osd.5 v2:172.21.15.184:6824/90894 2 ==== osd_op_reply(20 [pgnls start_epoch 39 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c68043040 con 0x7f4c6001d040 2023-10-06T04:37:26.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.402+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:21 6.5 6:a0000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e39) v8 -- 0x7f4c68029040 con 0x7f4c68010030 2023-10-06T04:37:26.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.402+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 <== osd.7 v2:172.21.15.184:6808/90869 4 ==== osd_op_reply(21 [pgnls start_epoch 39 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c60062040 con 0x7f4c68010030 2023-10-06T04:37:26.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.402+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:22 6.15 6:a8000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e39) v8 -- 0x7f4c68029040 con 0x7f4c68010030 2023-10-06T04:37:26.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.402+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 <== osd.7 v2:172.21.15.184:6808/90869 5 ==== osd_op_reply(22 [pgnls start_epoch 39 out=97b] v37'3 uv3 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x7f4c60062040 con 0x7f4c68010030 2023-10-06T04:37:26.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.403+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:23 6.d 6:b0000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e39) v8 -- 0x7f4c68029040 con 0x7f4c6001d040 2023-10-06T04:37:26.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.403+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 <== osd.5 v2:172.21.15.184:6824/90894 3 ==== osd_op_reply(23 [pgnls start_epoch 39 out=74b] v37'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f4c68043040 con 0x7f4c6001d040 2023-10-06T04:37:26.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.403+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] -- osd_op(unknown.0.0:24 6.1d 6:b8000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e39) v8 -- 0x7f4c68029040 con 0x7f4c6801cc30 2023-10-06T04:37:26.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.403+0000 7f4c6da1b700 1 -- 172.21.15.8:0/1345683355 <== osd.1 v2:172.21.15.8:6816/90669 3 ==== osd_op_reply(24 [pgnls start_epoch 39 out=73b] v37'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f4c64017040 con 0x7f4c6801cc30 2023-10-06T04:37:26.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.403+0000 7f4c6da1b700 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:25 6.3 6:c0000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e39) v8 -- 0x7f4c68029040 con 0x7f4c68010030 2023-10-06T04:37:26.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.403+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 <== osd.7 v2:172.21.15.184:6808/90869 6 ==== osd_op_reply(25 [pgnls start_epoch 39 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c60062040 con 0x7f4c68010030 2023-10-06T04:37:26.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.403+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:26 6.13 6:c8000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e39) v8 -- 0x7f4c68029040 con 0x7f4c6800f3a0 2023-10-06T04:37:26.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.404+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 <== osd.3 v2:172.21.15.8:6823/90671 4 ==== osd_op_reply(26 [pgnls start_epoch 39 out=98b] v38'3 uv3 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x7f4c60062040 con 0x7f4c6800f3a0 2023-10-06T04:37:26.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.404+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:27 6.b 6:d0000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e39) v8 -- 0x7f4c68029040 con 0x7f4c6800f3a0 2023-10-06T04:37:26.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.404+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 <== osd.3 v2:172.21.15.8:6823/90671 5 ==== osd_op_reply(27 [pgnls start_epoch 39 out=76b] v38'3 uv3 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x7f4c60062040 con 0x7f4c6800f3a0 2023-10-06T04:37:26.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.404+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:28 6.1b 6:d8000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e39) v8 -- 0x7f4c68029040 con 0x7f4c6800f3a0 2023-10-06T04:37:26.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.404+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 <== osd.3 v2:172.21.15.8:6823/90671 6 ==== osd_op_reply(28 [pgnls start_epoch 39 out=49b] v37'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c60062040 con 0x7f4c6800f3a0 2023-10-06T04:37:26.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.404+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:29 6.7 6:e0000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e39) v8 -- 0x7f4c68029040 con 0x7f4c6001d040 2023-10-06T04:37:26.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.405+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 <== osd.5 v2:172.21.15.184:6824/90894 4 ==== osd_op_reply(29 [pgnls start_epoch 39 out=73b] v37'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f4c68043040 con 0x7f4c6001d040 2023-10-06T04:37:26.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.405+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:30 6.17 6:e8000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e39) v8 -- 0x7f4c68029040 con 0x7f4c60026030 2023-10-06T04:37:26.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.405+0000 7f4c6da1b700 1 -- 172.21.15.8:0/1345683355 <== osd.4 v2:172.21.15.184:6800/90868 5 ==== osd_op_reply(30 [pgnls start_epoch 39 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c64017040 con 0x7f4c60026030 2023-10-06T04:37:26.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.405+0000 7f4c6da1b700 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] -- osd_op(unknown.0.0:31 6.f 6:f0000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e39) v8 -- 0x7f4c68029040 con 0x7f4c64012940 2023-10-06T04:37:26.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.405+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 <== osd.2 v2:172.21.15.8:6800/90670 2 ==== osd_op_reply(31 [pgnls start_epoch 39 out=73b] v37'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f4c68043040 con 0x7f4c64012940 2023-10-06T04:37:26.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.405+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:32 6.1f 6:f8000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e39) v8 -- 0x7f4c68029040 con 0x7f4c6800f3a0 2023-10-06T04:37:26.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.406+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 <== osd.3 v2:172.21.15.8:6823/90671 7 ==== osd_op_reply(32 [pgnls start_epoch 39 out=101b] v38'6 uv6 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x7f4c60062040 con 0x7f4c6800f3a0 2023-10-06T04:37:26.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.406+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:33 6.10 6:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e39) v8 -- 0x56408bc98480 con 0x56408bc9ad30 2023-10-06T04:37:26.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.406+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:34 6.10 6:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e39) v8 -- 0x56408bc0ea90 con 0x56408bc9ad30 2023-10-06T04:37:26.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.406+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:35 6.10 6:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e39) v8 -- 0x56408bcbaab0 con 0x56408bc9ad30 2023-10-06T04:37:26.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.406+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:36 6.10 6:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e39) v8 -- 0x56408bcbd490 con 0x56408bc9ad30 2023-10-06T04:37:26.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.406+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:37 6.10 6:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e39) v8 -- 0x56408bcbdd30 con 0x56408bc9ad30 2023-10-06T04:37:26.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.406+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] -- osd_op(unknown.0.0:38 6.14 6:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e39) v8 -- 0x56408bcbe5d0 con 0x7f4c64012940 2023-10-06T04:37:26.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.406+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] -- osd_op(unknown.0.0:39 6.14 6:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e39) v8 -- 0x56408bcbee70 con 0x7f4c64012940 2023-10-06T04:37:26.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.406+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] -- osd_op(unknown.0.0:40 6.14 6:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e39) v8 -- 0x56408bcbf710 con 0x7f4c64012940 2023-10-06T04:37:26.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.406+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] -- osd_op(unknown.0.0:41 6.14 6:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e39) v8 -- 0x56408bcc02a0 con 0x7f4c64012940 2023-10-06T04:37:26.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.406+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:42 6.1c 6:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e39) v8 -- 0x56408bcc0db0 con 0x7f4c68010030 2023-10-06T04:37:26.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.406+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:43 6.6 6:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e39) v8 -- 0x56408bcc1980 con 0x7f4c6800f3a0 2023-10-06T04:37:26.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.406+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:44 6.e 6:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e39) v8 -- 0x56408bcc24f0 con 0x7f4c60026030 2023-10-06T04:37:26.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.406+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:45 6.15 6:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e39) v8 -- 0x56408bcc3080 con 0x7f4c68010030 2023-10-06T04:37:26.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.406+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:46 6.15 6:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e39) v8 -- 0x56408bcc3c10 con 0x7f4c68010030 2023-10-06T04:37:26.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.406+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:47 6.d 6:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e39) v8 -- 0x56408bcc4750 con 0x7f4c6001d040 2023-10-06T04:37:26.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.406+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] -- osd_op(unknown.0.0:48 6.1d 6:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e39) v8 -- 0x56408bcc5290 con 0x7f4c6801cc30 2023-10-06T04:37:26.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.408+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 <== osd.7 v2:172.21.15.184:6808/90869 7 ==== osd_op_reply(42 607.00000000 [delete] v39'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4c60062040 con 0x7f4c68010030 2023-10-06T04:37:26.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.408+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 <== osd.3 v2:172.21.15.8:6823/90671 8 ==== osd_op_reply(43 mds0_openfiles.0 [delete] v39'3 uv3 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f4c60062040 con 0x7f4c6800f3a0 2023-10-06T04:37:26.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.408+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 <== osd.7 v2:172.21.15.184:6808/90869 8 ==== osd_op_reply(45 604.00000000 [delete] v39'4 uv4 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4c60062040 con 0x7f4c68010030 2023-10-06T04:37:26.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.408+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 <== osd.7 v2:172.21.15.184:6808/90869 9 ==== osd_op_reply(46 500.00000000 [delete] v39'5 uv5 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4c60062040 con 0x7f4c68010030 2023-10-06T04:37:26.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.408+0000 7f4c6da1b700 1 -- 172.21.15.8:0/1345683355 <== osd.4 v2:172.21.15.184:6800/90868 6 ==== osd_op_reply(44 608.00000000 [delete] v39'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4c64017040 con 0x7f4c60026030 2023-10-06T04:37:26.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.408+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 <== osd.5 v2:172.21.15.184:6824/90894 5 ==== osd_op_reply(47 mds_snaptable [delete] v39'2 uv2 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4c68043040 con 0x7f4c6001d040 2023-10-06T04:37:26.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.409+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:49 6.13 6:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e39) v8 -- 0x56408bcbee70 con 0x7f4c6800f3a0 2023-10-06T04:37:26.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.409+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:50 6.13 6:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e39) v8 -- 0x56408bcc02a0 con 0x7f4c6800f3a0 2023-10-06T04:37:26.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.409+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:51 6.b 6:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e39) v8 -- 0x56408bcc4710 con 0x7f4c6800f3a0 2023-10-06T04:37:26.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.409+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:52 6.7 6:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e39) v8 -- 0x56408bcc2a70 con 0x7f4c6001d040 2023-10-06T04:37:26.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.409+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] -- osd_op(unknown.0.0:53 6.f 6:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e39) v8 -- 0x56408bcc56c0 con 0x7f4c64012940 2023-10-06T04:37:26.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.409+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:54 6.1f 6:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e39) v8 -- 0x56408bcc02a0 con 0x7f4c6800f3a0 2023-10-06T04:37:26.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.409+0000 7f4c6da1b700 1 -- 172.21.15.8:0/1345683355 <== osd.1 v2:172.21.15.8:6816/90669 4 ==== osd_op_reply(48 605.00000000 [delete] v39'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4c64017040 con 0x7f4c6801cc30 2023-10-06T04:37:26.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.409+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 <== osd.2 v2:172.21.15.8:6800/90670 3 ==== osd_op_reply(38 1.00000000.inode [delete] v39'20 uv20 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f4c68043040 con 0x7f4c64012940 2023-10-06T04:37:26.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.410+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 <== osd.0 v2:172.21.15.8:6808/90668 6 ==== osd_op_reply(33 601.00000000 [delete] v39'11 uv11 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4c68043040 con 0x56408bc9ad30 2023-10-06T04:37:26.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.410+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 <== osd.0 v2:172.21.15.8:6808/90668 7 ==== osd_op_reply(34 602.00000000 [delete] v39'12 uv12 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4c68043040 con 0x56408bc9ad30 2023-10-06T04:37:26.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.410+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 <== osd.3 v2:172.21.15.8:6823/90671 9 ==== osd_op_reply(49 mds0_inotable [delete] v39'4 uv4 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4c60062040 con 0x7f4c6800f3a0 2023-10-06T04:37:26.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.411+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 <== osd.5 v2:172.21.15.184:6824/90894 6 ==== osd_op_reply(52 609.00000000 [delete] v39'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4c68043040 con 0x7f4c6001d040 2023-10-06T04:37:26.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.411+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 <== osd.2 v2:172.21.15.8:6800/90670 4 ==== osd_op_reply(39 200.00000000 [delete] v39'21 uv21 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4c68043040 con 0x7f4c64012940 2023-10-06T04:37:26.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.411+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 <== osd.0 v2:172.21.15.8:6808/90668 8 ==== osd_op_reply(35 10000000000.00000000 [delete] v39'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f4c68043040 con 0x56408bc9ad30 2023-10-06T04:37:26.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.411+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 <== osd.0 v2:172.21.15.8:6808/90668 9 ==== osd_op_reply(36 600.00000000 [delete] v39'14 uv14 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4c68043040 con 0x56408bc9ad30 2023-10-06T04:37:26.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.411+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 <== osd.0 v2:172.21.15.8:6808/90668 10 ==== osd_op_reply(37 603.00000000 [delete] v39'15 uv15 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4c68043040 con 0x56408bc9ad30 2023-10-06T04:37:26.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.411+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 <== osd.3 v2:172.21.15.8:6823/90671 10 ==== osd_op_reply(50 100.00000000 [delete] v39'5 uv5 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4c60062040 con 0x7f4c6800f3a0 2023-10-06T04:37:26.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.411+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 <== osd.2 v2:172.21.15.8:6800/90670 5 ==== osd_op_reply(53 400.00000000 [delete] v39'2 uv2 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4c68043040 con 0x7f4c64012940 2023-10-06T04:37:26.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.412+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:55 6.1f 6:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e39) v8 -- 0x56408bcc2a70 con 0x7f4c6800f3a0 2023-10-06T04:37:26.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.413+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 <== osd.3 v2:172.21.15.8:6823/90671 11 ==== osd_op_reply(51 mds0_sessionmap [delete] v39'4 uv4 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f4c60062040 con 0x7f4c6800f3a0 2023-10-06T04:37:26.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.413+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 <== osd.3 v2:172.21.15.8:6823/90671 12 ==== osd_op_reply(54 100.00000000.inode [delete] v39'7 uv7 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f4c60062040 con 0x7f4c6800f3a0 2023-10-06T04:37:26.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.413+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 <== osd.2 v2:172.21.15.8:6800/90670 6 ==== osd_op_reply(40 200.00000001 [delete] v39'22 uv22 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4c68043040 con 0x7f4c64012940 2023-10-06T04:37:26.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.413+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 <== osd.2 v2:172.21.15.8:6800/90670 7 ==== osd_op_reply(41 606.00000000 [delete] v39'23 uv23 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f4c68043040 con 0x7f4c64012940 2023-10-06T04:37:26.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.415+0000 7f4c6e21c700 1 -- 172.21.15.8:0/1345683355 <== osd.3 v2:172.21.15.8:6823/90671 13 ==== osd_op_reply(55 1.00000000 [delete] v39'8 uv8 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f4c60062040 con 0x7f4c6800f3a0 2023-10-06T04:37:26.418 INFO:teuthology.orchestra.run.smithi008.stdout:Removed 23 objects 2023-10-06T04:37:26.418 INFO:teuthology.orchestra.run.smithi008.stdout:successfully purged pool cephfs_metadata 2023-10-06T04:37:26.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.416+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x56408bc9ad30 msgr2=0x56408bc9e790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:26.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.416+0000 7f4c74fe1000 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x56408bc9ad30 0x56408bc9e790 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.416+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 >> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] conn(0x7f4c6801cc30 msgr2=0x7f4c6801a8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:26.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.416+0000 7f4c74fe1000 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] conn(0x7f4c6801cc30 0x7f4c6801a8c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.416+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 >> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] conn(0x7f4c64012940 msgr2=0x7f4c6401e3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:26.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.416+0000 7f4c74fe1000 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] conn(0x7f4c64012940 0x7f4c6401e3c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.416+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x7f4c6800f3a0 msgr2=0x7f4c6800f810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:26.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.416+0000 7f4c74fe1000 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x7f4c6800f3a0 0x7f4c6800f810 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.416+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x7f4c60026030 msgr2=0x7f4c60056780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:26.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.416+0000 7f4c74fe1000 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x7f4c60026030 0x7f4c60056780 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.416+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 >> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] conn(0x7f4c6001d040 msgr2=0x7f4c60054450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:26.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.416+0000 7f4c74fe1000 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] conn(0x7f4c6001d040 0x7f4c60054450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.416+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 >> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] conn(0x7f4c68010030 msgr2=0x7f4c68010910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:26.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.416+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 reap_dead start 2023-10-06T04:37:26.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.416+0000 7f4c74fe1000 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] conn(0x7f4c68010030 0x7f4c68010910 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.416+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 reap_dead start 2023-10-06T04:37:26.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.416+0000 7f4c6ea1d700 1 -- 172.21.15.8:0/1345683355 reap_dead start 2023-10-06T04:37:26.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.416+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4c50065890 msgr2=0x7f4c50067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:26.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.416+0000 7f4c74fe1000 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4c50065890 0x7f4c50067d40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4c6400f840 tx=0x7f4c64000bc0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.416+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56408bbf8230 msgr2=0x56408bbf2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:26.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.416+0000 7f4c74fe1000 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56408bbf8230 0x56408bbf2040 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4c60008ff0 tx=0x7f4c60017000 comp rx=0 tx=0).stop 2023-10-06T04:37:26.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.416+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 shutdown_connections 2023-10-06T04:37:26.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.416+0000 7f4c74fe1000 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56408bbf8230 0x56408bbf2040 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.416+0000 7f4c74fe1000 1 --2- 172.21.15.8:0/1345683355 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4c50065890 0x7f4c50067d40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.416+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 >> 172.21.15.8:0/1345683355 conn(0x56408bbc94f0 msgr2=0x56408bca1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:26.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.416+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 shutdown_connections 2023-10-06T04:37:26.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.416+0000 7f4c74fe1000 1 -- 172.21.15.8:0/1345683355 wait complete. 2023-10-06T04:37:26.422 INFO:tasks.ceph.mds.a.smithi008.stdout:starting mds.a at 2023-10-06T04:37:26.422 INFO:tasks.ceph.mds.c.smithi008.stdout:starting mds.c at 2023-10-06T04:37:26.424 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:37:26.475 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-10-06T04:37:26.476 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-10-06T04:37:26.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.581+0000 7f5418a11700 1 Processor -- start 2023-10-06T04:37:26.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.581+0000 7f5418a11700 1 -- start start 2023-10-06T04:37:26.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.582+0000 7f5418a11700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f54140af680 0x7f541415e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:26.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.582+0000 7f5418a11700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f54140cb360 0x7f54140d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:26.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.582+0000 7f5418a11700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54140d08d0 0x7f54140b0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:26.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.582+0000 7f5418a11700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f541415d460 con 0x7f54140cb360 2023-10-06T04:37:26.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.582+0000 7f5418a11700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54140d0d50 con 0x7f54140af680 2023-10-06T04:37:26.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.582+0000 7f5418a11700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54140cc4c0 con 0x7f54140d08d0 2023-10-06T04:37:26.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.582+0000 7f5411d9b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f54140cb360 0x7f54140d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:26.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.582+0000 7f5411d9b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f54140cb360 0x7f54140d0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33290/0 (socket says 172.21.15.8:33290) 2023-10-06T04:37:26.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.582+0000 7f5411d9b700 1 -- 172.21.15.8:0/1147616837 learned_addr learned my addr 172.21.15.8:0/1147616837 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:26.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.583+0000 7f541259c700 1 --2- 172.21.15.8:0/1147616837 >> v2:172.21.15.184:3300/0 conn(0x7f54140af680 0x7f541415e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:26.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.583+0000 7f5412d9d700 1 --2- 172.21.15.8:0/1147616837 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54140d08d0 0x7f54140b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:26.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.583+0000 7f5411d9b700 1 -- 172.21.15.8:0/1147616837 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54140d08d0 msgr2=0x7f54140b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:26.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.583+0000 7f5411d9b700 1 --2- 172.21.15.8:0/1147616837 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54140d08d0 0x7f54140b0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.583+0000 7f5411d9b700 1 -- 172.21.15.8:0/1147616837 >> v2:172.21.15.184:3300/0 conn(0x7f54140af680 msgr2=0x7f541415e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:26.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.583+0000 7f5411d9b700 1 --2- 172.21.15.8:0/1147616837 >> v2:172.21.15.184:3300/0 conn(0x7f54140af680 0x7f541415e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.583+0000 7f5411d9b700 1 -- 172.21.15.8:0/1147616837 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541415e580 con 0x7f54140cb360 2023-10-06T04:37:26.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.583+0000 7f541259c700 1 --2- 172.21.15.8:0/1147616837 >> v2:172.21.15.184:3300/0 conn(0x7f54140af680 0x7f541415e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:26.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.583+0000 7f5412d9d700 1 --2- 172.21.15.8:0/1147616837 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54140d08d0 0x7f54140b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:26.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.583+0000 7f5411d9b700 1 --2- 172.21.15.8:0/1147616837 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54140cb360 0x7f54140d0390 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f54140d1020 tx=0x7f53fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99879a054505bf1e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:26.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.583+0000 7f541159a700 1 -- 172.21.15.8:0/1147616837 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc00b860 con 0x7f54140cb360 2023-10-06T04:37:26.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.583+0000 7f541159a700 1 -- 172.21.15.8:0/1147616837 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53fc00b9c0 con 0x7f54140cb360 2023-10-06T04:37:26.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.583+0000 7f541159a700 1 -- 172.21.15.8:0/1147616837 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc00bd60 con 0x7f54140cb360 2023-10-06T04:37:26.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.583+0000 7f5418a11700 1 -- 172.21.15.8:0/1147616837 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54140cb360 msgr2=0x7f54140d0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:26.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.583+0000 7f5418a11700 1 --2- 172.21.15.8:0/1147616837 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54140cb360 0x7f54140d0390 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f54140d1020 tx=0x7f53fc009250 comp rx=0 tx=0).stop 2023-10-06T04:37:26.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.584+0000 7f5418a11700 1 -- 172.21.15.8:0/1147616837 shutdown_connections 2023-10-06T04:37:26.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.584+0000 7f5418a11700 1 --2- 172.21.15.8:0/1147616837 >> v2:172.21.15.184:3300/0 conn(0x7f54140af680 0x7f541415e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.584+0000 7f5418a11700 1 --2- 172.21.15.8:0/1147616837 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54140d08d0 0x7f54140b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.584+0000 7f5418a11700 1 --2- 172.21.15.8:0/1147616837 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54140cb360 0x7f54140d0390 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.584+0000 7f5418a11700 1 -- 172.21.15.8:0/1147616837 >> 172.21.15.8:0/1147616837 conn(0x7f54140633d0 msgr2=0x7f54140637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:26.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.584+0000 7f5418a11700 1 -- 172.21.15.8:0/1147616837 shutdown_connections 2023-10-06T04:37:26.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.584+0000 7f5418a11700 1 -- 172.21.15.8:0/1147616837 wait complete. 2023-10-06T04:37:26.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.585+0000 7f5418a11700 1 Processor -- start 2023-10-06T04:37:26.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.585+0000 7f5418a11700 1 -- start start 2023-10-06T04:37:26.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.585+0000 7f5418a11700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54140af680 0x7f541416abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:26.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.585+0000 7f5418a11700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54140cb360 0x7f54140b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:26.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.585+0000 7f5418a11700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54140d08d0 0x7f54140b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:26.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.585+0000 7f5418a11700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54140c5420 con 0x7f54140af680 2023-10-06T04:37:26.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.586+0000 7f5418a11700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54140c5c80 con 0x7f54140d08d0 2023-10-06T04:37:26.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.586+0000 7f5418a11700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54140c4c70 con 0x7f54140cb360 2023-10-06T04:37:26.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.586+0000 7f541259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54140af680 0x7f541416abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:26.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.586+0000 7f541259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54140af680 0x7f541416abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33292/0 (socket says 172.21.15.8:33292) 2023-10-06T04:37:26.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.586+0000 7f541259c700 1 -- 172.21.15.8:0/739159573 learned_addr learned my addr 172.21.15.8:0/739159573 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:26.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.586+0000 7f5411d9b700 1 --2- 172.21.15.8:0/739159573 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54140cb360 0x7f54140b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:26.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.586+0000 7f5412d9d700 1 --2- 172.21.15.8:0/739159573 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54140d08d0 0x7f54140b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:26.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.586+0000 7f541259c700 1 -- 172.21.15.8:0/739159573 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54140cb360 msgr2=0x7f54140b38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:26.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.586+0000 7f541259c700 1 --2- 172.21.15.8:0/739159573 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54140cb360 0x7f54140b38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.586+0000 7f541259c700 1 -- 172.21.15.8:0/739159573 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54140d08d0 msgr2=0x7f54140b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:26.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.586+0000 7f541259c700 1 --2- 172.21.15.8:0/739159573 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54140d08d0 0x7f54140b3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.586+0000 7f541259c700 1 -- 172.21.15.8:0/739159573 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53fc0094f0 con 0x7f54140af680 2023-10-06T04:37:26.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.586+0000 7f5412d9d700 1 --2- 172.21.15.8:0/739159573 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54140d08d0 0x7f54140b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:26.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.586+0000 7f541259c700 1 --2- 172.21.15.8:0/739159573 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54140af680 0x7f541416abe0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f540400cef0 tx=0x7f54040077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:26.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.586+0000 7f540a7fc700 1 -- 172.21.15.8:0/739159573 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540400adf0 con 0x7f54140af680 2023-10-06T04:37:26.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.586+0000 7f540a7fc700 1 -- 172.21.15.8:0/739159573 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5404016420 con 0x7f54140af680 2023-10-06T04:37:26.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.586+0000 7f5418a11700 1 -- 172.21.15.8:0/739159573 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54140c5630 con 0x7f54140af680 2023-10-06T04:37:26.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.586+0000 7f540a7fc700 1 -- 172.21.15.8:0/739159573 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54040167e0 con 0x7f54140af680 2023-10-06T04:37:26.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.586+0000 7f5418a11700 1 -- 172.21.15.8:0/739159573 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f541416b120 con 0x7f54140af680 2023-10-06T04:37:26.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.587+0000 7f5418a11700 1 -- 172.21.15.8:0/739159573 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5414071550 con 0x7f54140af680 2023-10-06T04:37:26.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.588+0000 7f540a7fc700 1 -- 172.21.15.8:0/739159573 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5404016bd0 con 0x7f54140af680 2023-10-06T04:37:26.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.588+0000 7f540a7fc700 1 --2- 172.21.15.8:0/739159573 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f53f4066f30 0x7f53f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:26.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.588+0000 7f540a7fc700 1 -- 172.21.15.8:0/739159573 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f5404012070 con 0x7f54140af680 2023-10-06T04:37:26.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.588+0000 7f5411d9b700 1 --2- 172.21.15.8:0/739159573 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f53f4066f30 0x7f53f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:26.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.589+0000 7f5411d9b700 1 --2- 172.21.15.8:0/739159573 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f53f4066f30 0x7f53f40693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f54140d1020 tx=0x7f53fc017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:26.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.592+0000 7f540a7fc700 1 -- 172.21.15.8:0/739159573 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f540404e5a0 con 0x7f54140af680 2023-10-06T04:37:26.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.792+0000 7f5418a11700 1 -- 172.21.15.8:0/739159573 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54140c8210 con 0x7f54140af680 2023-10-06T04:37:26.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.792+0000 7f540a7fc700 1 -- 172.21.15.8:0/739159573 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+17150 (secure 0 0 0) 0x7f5404052060 con 0x7f54140af680 2023-10-06T04:37:26.795 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:26.795 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":43,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:37:26.776844+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:36:10.148177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:36:10.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:37:15.099258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T04:37:15.902657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.555871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.490505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.504578+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.517217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:05.991135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.537329+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.543232+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.443715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6835/3478733664":"2023-10-07T04:37:26.044067+0000","172.21.15.8:6833/3478733664":"2023-10-07T04:37:26.044067+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:37:26.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.794+0000 7f5418a11700 1 -- 172.21.15.8:0/739159573 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f53f4066f30 msgr2=0x7f53f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:26.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.794+0000 7f5418a11700 1 --2- 172.21.15.8:0/739159573 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f53f4066f30 0x7f53f40693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f54140d1020 tx=0x7f53fc017000 comp rx=0 tx=0).stop 2023-10-06T04:37:26.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.794+0000 7f5418a11700 1 -- 172.21.15.8:0/739159573 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54140af680 msgr2=0x7f541416abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:26.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.794+0000 7f5418a11700 1 --2- 172.21.15.8:0/739159573 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54140af680 0x7f541416abe0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f540400cef0 tx=0x7f54040077e0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.794+0000 7f5418a11700 1 -- 172.21.15.8:0/739159573 shutdown_connections 2023-10-06T04:37:26.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.794+0000 7f5418a11700 1 --2- 172.21.15.8:0/739159573 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f53f4066f30 0x7f53f40693e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.794+0000 7f5418a11700 1 --2- 172.21.15.8:0/739159573 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54140d08d0 0x7f54140b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.794+0000 7f5418a11700 1 --2- 172.21.15.8:0/739159573 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f54140af680 0x7f541416abe0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.794+0000 7f5418a11700 1 --2- 172.21.15.8:0/739159573 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54140cb360 0x7f54140b38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.794+0000 7f5418a11700 1 -- 172.21.15.8:0/739159573 >> 172.21.15.8:0/739159573 conn(0x7f54140633d0 msgr2=0x7f54140cf820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:26.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.794+0000 7f5418a11700 1 -- 172.21.15.8:0/739159573 shutdown_connections 2023-10-06T04:37:26.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.794+0000 7f5418a11700 1 -- 172.21.15.8:0/739159573 wait complete. 2023-10-06T04:37:26.808 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:36:10.148177+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:36:10.684157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:37:15.099258+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:37:15.902657+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:37:26.808 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:37:26.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.928+0000 7f87fe44f700 1 Processor -- start 2023-10-06T04:37:26.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.928+0000 7f87fe44f700 1 -- start start 2023-10-06T04:37:26.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.929+0000 7f87fe44f700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f87f8067820 0x7f87f806a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:26.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.929+0000 7f87fe44f700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f87f806ac80 0x7f87f8140800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:26.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.929+0000 7f87fe44f700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87f806b200 con 0x7f87f8067bf0 2023-10-06T04:37:26.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.929+0000 7f87fe44f700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f806b4e0 con 0x7f87f8067820 2023-10-06T04:37:26.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.929+0000 7f87fe44f700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f806b7c0 con 0x7f87f806ac80 2023-10-06T04:37:26.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.929+0000 7f87f7fff700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f87f8067820 0x7f87f806a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:26.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.929+0000 7f87f7fff700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f87f8067820 0x7f87f806a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33308/0 (socket says 172.21.15.8:33308) 2023-10-06T04:37:26.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.930+0000 7f87f7fff700 1 -- 172.21.15.8:0/1716739734 learned_addr learned my addr 172.21.15.8:0/1716739734 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:26.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.930+0000 7f87f77fe700 1 --2- 172.21.15.8:0/1716739734 >> v2:172.21.15.184:3300/0 conn(0x7f87f806ac80 0x7f87f8140800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:26.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.930+0000 7f87f7fff700 1 -- 172.21.15.8:0/1716739734 >> v2:172.21.15.184:3300/0 conn(0x7f87f806ac80 msgr2=0x7f87f8140800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:26.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.930+0000 7f87f7fff700 1 --2- 172.21.15.8:0/1716739734 >> v2:172.21.15.184:3300/0 conn(0x7f87f806ac80 0x7f87f8140800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.930+0000 7f87f7fff700 1 -- 172.21.15.8:0/1716739734 >> v1:172.21.15.184:6789/0 conn(0x7f87f8067bf0 legacy=0x7f87f806e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:26.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.930+0000 7f87f7fff700 1 -- 172.21.15.8:0/1716739734 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f806baa0 con 0x7f87f8067820 2023-10-06T04:37:26.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.930+0000 7f87f7fff700 1 --2- 172.21.15.8:0/1716739734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87f8067820 0x7f87f806a740 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f87f80afc60 tx=0x7f87e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=477be9279221ebd7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:26.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.930+0000 7f87f6ffd700 1 -- 172.21.15.8:0/1716739734 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e000b860 con 0x7f87f8067820 2023-10-06T04:37:26.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.930+0000 7f87f6ffd700 1 -- 172.21.15.8:0/1716739734 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e000b9c0 con 0x7f87f8067820 2023-10-06T04:37:26.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.930+0000 7f87f6ffd700 1 -- 172.21.15.8:0/1716739734 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e000bd60 con 0x7f87f8067820 2023-10-06T04:37:26.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.931+0000 7f87fe44f700 1 -- 172.21.15.8:0/1716739734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87f8067820 msgr2=0x7f87f806a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:26.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.931+0000 7f87fe44f700 1 --2- 172.21.15.8:0/1716739734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87f8067820 0x7f87f806a740 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f87f80afc60 tx=0x7f87e0009250 comp rx=0 tx=0).stop 2023-10-06T04:37:26.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.931+0000 7f87fe44f700 1 -- 172.21.15.8:0/1716739734 shutdown_connections 2023-10-06T04:37:26.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.931+0000 7f87fe44f700 1 --2- 172.21.15.8:0/1716739734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87f8067820 0x7f87f806a740 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.931+0000 7f87fe44f700 1 --2- 172.21.15.8:0/1716739734 >> v2:172.21.15.184:3300/0 conn(0x7f87f806ac80 0x7f87f8140800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.931+0000 7f87fe44f700 1 -- 172.21.15.8:0/1716739734 >> 172.21.15.8:0/1716739734 conn(0x7f87f80cd120 msgr2=0x7f87f80cd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:26.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.931+0000 7f87fe44f700 1 -- 172.21.15.8:0/1716739734 shutdown_connections 2023-10-06T04:37:26.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.931+0000 7f87fe44f700 1 -- 172.21.15.8:0/1716739734 wait complete. 2023-10-06T04:37:26.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.932+0000 7f87fe44f700 1 Processor -- start 2023-10-06T04:37:26.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.932+0000 7f87fe44f700 1 -- start start 2023-10-06T04:37:26.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.933+0000 7f87fe44f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87f8067820 0x7f87f816a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:26.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.933+0000 7f87fe44f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87f8067bf0 0x7f87f80cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:26.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.933+0000 7f87fe44f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87f806ac80 0x7f87f8156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:26.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.933+0000 7f87fe44f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f80c41d0 con 0x7f87f8067820 2023-10-06T04:37:26.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.933+0000 7f87fe44f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f80ccbc0 con 0x7f87f8067bf0 2023-10-06T04:37:26.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.933+0000 7f87fe44f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f80c4420 con 0x7f87f806ac80 2023-10-06T04:37:26.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.933+0000 7f87f7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87f8067820 0x7f87f816a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:26.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.933+0000 7f87f7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87f8067820 0x7f87f816a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33312/0 (socket says 172.21.15.8:33312) 2023-10-06T04:37:26.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.933+0000 7f87f7fff700 1 -- 172.21.15.8:0/3269387292 learned_addr learned my addr 172.21.15.8:0/3269387292 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:26.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.933+0000 7f87f77fe700 1 --2- 172.21.15.8:0/3269387292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87f8067bf0 0x7f87f80cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:26.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.933+0000 7f87fc9ec700 1 --2- 172.21.15.8:0/3269387292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87f806ac80 0x7f87f8156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:26.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.933+0000 7f87f7fff700 1 -- 172.21.15.8:0/3269387292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87f806ac80 msgr2=0x7f87f8156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:26.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.933+0000 7f87f7fff700 1 --2- 172.21.15.8:0/3269387292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87f806ac80 0x7f87f8156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.933+0000 7f87f7fff700 1 -- 172.21.15.8:0/3269387292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87f8067bf0 msgr2=0x7f87f80cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:26.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.933+0000 7f87f7fff700 1 --2- 172.21.15.8:0/3269387292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87f8067bf0 0x7f87f80cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:26.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.933+0000 7f87f7fff700 1 -- 172.21.15.8:0/3269387292 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e00094f0 con 0x7f87f8067820 2023-10-06T04:37:26.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.933+0000 7f87f7fff700 1 --2- 172.21.15.8:0/3269387292 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87f8067820 0x7f87f816a460 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f87e0009290 tx=0x7f87e0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:26.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.934+0000 7f87effff700 1 -- 172.21.15.8:0/3269387292 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e0011e40 con 0x7f87f8067820 2023-10-06T04:37:26.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.934+0000 7f87effff700 1 -- 172.21.15.8:0/3269387292 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e0026450 con 0x7f87f8067820 2023-10-06T04:37:26.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.934+0000 7f87fe44f700 1 -- 172.21.15.8:0/3269387292 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f80c4700 con 0x7f87f8067820 2023-10-06T04:37:26.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.934+0000 7f87effff700 1 -- 172.21.15.8:0/3269387292 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e0026810 con 0x7f87f8067820 2023-10-06T04:37:26.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.934+0000 7f87fe44f700 1 -- 172.21.15.8:0/3269387292 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f80c4cc0 con 0x7f87f8067820 2023-10-06T04:37:26.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.935+0000 7f87fe44f700 1 -- 172.21.15.8:0/3269387292 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f80c4ee0 con 0x7f87f8067820 2023-10-06T04:37:26.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.935+0000 7f87effff700 1 -- 172.21.15.8:0/3269387292 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f87e0026c40 con 0x7f87f8067820 2023-10-06T04:37:26.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.935+0000 7f87effff700 1 --2- 172.21.15.8:0/3269387292 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f87d8066f30 0x7f87d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:26.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.936+0000 7f87effff700 1 -- 172.21.15.8:0/3269387292 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f87e0086440 con 0x7f87f8067820 2023-10-06T04:37:26.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.936+0000 7f87f77fe700 1 --2- 172.21.15.8:0/3269387292 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f87d8066f30 0x7f87d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:26.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.936+0000 7f87f77fe700 1 --2- 172.21.15.8:0/3269387292 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f87d8066f30 0x7f87d80693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f87e8006fd0 tx=0x7f87e8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:26.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:26.940+0000 7f87effff700 1 -- 172.21.15.8:0/3269387292 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f87e0053440 con 0x7f87f8067820 2023-10-06T04:37:27.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.137+0000 7f87fe44f700 1 -- 172.21.15.8:0/3269387292 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f87f8071550 con 0x7f87f8067820 2023-10-06T04:37:27.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.137+0000 7f87effff700 1 -- 172.21.15.8:0/3269387292 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v43) v1 ==== 92+0+10 (secure 0 0 0) 0x7f87e0015020 con 0x7f87f8067820 2023-10-06T04:37:27.139 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 8 2023-10-06T04:37:27.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.139+0000 7f87fe44f700 1 -- 172.21.15.8:0/3269387292 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f87d8066f30 msgr2=0x7f87d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:27.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.139+0000 7f87fe44f700 1 --2- 172.21.15.8:0/3269387292 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f87d8066f30 0x7f87d80693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f87e8006fd0 tx=0x7f87e8008040 comp rx=0 tx=0).stop 2023-10-06T04:37:27.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.139+0000 7f87fe44f700 1 -- 172.21.15.8:0/3269387292 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87f8067820 msgr2=0x7f87f816a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:27.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.139+0000 7f87fe44f700 1 --2- 172.21.15.8:0/3269387292 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87f8067820 0x7f87f816a460 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f87e0009290 tx=0x7f87e0017000 comp rx=0 tx=0).stop 2023-10-06T04:37:27.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.139+0000 7f87fe44f700 1 -- 172.21.15.8:0/3269387292 shutdown_connections 2023-10-06T04:37:27.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.139+0000 7f87fe44f700 1 --2- 172.21.15.8:0/3269387292 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f87d8066f30 0x7f87d80693e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:27.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.139+0000 7f87fe44f700 1 --2- 172.21.15.8:0/3269387292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87f806ac80 0x7f87f8156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:27.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.139+0000 7f87fe44f700 1 --2- 172.21.15.8:0/3269387292 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87f8067820 0x7f87f816a460 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:27.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.139+0000 7f87fe44f700 1 --2- 172.21.15.8:0/3269387292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87f8067bf0 0x7f87f80cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:27.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.139+0000 7f87fe44f700 1 -- 172.21.15.8:0/3269387292 >> 172.21.15.8:0/3269387292 conn(0x7f87f80cd120 msgr2=0x7f87f813f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:27.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.139+0000 7f87fe44f700 1 -- 172.21.15.8:0/3269387292 shutdown_connections 2023-10-06T04:37:27.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.139+0000 7f87fe44f700 1 -- 172.21.15.8:0/3269387292 wait complete. 2023-10-06T04:37:27.152 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:37:27.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.273+0000 7fbd193c2700 1 Processor -- start 2023-10-06T04:37:27.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.273+0000 7fbd193c2700 1 -- start start 2023-10-06T04:37:27.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.274+0000 7fbd193c2700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fbd14142cf0 0x7fbd140b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:27.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.274+0000 7fbd193c2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd141430c0 0x7fbd140cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:27.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.274+0000 7fbd193c2700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbd140cfee0 0x7fbd140b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:27.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.274+0000 7fbd193c2700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd140cf510 con 0x7fbd140cfee0 2023-10-06T04:37:27.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.274+0000 7fbd193c2700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd140ce6a0 con 0x7fbd14142cf0 2023-10-06T04:37:27.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.274+0000 7fbd193c2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd140ce900 con 0x7fbd141430c0 2023-10-06T04:37:27.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.274+0000 7fbd137fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbd140cfee0 0x7fbd140b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:27.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.274+0000 7fbd137fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbd140cfee0 0x7fbd140b3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33322/0 (socket says 172.21.15.8:33322) 2023-10-06T04:37:27.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.274+0000 7fbd137fe700 1 -- 172.21.15.8:0/2974543341 learned_addr learned my addr 172.21.15.8:0/2974543341 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:27.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.274+0000 7fbd127fc700 1 --2- 172.21.15.8:0/2974543341 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd141430c0 0x7fbd140cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:27.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.274+0000 7fbd12ffd700 1 --2- 172.21.15.8:0/2974543341 >> v2:172.21.15.184:3300/0 conn(0x7fbd14142cf0 0x7fbd140b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:27.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.274+0000 7fbd137fe700 1 -- 172.21.15.8:0/2974543341 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd141430c0 msgr2=0x7fbd140cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:27.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.274+0000 7fbd137fe700 1 --2- 172.21.15.8:0/2974543341 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd141430c0 0x7fbd140cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:27.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.274+0000 7fbd137fe700 1 -- 172.21.15.8:0/2974543341 >> v2:172.21.15.184:3300/0 conn(0x7fbd14142cf0 msgr2=0x7fbd140b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:27.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.274+0000 7fbd137fe700 1 --2- 172.21.15.8:0/2974543341 >> v2:172.21.15.184:3300/0 conn(0x7fbd14142cf0 0x7fbd140b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:27.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.274+0000 7fbd137fe700 1 -- 172.21.15.8:0/2974543341 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd140cebe0 con 0x7fbd140cfee0 2023-10-06T04:37:27.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.274+0000 7fbd137fe700 1 --2- 172.21.15.8:0/2974543341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd140cfee0 0x7fbd140b3790 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbd14089240 tx=0x7fbd0c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4fa82ce615cf68e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:27.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.275+0000 7fbd11ffb700 1 -- 172.21.15.8:0/2974543341 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c00b640 con 0x7fbd140cfee0 2023-10-06T04:37:27.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.275+0000 7fbd11ffb700 1 -- 172.21.15.8:0/2974543341 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0c00b7a0 con 0x7fbd140cfee0 2023-10-06T04:37:27.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.275+0000 7fbd11ffb700 1 -- 172.21.15.8:0/2974543341 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c00bb60 con 0x7fbd140cfee0 2023-10-06T04:37:27.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.275+0000 7fbd193c2700 1 -- 172.21.15.8:0/2974543341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd140cfee0 msgr2=0x7fbd140b3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:27.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.275+0000 7fbd193c2700 1 --2- 172.21.15.8:0/2974543341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd140cfee0 0x7fbd140b3790 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbd14089240 tx=0x7fbd0c009250 comp rx=0 tx=0).stop 2023-10-06T04:37:27.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.275+0000 7fbd193c2700 1 -- 172.21.15.8:0/2974543341 shutdown_connections 2023-10-06T04:37:27.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.275+0000 7fbd193c2700 1 --2- 172.21.15.8:0/2974543341 >> v2:172.21.15.184:3300/0 conn(0x7fbd14142cf0 0x7fbd140b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:27.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.275+0000 7fbd193c2700 1 --2- 172.21.15.8:0/2974543341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd140cfee0 0x7fbd140b3790 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:27.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.275+0000 7fbd193c2700 1 --2- 172.21.15.8:0/2974543341 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd141430c0 0x7fbd140cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:27.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.275+0000 7fbd193c2700 1 -- 172.21.15.8:0/2974543341 >> 172.21.15.8:0/2974543341 conn(0x7fbd1406ed00 msgr2=0x7fbd1406f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:27.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.275+0000 7fbd193c2700 1 -- 172.21.15.8:0/2974543341 shutdown_connections 2023-10-06T04:37:27.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.275+0000 7fbd193c2700 1 -- 172.21.15.8:0/2974543341 wait complete. 2023-10-06T04:37:27.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.276+0000 7fbd193c2700 1 Processor -- start 2023-10-06T04:37:27.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.276+0000 7fbd193c2700 1 -- start start 2023-10-06T04:37:27.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.277+0000 7fbd193c2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd140cfee0 0x7fbd141590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:27.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.277+0000 7fbd193c2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd14142cf0 0x7fbd140c5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:27.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.277+0000 7fbd193c2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd141430c0 0x7fbd140b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:27.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.277+0000 7fbd193c2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1415eca0 con 0x7fbd140cfee0 2023-10-06T04:37:27.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.277+0000 7fbd193c2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1415e0d0 con 0x7fbd14142cf0 2023-10-06T04:37:27.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.277+0000 7fbd193c2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1415e370 con 0x7fbd141430c0 2023-10-06T04:37:27.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.277+0000 7fbd12ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd140cfee0 0x7fbd141590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:27.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.277+0000 7fbd12ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd140cfee0 0x7fbd141590e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33338/0 (socket says 172.21.15.8:33338) 2023-10-06T04:37:27.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.277+0000 7fbd12ffd700 1 -- 172.21.15.8:0/628309969 learned_addr learned my addr 172.21.15.8:0/628309969 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:27.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.277+0000 7fbd127fc700 1 --2- 172.21.15.8:0/628309969 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd14142cf0 0x7fbd140c5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:27.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.277+0000 7fbd137fe700 1 --2- 172.21.15.8:0/628309969 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd141430c0 0x7fbd140b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:27.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.278+0000 7fbd12ffd700 1 -- 172.21.15.8:0/628309969 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd141430c0 msgr2=0x7fbd140b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:27.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.278+0000 7fbd12ffd700 1 --2- 172.21.15.8:0/628309969 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd141430c0 0x7fbd140b4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:27.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.278+0000 7fbd12ffd700 1 -- 172.21.15.8:0/628309969 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd14142cf0 msgr2=0x7fbd140c5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:27.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.278+0000 7fbd12ffd700 1 --2- 172.21.15.8:0/628309969 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd14142cf0 0x7fbd140c5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:27.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.278+0000 7fbd12ffd700 1 -- 172.21.15.8:0/628309969 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0c0094f0 con 0x7fbd140cfee0 2023-10-06T04:37:27.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.278+0000 7fbd137fe700 1 --2- 172.21.15.8:0/628309969 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd141430c0 0x7fbd140b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:27.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.278+0000 7fbd12ffd700 1 --2- 172.21.15.8:0/628309969 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd140cfee0 0x7fbd141590e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbd04009ef0 tx=0x7fbd0400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:27.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.278+0000 7fbd0affd700 1 -- 172.21.15.8:0/628309969 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0400cc20 con 0x7fbd140cfee0 2023-10-06T04:37:27.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.278+0000 7fbd0affd700 1 -- 172.21.15.8:0/628309969 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0400f040 con 0x7fbd140cfee0 2023-10-06T04:37:27.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.278+0000 7fbd193c2700 1 -- 172.21.15.8:0/628309969 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd1415e650 con 0x7fbd140cfee0 2023-10-06T04:37:27.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.278+0000 7fbd0affd700 1 -- 172.21.15.8:0/628309969 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd04014480 con 0x7fbd140cfee0 2023-10-06T04:37:27.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.278+0000 7fbd193c2700 1 -- 172.21.15.8:0/628309969 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd1416a7c0 con 0x7fbd140cfee0 2023-10-06T04:37:27.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.279+0000 7fbd193c2700 1 -- 172.21.15.8:0/628309969 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd14071550 con 0x7fbd140cfee0 2023-10-06T04:37:27.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.279+0000 7fbd0affd700 1 -- 172.21.15.8:0/628309969 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbd040147f0 con 0x7fbd140cfee0 2023-10-06T04:37:27.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.280+0000 7fbd0affd700 1 --2- 172.21.15.8:0/628309969 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fbcf4066f30 0x7fbcf40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:27.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.280+0000 7fbd0affd700 1 -- 172.21.15.8:0/628309969 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fbd040854d0 con 0x7fbd140cfee0 2023-10-06T04:37:27.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.280+0000 7fbd127fc700 1 --2- 172.21.15.8:0/628309969 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fbcf4066f30 0x7fbcf40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:27.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.280+0000 7fbd127fc700 1 --2- 172.21.15.8:0/628309969 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fbcf4066f30 0x7fbcf40693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbd140b4ca0 tx=0x7fbcfc0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:27.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.284+0000 7fbd0affd700 1 -- 172.21.15.8:0/628309969 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbd04052450 con 0x7fbd140cfee0 2023-10-06T04:37:27.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.474+0000 7fbd193c2700 1 -- 172.21.15.8:0/628309969 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbd140ceec0 con 0x7fbd140cfee0 2023-10-06T04:37:27.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.475+0000 7fbd0affd700 1 -- 172.21.15.8:0/628309969 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbd04055a70 con 0x7fbd140cfee0 2023-10-06T04:37:27.476 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-06T04:37:27.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.477+0000 7fbd193c2700 1 -- 172.21.15.8:0/628309969 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fbcf4066f30 msgr2=0x7fbcf40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:27.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.477+0000 7fbd193c2700 1 --2- 172.21.15.8:0/628309969 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fbcf4066f30 0x7fbcf40693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbd140b4ca0 tx=0x7fbcfc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:27.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.477+0000 7fbd193c2700 1 -- 172.21.15.8:0/628309969 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd140cfee0 msgr2=0x7fbd141590e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:27.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.477+0000 7fbd193c2700 1 --2- 172.21.15.8:0/628309969 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd140cfee0 0x7fbd141590e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbd04009ef0 tx=0x7fbd0400b040 comp rx=0 tx=0).stop 2023-10-06T04:37:27.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.477+0000 7fbd193c2700 1 -- 172.21.15.8:0/628309969 shutdown_connections 2023-10-06T04:37:27.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.477+0000 7fbd193c2700 1 --2- 172.21.15.8:0/628309969 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fbcf4066f30 0x7fbcf40693e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:27.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.477+0000 7fbd193c2700 1 --2- 172.21.15.8:0/628309969 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd141430c0 0x7fbd140b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:27.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.477+0000 7fbd193c2700 1 --2- 172.21.15.8:0/628309969 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd140cfee0 0x7fbd141590e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:27.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.477+0000 7fbd193c2700 1 --2- 172.21.15.8:0/628309969 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd14142cf0 0x7fbd140c5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:27.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.477+0000 7fbd193c2700 1 -- 172.21.15.8:0/628309969 >> 172.21.15.8:0/628309969 conn(0x7fbd1406ed00 msgr2=0x7fbd14070820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:27.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.477+0000 7fbd193c2700 1 -- 172.21.15.8:0/628309969 shutdown_connections 2023-10-06T04:37:27.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.477+0000 7fbd193c2700 1 -- 172.21.15.8:0/628309969 wait complete. 2023-10-06T04:37:27.490 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:37:27.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.610+0000 7fa6cb0f9700 1 Processor -- start 2023-10-06T04:37:27.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.610+0000 7fa6cb0f9700 1 -- start start 2023-10-06T04:37:27.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.611+0000 7fa6cb0f9700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa6c41430c0 0x7fa6c40cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:27.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.611+0000 7fa6cb0f9700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa6c40cfee0 0x7fa6c40b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:27.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.611+0000 7fa6cb0f9700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6c40cf510 con 0x7fa6c4142cf0 2023-10-06T04:37:27.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.611+0000 7fa6cb0f9700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6c40ce6a0 con 0x7fa6c40cfee0 2023-10-06T04:37:27.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.611+0000 7fa6cb0f9700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6c40ce900 con 0x7fa6c41430c0 2023-10-06T04:37:27.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.611+0000 7fa6c8e95700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fa6c4142cf0 0x7fa6c40b5cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46144/0 (socket says 172.21.15.8:46144) 2023-10-06T04:37:27.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.611+0000 7fa6c8e95700 1 -- 172.21.15.8:0/2706228369 learned_addr learned my addr 172.21.15.8:0/2706228369 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:27.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.611+0000 7fa6c9696700 1 --2- 172.21.15.8:0/2706228369 >> v2:172.21.15.8:3300/0 conn(0x7fa6c40cfee0 0x7fa6c40b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:27.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.611+0000 7fa6c3fff700 1 --2- 172.21.15.8:0/2706228369 >> v2:172.21.15.184:3300/0 conn(0x7fa6c41430c0 0x7fa6c40cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:27.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.611+0000 7fa6c37fe700 1 -- 172.21.15.8:0/2706228369 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3857913425 0 0) 0x7fa6c40cf510 con 0x7fa6c4142cf0 2023-10-06T04:37:27.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.611+0000 7fa6c37fe700 1 -- 172.21.15.8:0/2706228369 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6ac003570 con 0x7fa6c4142cf0 2023-10-06T04:37:27.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.611+0000 7fa6c9696700 1 -- 172.21.15.8:0/2706228369 >> v2:172.21.15.184:3300/0 conn(0x7fa6c41430c0 msgr2=0x7fa6c40cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:27.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.611+0000 7fa6c9696700 1 --2- 172.21.15.8:0/2706228369 >> v2:172.21.15.184:3300/0 conn(0x7fa6c41430c0 0x7fa6c40cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:27.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.611+0000 7fa6c9696700 1 -- 172.21.15.8:0/2706228369 >> v1:172.21.15.8:6789/0 conn(0x7fa6c4142cf0 legacy=0x7fa6c40b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:27.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.611+0000 7fa6c9696700 1 -- 172.21.15.8:0/2706228369 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c40cebe0 con 0x7fa6c40cfee0 2023-10-06T04:37:27.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.611+0000 7fa6c9696700 1 --2- 172.21.15.8:0/2706228369 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6c40cfee0 0x7fa6c40b3790 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa6c40ab440 tx=0x7fa6bc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb694de8af51dfd8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:27.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.612+0000 7fa6c37fe700 1 -- 172.21.15.8:0/2706228369 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc00e070 con 0x7fa6c40cfee0 2023-10-06T04:37:27.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.612+0000 7fa6c37fe700 1 -- 172.21.15.8:0/2706228369 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6bc00bab0 con 0x7fa6c40cfee0 2023-10-06T04:37:27.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.612+0000 7fa6c37fe700 1 -- 172.21.15.8:0/2706228369 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc00be70 con 0x7fa6c40cfee0 2023-10-06T04:37:27.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.612+0000 7fa6cb0f9700 1 -- 172.21.15.8:0/2706228369 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6c40cfee0 msgr2=0x7fa6c40b3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:27.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.612+0000 7fa6cb0f9700 1 --2- 172.21.15.8:0/2706228369 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6c40cfee0 0x7fa6c40b3790 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa6c40ab440 tx=0x7fa6bc009780 comp rx=0 tx=0).stop 2023-10-06T04:37:27.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.612+0000 7fa6cb0f9700 1 -- 172.21.15.8:0/2706228369 shutdown_connections 2023-10-06T04:37:27.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.612+0000 7fa6cb0f9700 1 --2- 172.21.15.8:0/2706228369 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6c40cfee0 0x7fa6c40b3790 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:27.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.612+0000 7fa6cb0f9700 1 --2- 172.21.15.8:0/2706228369 >> v2:172.21.15.184:3300/0 conn(0x7fa6c41430c0 0x7fa6c40cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:27.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.612+0000 7fa6cb0f9700 1 -- 172.21.15.8:0/2706228369 >> 172.21.15.8:0/2706228369 conn(0x7fa6c406ed00 msgr2=0x7fa6c406f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:27.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.612+0000 7fa6cb0f9700 1 -- 172.21.15.8:0/2706228369 shutdown_connections 2023-10-06T04:37:27.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.612+0000 7fa6cb0f9700 1 -- 172.21.15.8:0/2706228369 wait complete. 2023-10-06T04:37:27.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.613+0000 7fa6cb0f9700 1 Processor -- start 2023-10-06T04:37:27.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.613+0000 7fa6cb0f9700 1 -- start start 2023-10-06T04:37:27.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.614+0000 7fa6cb0f9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6c40cfee0 0x7fa6c41439e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:27.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.614+0000 7fa6cb0f9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6c4142cf0 0x7fa6c41451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:27.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.614+0000 7fa6cb0f9700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6c41430c0 0x7fa6c40a6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:27.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.614+0000 7fa6cb0f9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c4141a70 con 0x7fa6c40cfee0 2023-10-06T04:37:27.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.614+0000 7fa6cb0f9700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c4143f20 con 0x7fa6c4142cf0 2023-10-06T04:37:27.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.614+0000 7fa6cb0f9700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c41456f0 con 0x7fa6c41430c0 2023-10-06T04:37:27.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.614+0000 7fa6c8e95700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6c40cfee0 0x7fa6c41439e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:27.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.614+0000 7fa6c8e95700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6c40cfee0 0x7fa6c41439e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33350/0 (socket says 172.21.15.8:33350) 2023-10-06T04:37:27.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.614+0000 7fa6c8e95700 1 -- 172.21.15.8:0/3011517286 learned_addr learned my addr 172.21.15.8:0/3011517286 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:27.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.614+0000 7fa6c3fff700 1 --2- 172.21.15.8:0/3011517286 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6c4142cf0 0x7fa6c41451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:27.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.614+0000 7fa6c9696700 1 --2- 172.21.15.8:0/3011517286 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6c41430c0 0x7fa6c40a6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:27.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.614+0000 7fa6c8e95700 1 -- 172.21.15.8:0/3011517286 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6c41430c0 msgr2=0x7fa6c40a6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:27.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.614+0000 7fa6c8e95700 1 --2- 172.21.15.8:0/3011517286 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6c41430c0 0x7fa6c40a6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:27.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.614+0000 7fa6c8e95700 1 -- 172.21.15.8:0/3011517286 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6c4142cf0 msgr2=0x7fa6c41451b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:27.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.614+0000 7fa6c8e95700 1 --2- 172.21.15.8:0/3011517286 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6c4142cf0 0x7fa6c41451b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:27.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.614+0000 7fa6c8e95700 1 -- 172.21.15.8:0/3011517286 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6bc009a20 con 0x7fa6c40cfee0 2023-10-06T04:37:27.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.614+0000 7fa6c3fff700 1 --2- 172.21.15.8:0/3011517286 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6c4142cf0 0x7fa6c41451b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:27.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.615+0000 7fa6c8e95700 1 --2- 172.21.15.8:0/3011517286 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6c40cfee0 0x7fa6c41439e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa6b400c7c0 tx=0x7fa6b4007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:27.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.615+0000 7fa6c0ff9700 1 -- 172.21.15.8:0/3011517286 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4005b30 con 0x7fa6c40cfee0 2023-10-06T04:37:27.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.615+0000 7fa6c0ff9700 1 -- 172.21.15.8:0/3011517286 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b4005c90 con 0x7fa6c40cfee0 2023-10-06T04:37:27.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.615+0000 7fa6cb0f9700 1 -- 172.21.15.8:0/3011517286 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6c4144d20 con 0x7fa6c40cfee0 2023-10-06T04:37:27.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.615+0000 7fa6c0ff9700 1 -- 172.21.15.8:0/3011517286 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4007340 con 0x7fa6c40cfee0 2023-10-06T04:37:27.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.615+0000 7fa6cb0f9700 1 -- 172.21.15.8:0/3011517286 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6c41443f0 con 0x7fa6c40cfee0 2023-10-06T04:37:27.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.616+0000 7fa6cb0f9700 1 -- 172.21.15.8:0/3011517286 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6c4071550 con 0x7fa6c40cfee0 2023-10-06T04:37:27.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.616+0000 7fa6c0ff9700 1 -- 172.21.15.8:0/3011517286 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa6b401b400 con 0x7fa6c40cfee0 2023-10-06T04:37:27.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.617+0000 7fa6c0ff9700 1 --2- 172.21.15.8:0/3011517286 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa6b0066f30 0x7fa6b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:27.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.617+0000 7fa6c0ff9700 1 -- 172.21.15.8:0/3011517286 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fa6b40843b0 con 0x7fa6c40cfee0 2023-10-06T04:37:27.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.617+0000 7fa6c3fff700 1 --2- 172.21.15.8:0/3011517286 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa6b0066f30 0x7fa6b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:27.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.617+0000 7fa6c3fff700 1 --2- 172.21.15.8:0/3011517286 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa6b0066f30 0x7fa6b00693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8006f00 tx=0x7fa6b8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:27.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.621+0000 7fa6c0ff9700 1 -- 172.21.15.8:0/3011517286 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa6b4051330 con 0x7fa6c40cfee0 2023-10-06T04:37:27.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.813+0000 7fa6cb0f9700 1 -- 172.21.15.8:0/3011517286 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa6c40ceec0 con 0x7fa6c40cfee0 2023-10-06T04:37:27.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.814+0000 7fa6c0ff9700 1 -- 172.21.15.8:0/3011517286 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa6b4054950 con 0x7fa6c40cfee0 2023-10-06T04:37:27.815 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-06T04:37:27.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.815+0000 7fa6cb0f9700 1 -- 172.21.15.8:0/3011517286 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa6b0066f30 msgr2=0x7fa6b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:27.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.816+0000 7fa6cb0f9700 1 --2- 172.21.15.8:0/3011517286 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa6b0066f30 0x7fa6b00693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8006f00 tx=0x7fa6b8008040 comp rx=0 tx=0).stop 2023-10-06T04:37:27.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.816+0000 7fa6cb0f9700 1 -- 172.21.15.8:0/3011517286 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6c40cfee0 msgr2=0x7fa6c41439e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:27.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.816+0000 7fa6cb0f9700 1 --2- 172.21.15.8:0/3011517286 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6c40cfee0 0x7fa6c41439e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa6b400c7c0 tx=0x7fa6b4007e00 comp rx=0 tx=0).stop 2023-10-06T04:37:27.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.816+0000 7fa6cb0f9700 1 -- 172.21.15.8:0/3011517286 shutdown_connections 2023-10-06T04:37:27.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.816+0000 7fa6cb0f9700 1 --2- 172.21.15.8:0/3011517286 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa6b0066f30 0x7fa6b00693e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:27.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.816+0000 7fa6cb0f9700 1 --2- 172.21.15.8:0/3011517286 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6c41430c0 0x7fa6c40a6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:27.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.816+0000 7fa6cb0f9700 1 --2- 172.21.15.8:0/3011517286 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6c40cfee0 0x7fa6c41439e0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:27.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.816+0000 7fa6cb0f9700 1 --2- 172.21.15.8:0/3011517286 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6c4142cf0 0x7fa6c41451b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:27.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.816+0000 7fa6cb0f9700 1 -- 172.21.15.8:0/3011517286 >> 172.21.15.8:0/3011517286 conn(0x7fa6c406ed00 msgr2=0x7fa6c40d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:27.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.816+0000 7fa6cb0f9700 1 -- 172.21.15.8:0/3011517286 shutdown_connections 2023-10-06T04:37:27.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.816+0000 7fa6cb0f9700 1 -- 172.21.15.8:0/3011517286 wait complete. 2023-10-06T04:37:27.830 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:37:27.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.949+0000 7fef6cdf0700 1 Processor -- start 2023-10-06T04:37:27.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.950+0000 7fef6cdf0700 1 -- start start 2023-10-06T04:37:27.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.950+0000 7fef6cdf0700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fef681430c0 0x7fef680cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:27.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.950+0000 7fef6cdf0700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef680cf510 con 0x7fef680cfee0 2023-10-06T04:37:27.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.950+0000 7fef6cdf0700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef680ce6a0 con 0x7fef68142cf0 2023-10-06T04:37:27.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.950+0000 7fef6cdf0700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef680ce900 con 0x7fef681430c0 2023-10-06T04:37:27.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.951+0000 7fef65d9b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fef681430c0 0x7fef680cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:27.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.951+0000 7fef66d9d700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fef680cfee0 0x7fef680b3790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46148/0 (socket says 172.21.15.8:46148) 2023-10-06T04:37:27.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.951+0000 7fef66d9d700 1 -- 172.21.15.8:0/1012662391 learned_addr learned my addr 172.21.15.8:0/1012662391 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:27.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.951+0000 7fef65d9b700 1 -- 172.21.15.8:0/1012662391 >> v1:172.21.15.184:6789/0 conn(0x7fef68142cf0 legacy=0x7fef680b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:27.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.951+0000 7fef65d9b700 1 -- 172.21.15.8:0/1012662391 >> v1:172.21.15.8:6789/0 conn(0x7fef680cfee0 legacy=0x7fef680b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:27.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.951+0000 7fef65d9b700 1 -- 172.21.15.8:0/1012662391 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef680cebe0 con 0x7fef681430c0 2023-10-06T04:37:27.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.951+0000 7fef6559a700 1 -- 172.21.15.8:0/1012662391 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1582897196 0 0) 0x7fef680ce6a0 con 0x7fef68142cf0 2023-10-06T04:37:27.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.951+0000 7fef65d9b700 1 --2- 172.21.15.8:0/1012662391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef681430c0 0x7fef680cf9a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fef500098e0 tx=0x7fef500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eac66e0967ae6e34 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:27.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.951+0000 7fef6559a700 1 -- 172.21.15.8:0/1012662391 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef50009e80 con 0x7fef681430c0 2023-10-06T04:37:27.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.951+0000 7fef6559a700 1 -- 172.21.15.8:0/1012662391 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5000b760 con 0x7fef681430c0 2023-10-06T04:37:27.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.951+0000 7fef6559a700 1 -- 172.21.15.8:0/1012662391 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5000bae0 con 0x7fef681430c0 2023-10-06T04:37:27.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.952+0000 7fef6cdf0700 1 -- 172.21.15.8:0/1012662391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef681430c0 msgr2=0x7fef680cf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:27.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.952+0000 7fef6cdf0700 1 --2- 172.21.15.8:0/1012662391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef681430c0 0x7fef680cf9a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fef500098e0 tx=0x7fef500091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:27.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.952+0000 7fef6cdf0700 1 -- 172.21.15.8:0/1012662391 shutdown_connections 2023-10-06T04:37:27.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.952+0000 7fef6cdf0700 1 --2- 172.21.15.8:0/1012662391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef681430c0 0x7fef680cf9a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:27.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.952+0000 7fef6cdf0700 1 -- 172.21.15.8:0/1012662391 >> 172.21.15.8:0/1012662391 conn(0x7fef6806ed00 msgr2=0x7fef6806f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:27.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.952+0000 7fef6cdf0700 1 -- 172.21.15.8:0/1012662391 shutdown_connections 2023-10-06T04:37:27.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.952+0000 7fef6cdf0700 1 -- 172.21.15.8:0/1012662391 wait complete. 2023-10-06T04:37:27.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.953+0000 7fef6cdf0700 1 Processor -- start 2023-10-06T04:37:27.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.953+0000 7fef6cdf0700 1 -- start start 2023-10-06T04:37:27.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.954+0000 7fef6cdf0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef680cfee0 0x7fef68141d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:27.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.954+0000 7fef6cdf0700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef68142cf0 0x7fef6816d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:27.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.954+0000 7fef6cdf0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef681430c0 0x7fef6816d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:27.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.954+0000 7fef6cdf0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef680a9760 con 0x7fef681430c0 2023-10-06T04:37:27.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.954+0000 7fef6cdf0700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef680a8940 con 0x7fef680cfee0 2023-10-06T04:37:27.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.954+0000 7fef6cdf0700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6816dc30 con 0x7fef68142cf0 2023-10-06T04:37:27.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.954+0000 7fef66d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef681430c0 0x7fef6816d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:27.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.954+0000 7fef66d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef681430c0 0x7fef6816d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33366/0 (socket says 172.21.15.8:33366) 2023-10-06T04:37:27.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.954+0000 7fef66d9d700 1 -- 172.21.15.8:0/1391297116 learned_addr learned my addr 172.21.15.8:0/1391297116 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:27.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.954+0000 7fef65d9b700 1 --2- 172.21.15.8:0/1391297116 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef68142cf0 0x7fef6816d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:27.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.954+0000 7fef6659c700 1 --2- 172.21.15.8:0/1391297116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef680cfee0 0x7fef68141d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:27.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.954+0000 7fef66d9d700 1 -- 172.21.15.8:0/1391297116 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef68142cf0 msgr2=0x7fef6816d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:27.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.954+0000 7fef66d9d700 1 --2- 172.21.15.8:0/1391297116 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef68142cf0 0x7fef6816d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:27.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.954+0000 7fef66d9d700 1 -- 172.21.15.8:0/1391297116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef680cfee0 msgr2=0x7fef68141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:27.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.954+0000 7fef66d9d700 1 --2- 172.21.15.8:0/1391297116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef680cfee0 0x7fef68141d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:27.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.954+0000 7fef66d9d700 1 -- 172.21.15.8:0/1391297116 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef50009420 con 0x7fef681430c0 2023-10-06T04:37:27.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.954+0000 7fef66d9d700 1 --2- 172.21.15.8:0/1391297116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef681430c0 0x7fef6816d600 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fef58002230 tx=0x7fef58001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:27.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.955+0000 7fef5e7fc700 1 -- 172.21.15.8:0/1391297116 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5800ab30 con 0x7fef681430c0 2023-10-06T04:37:27.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.955+0000 7fef5e7fc700 1 -- 172.21.15.8:0/1391297116 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5800ac90 con 0x7fef681430c0 2023-10-06T04:37:27.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.955+0000 7fef5e7fc700 1 -- 172.21.15.8:0/1391297116 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef58007340 con 0x7fef681430c0 2023-10-06T04:37:27.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.955+0000 7fef6cdf0700 1 -- 172.21.15.8:0/1391297116 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef680a9110 con 0x7fef681430c0 2023-10-06T04:37:27.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.955+0000 7fef6cdf0700 1 -- 172.21.15.8:0/1391297116 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef681422d0 con 0x7fef681430c0 2023-10-06T04:37:27.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.955+0000 7fef6cdf0700 1 -- 172.21.15.8:0/1391297116 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef680a98d0 con 0x7fef681430c0 2023-10-06T04:37:27.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.956+0000 7fef5e7fc700 1 -- 172.21.15.8:0/1391297116 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef580076f0 con 0x7fef681430c0 2023-10-06T04:37:27.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.956+0000 7fef5e7fc700 1 --2- 172.21.15.8:0/1391297116 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fef48066f30 0x7fef480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:27.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.956+0000 7fef5e7fc700 1 -- 172.21.15.8:0/1391297116 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fef58084e10 con 0x7fef681430c0 2023-10-06T04:37:27.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.957+0000 7fef6659c700 1 --2- 172.21.15.8:0/1391297116 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fef48066f30 0x7fef480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:27.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.957+0000 7fef6659c700 1 --2- 172.21.15.8:0/1391297116 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fef48066f30 0x7fef480693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fef600011e0 tx=0x7fef60009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:27.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:27.961+0000 7fef5e7fc700 1 -- 172.21.15.8:0/1391297116 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef58088030 con 0x7fef681430c0 2023-10-06T04:37:28.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.152+0000 7fef6cdf0700 1 -- 172.21.15.8:0/1391297116 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fef68071550 con 0x7fef681430c0 2023-10-06T04:37:28.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.152+0000 7fef5e7fc700 1 -- 172.21.15.8:0/1391297116 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7fef58051d90 con 0x7fef681430c0 2023-10-06T04:37:28.154 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-06T04:37:28.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.154+0000 7fef6cdf0700 1 -- 172.21.15.8:0/1391297116 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fef48066f30 msgr2=0x7fef480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:28.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.154+0000 7fef6cdf0700 1 --2- 172.21.15.8:0/1391297116 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fef48066f30 0x7fef480693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fef600011e0 tx=0x7fef60009040 comp rx=0 tx=0).stop 2023-10-06T04:37:28.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.154+0000 7fef6cdf0700 1 -- 172.21.15.8:0/1391297116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef681430c0 msgr2=0x7fef6816d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:28.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.154+0000 7fef6cdf0700 1 --2- 172.21.15.8:0/1391297116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef681430c0 0x7fef6816d600 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fef58002230 tx=0x7fef58001b90 comp rx=0 tx=0).stop 2023-10-06T04:37:28.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.154+0000 7fef6cdf0700 1 -- 172.21.15.8:0/1391297116 shutdown_connections 2023-10-06T04:37:28.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.154+0000 7fef6cdf0700 1 --2- 172.21.15.8:0/1391297116 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fef48066f30 0x7fef480693e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:28.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.154+0000 7fef6cdf0700 1 --2- 172.21.15.8:0/1391297116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef681430c0 0x7fef6816d600 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:28.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.154+0000 7fef6cdf0700 1 --2- 172.21.15.8:0/1391297116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef680cfee0 0x7fef68141d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:28.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.154+0000 7fef6cdf0700 1 --2- 172.21.15.8:0/1391297116 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef68142cf0 0x7fef6816d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:28.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.154+0000 7fef6cdf0700 1 -- 172.21.15.8:0/1391297116 >> 172.21.15.8:0/1391297116 conn(0x7fef6806ed00 msgr2=0x7fef6806f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:28.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.155+0000 7fef6cdf0700 1 -- 172.21.15.8:0/1391297116 shutdown_connections 2023-10-06T04:37:28.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.155+0000 7fef6cdf0700 1 -- 172.21.15.8:0/1391297116 wait complete. 2023-10-06T04:37:28.168 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'recovery_fs' 2023-10-06T04:37:28.168 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create recovery_fs_metadata --pg_num_min 64 2023-10-06T04:37:28.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.289+0000 7fc9939f2700 1 Processor -- start 2023-10-06T04:37:28.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.289+0000 7fc9939f2700 1 -- start start 2023-10-06T04:37:28.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.290+0000 7fc9939f2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc98c0d0650 0x7fc98c0b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:28.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.290+0000 7fc9939f2700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc98c0d0a20 0x7fc98c1592b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:28.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.290+0000 7fc9939f2700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc98c1597f0 0x7fc98c15d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:28.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.290+0000 7fc9939f2700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc98c15e3b0 con 0x7fc98c1597f0 2023-10-06T04:37:28.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.290+0000 7fc9939f2700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc98c0c6070 con 0x7fc98c0d0a20 2023-10-06T04:37:28.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.290+0000 7fc9939f2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c0b0700 con 0x7fc98c0d0650 2023-10-06T04:37:28.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.290+0000 7fc991f8f700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc98c1597f0 0x7fc98c15d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:28.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.291+0000 7fc991f8f700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc98c1597f0 0x7fc98c15d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33380/0 (socket says 172.21.15.8:33380) 2023-10-06T04:37:28.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.291+0000 7fc990f8d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc98c0d0a20 0x7fc98c1592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:28.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.291+0000 7fc991f8f700 1 -- 172.21.15.8:0/463934859 learned_addr learned my addr 172.21.15.8:0/463934859 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:28.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.291+0000 7fc99178e700 1 --2- 172.21.15.8:0/463934859 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc98c0d0650 0x7fc98c0b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:28.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.291+0000 7fc991f8f700 1 -- 172.21.15.8:0/463934859 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc98c0d0650 msgr2=0x7fc98c0b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:28.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.291+0000 7fc991f8f700 1 --2- 172.21.15.8:0/463934859 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc98c0d0650 0x7fc98c0b01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:28.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.291+0000 7fc991f8f700 1 -- 172.21.15.8:0/463934859 >> v2:172.21.15.184:3300/0 conn(0x7fc98c0d0a20 msgr2=0x7fc98c1592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:28.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.291+0000 7fc991f8f700 1 --2- 172.21.15.8:0/463934859 >> v2:172.21.15.184:3300/0 conn(0x7fc98c0d0a20 0x7fc98c1592b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:28.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.291+0000 7fc991f8f700 1 -- 172.21.15.8:0/463934859 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98c0c5740 con 0x7fc98c1597f0 2023-10-06T04:37:28.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.291+0000 7fc991f8f700 1 --2- 172.21.15.8:0/463934859 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc98c1597f0 0x7fc98c15d5f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc98c0cdfb0 tx=0x7fc97c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9892613f0218937 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:28.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.291+0000 7fc98bfff700 1 -- 172.21.15.8:0/463934859 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c00b640 con 0x7fc98c1597f0 2023-10-06T04:37:28.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.291+0000 7fc98bfff700 1 -- 172.21.15.8:0/463934859 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97c00b7a0 con 0x7fc98c1597f0 2023-10-06T04:37:28.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.291+0000 7fc98bfff700 1 -- 172.21.15.8:0/463934859 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c00bb60 con 0x7fc98c1597f0 2023-10-06T04:37:28.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.292+0000 7fc9939f2700 1 -- 172.21.15.8:0/463934859 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc98c1597f0 msgr2=0x7fc98c15d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:28.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.292+0000 7fc9939f2700 1 --2- 172.21.15.8:0/463934859 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc98c1597f0 0x7fc98c15d5f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc98c0cdfb0 tx=0x7fc97c009250 comp rx=0 tx=0).stop 2023-10-06T04:37:28.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.292+0000 7fc9939f2700 1 -- 172.21.15.8:0/463934859 shutdown_connections 2023-10-06T04:37:28.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.292+0000 7fc9939f2700 1 --2- 172.21.15.8:0/463934859 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc98c1597f0 0x7fc98c15d5f0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:28.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.292+0000 7fc9939f2700 1 --2- 172.21.15.8:0/463934859 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc98c0d0650 0x7fc98c0b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:28.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.292+0000 7fc9939f2700 1 --2- 172.21.15.8:0/463934859 >> v2:172.21.15.184:3300/0 conn(0x7fc98c0d0a20 0x7fc98c1592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:28.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.292+0000 7fc9939f2700 1 -- 172.21.15.8:0/463934859 >> 172.21.15.8:0/463934859 conn(0x7fc98c0698b0 msgr2=0x7fc98c069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:28.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.292+0000 7fc9939f2700 1 -- 172.21.15.8:0/463934859 shutdown_connections 2023-10-06T04:37:28.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.292+0000 7fc9939f2700 1 -- 172.21.15.8:0/463934859 wait complete. 2023-10-06T04:37:28.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.293+0000 7fc9939f2700 1 Processor -- start 2023-10-06T04:37:28.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.293+0000 7fc9939f2700 1 -- start start 2023-10-06T04:37:28.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.294+0000 7fc9939f2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc98c0d0650 0x7fc98c0c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:28.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.294+0000 7fc9939f2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc98c0d0a20 0x7fc98c159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:28.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.294+0000 7fc9939f2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc98c1597f0 0x7fc98c15b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:28.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.294+0000 7fc9939f2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c15a130 con 0x7fc98c0d0a20 2023-10-06T04:37:28.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.294+0000 7fc9939f2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c154720 con 0x7fc98c1597f0 2023-10-06T04:37:28.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.294+0000 7fc9939f2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c153b50 con 0x7fc98c0d0650 2023-10-06T04:37:28.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.294+0000 7fc990f8d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc98c0d0a20 0x7fc98c159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:28.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.294+0000 7fc990f8d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc98c0d0a20 0x7fc98c159bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33390/0 (socket says 172.21.15.8:33390) 2023-10-06T04:37:28.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.294+0000 7fc990f8d700 1 -- 172.21.15.8:0/216877965 learned_addr learned my addr 172.21.15.8:0/216877965 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:28.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.294+0000 7fc99178e700 1 --2- 172.21.15.8:0/216877965 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc98c0d0650 0x7fc98c0c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:28.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.294+0000 7fc991f8f700 1 --2- 172.21.15.8:0/216877965 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc98c1597f0 0x7fc98c15b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:28.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.294+0000 7fc990f8d700 1 -- 172.21.15.8:0/216877965 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc98c0d0650 msgr2=0x7fc98c0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:28.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.294+0000 7fc990f8d700 1 --2- 172.21.15.8:0/216877965 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc98c0d0650 0x7fc98c0c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:28.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.294+0000 7fc990f8d700 1 -- 172.21.15.8:0/216877965 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc98c1597f0 msgr2=0x7fc98c15b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:28.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.294+0000 7fc990f8d700 1 --2- 172.21.15.8:0/216877965 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc98c1597f0 0x7fc98c15b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:28.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.294+0000 7fc990f8d700 1 -- 172.21.15.8:0/216877965 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc97c0094f0 con 0x7fc98c0d0a20 2023-10-06T04:37:28.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.294+0000 7fc990f8d700 1 --2- 172.21.15.8:0/216877965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc98c0d0a20 0x7fc98c159bf0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc98000e930 tx=0x7fc9800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:28.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.295+0000 7fc9897fa700 1 -- 172.21.15.8:0/216877965 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc980013680 con 0x7fc98c0d0a20 2023-10-06T04:37:28.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.295+0000 7fc9897fa700 1 -- 172.21.15.8:0/216877965 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9800137e0 con 0x7fc98c0d0a20 2023-10-06T04:37:28.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.295+0000 7fc9939f2700 1 -- 172.21.15.8:0/216877965 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc98c151240 con 0x7fc98c0d0a20 2023-10-06T04:37:28.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.295+0000 7fc9897fa700 1 -- 172.21.15.8:0/216877965 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc980013b80 con 0x7fc98c0d0a20 2023-10-06T04:37:28.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.295+0000 7fc9939f2700 1 -- 172.21.15.8:0/216877965 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc98c1540d0 con 0x7fc98c0d0a20 2023-10-06T04:37:28.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.296+0000 7fc9939f2700 1 -- 172.21.15.8:0/216877965 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc98c1548b0 con 0x7fc98c0d0a20 2023-10-06T04:37:28.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.296+0000 7fc9897fa700 1 -- 172.21.15.8:0/216877965 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc98000c3e0 con 0x7fc98c0d0a20 2023-10-06T04:37:28.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.296+0000 7fc9897fa700 1 --2- 172.21.15.8:0/216877965 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc978066f30 0x7fc9780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:28.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.296+0000 7fc9897fa700 1 -- 172.21.15.8:0/216877965 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fc9800848d0 con 0x7fc98c0d0a20 2023-10-06T04:37:28.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.297+0000 7fc99178e700 1 --2- 172.21.15.8:0/216877965 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc978066f30 0x7fc9780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:28.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.297+0000 7fc99178e700 1 --2- 172.21.15.8:0/216877965 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc978066f30 0x7fc9780693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc984009fd0 tx=0x7fc98400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:28.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.301+0000 7fc9897fa700 1 -- 172.21.15.8:0/216877965 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc980051850 con 0x7fc98c0d0a20 2023-10-06T04:37:28.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.494+0000 7fc9939f2700 1 -- 172.21.15.8:0/216877965 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "recovery_fs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc98c071550 con 0x7fc98c0d0a20 2023-10-06T04:37:28.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.775+0000 7fc9897fa700 1 -- 172.21.15.8:0/216877965 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "recovery_fs_metadata", "pg_num_min": 64}]=0 pool 'recovery_fs_metadata' created v44) v1 ==== 148+0+0 (secure 0 0 0) 0x7fc980054e70 con 0x7fc98c0d0a20 2023-10-06T04:37:28.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.777+0000 7fc9939f2700 1 -- 172.21.15.8:0/216877965 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc978066f30 msgr2=0x7fc9780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:28.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.777+0000 7fc9939f2700 1 --2- 172.21.15.8:0/216877965 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc978066f30 0x7fc9780693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc984009fd0 tx=0x7fc98400b040 comp rx=0 tx=0).stop 2023-10-06T04:37:28.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.777+0000 7fc9939f2700 1 -- 172.21.15.8:0/216877965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc98c0d0a20 msgr2=0x7fc98c159bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:28.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.777+0000 7fc9939f2700 1 --2- 172.21.15.8:0/216877965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc98c0d0a20 0x7fc98c159bf0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc98000e930 tx=0x7fc9800091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:28.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.777+0000 7fc9939f2700 1 -- 172.21.15.8:0/216877965 shutdown_connections 2023-10-06T04:37:28.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.777+0000 7fc9939f2700 1 --2- 172.21.15.8:0/216877965 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc978066f30 0x7fc9780693e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:28.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.777+0000 7fc9939f2700 1 --2- 172.21.15.8:0/216877965 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc98c1597f0 0x7fc98c15b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:28.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.777+0000 7fc9939f2700 1 --2- 172.21.15.8:0/216877965 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc98c0d0650 0x7fc98c0c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:28.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.777+0000 7fc9939f2700 1 --2- 172.21.15.8:0/216877965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc98c0d0a20 0x7fc98c159bf0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:28.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.777+0000 7fc9939f2700 1 -- 172.21.15.8:0/216877965 >> 172.21.15.8:0/216877965 conn(0x7fc98c0698b0 msgr2=0x7fc98c0c6350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:28.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.777+0000 7fc9939f2700 1 -- 172.21.15.8:0/216877965 shutdown_connections 2023-10-06T04:37:28.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.777+0000 7fc9939f2700 1 -- 172.21.15.8:0/216877965 wait complete. 2023-10-06T04:37:28.781 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'recovery_fs_metadata' created 2023-10-06T04:37:28.795 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T04:37:28.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.919+0000 7f5b6886d700 1 Processor -- start 2023-10-06T04:37:28.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.919+0000 7f5b6886d700 1 -- start start 2023-10-06T04:37:28.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.920+0000 7f5b6886d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5b6415d570 0x7f5b64156a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:28.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.920+0000 7f5b6886d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5b64156f40 0x7f5b6415b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:28.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.920+0000 7f5b6886d700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b640cb1d0 con 0x7f5b6415d1a0 2023-10-06T04:37:28.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.920+0000 7f5b6886d700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b640afd20 con 0x7f5b64156f40 2023-10-06T04:37:28.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.920+0000 7f5b6886d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b640cb4b0 con 0x7f5b6415d570 2023-10-06T04:37:28.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.920+0000 7f5b63fff700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5b64156f40 0x7f5b6415b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:28.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.920+0000 7f5b637fe700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f5b6415d1a0 0x7f5b640ca930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46164/0 (socket says 172.21.15.8:46164) 2023-10-06T04:37:28.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.920+0000 7f5b637fe700 1 -- 172.21.15.8:0/1833164460 learned_addr learned my addr 172.21.15.8:0/1833164460 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:28.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.920+0000 7f5b62ffd700 1 --2- 172.21.15.8:0/1833164460 >> v2:172.21.15.184:3300/0 conn(0x7f5b6415d570 0x7f5b64156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:28.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.921+0000 7f5b63fff700 1 -- 172.21.15.8:0/1833164460 >> v2:172.21.15.184:3300/0 conn(0x7f5b6415d570 msgr2=0x7f5b64156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:28.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.921+0000 7f5b63fff700 1 --2- 172.21.15.8:0/1833164460 >> v2:172.21.15.184:3300/0 conn(0x7f5b6415d570 0x7f5b64156a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:28.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.921+0000 7f5b63fff700 1 -- 172.21.15.8:0/1833164460 >> v1:172.21.15.8:6789/0 conn(0x7f5b6415d1a0 legacy=0x7f5b640ca930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:28.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.921+0000 7f5b63fff700 1 -- 172.21.15.8:0/1833164460 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b640cb790 con 0x7f5b64156f40 2023-10-06T04:37:28.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.921+0000 7f5b627fc700 1 -- 172.21.15.8:0/1833164460 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3106729894 0 0) 0x7f5b640cb1d0 con 0x7f5b6415d1a0 2023-10-06T04:37:28.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.921+0000 7f5b63fff700 1 --2- 172.21.15.8:0/1833164460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b64156f40 0x7f5b6415b600 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5b640c7300 tx=0x7f5b5c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed591fddb715541f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:28.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.921+0000 7f5b627fc700 1 -- 172.21.15.8:0/1833164460 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c00e070 con 0x7f5b64156f40 2023-10-06T04:37:28.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.921+0000 7f5b627fc700 1 -- 172.21.15.8:0/1833164460 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5c00bcc0 con 0x7f5b64156f40 2023-10-06T04:37:28.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.921+0000 7f5b627fc700 1 -- 172.21.15.8:0/1833164460 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c012680 con 0x7f5b64156f40 2023-10-06T04:37:28.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.921+0000 7f5b6886d700 1 -- 172.21.15.8:0/1833164460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b64156f40 msgr2=0x7f5b6415b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:28.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.921+0000 7f5b6886d700 1 --2- 172.21.15.8:0/1833164460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b64156f40 0x7f5b6415b600 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5b640c7300 tx=0x7f5b5c009780 comp rx=0 tx=0).stop 2023-10-06T04:37:28.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.921+0000 7f5b6886d700 1 -- 172.21.15.8:0/1833164460 shutdown_connections 2023-10-06T04:37:28.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.921+0000 7f5b6886d700 1 --2- 172.21.15.8:0/1833164460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b64156f40 0x7f5b6415b600 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:28.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.921+0000 7f5b6886d700 1 --2- 172.21.15.8:0/1833164460 >> v2:172.21.15.184:3300/0 conn(0x7f5b6415d570 0x7f5b64156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:28.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.921+0000 7f5b6886d700 1 -- 172.21.15.8:0/1833164460 >> 172.21.15.8:0/1833164460 conn(0x7f5b64069800 msgr2=0x7f5b64069c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:28.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.922+0000 7f5b6886d700 1 -- 172.21.15.8:0/1833164460 shutdown_connections 2023-10-06T04:37:28.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.922+0000 7f5b6886d700 1 -- 172.21.15.8:0/1833164460 wait complete. 2023-10-06T04:37:28.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.923+0000 7f5b6886d700 1 Processor -- start 2023-10-06T04:37:28.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.923+0000 7f5b6886d700 1 -- start start 2023-10-06T04:37:28.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.924+0000 7f5b6886d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b64156f40 0x7f5b64145e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:28.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.924+0000 7f5b6886d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b6415d1a0 0x7f5b64159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:28.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.924+0000 7f5b6886d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b6415d570 0x7f5b640b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:28.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.924+0000 7f5b6886d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b64146340 con 0x7f5b6415d570 2023-10-06T04:37:28.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.924+0000 7f5b6886d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b64158bc0 con 0x7f5b64156f40 2023-10-06T04:37:28.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.924+0000 7f5b6886d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b640b4990 con 0x7f5b6415d1a0 2023-10-06T04:37:28.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.924+0000 7f5b63fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b6415d570 0x7f5b640b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:28.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.924+0000 7f5b63fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b6415d570 0x7f5b640b3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33396/0 (socket says 172.21.15.8:33396) 2023-10-06T04:37:28.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.924+0000 7f5b63fff700 1 -- 172.21.15.8:0/4034543842 learned_addr learned my addr 172.21.15.8:0/4034543842 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:28.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.924+0000 7f5b637fe700 1 --2- 172.21.15.8:0/4034543842 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b64156f40 0x7f5b64145e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:28.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.924+0000 7f5b62ffd700 1 --2- 172.21.15.8:0/4034543842 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b6415d1a0 0x7f5b64159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:28.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.924+0000 7f5b63fff700 1 -- 172.21.15.8:0/4034543842 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b6415d1a0 msgr2=0x7f5b64159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:28.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.924+0000 7f5b63fff700 1 --2- 172.21.15.8:0/4034543842 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b6415d1a0 0x7f5b64159050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:28.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.924+0000 7f5b63fff700 1 -- 172.21.15.8:0/4034543842 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b64156f40 msgr2=0x7f5b64145e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:28.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.924+0000 7f5b63fff700 1 --2- 172.21.15.8:0/4034543842 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b64156f40 0x7f5b64145e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:28.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.924+0000 7f5b63fff700 1 -- 172.21.15.8:0/4034543842 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b5c009a20 con 0x7f5b6415d570 2023-10-06T04:37:28.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.924+0000 7f5b637fe700 1 --2- 172.21.15.8:0/4034543842 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b64156f40 0x7f5b64145e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:28.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.924+0000 7f5b63fff700 1 --2- 172.21.15.8:0/4034543842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b6415d570 0x7f5b640b3fb0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5b64067eb0 tx=0x7f5b5c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:28.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.924+0000 7f5b4b7fe700 1 -- 172.21.15.8:0/4034543842 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c01d630 con 0x7f5b6415d570 2023-10-06T04:37:28.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.924+0000 7f5b4b7fe700 1 -- 172.21.15.8:0/4034543842 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5c01d790 con 0x7f5b6415d570 2023-10-06T04:37:28.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.924+0000 7f5b4b7fe700 1 -- 172.21.15.8:0/4034543842 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c01db50 con 0x7f5b6415d570 2023-10-06T04:37:28.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.924+0000 7f5b6886d700 1 -- 172.21.15.8:0/4034543842 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b64158570 con 0x7f5b6415d570 2023-10-06T04:37:28.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.924+0000 7f5b6886d700 1 -- 172.21.15.8:0/4034543842 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b64159590 con 0x7f5b6415d570 2023-10-06T04:37:28.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.926+0000 7f5b6886d700 1 -- 172.21.15.8:0/4034543842 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b64158d70 con 0x7f5b6415d570 2023-10-06T04:37:28.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.926+0000 7f5b4b7fe700 1 -- 172.21.15.8:0/4034543842 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5b5c024070 con 0x7f5b6415d570 2023-10-06T04:37:28.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.926+0000 7f5b4b7fe700 1 --2- 172.21.15.8:0/4034543842 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5b50066f30 0x7f5b500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:28.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.926+0000 7f5b4b7fe700 1 -- 172.21.15.8:0/4034543842 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6839+0+0 (secure 0 0 0) 0x7f5b5c087360 con 0x7f5b6415d570 2023-10-06T04:37:28.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.926+0000 7f5b637fe700 1 --2- 172.21.15.8:0/4034543842 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5b50066f30 0x7f5b500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:28.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.927+0000 7f5b637fe700 1 --2- 172.21.15.8:0/4034543842 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5b50066f30 0x7f5b500693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5b540011e0 tx=0x7f5b54009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:28.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:28.931+0000 7f5b4b7fe700 1 -- 172.21.15.8:0/4034543842 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5b64158d70 con 0x7f5b6415d570 2023-10-06T04:37:29.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.126+0000 7f5b6886d700 1 -- 172.21.15.8:0/4034543842 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5b64158d30 con 0x7f5b6415d570 2023-10-06T04:37:29.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.127+0000 7f5b4b7fe700 1 -- 172.21.15.8:0/4034543842 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' already exists v44) v1 ==== 177+0+0 (secure 0 0 0) 0x7f5b5c054210 con 0x7f5b6415d570 2023-10-06T04:37:29.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.129+0000 7f5b6886d700 1 -- 172.21.15.8:0/4034543842 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5b50066f30 msgr2=0x7f5b500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:29.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.129+0000 7f5b6886d700 1 --2- 172.21.15.8:0/4034543842 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5b50066f30 0x7f5b500693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5b540011e0 tx=0x7f5b54009040 comp rx=0 tx=0).stop 2023-10-06T04:37:29.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.129+0000 7f5b6886d700 1 -- 172.21.15.8:0/4034543842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b6415d570 msgr2=0x7f5b640b3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:29.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.129+0000 7f5b6886d700 1 --2- 172.21.15.8:0/4034543842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b6415d570 0x7f5b640b3fb0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5b64067eb0 tx=0x7f5b5c019000 comp rx=0 tx=0).stop 2023-10-06T04:37:29.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.129+0000 7f5b6886d700 1 -- 172.21.15.8:0/4034543842 shutdown_connections 2023-10-06T04:37:29.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.129+0000 7f5b6886d700 1 --2- 172.21.15.8:0/4034543842 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5b50066f30 0x7f5b500693e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:29.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.129+0000 7f5b6886d700 1 --2- 172.21.15.8:0/4034543842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b6415d570 0x7f5b640b3fb0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:29.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.129+0000 7f5b6886d700 1 --2- 172.21.15.8:0/4034543842 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b64156f40 0x7f5b64145e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:29.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.129+0000 7f5b6886d700 1 --2- 172.21.15.8:0/4034543842 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b6415d1a0 0x7f5b64159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:29.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.129+0000 7f5b6886d700 1 -- 172.21.15.8:0/4034543842 >> 172.21.15.8:0/4034543842 conn(0x7f5b64069800 msgr2=0x7f5b6415b500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:29.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.129+0000 7f5b6886d700 1 -- 172.21.15.8:0/4034543842 shutdown_connections 2023-10-06T04:37:29.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.129+0000 7f5b6886d700 1 -- 172.21.15.8:0/4034543842 wait complete. 2023-10-06T04:37:29.132 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_data' already exists 2023-10-06T04:37:29.142 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new recovery_fs recovery_fs_metadata cephfs_data --recover --allow-dangerous-metadata-overlay 2023-10-06T04:37:29.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.265+0000 7f51e2585700 1 Processor -- start 2023-10-06T04:37:29.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.265+0000 7f51e2585700 1 -- start start 2023-10-06T04:37:29.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.265+0000 7f51e2585700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51dc0af5a0 0x7f51dc15d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:29.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.266+0000 7f51e2585700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f51dc0af970 0x7f51dc15a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:29.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.266+0000 7f51e2585700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51dc0ce820 con 0x7f51dc0cce20 2023-10-06T04:37:29.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.266+0000 7f51e2585700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51dc15e2d0 con 0x7f51dc0af970 2023-10-06T04:37:29.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.266+0000 7f51e2585700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc15ad10 con 0x7f51dc0af5a0 2023-10-06T04:37:29.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.266+0000 7f51e0b22700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f51dc0cce20 0x7f51dc068470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46178/0 (socket says 172.21.15.8:46178) 2023-10-06T04:37:29.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.266+0000 7f51e0b22700 1 -- 172.21.15.8:0/2303365376 learned_addr learned my addr 172.21.15.8:0/2303365376 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:29.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.266+0000 7f51daffd700 1 -- 172.21.15.8:0/2303365376 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1474656615 0 0) 0x7f51dc0ce820 con 0x7f51dc0cce20 2023-10-06T04:37:29.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.266+0000 7f51db7fe700 1 --2- 172.21.15.8:0/2303365376 >> v2:172.21.15.184:3300/0 conn(0x7f51dc0af970 0x7f51dc15a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:29.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.266+0000 7f51dbfff700 1 --2- 172.21.15.8:0/2303365376 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51dc0af5a0 0x7f51dc15d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:29.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.266+0000 7f51daffd700 1 -- 172.21.15.8:0/2303365376 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51c4003570 con 0x7f51dc0cce20 2023-10-06T04:37:29.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.266+0000 7f51daffd700 1 -- 172.21.15.8:0/2303365376 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3260172318 0 0) 0x7f51c4003570 con 0x7f51dc0cce20 2023-10-06T04:37:29.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.266+0000 7f51daffd700 1 -- 172.21.15.8:0/2303365376 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51dc0af5a0 msgr2=0x7f51dc15d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:29.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.266+0000 7f51daffd700 1 --2- 172.21.15.8:0/2303365376 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51dc0af5a0 0x7f51dc15d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:29.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.266+0000 7f51daffd700 1 -- 172.21.15.8:0/2303365376 >> v2:172.21.15.184:3300/0 conn(0x7f51dc0af970 msgr2=0x7f51dc15a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:29.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.266+0000 7f51daffd700 1 --2- 172.21.15.8:0/2303365376 >> v2:172.21.15.184:3300/0 conn(0x7f51dc0af970 0x7f51dc15a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:29.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.266+0000 7f51daffd700 1 -- 172.21.15.8:0/2303365376 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51dc15da30 con 0x7f51dc0cce20 2023-10-06T04:37:29.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.266+0000 7f51daffd700 1 -- 172.21.15.8:0/2303365376 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7f51d40017f0 con 0x7f51dc0cce20 2023-10-06T04:37:29.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.266+0000 7f51daffd700 1 -- 172.21.15.8:0/2303365376 >> v1:172.21.15.8:6789/0 conn(0x7f51dc0cce20 legacy=0x7f51dc068470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:29.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.266+0000 7f51daffd700 1 --2- 172.21.15.8:0/2303365376 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51dc0af5a0 0x7f51c4003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:29.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.266+0000 7f51daffd700 1 --2- 172.21.15.8:0/2303365376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51c4003fe0 0x7f51c4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:29.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.266+0000 7f51daffd700 1 --2- 172.21.15.8:0/2303365376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51c4004d50 0x7f51c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:29.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.266+0000 7f51daffd700 1 -- 172.21.15.8:0/2303365376 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc15e2d0 con 0x7f51c4004d50 2023-10-06T04:37:29.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.266+0000 7f51daffd700 1 -- 172.21.15.8:0/2303365376 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc15ad10 con 0x7f51c4003fe0 2023-10-06T04:37:29.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.266+0000 7f51daffd700 1 -- 172.21.15.8:0/2303365376 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c400ba90 con 0x7f51dc0af5a0 2023-10-06T04:37:29.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.266+0000 7f51e0b22700 1 --2- 172.21.15.8:0/2303365376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51c4004d50 0x7f51c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:29.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.267+0000 7f51dbfff700 1 --2- 172.21.15.8:0/2303365376 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51dc0af5a0 0x7f51c4003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:29.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.267+0000 7f51db7fe700 1 --2- 172.21.15.8:0/2303365376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51c4003fe0 0x7f51c4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:29.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.267+0000 7f51e0b22700 1 -- 172.21.15.8:0/2303365376 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51dc0af5a0 msgr2=0x7f51c4003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:29.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.267+0000 7f51e0b22700 1 --2- 172.21.15.8:0/2303365376 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51dc0af5a0 0x7f51c4003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:29.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.267+0000 7f51e0b22700 1 -- 172.21.15.8:0/2303365376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51c4003fe0 msgr2=0x7f51c4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:29.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.267+0000 7f51e0b22700 1 --2- 172.21.15.8:0/2303365376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51c4003fe0 0x7f51c4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:29.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.267+0000 7f51e0b22700 1 -- 172.21.15.8:0/2303365376 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c4003570 con 0x7f51c4004d50 2023-10-06T04:37:29.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.267+0000 7f51e0b22700 1 --2- 172.21.15.8:0/2303365376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51c4004d50 0x7f51c40051c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f51d400a970 tx=0x7f51d4002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82645f170dae92f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:29.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.267+0000 7f51daffd700 1 -- 172.21.15.8:0/2303365376 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d4012440 con 0x7f51c4004d50 2023-10-06T04:37:29.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.267+0000 7f51daffd700 1 -- 172.21.15.8:0/2303365376 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d40125c0 con 0x7f51c4004d50 2023-10-06T04:37:29.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.267+0000 7f51daffd700 1 -- 172.21.15.8:0/2303365376 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d4012980 con 0x7f51c4004d50 2023-10-06T04:37:29.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.268+0000 7f51e2585700 1 -- 172.21.15.8:0/2303365376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51c4004d50 msgr2=0x7f51c40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:29.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.268+0000 7f51e2585700 1 --2- 172.21.15.8:0/2303365376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51c4004d50 0x7f51c40051c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f51d400a970 tx=0x7f51d4002210 comp rx=0 tx=0).stop 2023-10-06T04:37:29.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.268+0000 7f51e0b22700 1 -- 172.21.15.8:0/2303365376 reap_dead start 2023-10-06T04:37:29.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.268+0000 7f51e2585700 1 -- 172.21.15.8:0/2303365376 shutdown_connections 2023-10-06T04:37:29.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.268+0000 7f51e2585700 1 -- 172.21.15.8:0/2303365376 >> 172.21.15.8:0/2303365376 conn(0x7f51dc06ed00 msgr2=0x7f51dc06f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:29.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.268+0000 7f51e2585700 1 -- 172.21.15.8:0/2303365376 shutdown_connections 2023-10-06T04:37:29.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.268+0000 7f51e2585700 1 -- 172.21.15.8:0/2303365376 wait complete. 2023-10-06T04:37:29.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.269+0000 7f51e2585700 1 Processor -- start 2023-10-06T04:37:29.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.269+0000 7f51e2585700 1 -- start start 2023-10-06T04:37:29.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.270+0000 7f51e2585700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51dc144f90 0x7f51dc0b5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:29.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.270+0000 7f51e2585700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51dc145360 0x7f51dc0b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:29.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.270+0000 7f51e2585700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51dc0b40c0 0x7f51dc16d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:29.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.270+0000 7f51e2585700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc0b4540 con 0x7f51dc0b40c0 2023-10-06T04:37:29.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.270+0000 7f51e2585700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc0b5fa0 con 0x7f51dc144f90 2023-10-06T04:37:29.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.270+0000 7f51e2585700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc0b1980 con 0x7f51dc145360 2023-10-06T04:37:29.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.270+0000 7f51e0b22700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51dc0b40c0 0x7f51dc16d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:29.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.270+0000 7f51e0b22700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51dc0b40c0 0x7f51dc16d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33408/0 (socket says 172.21.15.8:33408) 2023-10-06T04:37:29.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.270+0000 7f51e0b22700 1 -- 172.21.15.8:0/1618569844 learned_addr learned my addr 172.21.15.8:0/1618569844 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:29.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.270+0000 7f51db7fe700 1 --2- 172.21.15.8:0/1618569844 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51dc145360 0x7f51dc0b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:29.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.270+0000 7f51dbfff700 1 --2- 172.21.15.8:0/1618569844 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51dc144f90 0x7f51dc0b5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:29.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.270+0000 7f51e0b22700 1 -- 172.21.15.8:0/1618569844 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51dc145360 msgr2=0x7f51dc0b3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:29.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.270+0000 7f51e0b22700 1 --2- 172.21.15.8:0/1618569844 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51dc145360 0x7f51dc0b3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:29.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.270+0000 7f51e0b22700 1 -- 172.21.15.8:0/1618569844 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51dc144f90 msgr2=0x7f51dc0b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:29.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.270+0000 7f51e0b22700 1 --2- 172.21.15.8:0/1618569844 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51dc144f90 0x7f51dc0b5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:29.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.270+0000 7f51e0b22700 1 -- 172.21.15.8:0/1618569844 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51dc0b0e00 con 0x7f51dc0b40c0 2023-10-06T04:37:29.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.270+0000 7f51dbfff700 1 --2- 172.21.15.8:0/1618569844 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51dc144f90 0x7f51dc0b5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:29.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.270+0000 7f51e0b22700 1 --2- 172.21.15.8:0/1618569844 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51dc0b40c0 0x7f51dc16d0a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f51d4002250 tx=0x7f51d4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:29.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.270+0000 7f51c3fff700 1 -- 172.21.15.8:0/1618569844 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d4023070 con 0x7f51dc0b40c0 2023-10-06T04:37:29.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.270+0000 7f51c3fff700 1 -- 172.21.15.8:0/1618569844 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d40017b0 con 0x7f51dc0b40c0 2023-10-06T04:37:29.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.270+0000 7f51e2585700 1 -- 172.21.15.8:0/1618569844 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51dc0b10e0 con 0x7f51dc0b40c0 2023-10-06T04:37:29.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.270+0000 7f51c3fff700 1 -- 172.21.15.8:0/1618569844 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d4007510 con 0x7f51dc0b40c0 2023-10-06T04:37:29.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.270+0000 7f51e2585700 1 -- 172.21.15.8:0/1618569844 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51dc0b16a0 con 0x7f51dc0b40c0 2023-10-06T04:37:29.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.271+0000 7f51e2585700 1 -- 172.21.15.8:0/1618569844 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51dc0cf030 con 0x7f51dc0b40c0 2023-10-06T04:37:29.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.272+0000 7f51c3fff700 1 -- 172.21.15.8:0/1618569844 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f51d4019030 con 0x7f51dc0b40c0 2023-10-06T04:37:29.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.272+0000 7f51c3fff700 1 --2- 172.21.15.8:0/1618569844 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f51c8066f30 0x7f51c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:29.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.272+0000 7f51c3fff700 1 -- 172.21.15.8:0/1618569844 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6839+0+0 (secure 0 0 0) 0x7f51d4085cf0 con 0x7f51dc0b40c0 2023-10-06T04:37:29.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.272+0000 7f51dbfff700 1 --2- 172.21.15.8:0/1618569844 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f51c8066f30 0x7f51c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:29.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.273+0000 7f51dbfff700 1 --2- 172.21.15.8:0/1618569844 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f51c8066f30 0x7f51c80693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f51cc006f00 tx=0x7f51cc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:29.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.277+0000 7f51c3fff700 1 -- 172.21.15.8:0/1618569844 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f51dc0cf030 con 0x7f51dc0b40c0 2023-10-06T04:37:29.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.512+0000 7f51e2585700 1 -- 172.21.15.8:0/1618569844 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "recovery_fs", "metadata": "recovery_fs_metadata", "data": "cephfs_data", "recover": true, "allow_dangerous_metadata_overlay": true} v 0) v1 -- 0x7f51dc0cf030 con 0x7f51dc0b40c0 2023-10-06T04:37:29.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.777+0000 7f51c3fff700 1 -- 172.21.15.8:0/1618569844 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "recovery_fs", "metadata": "recovery_fs_metadata", "data": "cephfs_data", "recover": true, "allow_dangerous_metadata_overlay": true}]=0 new fs with metadata pool 8 and data pool 7 v21) v1 ==== 241+0+0 (secure 0 0 0) 0x7f51dc0cf030 con 0x7f51dc0b40c0 2023-10-06T04:37:29.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.782+0000 7f51e2585700 1 -- 172.21.15.8:0/1618569844 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f51c8066f30 msgr2=0x7f51c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:29.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.782+0000 7f51e2585700 1 --2- 172.21.15.8:0/1618569844 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f51c8066f30 0x7f51c80693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f51cc006f00 tx=0x7f51cc008040 comp rx=0 tx=0).stop 2023-10-06T04:37:29.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.782+0000 7f51e2585700 1 -- 172.21.15.8:0/1618569844 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51dc0b40c0 msgr2=0x7f51dc16d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:29.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.782+0000 7f51e2585700 1 --2- 172.21.15.8:0/1618569844 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51dc0b40c0 0x7f51dc16d0a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f51d4002250 tx=0x7f51d4015000 comp rx=0 tx=0).stop 2023-10-06T04:37:29.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.785+0000 7f51e2585700 1 -- 172.21.15.8:0/1618569844 shutdown_connections 2023-10-06T04:37:29.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.785+0000 7f51e2585700 1 --2- 172.21.15.8:0/1618569844 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f51c8066f30 0x7f51c80693e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:29.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.785+0000 7f51e2585700 1 --2- 172.21.15.8:0/1618569844 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51dc0b40c0 0x7f51dc16d0a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:29.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.785+0000 7f51e2585700 1 --2- 172.21.15.8:0/1618569844 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51dc144f90 0x7f51dc0b5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:29.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.785+0000 7f51e2585700 1 --2- 172.21.15.8:0/1618569844 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51dc145360 0x7f51dc0b3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:29.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.785+0000 7f51e2585700 1 -- 172.21.15.8:0/1618569844 >> 172.21.15.8:0/1618569844 conn(0x7f51dc06ed00 msgr2=0x7f51dc15c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:29.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.785+0000 7f51e2585700 1 -- 172.21.15.8:0/1618569844 shutdown_connections 2023-10-06T04:37:29.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.785+0000 7f51e2585700 1 -- 172.21.15.8:0/1618569844 wait complete. 2023-10-06T04:37:29.792 INFO:teuthology.orchestra.run.smithi008.stderr:new fs with metadata pool 8 and data pool 7 2023-10-06T04:37:29.805 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:37:29.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.923+0000 7fe91f59e700 1 Processor -- start 2023-10-06T04:37:29.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.923+0000 7fe91f59e700 1 -- start start 2023-10-06T04:37:29.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.924+0000 7fe91f59e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe92015a7b0 0x7fe920153b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:29.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.924+0000 7fe91f59e700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe92015d170 con 0x7fe92015d8e0 2023-10-06T04:37:29.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.924+0000 7fe91f59e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9200ca990 con 0x7fe920153740 2023-10-06T04:37:29.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.924+0000 7fe91f59e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9200cac70 con 0x7fe92015a7b0 2023-10-06T04:37:29.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.924+0000 7fe91ed9d700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe92015d8e0 0x7fe9200696c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46194/0 (socket says 172.21.15.8:46194) 2023-10-06T04:37:29.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.924+0000 7fe91ed9d700 1 -- 172.21.15.8:0/2572397632 learned_addr learned my addr 172.21.15.8:0/2572397632 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:29.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.924+0000 7fe91dd9b700 1 --2- 172.21.15.8:0/2572397632 >> v2:172.21.15.184:3300/0 conn(0x7fe92015a7b0 0x7fe920153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:29.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.924+0000 7fe91d59a700 1 -- 172.21.15.8:0/2572397632 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3308873030 0 0) 0x7fe92015d170 con 0x7fe92015d8e0 2023-10-06T04:37:29.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.924+0000 7fe91d59a700 1 -- 172.21.15.8:0/2572397632 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe90c003570 con 0x7fe92015d8e0 2023-10-06T04:37:29.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.925+0000 7fe91d59a700 1 -- 172.21.15.8:0/2572397632 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1130063851 0 0) 0x7fe9200ca990 con 0x7fe920153740 2023-10-06T04:37:29.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.925+0000 7fe91d59a700 1 -- 172.21.15.8:0/2572397632 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe92015d170 con 0x7fe920153740 2023-10-06T04:37:29.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.925+0000 7fe91d59a700 1 -- 172.21.15.8:0/2572397632 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1766773288 0 0) 0x7fe90c003570 con 0x7fe92015d8e0 2023-10-06T04:37:29.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.925+0000 7fe91d59a700 1 -- 172.21.15.8:0/2572397632 >> v2:172.21.15.184:3300/0 conn(0x7fe92015a7b0 msgr2=0x7fe920153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:29.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.925+0000 7fe91d59a700 1 --2- 172.21.15.8:0/2572397632 >> v2:172.21.15.184:3300/0 conn(0x7fe92015a7b0 0x7fe920153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:29.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.925+0000 7fe91d59a700 1 -- 172.21.15.8:0/2572397632 >> v1:172.21.15.184:6789/0 conn(0x7fe920153740 legacy=0x7fe9200cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:29.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.925+0000 7fe91d59a700 1 -- 172.21.15.8:0/2572397632 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9200caf50 con 0x7fe92015d8e0 2023-10-06T04:37:29.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.925+0000 7fe91d59a700 1 -- 172.21.15.8:0/2572397632 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7fe910001470 con 0x7fe92015d8e0 2023-10-06T04:37:29.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.925+0000 7fe91d59a700 1 -- 172.21.15.8:0/2572397632 >> v1:172.21.15.8:6789/0 conn(0x7fe92015d8e0 legacy=0x7fe9200696c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:29.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.925+0000 7fe91d59a700 1 --2- 172.21.15.8:0/2572397632 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe90c003bf0 0x7fe90c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:29.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.925+0000 7fe91d59a700 1 --2- 172.21.15.8:0/2572397632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe90c004810 0x7fe90c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:29.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.925+0000 7fe91d59a700 1 --2- 172.21.15.8:0/2572397632 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe90c0051c0 0x7fe90c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:29.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.925+0000 7fe91d59a700 1 -- 172.21.15.8:0/2572397632 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9200cac70 con 0x7fe90c004810 2023-10-06T04:37:29.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.925+0000 7fe91d59a700 1 -- 172.21.15.8:0/2572397632 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90c00c0b0 con 0x7fe90c003bf0 2023-10-06T04:37:29.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.925+0000 7fe91d59a700 1 -- 172.21.15.8:0/2572397632 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe90c00c270 con 0x7fe90c0051c0 2023-10-06T04:37:29.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.925+0000 7fe91dd9b700 1 --2- 172.21.15.8:0/2572397632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe90c004810 0x7fe90c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:29.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.925+0000 7fe91e59c700 1 --2- 172.21.15.8:0/2572397632 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe90c003bf0 0x7fe90c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:29.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.925+0000 7fe91ed9d700 1 --2- 172.21.15.8:0/2572397632 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe90c0051c0 0x7fe90c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:29.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.925+0000 7fe91dd9b700 1 -- 172.21.15.8:0/2572397632 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe90c0051c0 msgr2=0x7fe90c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:29.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.925+0000 7fe91dd9b700 1 --2- 172.21.15.8:0/2572397632 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe90c0051c0 0x7fe90c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:29.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.925+0000 7fe91dd9b700 1 -- 172.21.15.8:0/2572397632 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe90c003bf0 msgr2=0x7fe90c003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:29.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.925+0000 7fe91dd9b700 1 --2- 172.21.15.8:0/2572397632 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe90c003bf0 0x7fe90c003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:29.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.925+0000 7fe91dd9b700 1 -- 172.21.15.8:0/2572397632 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe90c003570 con 0x7fe90c004810 2023-10-06T04:37:29.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.925+0000 7fe91ed9d700 1 -- 172.21.15.8:0/2572397632 reap_dead start 2023-10-06T04:37:29.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.926+0000 7fe91dd9b700 1 --2- 172.21.15.8:0/2572397632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe90c004810 0x7fe90c004c80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe92015abf0 tx=0x7fe9080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=905d520bfbf83b18 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:29.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.926+0000 7fe91d59a700 1 -- 172.21.15.8:0/2572397632 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90800e710 con 0x7fe90c004810 2023-10-06T04:37:29.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.926+0000 7fe91d59a700 1 -- 172.21.15.8:0/2572397632 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90800e870 con 0x7fe90c004810 2023-10-06T04:37:29.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.926+0000 7fe91d59a700 1 -- 172.21.15.8:0/2572397632 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90800ec30 con 0x7fe90c004810 2023-10-06T04:37:29.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.926+0000 7fe91f59e700 1 -- 172.21.15.8:0/2572397632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe90c004810 msgr2=0x7fe90c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:29.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.926+0000 7fe91f59e700 1 --2- 172.21.15.8:0/2572397632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe90c004810 0x7fe90c004c80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe92015abf0 tx=0x7fe9080091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:29.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.926+0000 7fe91f59e700 1 -- 172.21.15.8:0/2572397632 shutdown_connections 2023-10-06T04:37:29.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.926+0000 7fe91f59e700 1 --2- 172.21.15.8:0/2572397632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe90c004810 0x7fe90c004c80 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:29.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.926+0000 7fe91f59e700 1 -- 172.21.15.8:0/2572397632 >> 172.21.15.8:0/2572397632 conn(0x7fe9200d02b0 msgr2=0x7fe9200d06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:29.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.926+0000 7fe91f59e700 1 -- 172.21.15.8:0/2572397632 shutdown_connections 2023-10-06T04:37:29.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.926+0000 7fe91f59e700 1 -- 172.21.15.8:0/2572397632 wait complete. 2023-10-06T04:37:29.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.927+0000 7fe91f59e700 1 Processor -- start 2023-10-06T04:37:29.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.927+0000 7fe91f59e700 1 -- start start 2023-10-06T04:37:29.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.928+0000 7fe91f59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe90c004810 0x7fe9200c9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:29.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.928+0000 7fe91f59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9200c6d40 0x7fe92016a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:29.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.928+0000 7fe91f59e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9201699b0 0x7fe9200ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:29.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.928+0000 7fe91f59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92016dec0 con 0x7fe9200c6d40 2023-10-06T04:37:29.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.928+0000 7fe91f59e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9200c9750 con 0x7fe9201699b0 2023-10-06T04:37:29.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.928+0000 7fe91f59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe92016a850 con 0x7fe90c004810 2023-10-06T04:37:29.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.928+0000 7fe91dd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9200c6d40 0x7fe92016a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:29.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.928+0000 7fe91dd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9200c6d40 0x7fe92016a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33440/0 (socket says 172.21.15.8:33440) 2023-10-06T04:37:29.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.928+0000 7fe91dd9b700 1 -- 172.21.15.8:0/4214707258 learned_addr learned my addr 172.21.15.8:0/4214707258 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:29.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.928+0000 7fe91ed9d700 1 --2- 172.21.15.8:0/4214707258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9201699b0 0x7fe9200ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:29.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.928+0000 7fe91e59c700 1 --2- 172.21.15.8:0/4214707258 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe90c004810 0x7fe9200c9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:29.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.928+0000 7fe91dd9b700 1 -- 172.21.15.8:0/4214707258 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe90c004810 msgr2=0x7fe9200c9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:29.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.928+0000 7fe91dd9b700 1 --2- 172.21.15.8:0/4214707258 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe90c004810 0x7fe9200c9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:29.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.928+0000 7fe91dd9b700 1 -- 172.21.15.8:0/4214707258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9201699b0 msgr2=0x7fe9200ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:29.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.928+0000 7fe91dd9b700 1 --2- 172.21.15.8:0/4214707258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9201699b0 0x7fe9200ccc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:29.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.928+0000 7fe91dd9b700 1 -- 172.21.15.8:0/4214707258 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92016d2b0 con 0x7fe9200c6d40 2023-10-06T04:37:29.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.929+0000 7fe91ed9d700 1 --2- 172.21.15.8:0/4214707258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9201699b0 0x7fe9200ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:29.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.929+0000 7fe91e59c700 1 --2- 172.21.15.8:0/4214707258 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe90c004810 0x7fe9200c9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:29.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.929+0000 7fe91dd9b700 1 --2- 172.21.15.8:0/4214707258 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9200c6d40 0x7fe92016a310 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe90c00c080 tx=0x7fe90801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:29.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.929+0000 7fe9167fc700 1 -- 172.21.15.8:0/4214707258 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe908022070 con 0x7fe9200c6d40 2023-10-06T04:37:29.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.929+0000 7fe9167fc700 1 -- 172.21.15.8:0/4214707258 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90800e9e0 con 0x7fe9200c6d40 2023-10-06T04:37:29.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.929+0000 7fe9167fc700 1 -- 172.21.15.8:0/4214707258 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe908027470 con 0x7fe9200c6d40 2023-10-06T04:37:29.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.929+0000 7fe91f59e700 1 -- 172.21.15.8:0/4214707258 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe92016d590 con 0x7fe9200c6d40 2023-10-06T04:37:29.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.929+0000 7fe91f59e700 1 -- 172.21.15.8:0/4214707258 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe92016db50 con 0x7fe9200c6d40 2023-10-06T04:37:29.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.930+0000 7fe91f59e700 1 -- 172.21.15.8:0/4214707258 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe920089440 con 0x7fe9200c6d40 2023-10-06T04:37:29.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.930+0000 7fe9167fc700 1 -- 172.21.15.8:0/4214707258 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe90801c450 con 0x7fe9200c6d40 2023-10-06T04:37:29.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.931+0000 7fe9167fc700 1 --2- 172.21.15.8:0/4214707258 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe900066f30 0x7fe9000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:29.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.931+0000 7fe9167fc700 1 -- 172.21.15.8:0/4214707258 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6917+0+0 (secure 0 0 0) 0x7fe9080864e0 con 0x7fe9200c6d40 2023-10-06T04:37:29.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.931+0000 7fe91e59c700 1 --2- 172.21.15.8:0/4214707258 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe900066f30 0x7fe9000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:29.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.931+0000 7fe91e59c700 1 --2- 172.21.15.8:0/4214707258 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe900066f30 0x7fe9000693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe918007f40 tx=0x7fe9180017a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:29.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:29.935+0000 7fe9167fc700 1 -- 172.21.15.8:0/4214707258 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe908053270 con 0x7fe9200c6d40 2023-10-06T04:37:30.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.128+0000 7fe91f59e700 1 -- 172.21.15.8:0/4214707258 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9200c7970 con 0x7fe9200c6d40 2023-10-06T04:37:30.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.129+0000 7fe9167fc700 1 -- 172.21.15.8:0/4214707258 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+18792 (secure 0 0 0) 0x7fe908056810 con 0x7fe9200c6d40 2023-10-06T04:37:30.130 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:30.131 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":45,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:37:29.513843+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:36:10.148177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:36:10.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:37:15.099258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T04:37:15.902657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}}},{"pool":8,"pool_name":"recovery_fs_metadata","create_time":"2023-10-06T04:37:28.524294+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}}}],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.555871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.490505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.504578+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.517217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:05.991135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.537329+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.543232+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.443715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6835/3478733664":"2023-10-07T04:37:26.044067+0000","172.21.15.8:6833/3478733664":"2023-10-07T04:37:26.044067+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:37:30.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.131+0000 7fe91f59e700 1 -- 172.21.15.8:0/4214707258 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe900066f30 msgr2=0x7fe9000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:30.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.131+0000 7fe91f59e700 1 --2- 172.21.15.8:0/4214707258 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe900066f30 0x7fe9000693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe918007f40 tx=0x7fe9180017a0 comp rx=0 tx=0).stop 2023-10-06T04:37:30.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.131+0000 7fe91f59e700 1 -- 172.21.15.8:0/4214707258 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9200c6d40 msgr2=0x7fe92016a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:30.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.131+0000 7fe91f59e700 1 --2- 172.21.15.8:0/4214707258 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9200c6d40 0x7fe92016a310 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe90c00c080 tx=0x7fe90801a000 comp rx=0 tx=0).stop 2023-10-06T04:37:30.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.131+0000 7fe91f59e700 1 -- 172.21.15.8:0/4214707258 shutdown_connections 2023-10-06T04:37:30.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.131+0000 7fe91f59e700 1 --2- 172.21.15.8:0/4214707258 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe900066f30 0x7fe9000693e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:30.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.131+0000 7fe91f59e700 1 --2- 172.21.15.8:0/4214707258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9201699b0 0x7fe9200ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:30.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.131+0000 7fe91f59e700 1 --2- 172.21.15.8:0/4214707258 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe90c004810 0x7fe9200c9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:30.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.131+0000 7fe91f59e700 1 --2- 172.21.15.8:0/4214707258 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9200c6d40 0x7fe92016a310 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:30.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.131+0000 7fe91f59e700 1 -- 172.21.15.8:0/4214707258 >> 172.21.15.8:0/4214707258 conn(0x7fe9200d02b0 msgr2=0x7fe920152170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:30.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.131+0000 7fe91f59e700 1 -- 172.21.15.8:0/4214707258 shutdown_connections 2023-10-06T04:37:30.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.131+0000 7fe91f59e700 1 -- 172.21.15.8:0/4214707258 wait complete. 2023-10-06T04:37:30.146 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:37:30.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.264+0000 7f49b17ed700 1 Processor -- start 2023-10-06T04:37:30.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.264+0000 7f49b17ed700 1 -- start start 2023-10-06T04:37:30.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.264+0000 7f49b17ed700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f49ac0cb360 0x7f49ac0d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:30.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.264+0000 7f49b17ed700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49ac0cc4c0 con 0x7f49ac0d08d0 2023-10-06T04:37:30.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.264+0000 7f49b17ed700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49ac0d0d20 con 0x7f49ac0af680 2023-10-06T04:37:30.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.264+0000 7f49b17ed700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49ac15d460 con 0x7f49ac0cb360 2023-10-06T04:37:30.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.265+0000 7f49ab7fe700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f49ac0d08d0 0x7f49ac0cc950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46206/0 (socket says 172.21.15.8:46206) 2023-10-06T04:37:30.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.265+0000 7f49ab7fe700 1 -- 172.21.15.8:0/1738271375 learned_addr learned my addr 172.21.15.8:0/1738271375 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:30.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.265+0000 7f49a27fc700 1 --2- 172.21.15.8:0/1738271375 >> v2:172.21.15.184:3300/0 conn(0x7f49ac0cb360 0x7f49ac0d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:30.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.265+0000 7f49aa7fc700 1 -- 172.21.15.8:0/1738271375 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 286933078 0 0) 0x7f49ac0cc4c0 con 0x7f49ac0d08d0 2023-10-06T04:37:30.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.265+0000 7f49aa7fc700 1 -- 172.21.15.8:0/1738271375 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4998003570 con 0x7f49ac0d08d0 2023-10-06T04:37:30.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.265+0000 7f49aa7fc700 1 -- 172.21.15.8:0/1738271375 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2404907369 0 0) 0x7f49ac0d0d20 con 0x7f49ac0af680 2023-10-06T04:37:30.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.265+0000 7f49aa7fc700 1 -- 172.21.15.8:0/1738271375 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49ac0cc4c0 con 0x7f49ac0af680 2023-10-06T04:37:30.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.265+0000 7f49a27fc700 1 -- 172.21.15.8:0/1738271375 >> v1:172.21.15.184:6789/0 conn(0x7f49ac0af680 legacy=0x7f49ac15e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:30.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.265+0000 7f49a27fc700 1 -- 172.21.15.8:0/1738271375 >> v1:172.21.15.8:6789/0 conn(0x7f49ac0d08d0 legacy=0x7f49ac0cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:30.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.265+0000 7f49a27fc700 1 -- 172.21.15.8:0/1738271375 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ac0cb8b0 con 0x7f49ac0cb360 2023-10-06T04:37:30.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.265+0000 7f49a27fc700 1 --2- 172.21.15.8:0/1738271375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49ac0cb360 0x7f49ac0d0390 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f49940098e0 tx=0x7f49940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2a01ea4f1fac3a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:30.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.265+0000 7f49aa7fc700 1 -- 172.21.15.8:0/1738271375 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4994011630 con 0x7f49ac0cb360 2023-10-06T04:37:30.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.265+0000 7f49aa7fc700 1 -- 172.21.15.8:0/1738271375 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4994011790 con 0x7f49ac0cb360 2023-10-06T04:37:30.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.265+0000 7f49aa7fc700 1 -- 172.21.15.8:0/1738271375 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4994011b30 con 0x7f49ac0cb360 2023-10-06T04:37:30.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.266+0000 7f49b17ed700 1 -- 172.21.15.8:0/1738271375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49ac0cb360 msgr2=0x7f49ac0d0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:30.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.266+0000 7f49b17ed700 1 --2- 172.21.15.8:0/1738271375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49ac0cb360 0x7f49ac0d0390 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f49940098e0 tx=0x7f49940091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:30.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.266+0000 7f49b17ed700 1 -- 172.21.15.8:0/1738271375 shutdown_connections 2023-10-06T04:37:30.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.266+0000 7f49b17ed700 1 --2- 172.21.15.8:0/1738271375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49ac0cb360 0x7f49ac0d0390 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:30.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.266+0000 7f49b17ed700 1 -- 172.21.15.8:0/1738271375 >> 172.21.15.8:0/1738271375 conn(0x7f49ac0633d0 msgr2=0x7f49ac0637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:30.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.266+0000 7f49b17ed700 1 -- 172.21.15.8:0/1738271375 shutdown_connections 2023-10-06T04:37:30.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.266+0000 7f49b17ed700 1 -- 172.21.15.8:0/1738271375 wait complete. 2023-10-06T04:37:30.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.267+0000 7f49b17ed700 1 Processor -- start 2023-10-06T04:37:30.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.267+0000 7f49b17ed700 1 -- start start 2023-10-06T04:37:30.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.268+0000 7f49b17ed700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49ac0af680 0x7f49ac152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:30.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.268+0000 7f49b17ed700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49ac0cb360 0x7f49ac1521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:30.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.268+0000 7f49b17ed700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49ac0d08d0 0x7f49ac0b3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:30.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.268+0000 7f49b17ed700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac0c8fa0 con 0x7f49ac0cb360 2023-10-06T04:37:30.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.268+0000 7f49b17ed700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac0c8cc0 con 0x7f49ac0d08d0 2023-10-06T04:37:30.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.268+0000 7f49b17ed700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac0c75d0 con 0x7f49ac0af680 2023-10-06T04:37:30.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.268+0000 7f49a27fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49ac0cb360 0x7f49ac1521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:30.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.268+0000 7f49a27fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49ac0cb360 0x7f49ac1521e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33456/0 (socket says 172.21.15.8:33456) 2023-10-06T04:37:30.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.268+0000 7f49a27fc700 1 -- 172.21.15.8:0/1842686544 learned_addr learned my addr 172.21.15.8:0/1842686544 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:30.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.268+0000 7f49aaffd700 1 --2- 172.21.15.8:0/1842686544 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49ac0af680 0x7f49ac152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:30.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.268+0000 7f49ab7fe700 1 --2- 172.21.15.8:0/1842686544 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49ac0d08d0 0x7f49ac0b3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:30.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.268+0000 7f49a27fc700 1 -- 172.21.15.8:0/1842686544 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49ac0af680 msgr2=0x7f49ac152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:30.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.268+0000 7f49a27fc700 1 --2- 172.21.15.8:0/1842686544 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49ac0af680 0x7f49ac152810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:30.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.268+0000 7f49a27fc700 1 -- 172.21.15.8:0/1842686544 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49ac0d08d0 msgr2=0x7f49ac0b3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:30.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.268+0000 7f49a27fc700 1 --2- 172.21.15.8:0/1842686544 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49ac0d08d0 0x7f49ac0b3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:30.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.268+0000 7f49a27fc700 1 -- 172.21.15.8:0/1842686544 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4994009420 con 0x7f49ac0cb360 2023-10-06T04:37:30.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.269+0000 7f49a27fc700 1 --2- 172.21.15.8:0/1842686544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49ac0cb360 0x7f49ac1521e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f49ac063f80 tx=0x7f4994017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:30.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.269+0000 7f49a37fe700 1 -- 172.21.15.8:0/1842686544 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499401f070 con 0x7f49ac0cb360 2023-10-06T04:37:30.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.269+0000 7f49a37fe700 1 -- 172.21.15.8:0/1842686544 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4994000bc0 con 0x7f49ac0cb360 2023-10-06T04:37:30.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.269+0000 7f49a37fe700 1 -- 172.21.15.8:0/1842686544 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4994025420 con 0x7f49ac0cb360 2023-10-06T04:37:30.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.269+0000 7f49b17ed700 1 -- 172.21.15.8:0/1842686544 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49ac0c78b0 con 0x7f49ac0cb360 2023-10-06T04:37:30.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.269+0000 7f49b17ed700 1 -- 172.21.15.8:0/1842686544 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49ac0c8830 con 0x7f49ac0cb360 2023-10-06T04:37:30.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.270+0000 7f49b17ed700 1 -- 172.21.15.8:0/1842686544 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49ac0c7430 con 0x7f49ac0cb360 2023-10-06T04:37:30.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.270+0000 7f49a37fe700 1 -- 172.21.15.8:0/1842686544 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4994023070 con 0x7f49ac0cb360 2023-10-06T04:37:30.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.271+0000 7f49a37fe700 1 --2- 172.21.15.8:0/1842686544 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f498c066f30 0x7f498c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:30.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.271+0000 7f49a37fe700 1 -- 172.21.15.8:0/1842686544 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6917+0+0 (secure 0 0 0) 0x7f4994085cd0 con 0x7f49ac0cb360 2023-10-06T04:37:30.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.271+0000 7f49aaffd700 1 --2- 172.21.15.8:0/1842686544 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f498c066f30 0x7f498c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:30.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.271+0000 7f49aaffd700 1 --2- 172.21.15.8:0/1842686544 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f498c066f30 0x7f498c0693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f499c007fd0 tx=0x7f499c007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:30.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.275+0000 7f49a37fe700 1 -- 172.21.15.8:0/1842686544 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49ac0c7430 con 0x7f49ac0cb360 2023-10-06T04:37:30.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.468+0000 7f49b17ed700 1 -- 172.21.15.8:0/1842686544 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49ac0c7430 con 0x7f49ac0cb360 2023-10-06T04:37:30.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.469+0000 7f49a37fe700 1 -- 172.21.15.8:0/1842686544 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+18792 (secure 0 0 0) 0x7f49ac0c7430 con 0x7f49ac0cb360 2023-10-06T04:37:30.471 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:30.472 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":45,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:37:29.513843+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:36:10.148177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:36:10.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:37:15.099258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T04:37:15.902657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}}},{"pool":8,"pool_name":"recovery_fs_metadata","create_time":"2023-10-06T04:37:28.524294+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}}}],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.555871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.490505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.504578+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.517217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:05.991135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.537329+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.543232+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.443715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6835/3478733664":"2023-10-07T04:37:26.044067+0000","172.21.15.8:6833/3478733664":"2023-10-07T04:37:26.044067+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:37:30.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.471+0000 7f49b17ed700 1 -- 172.21.15.8:0/1842686544 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f498c066f30 msgr2=0x7f498c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:30.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.471+0000 7f49b17ed700 1 --2- 172.21.15.8:0/1842686544 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f498c066f30 0x7f498c0693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f499c007fd0 tx=0x7f499c007d50 comp rx=0 tx=0).stop 2023-10-06T04:37:30.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.471+0000 7f49b17ed700 1 -- 172.21.15.8:0/1842686544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49ac0cb360 msgr2=0x7f49ac1521e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:30.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.471+0000 7f49b17ed700 1 --2- 172.21.15.8:0/1842686544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49ac0cb360 0x7f49ac1521e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f49ac063f80 tx=0x7f4994017000 comp rx=0 tx=0).stop 2023-10-06T04:37:30.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.471+0000 7f49b17ed700 1 -- 172.21.15.8:0/1842686544 shutdown_connections 2023-10-06T04:37:30.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.471+0000 7f49b17ed700 1 --2- 172.21.15.8:0/1842686544 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f498c066f30 0x7f498c0693e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:30.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.471+0000 7f49b17ed700 1 --2- 172.21.15.8:0/1842686544 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49ac0d08d0 0x7f49ac0b3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:30.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.471+0000 7f49b17ed700 1 --2- 172.21.15.8:0/1842686544 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49ac0af680 0x7f49ac152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:30.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.471+0000 7f49b17ed700 1 --2- 172.21.15.8:0/1842686544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49ac0cb360 0x7f49ac1521e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:30.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.471+0000 7f49b17ed700 1 -- 172.21.15.8:0/1842686544 >> 172.21.15.8:0/1842686544 conn(0x7f49ac0633d0 msgr2=0x7f49ac0d0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:30.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.471+0000 7f49b17ed700 1 -- 172.21.15.8:0/1842686544 shutdown_connections 2023-10-06T04:37:30.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.471+0000 7f49b17ed700 1 -- 172.21.15.8:0/1842686544 wait complete. 2023-10-06T04:37:30.485 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set recovery_fs standby_count_wanted 0 2023-10-06T04:37:30.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.607+0000 7f5c78898700 1 Processor -- start 2023-10-06T04:37:30.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.607+0000 7f5c78898700 1 -- start start 2023-10-06T04:37:30.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.608+0000 7f5c78898700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5c74153d50 0x7f5c740675d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:30.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.608+0000 7f5c78898700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c740cbc40 con 0x7f5c74153980 2023-10-06T04:37:30.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.608+0000 7f5c78898700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c740cb030 con 0x7f5c740caae0 2023-10-06T04:37:30.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.608+0000 7f5c78898700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c740c7ac0 con 0x7f5c74153d50 2023-10-06T04:37:30.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.608+0000 7f5c737fe700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f5c74153980 0x7f5c7415a570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46214/0 (socket says 172.21.15.8:46214) 2023-10-06T04:37:30.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.608+0000 7f5c737fe700 1 -- 172.21.15.8:0/4173129682 learned_addr learned my addr 172.21.15.8:0/4173129682 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:30.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.608+0000 7f5c72ffd700 1 --2- 172.21.15.8:0/4173129682 >> v2:172.21.15.8:3300/0 conn(0x7f5c74153d50 0x7f5c740675d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:30.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.608+0000 7f5c727fc700 1 -- 172.21.15.8:0/4173129682 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2403652498 0 0) 0x7f5c740cbc40 con 0x7f5c74153980 2023-10-06T04:37:30.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.608+0000 7f5c727fc700 1 -- 172.21.15.8:0/4173129682 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c5c003570 con 0x7f5c74153980 2023-10-06T04:37:30.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.608+0000 7f5c72ffd700 1 -- 172.21.15.8:0/4173129682 >> v1:172.21.15.184:6789/0 conn(0x7f5c740caae0 legacy=0x7f5c740aeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:30.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.608+0000 7f5c72ffd700 1 -- 172.21.15.8:0/4173129682 >> v1:172.21.15.8:6789/0 conn(0x7f5c74153980 legacy=0x7f5c7415a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:30.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.608+0000 7f5c72ffd700 1 -- 172.21.15.8:0/4173129682 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c740cb310 con 0x7f5c74153d50 2023-10-06T04:37:30.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.608+0000 7f5c72ffd700 1 --2- 172.21.15.8:0/4173129682 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c74153d50 0x7f5c740675d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5c680098e0 tx=0x7f5c680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=333cd04eee2d5bb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:30.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.609+0000 7f5c727fc700 1 -- 172.21.15.8:0/4173129682 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6800b640 con 0x7f5c74153d50 2023-10-06T04:37:30.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.609+0000 7f5c727fc700 1 -- 172.21.15.8:0/4173129682 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c6800b7a0 con 0x7f5c74153d50 2023-10-06T04:37:30.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.609+0000 7f5c727fc700 1 -- 172.21.15.8:0/4173129682 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6800bb20 con 0x7f5c74153d50 2023-10-06T04:37:30.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.609+0000 7f5c78898700 1 -- 172.21.15.8:0/4173129682 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c74153d50 msgr2=0x7f5c740675d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:30.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.609+0000 7f5c78898700 1 --2- 172.21.15.8:0/4173129682 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c74153d50 0x7f5c740675d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5c680098e0 tx=0x7f5c680091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:30.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.609+0000 7f5c78898700 1 -- 172.21.15.8:0/4173129682 shutdown_connections 2023-10-06T04:37:30.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.609+0000 7f5c78898700 1 --2- 172.21.15.8:0/4173129682 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c74153d50 0x7f5c740675d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:30.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.609+0000 7f5c78898700 1 -- 172.21.15.8:0/4173129682 >> 172.21.15.8:0/4173129682 conn(0x7f5c740ccf10 msgr2=0x7f5c740cd310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:30.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.609+0000 7f5c78898700 1 -- 172.21.15.8:0/4173129682 shutdown_connections 2023-10-06T04:37:30.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.609+0000 7f5c78898700 1 -- 172.21.15.8:0/4173129682 wait complete. 2023-10-06T04:37:30.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.610+0000 7f5c78898700 1 Processor -- start 2023-10-06T04:37:30.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.611+0000 7f5c78898700 1 -- start start 2023-10-06T04:37:30.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.611+0000 7f5c78898700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c740caae0 0x7f5c74152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:30.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.611+0000 7f5c78898700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c74153980 0x7f5c74154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:30.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.611+0000 7f5c78898700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5c74154f70 0x7f5c7406b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:30.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.611+0000 7f5c78898700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c741554f0 con 0x7f5c740caae0 2023-10-06T04:37:30.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.611+0000 7f5c78898700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7416a970 con 0x7f5c74153980 2023-10-06T04:37:30.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.611+0000 7f5c78898700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c74169bb0 con 0x7f5c74154f70 2023-10-06T04:37:30.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.611+0000 7f5c737fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c740caae0 0x7f5c74152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:30.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.611+0000 7f5c737fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c740caae0 0x7f5c74152c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33486/0 (socket says 172.21.15.8:33486) 2023-10-06T04:37:30.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.611+0000 7f5c737fe700 1 -- 172.21.15.8:0/1802987329 learned_addr learned my addr 172.21.15.8:0/1802987329 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:30.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.612+0000 7f5c72ffd700 1 --2- 172.21.15.8:0/1802987329 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c74153980 0x7f5c74154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:30.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.612+0000 7f5c73fff700 1 --2- 172.21.15.8:0/1802987329 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5c74154f70 0x7f5c7406b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:30.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.612+0000 7f5c737fe700 1 -- 172.21.15.8:0/1802987329 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5c74154f70 msgr2=0x7f5c7406b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:30.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.612+0000 7f5c737fe700 1 --2- 172.21.15.8:0/1802987329 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5c74154f70 0x7f5c7406b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:30.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.612+0000 7f5c737fe700 1 -- 172.21.15.8:0/1802987329 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c74153980 msgr2=0x7f5c74154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:30.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.612+0000 7f5c737fe700 1 --2- 172.21.15.8:0/1802987329 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c74153980 0x7f5c74154a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:30.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.612+0000 7f5c737fe700 1 -- 172.21.15.8:0/1802987329 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c68009420 con 0x7f5c740caae0 2023-10-06T04:37:30.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.612+0000 7f5c72ffd700 1 --2- 172.21.15.8:0/1802987329 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c74153980 0x7f5c74154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:30.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.612+0000 7f5c737fe700 1 --2- 172.21.15.8:0/1802987329 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c740caae0 0x7f5c74152c30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5c6400c590 tx=0x7f5c64007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:30.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.612+0000 7f5c5b7fe700 1 -- 172.21.15.8:0/1802987329 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c64005b30 con 0x7f5c740caae0 2023-10-06T04:37:30.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.612+0000 7f5c5b7fe700 1 -- 172.21.15.8:0/1802987329 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c64005cb0 con 0x7f5c740caae0 2023-10-06T04:37:30.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.612+0000 7f5c78898700 1 -- 172.21.15.8:0/1802987329 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c74169e90 con 0x7f5c740caae0 2023-10-06T04:37:30.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.612+0000 7f5c5b7fe700 1 -- 172.21.15.8:0/1802987329 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c64007320 con 0x7f5c740caae0 2023-10-06T04:37:30.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.612+0000 7f5c78898700 1 -- 172.21.15.8:0/1802987329 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c7416a450 con 0x7f5c740caae0 2023-10-06T04:37:30.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.613+0000 7f5c78898700 1 -- 172.21.15.8:0/1802987329 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c7416a640 con 0x7f5c740caae0 2023-10-06T04:37:30.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.614+0000 7f5c5b7fe700 1 -- 172.21.15.8:0/1802987329 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5c6401b3b0 con 0x7f5c740caae0 2023-10-06T04:37:30.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.614+0000 7f5c5b7fe700 1 --2- 172.21.15.8:0/1802987329 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5c60066f30 0x7f5c600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:30.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.614+0000 7f5c5b7fe700 1 -- 172.21.15.8:0/1802987329 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6917+0+0 (secure 0 0 0) 0x7f5c64083fb0 con 0x7f5c740caae0 2023-10-06T04:37:30.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.614+0000 7f5c72ffd700 1 --2- 172.21.15.8:0/1802987329 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5c60066f30 0x7f5c600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:30.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.615+0000 7f5c72ffd700 1 --2- 172.21.15.8:0/1802987329 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5c60066f30 0x7f5c600693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5c74154120 tx=0x7f5c68017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:30.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.618+0000 7f5c5b7fe700 1 -- 172.21.15.8:0/1802987329 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5c64050d60 con 0x7f5c740caae0 2023-10-06T04:37:30.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:30.858+0000 7f5c78898700 1 -- 172.21.15.8:0/1802987329 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "recovery_fs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5c7404c380 con 0x7f5c740caae0 2023-10-06T04:37:31.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.793+0000 7f5c5b7fe700 1 -- 172.21.15.8:0/1802987329 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "recovery_fs", "var": "standby_count_wanted", "val": "0"}]=0 v22) v1 ==== 123+0+0 (secure 0 0 0) 0x7f5c64017020 con 0x7f5c740caae0 2023-10-06T04:37:31.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.796+0000 7f5c78898700 1 -- 172.21.15.8:0/1802987329 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5c60066f30 msgr2=0x7f5c600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:31.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.796+0000 7f5c78898700 1 --2- 172.21.15.8:0/1802987329 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5c60066f30 0x7f5c600693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5c74154120 tx=0x7f5c68017000 comp rx=0 tx=0).stop 2023-10-06T04:37:31.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.796+0000 7f5c78898700 1 -- 172.21.15.8:0/1802987329 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c740caae0 msgr2=0x7f5c74152c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:31.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.796+0000 7f5c78898700 1 --2- 172.21.15.8:0/1802987329 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c740caae0 0x7f5c74152c30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5c6400c590 tx=0x7f5c64007e00 comp rx=0 tx=0).stop 2023-10-06T04:37:31.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.796+0000 7f5c78898700 1 -- 172.21.15.8:0/1802987329 shutdown_connections 2023-10-06T04:37:31.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.796+0000 7f5c78898700 1 --2- 172.21.15.8:0/1802987329 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5c60066f30 0x7f5c600693e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:31.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.796+0000 7f5c78898700 1 --2- 172.21.15.8:0/1802987329 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5c74154f70 0x7f5c7406b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:31.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.796+0000 7f5c78898700 1 --2- 172.21.15.8:0/1802987329 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c740caae0 0x7f5c74152c30 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:31.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.796+0000 7f5c78898700 1 --2- 172.21.15.8:0/1802987329 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c74153980 0x7f5c74154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:31.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.796+0000 7f5c78898700 1 -- 172.21.15.8:0/1802987329 >> 172.21.15.8:0/1802987329 conn(0x7f5c740ccf10 msgr2=0x7f5c74158350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:31.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.796+0000 7f5c78898700 1 -- 172.21.15.8:0/1802987329 shutdown_connections 2023-10-06T04:37:31.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.796+0000 7f5c78898700 1 -- 172.21.15.8:0/1802987329 wait complete. 2023-10-06T04:37:31.812 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set recovery_fs allow_standby_replay false 2023-10-06T04:37:31.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.940+0000 7f49e6758700 1 Processor -- start 2023-10-06T04:37:31.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.940+0000 7f49e6758700 1 -- start start 2023-10-06T04:37:31.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.941+0000 7f49e6758700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f49e00b1c70 0x7f49e00b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:31.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.941+0000 7f49e6758700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f49e015ad80 0x7f49e015b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:31.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.941+0000 7f49e6758700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e00b2620 con 0x7f49e0156e30 2023-10-06T04:37:31.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.941+0000 7f49e6758700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e00cf370 con 0x7f49e00b1c70 2023-10-06T04:37:31.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.941+0000 7f49e6758700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e00ce800 con 0x7f49e015ad80 2023-10-06T04:37:31.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.941+0000 7f49e4f55700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f49e00b1c70 0x7f49e00b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:31.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.942+0000 7f49e4f55700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f49e00b1c70 0x7f49e00b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33498/0 (socket says 172.21.15.8:33498) 2023-10-06T04:37:31.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.942+0000 7f49e4f55700 1 -- 172.21.15.8:0/139356715 learned_addr learned my addr 172.21.15.8:0/139356715 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:31.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.942+0000 7f49e5f57700 1 --2- 172.21.15.8:0/139356715 >> v2:172.21.15.184:3300/0 conn(0x7f49e015ad80 0x7f49e015b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:31.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.942+0000 7f49e4f55700 1 -- 172.21.15.8:0/139356715 >> v2:172.21.15.184:3300/0 conn(0x7f49e015ad80 msgr2=0x7f49e015b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:31.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.942+0000 7f49e4f55700 1 --2- 172.21.15.8:0/139356715 >> v2:172.21.15.184:3300/0 conn(0x7f49e015ad80 0x7f49e015b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:31.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.942+0000 7f49e4f55700 1 -- 172.21.15.8:0/139356715 >> v1:172.21.15.184:6789/0 conn(0x7f49e0156e30 legacy=0x7f49e00cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:31.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.942+0000 7f49e4f55700 1 -- 172.21.15.8:0/139356715 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e00cea60 con 0x7f49e00b1c70 2023-10-06T04:37:31.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.942+0000 7f49e4f55700 1 --2- 172.21.15.8:0/139356715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49e00b1c70 0x7f49e00b20e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f49e0159ef0 tx=0x7f49d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d8fb3d8d4acb0b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:31.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.942+0000 7f49dffff700 1 -- 172.21.15.8:0/139356715 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d400b860 con 0x7f49e00b1c70 2023-10-06T04:37:31.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.942+0000 7f49dffff700 1 -- 172.21.15.8:0/139356715 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d400b9c0 con 0x7f49e00b1c70 2023-10-06T04:37:31.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.942+0000 7f49dffff700 1 -- 172.21.15.8:0/139356715 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d400bd60 con 0x7f49e00b1c70 2023-10-06T04:37:31.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.943+0000 7f49e6758700 1 -- 172.21.15.8:0/139356715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49e00b1c70 msgr2=0x7f49e00b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:31.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.943+0000 7f49e6758700 1 --2- 172.21.15.8:0/139356715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49e00b1c70 0x7f49e00b20e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f49e0159ef0 tx=0x7f49d4009250 comp rx=0 tx=0).stop 2023-10-06T04:37:31.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.943+0000 7f49e6758700 1 -- 172.21.15.8:0/139356715 shutdown_connections 2023-10-06T04:37:31.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.943+0000 7f49e6758700 1 --2- 172.21.15.8:0/139356715 >> v2:172.21.15.184:3300/0 conn(0x7f49e015ad80 0x7f49e015b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:31.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.943+0000 7f49e6758700 1 --2- 172.21.15.8:0/139356715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49e00b1c70 0x7f49e00b20e0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:31.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.943+0000 7f49e6758700 1 -- 172.21.15.8:0/139356715 >> 172.21.15.8:0/139356715 conn(0x7f49e006ed00 msgr2=0x7f49e006f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:31.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.943+0000 7f49e6758700 1 -- 172.21.15.8:0/139356715 shutdown_connections 2023-10-06T04:37:31.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.943+0000 7f49e6758700 1 -- 172.21.15.8:0/139356715 wait complete. 2023-10-06T04:37:31.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.944+0000 7f49e6758700 1 Processor -- start 2023-10-06T04:37:31.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.944+0000 7f49e6758700 1 -- start start 2023-10-06T04:37:31.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.945+0000 7f49e6758700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49e00b1c70 0x7f49e01475e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:31.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.945+0000 7f49e6758700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49e0156e30 0x7f49e01519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:31.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.945+0000 7f49e6758700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49e015ad80 0x7f49e01529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:31.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.945+0000 7f49e6758700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e0152f30 con 0x7f49e00b1c70 2023-10-06T04:37:31.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.945+0000 7f49e6758700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e01531b0 con 0x7f49e0156e30 2023-10-06T04:37:31.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.945+0000 7f49e6758700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e0153490 con 0x7f49e015ad80 2023-10-06T04:37:31.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.945+0000 7f49e5756700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49e00b1c70 0x7f49e01475e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:31.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.945+0000 7f49e5756700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49e00b1c70 0x7f49e01475e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33506/0 (socket says 172.21.15.8:33506) 2023-10-06T04:37:31.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.945+0000 7f49e5756700 1 -- 172.21.15.8:0/4255374578 learned_addr learned my addr 172.21.15.8:0/4255374578 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:31.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.945+0000 7f49e4f55700 1 --2- 172.21.15.8:0/4255374578 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49e0156e30 0x7f49e01519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:31.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.945+0000 7f49e5f57700 1 --2- 172.21.15.8:0/4255374578 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49e015ad80 0x7f49e01529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:31.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.945+0000 7f49e5756700 1 -- 172.21.15.8:0/4255374578 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49e015ad80 msgr2=0x7f49e01529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:31.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.945+0000 7f49e5756700 1 --2- 172.21.15.8:0/4255374578 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49e015ad80 0x7f49e01529f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:31.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.945+0000 7f49e5756700 1 -- 172.21.15.8:0/4255374578 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49e0156e30 msgr2=0x7f49e01519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:31.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.945+0000 7f49e5756700 1 --2- 172.21.15.8:0/4255374578 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49e0156e30 0x7f49e01519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:31.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.945+0000 7f49e5756700 1 -- 172.21.15.8:0/4255374578 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d40094f0 con 0x7f49e00b1c70 2023-10-06T04:37:31.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.946+0000 7f49e5756700 1 --2- 172.21.15.8:0/4255374578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49e00b1c70 0x7f49e01475e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f49d000cb10 tx=0x7f49d00017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:31.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.946+0000 7f49dd7fa700 1 -- 172.21.15.8:0/4255374578 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d000ce20 con 0x7f49e00b1c70 2023-10-06T04:37:31.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.946+0000 7f49dd7fa700 1 -- 172.21.15.8:0/4255374578 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d000a7e0 con 0x7f49e00b1c70 2023-10-06T04:37:31.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.946+0000 7f49e6758700 1 -- 172.21.15.8:0/4255374578 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e0153770 con 0x7f49e00b1c70 2023-10-06T04:37:31.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.946+0000 7f49dd7fa700 1 -- 172.21.15.8:0/4255374578 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d000aba0 con 0x7f49e00b1c70 2023-10-06T04:37:31.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.946+0000 7f49e6758700 1 -- 172.21.15.8:0/4255374578 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e00b16b0 con 0x7f49e00b1c70 2023-10-06T04:37:31.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.947+0000 7f49e6758700 1 -- 172.21.15.8:0/4255374578 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e004c380 con 0x7f49e00b1c70 2023-10-06T04:37:31.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.947+0000 7f49dd7fa700 1 -- 172.21.15.8:0/4255374578 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f49d0003030 con 0x7f49e00b1c70 2023-10-06T04:37:31.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.948+0000 7f49dd7fa700 1 --2- 172.21.15.8:0/4255374578 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f49cc066f30 0x7f49cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:31.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.948+0000 7f49dd7fa700 1 -- 172.21.15.8:0/4255374578 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7f49d0084a10 con 0x7f49e00b1c70 2023-10-06T04:37:31.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.948+0000 7f49e4f55700 1 --2- 172.21.15.8:0/4255374578 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f49cc066f30 0x7f49cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:31.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.948+0000 7f49e4f55700 1 --2- 172.21.15.8:0/4255374578 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f49cc066f30 0x7f49cc0693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f49e0159ef0 tx=0x7f49d4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:31.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:31.952+0000 7f49dd7fa700 1 -- 172.21.15.8:0/4255374578 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49d00517c0 con 0x7f49e00b1c70 2023-10-06T04:37:32.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.193+0000 7f49e6758700 1 -- 172.21.15.8:0/4255374578 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "recovery_fs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f49e00af4f0 con 0x7f49e00b1c70 2023-10-06T04:37:32.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.797+0000 7f49dd7fa700 1 -- 172.21.15.8:0/4255374578 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "recovery_fs", "var": "allow_standby_replay", "val": "false"}]=0 v23) v1 ==== 127+0+0 (secure 0 0 0) 0x7f49d0054de0 con 0x7f49e00b1c70 2023-10-06T04:37:32.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.800+0000 7f49e6758700 1 -- 172.21.15.8:0/4255374578 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f49cc066f30 msgr2=0x7f49cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:32.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.800+0000 7f49e6758700 1 --2- 172.21.15.8:0/4255374578 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f49cc066f30 0x7f49cc0693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f49e0159ef0 tx=0x7f49d4017000 comp rx=0 tx=0).stop 2023-10-06T04:37:32.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.800+0000 7f49e6758700 1 -- 172.21.15.8:0/4255374578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49e00b1c70 msgr2=0x7f49e01475e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:32.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.800+0000 7f49e6758700 1 --2- 172.21.15.8:0/4255374578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49e00b1c70 0x7f49e01475e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f49d000cb10 tx=0x7f49d00017b0 comp rx=0 tx=0).stop 2023-10-06T04:37:32.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.800+0000 7f49e6758700 1 -- 172.21.15.8:0/4255374578 shutdown_connections 2023-10-06T04:37:32.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.800+0000 7f49e6758700 1 --2- 172.21.15.8:0/4255374578 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f49cc066f30 0x7f49cc0693e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:32.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.800+0000 7f49e6758700 1 --2- 172.21.15.8:0/4255374578 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49e015ad80 0x7f49e01529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:32.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.800+0000 7f49e6758700 1 --2- 172.21.15.8:0/4255374578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49e00b1c70 0x7f49e01475e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:32.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.800+0000 7f49e6758700 1 --2- 172.21.15.8:0/4255374578 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49e0156e30 0x7f49e01519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:32.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.800+0000 7f49e6758700 1 -- 172.21.15.8:0/4255374578 >> 172.21.15.8:0/4255374578 conn(0x7f49e006ed00 msgr2=0x7f49e00cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:32.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.800+0000 7f49e6758700 1 -- 172.21.15.8:0/4255374578 shutdown_connections 2023-10-06T04:37:32.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.800+0000 7f49e6758700 1 -- 172.21.15.8:0/4255374578 wait complete. 2023-10-06T04:37:32.816 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:37:32.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.938+0000 7f83747ce700 1 Processor -- start 2023-10-06T04:37:32.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.938+0000 7f83747ce700 1 -- start start 2023-10-06T04:37:32.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.939+0000 7f83747ce700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f836c0d0aa0 0x7f836c1649b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:32.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.939+0000 7f83747ce700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f836c0cc4c0 con 0x7f836c0af680 2023-10-06T04:37:32.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.939+0000 7f83747ce700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f836c0cb8b0 con 0x7f836c0cb360 2023-10-06T04:37:32.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.939+0000 7f83747ce700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f836c15d460 con 0x7f836c0d0aa0 2023-10-06T04:37:32.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.939+0000 7f8372d6b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f836c0d0aa0 0x7f836c1649b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:32.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.939+0000 7f837256a700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f836c0af680 0x7f836c15e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46216/0 (socket says 172.21.15.8:46216) 2023-10-06T04:37:32.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.939+0000 7f837256a700 1 -- 172.21.15.8:0/3715740978 learned_addr learned my addr 172.21.15.8:0/3715740978 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:32.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.940+0000 7f8372d6b700 1 -- 172.21.15.8:0/3715740978 >> v1:172.21.15.184:6789/0 conn(0x7f836c0cb360 legacy=0x7f836c0d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:32.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.940+0000 7f8372d6b700 1 -- 172.21.15.8:0/3715740978 >> v1:172.21.15.8:6789/0 conn(0x7f836c0af680 legacy=0x7f836c15e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:32.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.940+0000 7f8372d6b700 1 -- 172.21.15.8:0/3715740978 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c0cbb90 con 0x7f836c0d0aa0 2023-10-06T04:37:32.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.940+0000 7f8371568700 1 -- 172.21.15.8:0/3715740978 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2001815390 0 0) 0x7f836c0cc4c0 con 0x7f836c0af680 2023-10-06T04:37:32.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.940+0000 7f8372d6b700 1 --2- 172.21.15.8:0/3715740978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f836c0d0aa0 0x7f836c1649b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f83640098e0 tx=0x7f83640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74d17f9178d814a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:32.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.940+0000 7f8371568700 1 -- 172.21.15.8:0/3715740978 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8364009e80 con 0x7f836c0d0aa0 2023-10-06T04:37:32.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.940+0000 7f8371568700 1 -- 172.21.15.8:0/3715740978 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836400b820 con 0x7f836c0d0aa0 2023-10-06T04:37:32.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.940+0000 7f8371568700 1 -- 172.21.15.8:0/3715740978 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836400bba0 con 0x7f836c0d0aa0 2023-10-06T04:37:32.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.941+0000 7f83747ce700 1 -- 172.21.15.8:0/3715740978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f836c0d0aa0 msgr2=0x7f836c1649b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:32.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.941+0000 7f83747ce700 1 --2- 172.21.15.8:0/3715740978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f836c0d0aa0 0x7f836c1649b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f83640098e0 tx=0x7f83640091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:32.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.941+0000 7f83747ce700 1 -- 172.21.15.8:0/3715740978 shutdown_connections 2023-10-06T04:37:32.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.941+0000 7f83747ce700 1 --2- 172.21.15.8:0/3715740978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f836c0d0aa0 0x7f836c1649b0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:32.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.941+0000 7f83747ce700 1 -- 172.21.15.8:0/3715740978 >> 172.21.15.8:0/3715740978 conn(0x7f836c0633d0 msgr2=0x7f836c0637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:32.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.941+0000 7f83747ce700 1 -- 172.21.15.8:0/3715740978 shutdown_connections 2023-10-06T04:37:32.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.941+0000 7f83747ce700 1 -- 172.21.15.8:0/3715740978 wait complete. 2023-10-06T04:37:32.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.942+0000 7f83747ce700 1 Processor -- start 2023-10-06T04:37:32.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.942+0000 7f83747ce700 1 -- start start 2023-10-06T04:37:32.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.943+0000 7f83747ce700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f836c0af680 0x7f836c14ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:32.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.943+0000 7f83747ce700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f836c0cb360 0x7f836c0c9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:32.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.943+0000 7f83747ce700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f836c0d0aa0 0x7f836c15be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:32.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.943+0000 7f83747ce700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836c0c85b0 con 0x7f836c0d0aa0 2023-10-06T04:37:32.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.943+0000 7f83747ce700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836c0c79a0 con 0x7f836c0af680 2023-10-06T04:37:32.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.943+0000 7f83747ce700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836c0c7c80 con 0x7f836c0cb360 2023-10-06T04:37:32.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.943+0000 7f8372d6b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f836c0d0aa0 0x7f836c15be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:32.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.943+0000 7f8372d6b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f836c0d0aa0 0x7f836c15be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33518/0 (socket says 172.21.15.8:33518) 2023-10-06T04:37:32.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.943+0000 7f8372d6b700 1 -- 172.21.15.8:0/1209719055 learned_addr learned my addr 172.21.15.8:0/1209719055 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:32.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.943+0000 7f8372d6b700 1 -- 172.21.15.8:0/1209719055 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f836c0cb360 msgr2=0x7f836c0c9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:32.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.943+0000 7f8372d6b700 1 --2- 172.21.15.8:0/1209719055 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f836c0cb360 0x7f836c0c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:32.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.943+0000 7f8372d6b700 1 -- 172.21.15.8:0/1209719055 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f836c0af680 msgr2=0x7f836c14ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:32.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.943+0000 7f8372d6b700 1 --2- 172.21.15.8:0/1209719055 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f836c0af680 0x7f836c14ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:32.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.943+0000 7f8372d6b700 1 -- 172.21.15.8:0/1209719055 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8364009420 con 0x7f836c0d0aa0 2023-10-06T04:37:32.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.943+0000 7f8372d6b700 1 --2- 172.21.15.8:0/1209719055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f836c0d0aa0 0x7f836c15be40 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f83640093f0 tx=0x7f8364016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:32.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.943+0000 7f836a7fc700 1 -- 172.21.15.8:0/1209719055 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836401b450 con 0x7f836c0d0aa0 2023-10-06T04:37:32.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.943+0000 7f836a7fc700 1 -- 172.21.15.8:0/1209719055 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8364020070 con 0x7f836c0d0aa0 2023-10-06T04:37:32.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.943+0000 7f83747ce700 1 -- 172.21.15.8:0/1209719055 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f836c0c7f60 con 0x7f836c0d0aa0 2023-10-06T04:37:32.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.943+0000 7f836a7fc700 1 -- 172.21.15.8:0/1209719055 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836401b820 con 0x7f836c0d0aa0 2023-10-06T04:37:32.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.943+0000 7f83747ce700 1 -- 172.21.15.8:0/1209719055 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f836c14bfa0 con 0x7f836c0d0aa0 2023-10-06T04:37:32.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.944+0000 7f83747ce700 1 -- 172.21.15.8:0/1209719055 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f836c14c190 con 0x7f836c0d0aa0 2023-10-06T04:37:32.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.945+0000 7f836a7fc700 1 -- 172.21.15.8:0/1209719055 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8364022030 con 0x7f836c0d0aa0 2023-10-06T04:37:32.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.945+0000 7f836a7fc700 1 --2- 172.21.15.8:0/1209719055 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8358066f30 0x7f83580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:32.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.945+0000 7f836a7fc700 1 -- 172.21.15.8:0/1209719055 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7f8364086b80 con 0x7f836c0d0aa0 2023-10-06T04:37:32.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.945+0000 7f837256a700 1 --2- 172.21.15.8:0/1209719055 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8358066f30 0x7f83580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:32.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.946+0000 7f837256a700 1 --2- 172.21.15.8:0/1209719055 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8358066f30 0x7f83580693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f835c001560 tx=0x7f835c0016c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:32.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:32.950+0000 7f836a7fc700 1 -- 172.21.15.8:0/1209719055 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8364053930 con 0x7f836c0d0aa0 2023-10-06T04:37:33.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.184+0000 7f83747ce700 1 -- 172.21.15.8:0/1209719055 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f836c14c190 con 0x7f836c0d0aa0 2023-10-06T04:37:33.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.185+0000 7f836a7fc700 1 -- 172.21.15.8:0/1209719055 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+5654 (secure 0 0 0) 0x7f8364056f50 con 0x7f836c0d0aa0 2023-10-06T04:37:33.186 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:33.186 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/867081044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":867081044},{"type":"v1","addr":"172.21.15.184:6835","nonce":867081044}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5176,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2754847040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2754847040},{"type":"v1","addr":"172.21.15.184:6837","nonce":2754847040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5358,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/1957165234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1957165234},{"type":"v1","addr":"172.21.15.8:6834","nonce":1957165234}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5361,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1173304661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1173304661},{"type":"v1","addr":"172.21.15.8:6835","nonce":1173304661}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:37:16.932006+0000","modified":"2023-10-06T04:37:26.044254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":39,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":23,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:37:29.514098+0000","modified":"2023-10-06T04:37:32.792406+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[7],"metadata_pool":8,"enabled":true,"fs_name":"recovery_fs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T04:37:33.188 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-10-06T04:37:33.188 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-10-06T04:37:33.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.187+0000 7f83747ce700 1 -- 172.21.15.8:0/1209719055 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8358066f30 msgr2=0x7f83580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:33.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.187+0000 7f83747ce700 1 --2- 172.21.15.8:0/1209719055 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8358066f30 0x7f83580693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f835c001560 tx=0x7f835c0016c0 comp rx=0 tx=0).stop 2023-10-06T04:37:33.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.187+0000 7f83747ce700 1 -- 172.21.15.8:0/1209719055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f836c0d0aa0 msgr2=0x7f836c15be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:33.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.187+0000 7f83747ce700 1 --2- 172.21.15.8:0/1209719055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f836c0d0aa0 0x7f836c15be40 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f83640093f0 tx=0x7f8364016000 comp rx=0 tx=0).stop 2023-10-06T04:37:33.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.187+0000 7f83747ce700 1 -- 172.21.15.8:0/1209719055 shutdown_connections 2023-10-06T04:37:33.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.187+0000 7f83747ce700 1 --2- 172.21.15.8:0/1209719055 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8358066f30 0x7f83580693e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:33.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.187+0000 7f83747ce700 1 --2- 172.21.15.8:0/1209719055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f836c0d0aa0 0x7f836c15be40 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:33.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.187+0000 7f83747ce700 1 --2- 172.21.15.8:0/1209719055 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f836c0af680 0x7f836c14ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:33.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.187+0000 7f83747ce700 1 --2- 172.21.15.8:0/1209719055 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f836c0cb360 0x7f836c0c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:33.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.187+0000 7f83747ce700 1 -- 172.21.15.8:0/1209719055 >> 172.21.15.8:0/1209719055 conn(0x7f836c0633d0 msgr2=0x7f836c0cc950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:33.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.187+0000 7f83747ce700 1 -- 172.21.15.8:0/1209719055 shutdown_connections 2023-10-06T04:37:33.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.187+0000 7f83747ce700 1 -- 172.21.15.8:0/1209719055 wait complete. 2023-10-06T04:37:33.190 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 23 2023-10-06T04:37:33.200 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:37:33.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.318+0000 7f536ecc1700 1 Processor -- start 2023-10-06T04:37:33.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.318+0000 7f536ecc1700 1 -- start start 2023-10-06T04:37:33.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.318+0000 7f536ecc1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5368140c30 0x7f53680cc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:33.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.318+0000 7f536ecc1700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f53680c8b30 0x7f536806b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:33.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.318+0000 7f536ecc1700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f536806bc90 0x7f536806cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:33.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.318+0000 7f536ecc1700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53680b11d0 con 0x7f53680c8b30 2023-10-06T04:37:33.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.318+0000 7f536ecc1700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f536806c110 con 0x7f536806bc90 2023-10-06T04:37:33.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.318+0000 7f536ecc1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53680cd790 con 0x7f5368140c30 2023-10-06T04:37:33.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.319+0000 7f5367fff700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f53680c8b30 0x7f536806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:33.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.319+0000 7f5367fff700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f53680c8b30 0x7f536806b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33522/0 (socket says 172.21.15.8:33522) 2023-10-06T04:37:33.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.319+0000 7f5367fff700 1 -- 172.21.15.8:0/718191205 learned_addr learned my addr 172.21.15.8:0/718191205 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:33.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.319+0000 7f536ca5d700 1 --2- 172.21.15.8:0/718191205 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5368140c30 0x7f53680cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:33.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.319+0000 7f536d25e700 1 --2- 172.21.15.8:0/718191205 >> v2:172.21.15.184:3300/0 conn(0x7f536806bc90 0x7f536806cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:33.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.319+0000 7f5367fff700 1 -- 172.21.15.8:0/718191205 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5368140c30 msgr2=0x7f53680cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:33.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.319+0000 7f5367fff700 1 --2- 172.21.15.8:0/718191205 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5368140c30 0x7f53680cc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:33.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.319+0000 7f5367fff700 1 -- 172.21.15.8:0/718191205 >> v2:172.21.15.184:3300/0 conn(0x7f536806bc90 msgr2=0x7f536806cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:33.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.319+0000 7f5367fff700 1 --2- 172.21.15.8:0/718191205 >> v2:172.21.15.184:3300/0 conn(0x7f536806bc90 0x7f536806cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:33.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.319+0000 7f5367fff700 1 -- 172.21.15.8:0/718191205 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53680ccef0 con 0x7f53680c8b30 2023-10-06T04:37:33.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.319+0000 7f536ca5d700 1 --2- 172.21.15.8:0/718191205 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5368140c30 0x7f53680cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:33.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.319+0000 7f5367fff700 1 --2- 172.21.15.8:0/718191205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53680c8b30 0x7f536806b750 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f536806ec10 tx=0x7f535c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31067b5d7d01371d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:33.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.319+0000 7f53677fe700 1 -- 172.21.15.8:0/718191205 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c00b860 con 0x7f53680c8b30 2023-10-06T04:37:33.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.319+0000 7f53677fe700 1 -- 172.21.15.8:0/718191205 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535c00b9c0 con 0x7f53680c8b30 2023-10-06T04:37:33.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.319+0000 7f53677fe700 1 -- 172.21.15.8:0/718191205 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c00bd60 con 0x7f53680c8b30 2023-10-06T04:37:33.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.320+0000 7f536ecc1700 1 -- 172.21.15.8:0/718191205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53680c8b30 msgr2=0x7f536806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:33.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.320+0000 7f536ecc1700 1 --2- 172.21.15.8:0/718191205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53680c8b30 0x7f536806b750 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f536806ec10 tx=0x7f535c009250 comp rx=0 tx=0).stop 2023-10-06T04:37:33.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.320+0000 7f536ecc1700 1 -- 172.21.15.8:0/718191205 shutdown_connections 2023-10-06T04:37:33.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.320+0000 7f536ecc1700 1 --2- 172.21.15.8:0/718191205 >> v2:172.21.15.184:3300/0 conn(0x7f536806bc90 0x7f536806cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:33.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.320+0000 7f536ecc1700 1 --2- 172.21.15.8:0/718191205 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5368140c30 0x7f53680cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:33.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.320+0000 7f536ecc1700 1 --2- 172.21.15.8:0/718191205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53680c8b30 0x7f536806b750 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:33.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.320+0000 7f536ecc1700 1 -- 172.21.15.8:0/718191205 >> 172.21.15.8:0/718191205 conn(0x7f53680ce250 msgr2=0x7f53680ce650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:33.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.320+0000 7f536ecc1700 1 -- 172.21.15.8:0/718191205 shutdown_connections 2023-10-06T04:37:33.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.320+0000 7f536ecc1700 1 -- 172.21.15.8:0/718191205 wait complete. 2023-10-06T04:37:33.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.321+0000 7f536ecc1700 1 Processor -- start 2023-10-06T04:37:33.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.321+0000 7f536ecc1700 1 -- start start 2023-10-06T04:37:33.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.322+0000 7f536ecc1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f536806bc90 0x7f5368156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:33.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.322+0000 7f536ecc1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53680c8b30 0x7f53680c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:33.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.322+0000 7f536ecc1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5368140c30 0x7f5368159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:33.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.322+0000 7f536ecc1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53680c4100 con 0x7f536806bc90 2023-10-06T04:37:33.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.322+0000 7f536ecc1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53680c34f0 con 0x7f5368140c30 2023-10-06T04:37:33.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.322+0000 7f536ecc1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53680c37d0 con 0x7f53680c8b30 2023-10-06T04:37:33.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.322+0000 7f536ca5d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f536806bc90 0x7f5368156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:33.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.322+0000 7f536ca5d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f536806bc90 0x7f5368156880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33530/0 (socket says 172.21.15.8:33530) 2023-10-06T04:37:33.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.322+0000 7f536ca5d700 1 -- 172.21.15.8:0/2257469731 learned_addr learned my addr 172.21.15.8:0/2257469731 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:33.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.322+0000 7f5367fff700 1 --2- 172.21.15.8:0/2257469731 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53680c8b30 0x7f53680c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:33.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.322+0000 7f536d25e700 1 --2- 172.21.15.8:0/2257469731 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5368140c30 0x7f5368159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:33.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.322+0000 7f536ca5d700 1 -- 172.21.15.8:0/2257469731 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53680c8b30 msgr2=0x7f53680c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:33.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.322+0000 7f536ca5d700 1 --2- 172.21.15.8:0/2257469731 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53680c8b30 0x7f53680c5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:33.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.322+0000 7f536ca5d700 1 -- 172.21.15.8:0/2257469731 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5368140c30 msgr2=0x7f5368159070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:33.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.322+0000 7f536ca5d700 1 --2- 172.21.15.8:0/2257469731 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5368140c30 0x7f5368159070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:33.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.322+0000 7f536ca5d700 1 -- 172.21.15.8:0/2257469731 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f535c0094f0 con 0x7f536806bc90 2023-10-06T04:37:33.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.322+0000 7f536d25e700 1 --2- 172.21.15.8:0/2257469731 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5368140c30 0x7f5368159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:33.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.322+0000 7f536ca5d700 1 --2- 172.21.15.8:0/2257469731 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f536806bc90 0x7f5368156880 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f535800c830 tx=0x7f5358008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:33.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.323+0000 7f5364ff9700 1 -- 172.21.15.8:0/2257469731 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5358005a00 con 0x7f536806bc90 2023-10-06T04:37:33.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.323+0000 7f5364ff9700 1 -- 172.21.15.8:0/2257469731 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5358005b60 con 0x7f536806bc90 2023-10-06T04:37:33.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.323+0000 7f5364ff9700 1 -- 172.21.15.8:0/2257469731 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5358011600 con 0x7f536806bc90 2023-10-06T04:37:33.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.323+0000 7f536ecc1700 1 -- 172.21.15.8:0/2257469731 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53680c3ab0 con 0x7f536806bc90 2023-10-06T04:37:33.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.323+0000 7f536ecc1700 1 -- 172.21.15.8:0/2257469731 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5368156dc0 con 0x7f536806bc90 2023-10-06T04:37:33.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.324+0000 7f536ecc1700 1 -- 172.21.15.8:0/2257469731 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5368071550 con 0x7f536806bc90 2023-10-06T04:37:33.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.324+0000 7f5364ff9700 1 -- 172.21.15.8:0/2257469731 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5358011970 con 0x7f536806bc90 2023-10-06T04:37:33.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.325+0000 7f5364ff9700 1 --2- 172.21.15.8:0/2257469731 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5354066f30 0x7f53540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:33.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.325+0000 7f5364ff9700 1 -- 172.21.15.8:0/2257469731 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7f53580848f0 con 0x7f536806bc90 2023-10-06T04:37:33.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.325+0000 7f5367fff700 1 --2- 172.21.15.8:0/2257469731 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5354066f30 0x7f53540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:33.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.325+0000 7f5367fff700 1 --2- 172.21.15.8:0/2257469731 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5354066f30 0x7f53540693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f536806ec10 tx=0x7f535c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:33.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.329+0000 7f5364ff9700 1 -- 172.21.15.8:0/2257469731 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5358055130 con 0x7f536806bc90 2023-10-06T04:37:33.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.523+0000 7f536ecc1700 1 -- 172.21.15.8:0/2257469731 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53680cd1d0 con 0x7f536806bc90 2023-10-06T04:37:33.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.524+0000 7f5364ff9700 1 -- 172.21.15.8:0/2257469731 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+18779 (secure 0 0 0) 0x7f5358054cc0 con 0x7f536806bc90 2023-10-06T04:37:33.525 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:33.526 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":46,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:37:30.782691+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:36:10.148177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:36:10.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:37:15.099258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T04:37:15.902657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}}},{"pool":8,"pool_name":"recovery_fs_metadata","create_time":"2023-10-06T04:37:28.524294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}}}],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.555871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.490505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.504578+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.517217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:05.991135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.537329+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.543232+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.443715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6835/3478733664":"2023-10-07T04:37:26.044067+0000","172.21.15.8:6833/3478733664":"2023-10-07T04:37:26.044067+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:37:33.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.526+0000 7f536ecc1700 1 -- 172.21.15.8:0/2257469731 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5354066f30 msgr2=0x7f53540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:33.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.526+0000 7f536ecc1700 1 --2- 172.21.15.8:0/2257469731 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5354066f30 0x7f53540693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f536806ec10 tx=0x7f535c017000 comp rx=0 tx=0).stop 2023-10-06T04:37:33.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.526+0000 7f536ecc1700 1 -- 172.21.15.8:0/2257469731 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f536806bc90 msgr2=0x7f5368156880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:33.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.526+0000 7f536ecc1700 1 --2- 172.21.15.8:0/2257469731 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f536806bc90 0x7f5368156880 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f535800c830 tx=0x7f5358008040 comp rx=0 tx=0).stop 2023-10-06T04:37:33.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.526+0000 7f536ecc1700 1 -- 172.21.15.8:0/2257469731 shutdown_connections 2023-10-06T04:37:33.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.526+0000 7f536ecc1700 1 --2- 172.21.15.8:0/2257469731 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5354066f30 0x7f53540693e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:33.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.526+0000 7f536ecc1700 1 --2- 172.21.15.8:0/2257469731 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5368140c30 0x7f5368159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:33.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.526+0000 7f536ecc1700 1 --2- 172.21.15.8:0/2257469731 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f536806bc90 0x7f5368156880 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:33.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.526+0000 7f536ecc1700 1 --2- 172.21.15.8:0/2257469731 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53680c8b30 0x7f53680c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:33.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.526+0000 7f536ecc1700 1 -- 172.21.15.8:0/2257469731 >> 172.21.15.8:0/2257469731 conn(0x7f53680ce250 msgr2=0x7f53680ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:33.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.526+0000 7f536ecc1700 1 -- 172.21.15.8:0/2257469731 shutdown_connections 2023-10-06T04:37:33.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.526+0000 7f536ecc1700 1 -- 172.21.15.8:0/2257469731 wait complete. 2023-10-06T04:37:33.540 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T04:37:33.540 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:37:33.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.658+0000 7fd914c7a700 1 Processor -- start 2023-10-06T04:37:33.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.658+0000 7fd914c7a700 1 -- start start 2023-10-06T04:37:33.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.659+0000 7fd914c7a700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd9101591d0 0x7fd9100b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:33.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.659+0000 7fd914c7a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9100b1610 0x7fd9100caf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:33.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.659+0000 7fd914c7a700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9100c8ce0 con 0x7fd910157700 2023-10-06T04:37:33.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.659+0000 7fd914c7a700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9100b1a90 con 0x7fd9101591d0 2023-10-06T04:37:33.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.659+0000 7fd914c7a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9100caa90 con 0x7fd9100b1610 2023-10-06T04:37:33.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.660+0000 7fd90e59c700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fd910157700 0x7fd9100c8020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46228/0 (socket says 172.21.15.8:46228) 2023-10-06T04:37:33.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.660+0000 7fd90e59c700 1 -- 172.21.15.8:0/4155229014 learned_addr learned my addr 172.21.15.8:0/4155229014 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:33.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.660+0000 7fd90ed9d700 1 --2- 172.21.15.8:0/4155229014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9100b1610 0x7fd9100caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:33.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.660+0000 7fd90dd9b700 1 --2- 172.21.15.8:0/4155229014 >> v2:172.21.15.184:3300/0 conn(0x7fd9101591d0 0x7fd9100b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:33.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.660+0000 7fd90d59a700 1 -- 172.21.15.8:0/4155229014 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1803465420 0 0) 0x7fd9100c8ce0 con 0x7fd910157700 2023-10-06T04:37:33.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.660+0000 7fd90d59a700 1 -- 172.21.15.8:0/4155229014 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8fc003570 con 0x7fd910157700 2023-10-06T04:37:33.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.660+0000 7fd90d59a700 1 -- 172.21.15.8:0/4155229014 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1776483050 0 0) 0x7fd8fc003570 con 0x7fd910157700 2023-10-06T04:37:33.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.660+0000 7fd90d59a700 1 -- 172.21.15.8:0/4155229014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9100b1610 msgr2=0x7fd9100caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:33.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.660+0000 7fd90d59a700 1 --2- 172.21.15.8:0/4155229014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9100b1610 0x7fd9100caf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:33.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.660+0000 7fd90d59a700 1 -- 172.21.15.8:0/4155229014 >> v2:172.21.15.184:3300/0 conn(0x7fd9101591d0 msgr2=0x7fd9100b10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:33.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.660+0000 7fd90d59a700 1 --2- 172.21.15.8:0/4155229014 >> v2:172.21.15.184:3300/0 conn(0x7fd9101591d0 0x7fd9100b10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:33.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.660+0000 7fd90d59a700 1 -- 172.21.15.8:0/4155229014 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9100c8730 con 0x7fd910157700 2023-10-06T04:37:33.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.660+0000 7fd90d59a700 1 -- 172.21.15.8:0/4155229014 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7fd908001470 con 0x7fd910157700 2023-10-06T04:37:33.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.660+0000 7fd90d59a700 1 -- 172.21.15.8:0/4155229014 >> v1:172.21.15.8:6789/0 conn(0x7fd910157700 legacy=0x7fd9100c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:33.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.660+0000 7fd90d59a700 1 --2- 172.21.15.8:0/4155229014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8fc003a60 0x7fd8fc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:33.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.660+0000 7fd90d59a700 1 --2- 172.21.15.8:0/4155229014 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8fc004810 0x7fd8fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:33.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.660+0000 7fd90d59a700 1 --2- 172.21.15.8:0/4155229014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9100b1610 0x7fd8fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:33.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.660+0000 7fd90d59a700 1 -- 172.21.15.8:0/4155229014 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9100b1a90 con 0x7fd8fc003a60 2023-10-06T04:37:33.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.660+0000 7fd90d59a700 1 -- 172.21.15.8:0/4155229014 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9100caa90 con 0x7fd8fc004810 2023-10-06T04:37:33.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.660+0000 7fd90d59a700 1 -- 172.21.15.8:0/4155229014 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc00ba60 con 0x7fd9100b1610 2023-10-06T04:37:33.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.660+0000 7fd90e59c700 1 --2- 172.21.15.8:0/4155229014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8fc003a60 0x7fd8fc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:33.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.660+0000 7fd90dd9b700 1 --2- 172.21.15.8:0/4155229014 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8fc004810 0x7fd8fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:33.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.660+0000 7fd90ed9d700 1 --2- 172.21.15.8:0/4155229014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9100b1610 0x7fd8fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:33.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.661+0000 7fd90e59c700 1 -- 172.21.15.8:0/4155229014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9100b1610 msgr2=0x7fd8fc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:33.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.661+0000 7fd90e59c700 1 --2- 172.21.15.8:0/4155229014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9100b1610 0x7fd8fc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:33.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.661+0000 7fd90e59c700 1 -- 172.21.15.8:0/4155229014 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8fc004810 msgr2=0x7fd8fc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:33.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.661+0000 7fd90e59c700 1 --2- 172.21.15.8:0/4155229014 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8fc004810 0x7fd8fc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:33.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.661+0000 7fd90e59c700 1 -- 172.21.15.8:0/4155229014 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8fc003570 con 0x7fd8fc003a60 2023-10-06T04:37:33.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.661+0000 7fd90e59c700 1 --2- 172.21.15.8:0/4155229014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8fc003a60 0x7fd8fc003e70 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd90800c3f0 tx=0x7fd9100caa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ab6bb483addf07 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:33.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.661+0000 7fd90d59a700 1 -- 172.21.15.8:0/4155229014 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90800cc80 con 0x7fd8fc003a60 2023-10-06T04:37:33.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.661+0000 7fd90d59a700 1 -- 172.21.15.8:0/4155229014 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90800ce20 con 0x7fd8fc003a60 2023-10-06T04:37:33.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.661+0000 7fd90d59a700 1 -- 172.21.15.8:0/4155229014 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd908005b70 con 0x7fd8fc003a60 2023-10-06T04:37:33.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.661+0000 7fd914c7a700 1 -- 172.21.15.8:0/4155229014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8fc003a60 msgr2=0x7fd8fc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:33.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.661+0000 7fd914c7a700 1 --2- 172.21.15.8:0/4155229014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8fc003a60 0x7fd8fc003e70 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd90800c3f0 tx=0x7fd9100caa00 comp rx=0 tx=0).stop 2023-10-06T04:37:33.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.661+0000 7fd90ed9d700 1 -- 172.21.15.8:0/4155229014 reap_dead start 2023-10-06T04:37:33.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.662+0000 7fd914c7a700 1 -- 172.21.15.8:0/4155229014 shutdown_connections 2023-10-06T04:37:33.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.662+0000 7fd914c7a700 1 -- 172.21.15.8:0/4155229014 >> 172.21.15.8:0/4155229014 conn(0x7fd910068070 msgr2=0x7fd9100cc000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:33.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.662+0000 7fd914c7a700 1 -- 172.21.15.8:0/4155229014 shutdown_connections 2023-10-06T04:37:33.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.662+0000 7fd914c7a700 1 -- 172.21.15.8:0/4155229014 wait complete. 2023-10-06T04:37:33.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.663+0000 7fd914c7a700 1 Processor -- start 2023-10-06T04:37:33.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.663+0000 7fd914c7a700 1 -- start start 2023-10-06T04:37:33.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.663+0000 7fd914c7a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8fc003a60 0x7fd910169320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:33.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.663+0000 7fd914c7a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9100aa6e0 0x7fd9100aab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:33.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.663+0000 7fd914c7a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd91015db70 0x7fd91015dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:33.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.663+0000 7fd914c7a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91015e530 con 0x7fd9100aa6e0 2023-10-06T04:37:33.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.663+0000 7fd914c7a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9100ab480 con 0x7fd8fc003a60 2023-10-06T04:37:33.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.663+0000 7fd914c7a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9100a7e70 con 0x7fd91015db70 2023-10-06T04:37:33.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.664+0000 7fd90dd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9100aa6e0 0x7fd9100aab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:33.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.664+0000 7fd90dd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9100aa6e0 0x7fd9100aab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33538/0 (socket says 172.21.15.8:33538) 2023-10-06T04:37:33.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.664+0000 7fd90dd9b700 1 -- 172.21.15.8:0/2317985311 learned_addr learned my addr 172.21.15.8:0/2317985311 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:33.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.664+0000 7fd90e59c700 1 --2- 172.21.15.8:0/2317985311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8fc003a60 0x7fd910169320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:33.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.664+0000 7fd90ed9d700 1 --2- 172.21.15.8:0/2317985311 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd91015db70 0x7fd91015dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:33.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.664+0000 7fd90dd9b700 1 -- 172.21.15.8:0/2317985311 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd91015db70 msgr2=0x7fd91015dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:33.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.664+0000 7fd90dd9b700 1 --2- 172.21.15.8:0/2317985311 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd91015db70 0x7fd91015dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:33.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.664+0000 7fd90dd9b700 1 -- 172.21.15.8:0/2317985311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8fc003a60 msgr2=0x7fd910169320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:33.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.664+0000 7fd90dd9b700 1 --2- 172.21.15.8:0/2317985311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8fc003a60 0x7fd910169320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:33.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.664+0000 7fd90dd9b700 1 -- 172.21.15.8:0/2317985311 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9100ab1a0 con 0x7fd9100aa6e0 2023-10-06T04:37:33.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.664+0000 7fd90dd9b700 1 --2- 172.21.15.8:0/2317985311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9100aa6e0 0x7fd9100aab50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8011cc0 tx=0x7fd8f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:33.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.664+0000 7fd9067fc700 1 -- 172.21.15.8:0/2317985311 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f800fac0 con 0x7fd9100aa6e0 2023-10-06T04:37:33.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.664+0000 7fd9067fc700 1 -- 172.21.15.8:0/2317985311 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f800fc20 con 0x7fd9100aa6e0 2023-10-06T04:37:33.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.664+0000 7fd914c7a700 1 -- 172.21.15.8:0/2317985311 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9100a55e0 con 0x7fd9100aa6e0 2023-10-06T04:37:33.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.664+0000 7fd9067fc700 1 -- 172.21.15.8:0/2317985311 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8014440 con 0x7fd9100aa6e0 2023-10-06T04:37:33.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.664+0000 7fd914c7a700 1 -- 172.21.15.8:0/2317985311 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9100a5ba0 con 0x7fd9100aa6e0 2023-10-06T04:37:33.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.665+0000 7fd914c7a700 1 -- 172.21.15.8:0/2317985311 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd91006b340 con 0x7fd9100aa6e0 2023-10-06T04:37:33.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.666+0000 7fd9067fc700 1 -- 172.21.15.8:0/2317985311 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd8f8014870 con 0x7fd9100aa6e0 2023-10-06T04:37:33.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.666+0000 7fd9067fc700 1 --2- 172.21.15.8:0/2317985311 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd8f0066f30 0x7fd8f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:33.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.666+0000 7fd9067fc700 1 -- 172.21.15.8:0/2317985311 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7fd8f8018030 con 0x7fd9100aa6e0 2023-10-06T04:37:33.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.666+0000 7fd90e59c700 1 --2- 172.21.15.8:0/2317985311 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd8f0066f30 0x7fd8f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:33.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.667+0000 7fd90e59c700 1 --2- 172.21.15.8:0/2317985311 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd8f0066f30 0x7fd8f00693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd90800c3f0 tx=0x7fd908015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:33.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.670+0000 7fd9067fc700 1 -- 172.21.15.8:0/2317985311 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd8f80521e0 con 0x7fd9100aa6e0 2023-10-06T04:37:33.763 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-06T04:37:33.762+0000 7f590d582700 -1 log_channel(cluster) log [ERR] : Health check update: 2 filesystems are offline (MDS_ALL_DOWN) 2023-10-06T04:37:33.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.860+0000 7fd914c7a700 1 -- 172.21.15.8:0/2317985311 --> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd9100648a0 con 0x7fd8f0066f30 2023-10-06T04:37:33.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.871+0000 7fd9067fc700 1 -- 172.21.15.8:0/2317985311 <== mgr.4105 v2:172.21.15.184:6832/90283 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+391385 (secure 0 0 0) 0x7fd9100648a0 con 0x7fd8f0066f30 2023-10-06T04:37:33.877 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:33.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.875+0000 7fd914c7a700 1 -- 172.21.15.8:0/2317985311 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd8f0066f30 msgr2=0x7fd8f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:33.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.875+0000 7fd914c7a700 1 --2- 172.21.15.8:0/2317985311 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd8f0066f30 0x7fd8f00693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd90800c3f0 tx=0x7fd908015000 comp rx=0 tx=0).stop 2023-10-06T04:37:33.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.875+0000 7fd914c7a700 1 -- 172.21.15.8:0/2317985311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9100aa6e0 msgr2=0x7fd9100aab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:33.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.875+0000 7fd914c7a700 1 --2- 172.21.15.8:0/2317985311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9100aa6e0 0x7fd9100aab50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8011cc0 tx=0x7fd8f80091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:33.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.875+0000 7fd914c7a700 1 -- 172.21.15.8:0/2317985311 shutdown_connections 2023-10-06T04:37:33.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.875+0000 7fd914c7a700 1 --2- 172.21.15.8:0/2317985311 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd8f0066f30 0x7fd8f00693e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:33.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.875+0000 7fd914c7a700 1 --2- 172.21.15.8:0/2317985311 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd91015db70 0x7fd91015dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:33.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.875+0000 7fd914c7a700 1 --2- 172.21.15.8:0/2317985311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8fc003a60 0x7fd910169320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:33.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.875+0000 7fd914c7a700 1 --2- 172.21.15.8:0/2317985311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9100aa6e0 0x7fd9100aab50 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:33.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.875+0000 7fd914c7a700 1 -- 172.21.15.8:0/2317985311 >> 172.21.15.8:0/2317985311 conn(0x7fd910068070 msgr2=0x7fd910153b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:33.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.875+0000 7fd914c7a700 1 -- 172.21.15.8:0/2317985311 shutdown_connections 2023-10-06T04:37:33.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:33.875+0000 7fd914c7a700 1 -- 172.21.15.8:0/2317985311 wait complete. 2023-10-06T04:37:33.881 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-06T04:37:33.888 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2023-10-06T04:37:32.649456+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6881824,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":100,"num_write":256,"num_write_kb":8601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":703,"ondisk_log_size":703,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":216,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2395740,"kb_used_data":17436,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752578980,"statfs":{"total":773094113280,"available":770640875520,"internally_reserved":0,"allocated":17854464,"data_stored":15646602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11726,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":45,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.870682"},"pg_stats":[{"pgid":"7.3f","version":"38'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.003905+0000","last_change":"2023-10-06T04:37:17.540825+0000","last_active":"2023-10-06T04:37:27.003905+0000","last_peered":"2023-10-06T04:37:27.003905+0000","last_clean":"2023-10-06T04:37:27.003905+0000","last_became_active":"2023-10-06T04:37:17.540537+0000","last_became_peered":"2023-10-06T04:37:17.540537+0000","last_unstale":"2023-10-06T04:37:27.003905+0000","last_undegraded":"2023-10-06T04:37:27.003905+0000","last_fullsized":"2023-10-06T04:37:27.003905+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:27.083777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"38'4","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010044+0000","last_change":"2023-10-06T04:37:17.550627+0000","last_active":"2023-10-06T04:37:27.010044+0000","last_peered":"2023-10-06T04:37:27.010044+0000","last_clean":"2023-10-06T04:37:27.010044+0000","last_became_active":"2023-10-06T04:37:17.550395+0000","last_became_peered":"2023-10-06T04:37:17.550395+0000","last_unstale":"2023-10-06T04:37:27.010044+0000","last_undegraded":"2023-10-06T04:37:27.010044+0000","last_fullsized":"2023-10-06T04:37:27.010044+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:49.714446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"38'7","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779750+0000","last_change":"2023-10-06T04:37:17.541131+0000","last_active":"2023-10-06T04:37:26.779750+0000","last_peered":"2023-10-06T04:37:26.779750+0000","last_clean":"2023-10-06T04:37:26.779750+0000","last_became_active":"2023-10-06T04:37:17.540816+0000","last_became_peered":"2023-10-06T04:37:17.540816+0000","last_unstale":"2023-10-06T04:37:26.779750+0000","last_undegraded":"2023-10-06T04:37:26.779750+0000","last_fullsized":"2023-10-06T04:37:26.779750+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:32:45.542874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"38'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010129+0000","last_change":"2023-10-06T04:37:17.545649+0000","last_active":"2023-10-06T04:37:27.010129+0000","last_peered":"2023-10-06T04:37:27.010129+0000","last_clean":"2023-10-06T04:37:27.010129+0000","last_became_active":"2023-10-06T04:37:17.545155+0000","last_became_peered":"2023-10-06T04:37:17.545155+0000","last_unstale":"2023-10-06T04:37:27.010129+0000","last_undegraded":"2023-10-06T04:37:27.010129+0000","last_fullsized":"2023-10-06T04:37:27.010129+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:09.823506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"38'4","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010286+0000","last_change":"2023-10-06T04:37:17.545451+0000","last_active":"2023-10-06T04:37:27.010286+0000","last_peered":"2023-10-06T04:37:27.010286+0000","last_clean":"2023-10-06T04:37:27.010286+0000","last_became_active":"2023-10-06T04:37:17.545135+0000","last_became_peered":"2023-10-06T04:37:17.545135+0000","last_unstale":"2023-10-06T04:37:27.010286+0000","last_undegraded":"2023-10-06T04:37:27.010286+0000","last_fullsized":"2023-10-06T04:37:27.010286+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:44.628778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"38'6","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.011289+0000","last_change":"2023-10-06T04:37:17.545054+0000","last_active":"2023-10-06T04:37:27.011289+0000","last_peered":"2023-10-06T04:37:27.011289+0000","last_clean":"2023-10-06T04:37:27.011289+0000","last_became_active":"2023-10-06T04:37:17.544822+0000","last_became_peered":"2023-10-06T04:37:17.544822+0000","last_unstale":"2023-10-06T04:37:27.011289+0000","last_undegraded":"2023-10-06T04:37:27.011289+0000","last_fullsized":"2023-10-06T04:37:27.011289+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:28:51.824521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"38'5","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.004522+0000","last_change":"2023-10-06T04:37:17.548819+0000","last_active":"2023-10-06T04:37:27.004522+0000","last_peered":"2023-10-06T04:37:27.004522+0000","last_clean":"2023-10-06T04:37:27.004522+0000","last_became_active":"2023-10-06T04:37:17.548629+0000","last_became_peered":"2023-10-06T04:37:17.548629+0000","last_unstale":"2023-10-06T04:37:27.004522+0000","last_undegraded":"2023-10-06T04:37:27.004522+0000","last_fullsized":"2023-10-06T04:37:27.004522+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:04.973984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"38'9","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009297+0000","last_change":"2023-10-06T04:37:17.547124+0000","last_active":"2023-10-06T04:37:27.009297+0000","last_peered":"2023-10-06T04:37:27.009297+0000","last_clean":"2023-10-06T04:37:27.009297+0000","last_became_active":"2023-10-06T04:37:17.546879+0000","last_became_peered":"2023-10-06T04:37:17.546879+0000","last_unstale":"2023-10-06T04:37:27.009297+0000","last_undegraded":"2023-10-06T04:37:27.009297+0000","last_fullsized":"2023-10-06T04:37:27.009297+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:45.225371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"38'11","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009694+0000","last_change":"2023-10-06T04:37:17.537910+0000","last_active":"2023-10-06T04:37:27.009694+0000","last_peered":"2023-10-06T04:37:27.009694+0000","last_clean":"2023-10-06T04:37:27.009694+0000","last_became_active":"2023-10-06T04:37:17.535864+0000","last_became_peered":"2023-10-06T04:37:17.535864+0000","last_unstale":"2023-10-06T04:37:27.009694+0000","last_undegraded":"2023-10-06T04:37:27.009694+0000","last_fullsized":"2023-10-06T04:37:27.009694+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:58.928454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"38'15","reported_seq":28,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010318+0000","last_change":"2023-10-06T04:37:17.548489+0000","last_active":"2023-10-06T04:37:27.010318+0000","last_peered":"2023-10-06T04:37:27.010318+0000","last_clean":"2023-10-06T04:37:27.010318+0000","last_became_active":"2023-10-06T04:37:17.547714+0000","last_became_peered":"2023-10-06T04:37:17.547714+0000","last_unstale":"2023-10-06T04:37:27.010318+0000","last_undegraded":"2023-10-06T04:37:27.010318+0000","last_fullsized":"2023-10-06T04:37:27.010318+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:56.687459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"38'6","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009488+0000","last_change":"2023-10-06T04:37:17.544501+0000","last_active":"2023-10-06T04:37:27.009488+0000","last_peered":"2023-10-06T04:37:27.009488+0000","last_clean":"2023-10-06T04:37:27.009488+0000","last_became_active":"2023-10-06T04:37:17.541822+0000","last_became_peered":"2023-10-06T04:37:17.541822+0000","last_unstale":"2023-10-06T04:37:27.009488+0000","last_undegraded":"2023-10-06T04:37:27.009488+0000","last_fullsized":"2023-10-06T04:37:27.009488+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:32:45.542874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"38'7","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009885+0000","last_change":"2023-10-06T04:37:17.545538+0000","last_active":"2023-10-06T04:37:27.009885+0000","last_peered":"2023-10-06T04:37:27.009885+0000","last_clean":"2023-10-06T04:37:27.009885+0000","last_became_active":"2023-10-06T04:37:17.545027+0000","last_became_peered":"2023-10-06T04:37:17.545027+0000","last_unstale":"2023-10-06T04:37:27.009885+0000","last_undegraded":"2023-10-06T04:37:27.009885+0000","last_fullsized":"2023-10-06T04:37:27.009885+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:23.847066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"38'10","reported_seq":23,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:37:28.775107+0000","last_change":"2023-10-06T04:37:17.541986+0000","last_active":"2023-10-06T04:37:28.775107+0000","last_peered":"2023-10-06T04:37:28.775107+0000","last_clean":"2023-10-06T04:37:28.775107+0000","last_became_active":"2023-10-06T04:37:17.541707+0000","last_became_peered":"2023-10-06T04:37:17.541707+0000","last_unstale":"2023-10-06T04:37:28.775107+0000","last_undegraded":"2023-10-06T04:37:28.775107+0000","last_fullsized":"2023-10-06T04:37:28.775107+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:25.707658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"38'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009443+0000","last_change":"2023-10-06T04:37:17.536298+0000","last_active":"2023-10-06T04:37:27.009443+0000","last_peered":"2023-10-06T04:37:27.009443+0000","last_clean":"2023-10-06T04:37:27.009443+0000","last_became_active":"2023-10-06T04:37:17.535937+0000","last_became_peered":"2023-10-06T04:37:17.535937+0000","last_unstale":"2023-10-06T04:37:27.009443+0000","last_undegraded":"2023-10-06T04:37:27.009443+0000","last_fullsized":"2023-10-06T04:37:27.009443+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:01.324339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"38'7","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010623+0000","last_change":"2023-10-06T04:37:17.538786+0000","last_active":"2023-10-06T04:37:27.010623+0000","last_peered":"2023-10-06T04:37:27.010623+0000","last_clean":"2023-10-06T04:37:27.010623+0000","last_became_active":"2023-10-06T04:37:17.538493+0000","last_became_peered":"2023-10-06T04:37:17.538493+0000","last_unstale":"2023-10-06T04:37:27.010623+0000","last_undegraded":"2023-10-06T04:37:27.010623+0000","last_fullsized":"2023-10-06T04:37:27.010623+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:09.823506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"38'9","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009207+0000","last_change":"2023-10-06T04:37:17.552277+0000","last_active":"2023-10-06T04:37:27.009207+0000","last_peered":"2023-10-06T04:37:27.009207+0000","last_clean":"2023-10-06T04:37:27.009207+0000","last_became_active":"2023-10-06T04:37:17.552001+0000","last_became_peered":"2023-10-06T04:37:17.552001+0000","last_unstale":"2023-10-06T04:37:27.009207+0000","last_undegraded":"2023-10-06T04:37:27.009207+0000","last_fullsized":"2023-10-06T04:37:27.009207+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:41.211245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"38'9","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779847+0000","last_change":"2023-10-06T04:37:17.547373+0000","last_active":"2023-10-06T04:37:26.779847+0000","last_peered":"2023-10-06T04:37:26.779847+0000","last_clean":"2023-10-06T04:37:26.779847+0000","last_became_active":"2023-10-06T04:37:17.547103+0000","last_became_peered":"2023-10-06T04:37:17.547103+0000","last_unstale":"2023-10-06T04:37:26.779847+0000","last_undegraded":"2023-10-06T04:37:26.779847+0000","last_fullsized":"2023-10-06T04:37:26.779847+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:09.823506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"38'10","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779780+0000","last_change":"2023-10-06T04:37:17.554683+0000","last_active":"2023-10-06T04:37:26.779780+0000","last_peered":"2023-10-06T04:37:26.779780+0000","last_clean":"2023-10-06T04:37:26.779780+0000","last_became_active":"2023-10-06T04:37:17.554412+0000","last_became_peered":"2023-10-06T04:37:17.554412+0000","last_unstale":"2023-10-06T04:37:26.779780+0000","last_undegraded":"2023-10-06T04:37:26.779780+0000","last_fullsized":"2023-10-06T04:37:26.779780+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:56.687459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"38'7","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009419+0000","last_change":"2023-10-06T04:37:17.551197+0000","last_active":"2023-10-06T04:37:27.009419+0000","last_peered":"2023-10-06T04:37:27.009419+0000","last_clean":"2023-10-06T04:37:27.009419+0000","last_became_active":"2023-10-06T04:37:17.550633+0000","last_became_peered":"2023-10-06T04:37:17.550633+0000","last_unstale":"2023-10-06T04:37:27.009419+0000","last_undegraded":"2023-10-06T04:37:27.009419+0000","last_fullsized":"2023-10-06T04:37:27.009419+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:25.707658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"38'8","reported_seq":21,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:37:28.775146+0000","last_change":"2023-10-06T04:37:17.541139+0000","last_active":"2023-10-06T04:37:28.775146+0000","last_peered":"2023-10-06T04:37:28.775146+0000","last_clean":"2023-10-06T04:37:28.775146+0000","last_became_active":"2023-10-06T04:37:17.540844+0000","last_became_peered":"2023-10-06T04:37:17.540844+0000","last_unstale":"2023-10-06T04:37:28.775146+0000","last_undegraded":"2023-10-06T04:37:28.775146+0000","last_fullsized":"2023-10-06T04:37:28.775146+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:40.800271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"38'11","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.011635+0000","last_change":"2023-10-06T04:37:17.546023+0000","last_active":"2023-10-06T04:37:27.011635+0000","last_peered":"2023-10-06T04:37:27.011635+0000","last_clean":"2023-10-06T04:37:27.011635+0000","last_became_active":"2023-10-06T04:37:17.545428+0000","last_became_peered":"2023-10-06T04:37:17.545428+0000","last_unstale":"2023-10-06T04:37:27.011635+0000","last_undegraded":"2023-10-06T04:37:27.011635+0000","last_fullsized":"2023-10-06T04:37:27.011635+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:52.574192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"38'9","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009573+0000","last_change":"2023-10-06T04:37:17.546918+0000","last_active":"2023-10-06T04:37:27.009573+0000","last_peered":"2023-10-06T04:37:27.009573+0000","last_clean":"2023-10-06T04:37:27.009573+0000","last_became_active":"2023-10-06T04:37:17.546562+0000","last_became_peered":"2023-10-06T04:37:17.546562+0000","last_unstale":"2023-10-06T04:37:27.009573+0000","last_undegraded":"2023-10-06T04:37:27.009573+0000","last_fullsized":"2023-10-06T04:37:27.009573+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:18.119835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"38'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009254+0000","last_change":"2023-10-06T04:37:17.549490+0000","last_active":"2023-10-06T04:37:27.009254+0000","last_peered":"2023-10-06T04:37:27.009254+0000","last_clean":"2023-10-06T04:37:27.009254+0000","last_became_active":"2023-10-06T04:37:17.549294+0000","last_became_peered":"2023-10-06T04:37:17.549294+0000","last_unstale":"2023-10-06T04:37:27.009254+0000","last_undegraded":"2023-10-06T04:37:27.009254+0000","last_fullsized":"2023-10-06T04:37:27.009254+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:50.973957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"38'6","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009221+0000","last_change":"2023-10-06T04:37:17.548512+0000","last_active":"2023-10-06T04:37:27.009221+0000","last_peered":"2023-10-06T04:37:27.009221+0000","last_clean":"2023-10-06T04:37:27.009221+0000","last_became_active":"2023-10-06T04:37:17.547910+0000","last_became_peered":"2023-10-06T04:37:17.547910+0000","last_unstale":"2023-10-06T04:37:27.009221+0000","last_undegraded":"2023-10-06T04:37:27.009221+0000","last_fullsized":"2023-10-06T04:37:27.009221+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:15:49.332577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"38'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010270+0000","last_change":"2023-10-06T04:37:17.551312+0000","last_active":"2023-10-06T04:37:27.010270+0000","last_peered":"2023-10-06T04:37:27.010270+0000","last_clean":"2023-10-06T04:37:27.010270+0000","last_became_active":"2023-10-06T04:37:17.550973+0000","last_became_peered":"2023-10-06T04:37:17.550973+0000","last_unstale":"2023-10-06T04:37:27.010270+0000","last_undegraded":"2023-10-06T04:37:27.010270+0000","last_fullsized":"2023-10-06T04:37:27.010270+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:40.800271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"38'15","reported_seq":28,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:37:28.775234+0000","last_change":"2023-10-06T04:37:17.542441+0000","last_active":"2023-10-06T04:37:28.775234+0000","last_peered":"2023-10-06T04:37:28.775234+0000","last_clean":"2023-10-06T04:37:28.775234+0000","last_became_active":"2023-10-06T04:37:17.542184+0000","last_became_peered":"2023-10-06T04:37:17.542184+0000","last_unstale":"2023-10-06T04:37:28.775234+0000","last_undegraded":"2023-10-06T04:37:28.775234+0000","last_fullsized":"2023-10-06T04:37:28.775234+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:57.066657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"38'6","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779729+0000","last_change":"2023-10-06T04:37:17.546567+0000","last_active":"2023-10-06T04:37:26.779729+0000","last_peered":"2023-10-06T04:37:26.779729+0000","last_clean":"2023-10-06T04:37:26.779729+0000","last_became_active":"2023-10-06T04:37:17.546294+0000","last_became_peered":"2023-10-06T04:37:17.546294+0000","last_unstale":"2023-10-06T04:37:26.779729+0000","last_undegraded":"2023-10-06T04:37:26.779729+0000","last_fullsized":"2023-10-06T04:37:26.779729+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:19.011564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"38'4","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009688+0000","last_change":"2023-10-06T04:37:17.545684+0000","last_active":"2023-10-06T04:37:27.009688+0000","last_peered":"2023-10-06T04:37:27.009688+0000","last_clean":"2023-10-06T04:37:27.009688+0000","last_became_active":"2023-10-06T04:37:17.545341+0000","last_became_peered":"2023-10-06T04:37:17.545341+0000","last_unstale":"2023-10-06T04:37:27.009688+0000","last_undegraded":"2023-10-06T04:37:27.009688+0000","last_fullsized":"2023-10-06T04:37:27.009688+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:04.973984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"38'7","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009408+0000","last_change":"2023-10-06T04:37:17.551198+0000","last_active":"2023-10-06T04:37:27.009408+0000","last_peered":"2023-10-06T04:37:27.009408+0000","last_clean":"2023-10-06T04:37:27.009408+0000","last_became_active":"2023-10-06T04:37:17.550871+0000","last_became_peered":"2023-10-06T04:37:17.550871+0000","last_unstale":"2023-10-06T04:37:27.009408+0000","last_undegraded":"2023-10-06T04:37:27.009408+0000","last_fullsized":"2023-10-06T04:37:27.009408+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:43.463619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"38'8","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779635+0000","last_change":"2023-10-06T04:37:17.544638+0000","last_active":"2023-10-06T04:37:26.779635+0000","last_peered":"2023-10-06T04:37:26.779635+0000","last_clean":"2023-10-06T04:37:26.779635+0000","last_became_active":"2023-10-06T04:37:17.544358+0000","last_became_peered":"2023-10-06T04:37:17.544358+0000","last_unstale":"2023-10-06T04:37:26.779635+0000","last_undegraded":"2023-10-06T04:37:26.779635+0000","last_fullsized":"2023-10-06T04:37:26.779635+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:16.140442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"38'12","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010754+0000","last_change":"2023-10-06T04:37:17.547875+0000","last_active":"2023-10-06T04:37:27.010754+0000","last_peered":"2023-10-06T04:37:27.010754+0000","last_clean":"2023-10-06T04:37:27.010754+0000","last_became_active":"2023-10-06T04:37:17.547504+0000","last_became_peered":"2023-10-06T04:37:17.547504+0000","last_unstale":"2023-10-06T04:37:27.010754+0000","last_undegraded":"2023-10-06T04:37:27.010754+0000","last_fullsized":"2023-10-06T04:37:27.010754+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:37.661915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"38'9","reported_seq":22,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:37:28.775022+0000","last_change":"2023-10-06T04:37:17.535486+0000","last_active":"2023-10-06T04:37:28.775022+0000","last_peered":"2023-10-06T04:37:28.775022+0000","last_clean":"2023-10-06T04:37:28.775022+0000","last_became_active":"2023-10-06T04:37:17.535215+0000","last_became_peered":"2023-10-06T04:37:17.535215+0000","last_unstale":"2023-10-06T04:37:28.775022+0000","last_undegraded":"2023-10-06T04:37:28.775022+0000","last_fullsized":"2023-10-06T04:37:28.775022+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:01.221591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781623+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:49.912213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"38'5","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009428+0000","last_change":"2023-10-06T04:37:17.540682+0000","last_active":"2023-10-06T04:37:27.009428+0000","last_peered":"2023-10-06T04:37:27.009428+0000","last_clean":"2023-10-06T04:37:27.009428+0000","last_became_active":"2023-10-06T04:37:17.540340+0000","last_became_peered":"2023-10-06T04:37:17.540340+0000","last_unstale":"2023-10-06T04:37:27.009428+0000","last_undegraded":"2023-10-06T04:37:27.009428+0000","last_fullsized":"2023-10-06T04:37:27.009428+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:57.066657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"39'8","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.012800+0000","last_change":"2023-10-06T04:37:16.539316+0000","last_active":"2023-10-06T04:37:27.012800+0000","last_peered":"2023-10-06T04:37:27.012800+0000","last_clean":"2023-10-06T04:37:27.012800+0000","last_became_active":"2023-10-06T04:37:16.538848+0000","last_became_peered":"2023-10-06T04:37:16.538848+0000","last_unstale":"2023-10-06T04:37:27.012800+0000","last_undegraded":"2023-10-06T04:37:27.012800+0000","last_fullsized":"2023-10-06T04:37:27.012800+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:44:55.156828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.780190+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:29:04.074820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"38'6","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010134+0000","last_change":"2023-10-06T04:37:17.549963+0000","last_active":"2023-10-06T04:37:27.010134+0000","last_peered":"2023-10-06T04:37:27.010134+0000","last_clean":"2023-10-06T04:37:27.010134+0000","last_became_active":"2023-10-06T04:37:17.545289+0000","last_became_peered":"2023-10-06T04:37:17.545289+0000","last_unstale":"2023-10-06T04:37:27.010134+0000","last_undegraded":"2023-10-06T04:37:27.010134+0000","last_fullsized":"2023-10-06T04:37:27.010134+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:01.221591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"37'1","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779943+0000","last_change":"2023-10-06T04:37:16.539806+0000","last_active":"2023-10-06T04:37:26.779943+0000","last_peered":"2023-10-06T04:37:26.779943+0000","last_clean":"2023-10-06T04:37:26.779943+0000","last_became_active":"2023-10-06T04:37:16.539514+0000","last_became_peered":"2023-10-06T04:37:16.539514+0000","last_unstale":"2023-10-06T04:37:26.779943+0000","last_undegraded":"2023-10-06T04:37:26.779943+0000","last_fullsized":"2023-10-06T04:37:26.779943+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:48.710239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":2,"reported_epoch":45,"state":"creating+activating","last_fresh":"2023-10-06T04:37:29.782949+0000","last_change":"2023-10-06T04:37:29.783069+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:29.782949+0000","last_undegraded":"2023-10-06T04:37:29.782949+0000","last_fullsized":"2023-10-06T04:37:29.782949+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:59.689245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"38'9","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009806+0000","last_change":"2023-10-06T04:37:17.549931+0000","last_active":"2023-10-06T04:37:27.009806+0000","last_peered":"2023-10-06T04:37:27.009806+0000","last_clean":"2023-10-06T04:37:27.009806+0000","last_became_active":"2023-10-06T04:37:17.549668+0000","last_became_peered":"2023-10-06T04:37:17.549668+0000","last_unstale":"2023-10-06T04:37:27.009806+0000","last_undegraded":"2023-10-06T04:37:27.009806+0000","last_fullsized":"2023-10-06T04:37:27.009806+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:27.083777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"39'3","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010418+0000","last_change":"2023-10-06T04:37:16.546111+0000","last_active":"2023-10-06T04:37:27.010418+0000","last_peered":"2023-10-06T04:37:27.010418+0000","last_clean":"2023-10-06T04:37:27.010418+0000","last_became_active":"2023-10-06T04:37:16.545811+0000","last_became_peered":"2023-10-06T04:37:16.545811+0000","last_unstale":"2023-10-06T04:37:27.010418+0000","last_undegraded":"2023-10-06T04:37:27.010418+0000","last_fullsized":"2023-10-06T04:37:27.010418+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:30.574778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.776912+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:04:11.178752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"38'15","reported_seq":28,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010260+0000","last_change":"2023-10-06T04:37:17.546138+0000","last_active":"2023-10-06T04:37:27.010260+0000","last_peered":"2023-10-06T04:37:27.010260+0000","last_clean":"2023-10-06T04:37:27.010260+0000","last_became_active":"2023-10-06T04:37:17.545845+0000","last_became_peered":"2023-10-06T04:37:17.545845+0000","last_unstale":"2023-10-06T04:37:27.010260+0000","last_undegraded":"2023-10-06T04:37:27.010260+0000","last_fullsized":"2023-10-06T04:37:27.010260+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:25.707658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"39'3","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.004858+0000","last_change":"2023-10-06T04:37:16.545947+0000","last_active":"2023-10-06T04:37:27.004858+0000","last_peered":"2023-10-06T04:37:27.004858+0000","last_clean":"2023-10-06T04:37:27.004858+0000","last_became_active":"2023-10-06T04:37:16.545700+0000","last_became_peered":"2023-10-06T04:37:16.545700+0000","last_unstale":"2023-10-06T04:37:27.004858+0000","last_undegraded":"2023-10-06T04:37:27.004858+0000","last_fullsized":"2023-10-06T04:37:27.004858+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:56.062450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.780593+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:57.475670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"38'7","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779634+0000","last_change":"2023-10-06T04:37:17.543400+0000","last_active":"2023-10-06T04:37:26.779634+0000","last_peered":"2023-10-06T04:37:26.779634+0000","last_clean":"2023-10-06T04:37:26.779634+0000","last_became_active":"2023-10-06T04:37:17.543132+0000","last_became_peered":"2023-10-06T04:37:17.543132+0000","last_unstale":"2023-10-06T04:37:26.779634+0000","last_undegraded":"2023-10-06T04:37:26.779634+0000","last_fullsized":"2023-10-06T04:37:26.779634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:50:28.268338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"37'1","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.011758+0000","last_change":"2023-10-06T04:37:16.541989+0000","last_active":"2023-10-06T04:37:27.011758+0000","last_peered":"2023-10-06T04:37:27.011758+0000","last_clean":"2023-10-06T04:37:27.011758+0000","last_became_active":"2023-10-06T04:37:16.541684+0000","last_became_peered":"2023-10-06T04:37:16.541684+0000","last_unstale":"2023-10-06T04:37:27.011758+0000","last_undegraded":"2023-10-06T04:37:27.011758+0000","last_fullsized":"2023-10-06T04:37:27.011758+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:13.019515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.779525+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:44:04.529543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"38'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009900+0000","last_change":"2023-10-06T04:37:17.546677+0000","last_active":"2023-10-06T04:37:27.009900+0000","last_peered":"2023-10-06T04:37:27.009900+0000","last_clean":"2023-10-06T04:37:27.009900+0000","last_became_active":"2023-10-06T04:37:17.546151+0000","last_became_peered":"2023-10-06T04:37:17.546151+0000","last_unstale":"2023-10-06T04:37:27.009900+0000","last_undegraded":"2023-10-06T04:37:27.009900+0000","last_fullsized":"2023-10-06T04:37:27.009900+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:16.140442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"37'1","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779812+0000","last_change":"2023-10-06T04:37:16.545939+0000","last_active":"2023-10-06T04:37:26.779812+0000","last_peered":"2023-10-06T04:37:26.779812+0000","last_clean":"2023-10-06T04:37:26.779812+0000","last_became_active":"2023-10-06T04:37:16.545722+0000","last_became_peered":"2023-10-06T04:37:16.545722+0000","last_unstale":"2023-10-06T04:37:26.779812+0000","last_undegraded":"2023-10-06T04:37:26.779812+0000","last_fullsized":"2023-10-06T04:37:26.779812+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:22.842860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781194+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:04.824490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"38'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009417+0000","last_change":"2023-10-06T04:37:17.547055+0000","last_active":"2023-10-06T04:37:27.009417+0000","last_peered":"2023-10-06T04:37:27.009417+0000","last_clean":"2023-10-06T04:37:27.009417+0000","last_became_active":"2023-10-06T04:37:17.546777+0000","last_became_peered":"2023-10-06T04:37:17.546777+0000","last_unstale":"2023-10-06T04:37:27.009417+0000","last_undegraded":"2023-10-06T04:37:27.009417+0000","last_fullsized":"2023-10-06T04:37:27.009417+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:28:51.824521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009578+0000","last_change":"2023-10-06T04:37:16.544251+0000","last_active":"2023-10-06T04:37:27.009578+0000","last_peered":"2023-10-06T04:37:27.009578+0000","last_clean":"2023-10-06T04:37:27.009578+0000","last_became_active":"2023-10-06T04:37:16.543853+0000","last_became_peered":"2023-10-06T04:37:16.543853+0000","last_unstale":"2023-10-06T04:37:27.009578+0000","last_undegraded":"2023-10-06T04:37:27.009578+0000","last_fullsized":"2023-10-06T04:37:27.009578+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:00.217384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":2,"reported_epoch":45,"state":"creating+activating","last_fresh":"2023-10-06T04:37:29.780968+0000","last_change":"2023-10-06T04:37:29.781107+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:29.780968+0000","last_undegraded":"2023-10-06T04:37:29.780968+0000","last_fullsized":"2023-10-06T04:37:29.780968+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:38:07.292570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"38'10","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009367+0000","last_change":"2023-10-06T04:37:17.550653+0000","last_active":"2023-10-06T04:37:27.009367+0000","last_peered":"2023-10-06T04:37:27.009367+0000","last_clean":"2023-10-06T04:37:27.009367+0000","last_became_active":"2023-10-06T04:37:17.550308+0000","last_became_peered":"2023-10-06T04:37:17.550308+0000","last_unstale":"2023-10-06T04:37:27.009367+0000","last_undegraded":"2023-10-06T04:37:27.009367+0000","last_fullsized":"2023-10-06T04:37:27.009367+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:06:24.079323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009535+0000","last_change":"2023-10-06T04:37:16.539539+0000","last_active":"2023-10-06T04:37:27.009535+0000","last_peered":"2023-10-06T04:37:27.009535+0000","last_clean":"2023-10-06T04:37:27.009535+0000","last_became_active":"2023-10-06T04:37:16.536276+0000","last_became_peered":"2023-10-06T04:37:16.536276+0000","last_unstale":"2023-10-06T04:37:27.009535+0000","last_undegraded":"2023-10-06T04:37:27.009535+0000","last_fullsized":"2023-10-06T04:37:27.009535+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:23.725665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781025+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:00:08.937757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"38'10","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779872+0000","last_change":"2023-10-06T04:37:17.547330+0000","last_active":"2023-10-06T04:37:26.779872+0000","last_peered":"2023-10-06T04:37:26.779872+0000","last_clean":"2023-10-06T04:37:26.779872+0000","last_became_active":"2023-10-06T04:37:17.547088+0000","last_became_peered":"2023-10-06T04:37:17.547088+0000","last_unstale":"2023-10-06T04:37:26.779872+0000","last_undegraded":"2023-10-06T04:37:26.779872+0000","last_fullsized":"2023-10-06T04:37:26.779872+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:12.970309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779917+0000","last_change":"2023-10-06T04:37:16.543071+0000","last_active":"2023-10-06T04:37:26.779917+0000","last_peered":"2023-10-06T04:37:26.779917+0000","last_clean":"2023-10-06T04:37:26.779917+0000","last_became_active":"2023-10-06T04:37:16.542755+0000","last_became_peered":"2023-10-06T04:37:16.542755+0000","last_unstale":"2023-10-06T04:37:26.779917+0000","last_undegraded":"2023-10-06T04:37:26.779917+0000","last_fullsized":"2023-10-06T04:37:26.779917+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:03.969778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.779740+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:05:06.685138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"38'9","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.004023+0000","last_change":"2023-10-06T04:37:17.546184+0000","last_active":"2023-10-06T04:37:27.004023+0000","last_peered":"2023-10-06T04:37:27.004023+0000","last_clean":"2023-10-06T04:37:27.004023+0000","last_became_active":"2023-10-06T04:37:17.545899+0000","last_became_peered":"2023-10-06T04:37:17.545899+0000","last_unstale":"2023-10-06T04:37:27.004023+0000","last_undegraded":"2023-10-06T04:37:27.004023+0000","last_fullsized":"2023-10-06T04:37:27.004023+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:35.648661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010409+0000","last_change":"2023-10-06T04:37:16.539739+0000","last_active":"2023-10-06T04:37:27.010409+0000","last_peered":"2023-10-06T04:37:27.010409+0000","last_clean":"2023-10-06T04:37:27.010409+0000","last_became_active":"2023-10-06T04:37:16.539470+0000","last_became_peered":"2023-10-06T04:37:16.539470+0000","last_unstale":"2023-10-06T04:37:27.010409+0000","last_undegraded":"2023-10-06T04:37:27.010409+0000","last_fullsized":"2023-10-06T04:37:27.010409+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:23.078870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.779529+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:01.912316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"38'11","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.012346+0000","last_change":"2023-10-06T04:37:17.543287+0000","last_active":"2023-10-06T04:37:27.012346+0000","last_peered":"2023-10-06T04:37:27.012346+0000","last_clean":"2023-10-06T04:37:27.012346+0000","last_became_active":"2023-10-06T04:37:17.543018+0000","last_became_peered":"2023-10-06T04:37:17.543018+0000","last_unstale":"2023-10-06T04:37:27.012346+0000","last_undegraded":"2023-10-06T04:37:27.012346+0000","last_fullsized":"2023-10-06T04:37:27.012346+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:18.119835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"39'5","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.005169+0000","last_change":"2023-10-06T04:37:16.545863+0000","last_active":"2023-10-06T04:37:27.005169+0000","last_peered":"2023-10-06T04:37:27.005169+0000","last_clean":"2023-10-06T04:37:27.005169+0000","last_became_active":"2023-10-06T04:37:16.545563+0000","last_became_peered":"2023-10-06T04:37:16.545563+0000","last_unstale":"2023-10-06T04:37:27.005169+0000","last_undegraded":"2023-10-06T04:37:27.005169+0000","last_fullsized":"2023-10-06T04:37:27.005169+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:36.947789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781442+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:05:06.685138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"38'6","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.005042+0000","last_change":"2023-10-06T04:37:17.541763+0000","last_active":"2023-10-06T04:37:27.005042+0000","last_peered":"2023-10-06T04:37:27.005042+0000","last_clean":"2023-10-06T04:37:27.005042+0000","last_became_active":"2023-10-06T04:37:17.541287+0000","last_became_peered":"2023-10-06T04:37:17.541287+0000","last_unstale":"2023-10-06T04:37:27.005042+0000","last_undegraded":"2023-10-06T04:37:27.005042+0000","last_fullsized":"2023-10-06T04:37:27.005042+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:34.429052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"39'23","reported_seq":37,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:37:28.775230+0000","last_change":"2023-10-06T04:37:16.538841+0000","last_active":"2023-10-06T04:37:28.775230+0000","last_peered":"2023-10-06T04:37:28.775230+0000","last_clean":"2023-10-06T04:37:28.775230+0000","last_became_active":"2023-10-06T04:37:16.538555+0000","last_became_peered":"2023-10-06T04:37:16.538555+0000","last_unstale":"2023-10-06T04:37:28.775230+0000","last_undegraded":"2023-10-06T04:37:28.775230+0000","last_fullsized":"2023-10-06T04:37:28.775230+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:01:56.504476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781750+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:51.489837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"38'10","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009545+0000","last_change":"2023-10-06T04:37:17.554238+0000","last_active":"2023-10-06T04:37:27.009545+0000","last_peered":"2023-10-06T04:37:27.009545+0000","last_clean":"2023-10-06T04:37:27.009545+0000","last_became_active":"2023-10-06T04:37:17.553995+0000","last_became_peered":"2023-10-06T04:37:17.553995+0000","last_unstale":"2023-10-06T04:37:27.009545+0000","last_undegraded":"2023-10-06T04:37:27.009545+0000","last_fullsized":"2023-10-06T04:37:27.009545+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:57.066657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"39'5","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.012000+0000","last_change":"2023-10-06T04:37:16.545424+0000","last_active":"2023-10-06T04:37:27.012000+0000","last_peered":"2023-10-06T04:37:27.012000+0000","last_clean":"2023-10-06T04:37:27.012000+0000","last_became_active":"2023-10-06T04:37:16.545158+0000","last_became_peered":"2023-10-06T04:37:16.545158+0000","last_unstale":"2023-10-06T04:37:27.012000+0000","last_undegraded":"2023-10-06T04:37:27.012000+0000","last_fullsized":"2023-10-06T04:37:27.012000+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:03.969778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781643+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:30.370133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"38'15","reported_seq":28,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009983+0000","last_change":"2023-10-06T04:37:17.543599+0000","last_active":"2023-10-06T04:37:27.009983+0000","last_peered":"2023-10-06T04:37:27.009983+0000","last_clean":"2023-10-06T04:37:27.009983+0000","last_became_active":"2023-10-06T04:37:17.543271+0000","last_became_peered":"2023-10-06T04:37:17.543271+0000","last_unstale":"2023-10-06T04:37:27.009983+0000","last_undegraded":"2023-10-06T04:37:27.009983+0000","last_fullsized":"2023-10-06T04:37:27.009983+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:37.661915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.004892+0000","last_change":"2023-10-06T04:37:16.541456+0000","last_active":"2023-10-06T04:37:27.004892+0000","last_peered":"2023-10-06T04:37:27.004892+0000","last_clean":"2023-10-06T04:37:27.004892+0000","last_became_active":"2023-10-06T04:37:16.541189+0000","last_became_peered":"2023-10-06T04:37:16.541189+0000","last_unstale":"2023-10-06T04:37:27.004892+0000","last_undegraded":"2023-10-06T04:37:27.004892+0000","last_fullsized":"2023-10-06T04:37:27.004892+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:23.078870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781759+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:07.671768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"38'6","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010461+0000","last_change":"2023-10-06T04:37:17.541658+0000","last_active":"2023-10-06T04:37:27.010461+0000","last_peered":"2023-10-06T04:37:27.010461+0000","last_clean":"2023-10-06T04:37:27.010461+0000","last_became_active":"2023-10-06T04:37:17.541349+0000","last_became_peered":"2023-10-06T04:37:17.541349+0000","last_unstale":"2023-10-06T04:37:27.010461+0000","last_undegraded":"2023-10-06T04:37:27.010461+0000","last_fullsized":"2023-10-06T04:37:27.010461+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:56.687459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010952+0000","last_change":"2023-10-06T04:37:16.545596+0000","last_active":"2023-10-06T04:37:27.010952+0000","last_peered":"2023-10-06T04:37:27.010952+0000","last_clean":"2023-10-06T04:37:27.010952+0000","last_became_active":"2023-10-06T04:37:16.545334+0000","last_became_peered":"2023-10-06T04:37:16.545334+0000","last_unstale":"2023-10-06T04:37:27.010952+0000","last_undegraded":"2023-10-06T04:37:27.010952+0000","last_fullsized":"2023-10-06T04:37:27.010952+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:26.079570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":2,"reported_epoch":45,"state":"creating+activating","last_fresh":"2023-10-06T04:37:29.781315+0000","last_change":"2023-10-06T04:37:29.781451+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:29.781315+0000","last_undegraded":"2023-10-06T04:37:29.781315+0000","last_fullsized":"2023-10-06T04:37:29.781315+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:19:45.702967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"38'6","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.004641+0000","last_change":"2023-10-06T04:37:17.552402+0000","last_active":"2023-10-06T04:37:27.004641+0000","last_peered":"2023-10-06T04:37:27.004641+0000","last_clean":"2023-10-06T04:37:27.004641+0000","last_became_active":"2023-10-06T04:37:17.552167+0000","last_became_peered":"2023-10-06T04:37:17.552167+0000","last_unstale":"2023-10-06T04:37:27.004641+0000","last_undegraded":"2023-10-06T04:37:27.004641+0000","last_fullsized":"2023-10-06T04:37:27.004641+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:14.023722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"39'15","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009650+0000","last_change":"2023-10-06T04:37:16.545180+0000","last_active":"2023-10-06T04:37:27.009650+0000","last_peered":"2023-10-06T04:37:27.009650+0000","last_clean":"2023-10-06T04:37:27.009650+0000","last_became_active":"2023-10-06T04:37:16.544707+0000","last_became_peered":"2023-10-06T04:37:16.544707+0000","last_unstale":"2023-10-06T04:37:27.009650+0000","last_undegraded":"2023-10-06T04:37:27.009650+0000","last_fullsized":"2023-10-06T04:37:27.009650+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:49.969750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.784527+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:03:50.233469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"38'5","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:37:28.775240+0000","last_change":"2023-10-06T04:37:17.545469+0000","last_active":"2023-10-06T04:37:28.775240+0000","last_peered":"2023-10-06T04:37:28.775240+0000","last_clean":"2023-10-06T04:37:28.775240+0000","last_became_active":"2023-10-06T04:37:17.545212+0000","last_became_peered":"2023-10-06T04:37:17.545212+0000","last_unstale":"2023-10-06T04:37:28.775240+0000","last_undegraded":"2023-10-06T04:37:28.775240+0000","last_fullsized":"2023-10-06T04:37:28.775240+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:41.211245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"39'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:37:28.775128+0000","last_change":"2023-10-06T04:37:16.537956+0000","last_active":"2023-10-06T04:37:28.775128+0000","last_peered":"2023-10-06T04:37:28.775128+0000","last_clean":"2023-10-06T04:37:28.775128+0000","last_became_active":"2023-10-06T04:37:16.537733+0000","last_became_peered":"2023-10-06T04:37:16.537733+0000","last_unstale":"2023-10-06T04:37:28.775128+0000","last_undegraded":"2023-10-06T04:37:28.775128+0000","last_fullsized":"2023-10-06T04:37:28.775128+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:26:53.482793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":2,"reported_epoch":45,"state":"creating+activating","last_fresh":"2023-10-06T04:37:29.781336+0000","last_change":"2023-10-06T04:37:29.781477+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:29.781336+0000","last_undegraded":"2023-10-06T04:37:29.781336+0000","last_fullsized":"2023-10-06T04:37:29.781336+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:20.831560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":["3","5"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"38'9","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009765+0000","last_change":"2023-10-06T04:37:17.540242+0000","last_active":"2023-10-06T04:37:27.009765+0000","last_peered":"2023-10-06T04:37:27.009765+0000","last_clean":"2023-10-06T04:37:27.009765+0000","last_became_active":"2023-10-06T04:37:17.539986+0000","last_became_peered":"2023-10-06T04:37:17.539986+0000","last_unstale":"2023-10-06T04:37:27.009765+0000","last_undegraded":"2023-10-06T04:37:27.009765+0000","last_fullsized":"2023-10-06T04:37:27.009765+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:50:28.268338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"39'3","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779857+0000","last_change":"2023-10-06T04:37:16.541934+0000","last_active":"2023-10-06T04:37:26.779857+0000","last_peered":"2023-10-06T04:37:26.779857+0000","last_clean":"2023-10-06T04:37:26.779857+0000","last_became_active":"2023-10-06T04:37:16.539725+0000","last_became_peered":"2023-10-06T04:37:16.539725+0000","last_unstale":"2023-10-06T04:37:26.779857+0000","last_undegraded":"2023-10-06T04:37:26.779857+0000","last_fullsized":"2023-10-06T04:37:26.779857+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:44:55.156828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.783668+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:58.515292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"38'6","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010154+0000","last_change":"2023-10-06T04:37:17.550239+0000","last_active":"2023-10-06T04:37:27.010154+0000","last_peered":"2023-10-06T04:37:27.010154+0000","last_clean":"2023-10-06T04:37:27.010154+0000","last_became_active":"2023-10-06T04:37:17.549997+0000","last_became_peered":"2023-10-06T04:37:17.549997+0000","last_unstale":"2023-10-06T04:37:27.010154+0000","last_undegraded":"2023-10-06T04:37:27.010154+0000","last_fullsized":"2023-10-06T04:37:27.010154+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:24.083076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"39'2","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009726+0000","last_change":"2023-10-06T04:37:16.544014+0000","last_active":"2023-10-06T04:37:27.009726+0000","last_peered":"2023-10-06T04:37:27.009726+0000","last_clean":"2023-10-06T04:37:27.009726+0000","last_became_active":"2023-10-06T04:37:16.543718+0000","last_became_peered":"2023-10-06T04:37:16.543718+0000","last_unstale":"2023-10-06T04:37:27.009726+0000","last_undegraded":"2023-10-06T04:37:27.009726+0000","last_fullsized":"2023-10-06T04:37:27.009726+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:39.796065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.779491+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:10:36.939764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"38'7","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009967+0000","last_change":"2023-10-06T04:37:17.551493+0000","last_active":"2023-10-06T04:37:27.009967+0000","last_peered":"2023-10-06T04:37:27.009967+0000","last_clean":"2023-10-06T04:37:27.009967+0000","last_became_active":"2023-10-06T04:37:17.550988+0000","last_became_peered":"2023-10-06T04:37:17.550988+0000","last_unstale":"2023-10-06T04:37:27.009967+0000","last_undegraded":"2023-10-06T04:37:27.009967+0000","last_fullsized":"2023-10-06T04:37:27.009967+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:33.731628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.012579+0000","last_change":"2023-10-06T04:37:16.537845+0000","last_active":"2023-10-06T04:37:27.012579+0000","last_peered":"2023-10-06T04:37:27.012579+0000","last_clean":"2023-10-06T04:37:27.012579+0000","last_became_active":"2023-10-06T04:37:16.537568+0000","last_became_peered":"2023-10-06T04:37:16.537568+0000","last_unstale":"2023-10-06T04:37:27.012579+0000","last_undegraded":"2023-10-06T04:37:27.012579+0000","last_fullsized":"2023-10-06T04:37:27.012579+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:43.624572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.776912+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:32:57.793172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"38'5","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.011164+0000","last_change":"2023-10-06T04:37:17.538502+0000","last_active":"2023-10-06T04:37:27.011164+0000","last_peered":"2023-10-06T04:37:27.011164+0000","last_clean":"2023-10-06T04:37:27.011164+0000","last_became_active":"2023-10-06T04:37:17.538215+0000","last_became_peered":"2023-10-06T04:37:17.538215+0000","last_unstale":"2023-10-06T04:37:27.011164+0000","last_undegraded":"2023-10-06T04:37:27.011164+0000","last_fullsized":"2023-10-06T04:37:27.011164+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:45.225371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"39'4","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.012118+0000","last_change":"2023-10-06T04:37:16.540351+0000","last_active":"2023-10-06T04:37:27.012118+0000","last_peered":"2023-10-06T04:37:27.012118+0000","last_clean":"2023-10-06T04:37:27.012118+0000","last_became_active":"2023-10-06T04:37:16.539257+0000","last_became_peered":"2023-10-06T04:37:16.539257+0000","last_unstale":"2023-10-06T04:37:27.012118+0000","last_undegraded":"2023-10-06T04:37:27.012118+0000","last_fullsized":"2023-10-06T04:37:27.012118+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:33.424846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781178+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:31.261862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"38'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009845+0000","last_change":"2023-10-06T04:37:17.546443+0000","last_active":"2023-10-06T04:37:27.009845+0000","last_peered":"2023-10-06T04:37:27.009845+0000","last_clean":"2023-10-06T04:37:27.009845+0000","last_became_active":"2023-10-06T04:37:17.546233+0000","last_became_peered":"2023-10-06T04:37:17.546233+0000","last_unstale":"2023-10-06T04:37:27.009845+0000","last_undegraded":"2023-10-06T04:37:27.009845+0000","last_fullsized":"2023-10-06T04:37:27.009845+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:41.211245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009787+0000","last_change":"2023-10-06T04:37:16.545188+0000","last_active":"2023-10-06T04:37:27.009787+0000","last_peered":"2023-10-06T04:37:27.009787+0000","last_clean":"2023-10-06T04:37:27.009787+0000","last_became_active":"2023-10-06T04:37:16.544735+0000","last_became_peered":"2023-10-06T04:37:16.544735+0000","last_unstale":"2023-10-06T04:37:27.009787+0000","last_undegraded":"2023-10-06T04:37:27.009787+0000","last_fullsized":"2023-10-06T04:37:27.009787+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:56.062450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.784055+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:49.503329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"38'9","reported_seq":22,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:37:28.775026+0000","last_change":"2023-10-06T04:37:17.544085+0000","last_active":"2023-10-06T04:37:28.775026+0000","last_peered":"2023-10-06T04:37:28.775026+0000","last_clean":"2023-10-06T04:37:28.775026+0000","last_became_active":"2023-10-06T04:37:17.543802+0000","last_became_peered":"2023-10-06T04:37:17.543802+0000","last_unstale":"2023-10-06T04:37:28.775026+0000","last_undegraded":"2023-10-06T04:37:28.775026+0000","last_fullsized":"2023-10-06T04:37:28.775026+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:31.578985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010008+0000","last_change":"2023-10-06T04:37:16.539674+0000","last_active":"2023-10-06T04:37:27.010008+0000","last_peered":"2023-10-06T04:37:27.010008+0000","last_clean":"2023-10-06T04:37:27.010008+0000","last_became_active":"2023-10-06T04:37:16.539399+0000","last_became_peered":"2023-10-06T04:37:16.539399+0000","last_unstale":"2023-10-06T04:37:27.010008+0000","last_undegraded":"2023-10-06T04:37:27.010008+0000","last_fullsized":"2023-10-06T04:37:27.010008+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:36.947789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.782348+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:14:52.399101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"38'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010119+0000","last_change":"2023-10-06T04:37:17.536857+0000","last_active":"2023-10-06T04:37:27.010119+0000","last_peered":"2023-10-06T04:37:27.010119+0000","last_clean":"2023-10-06T04:37:27.010119+0000","last_became_active":"2023-10-06T04:37:17.536593+0000","last_became_peered":"2023-10-06T04:37:17.536593+0000","last_unstale":"2023-10-06T04:37:27.010119+0000","last_undegraded":"2023-10-06T04:37:27.010119+0000","last_fullsized":"2023-10-06T04:37:27.010119+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:37.253030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.004474+0000","last_change":"2023-10-06T04:37:16.541430+0000","last_active":"2023-10-06T04:37:27.004474+0000","last_peered":"2023-10-06T04:37:27.004474+0000","last_clean":"2023-10-06T04:37:27.004474+0000","last_became_active":"2023-10-06T04:37:16.541211+0000","last_became_peered":"2023-10-06T04:37:16.541211+0000","last_unstale":"2023-10-06T04:37:27.004474+0000","last_undegraded":"2023-10-06T04:37:27.004474+0000","last_fullsized":"2023-10-06T04:37:27.004474+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:15:48.328371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781549+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:23.375847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"38'7","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.011879+0000","last_change":"2023-10-06T04:37:17.541674+0000","last_active":"2023-10-06T04:37:27.011879+0000","last_peered":"2023-10-06T04:37:27.011879+0000","last_clean":"2023-10-06T04:37:27.011879+0000","last_became_active":"2023-10-06T04:37:17.541397+0000","last_became_peered":"2023-10-06T04:37:17.541397+0000","last_unstale":"2023-10-06T04:37:27.011879+0000","last_undegraded":"2023-10-06T04:37:27.011879+0000","last_fullsized":"2023-10-06T04:37:27.011879+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:19.011564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779727+0000","last_change":"2023-10-06T04:37:16.539297+0000","last_active":"2023-10-06T04:37:26.779727+0000","last_peered":"2023-10-06T04:37:26.779727+0000","last_clean":"2023-10-06T04:37:26.779727+0000","last_became_active":"2023-10-06T04:37:16.538921+0000","last_became_peered":"2023-10-06T04:37:16.538921+0000","last_unstale":"2023-10-06T04:37:26.779727+0000","last_undegraded":"2023-10-06T04:37:26.779727+0000","last_fullsized":"2023-10-06T04:37:26.779727+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:26.079570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":35,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779801+0000","last_change":"2023-10-06T04:36:11.192215+0000","last_active":"2023-10-06T04:37:26.779801+0000","last_peered":"2023-10-06T04:37:26.779801+0000","last_clean":"2023-10-06T04:37:26.779801+0000","last_became_active":"2023-10-06T04:36:11.191953+0000","last_became_peered":"2023-10-06T04:36:11.191953+0000","last_unstale":"2023-10-06T04:37:26.779801+0000","last_undegraded":"2023-10-06T04:37:26.779801+0000","last_fullsized":"2023-10-06T04:37:26.779801+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:37.026121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.783158+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:29:04.074820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"38'8","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.011406+0000","last_change":"2023-10-06T04:37:17.536572+0000","last_active":"2023-10-06T04:37:27.011406+0000","last_peered":"2023-10-06T04:37:27.011406+0000","last_clean":"2023-10-06T04:37:27.011406+0000","last_became_active":"2023-10-06T04:37:17.536250+0000","last_became_peered":"2023-10-06T04:37:17.536250+0000","last_unstale":"2023-10-06T04:37:27.011406+0000","last_undegraded":"2023-10-06T04:37:27.011406+0000","last_fullsized":"2023-10-06T04:37:27.011406+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:16.140442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.005195+0000","last_change":"2023-10-06T04:37:16.542301+0000","last_active":"2023-10-06T04:37:27.005195+0000","last_peered":"2023-10-06T04:37:27.005195+0000","last_clean":"2023-10-06T04:37:27.005195+0000","last_became_active":"2023-10-06T04:37:16.541967+0000","last_became_peered":"2023-10-06T04:37:16.541967+0000","last_unstale":"2023-10-06T04:37:27.005195+0000","last_undegraded":"2023-10-06T04:37:27.005195+0000","last_fullsized":"2023-10-06T04:37:27.005195+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:24.703451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":32,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.012571+0000","last_change":"2023-10-06T04:36:11.184555+0000","last_active":"2023-10-06T04:37:27.012571+0000","last_peered":"2023-10-06T04:37:27.012571+0000","last_clean":"2023-10-06T04:37:27.012571+0000","last_became_active":"2023-10-06T04:36:11.184229+0000","last_became_peered":"2023-10-06T04:36:11.184229+0000","last_unstale":"2023-10-06T04:37:27.012571+0000","last_undegraded":"2023-10-06T04:37:27.012571+0000","last_fullsized":"2023-10-06T04:37:27.012571+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:19.938716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.785119+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:47:25.866319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"38'5","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.005105+0000","last_change":"2023-10-06T04:37:17.548551+0000","last_active":"2023-10-06T04:37:27.005105+0000","last_peered":"2023-10-06T04:37:27.005105+0000","last_clean":"2023-10-06T04:37:27.005105+0000","last_became_active":"2023-10-06T04:37:17.548252+0000","last_became_peered":"2023-10-06T04:37:17.548252+0000","last_unstale":"2023-10-06T04:37:27.005105+0000","last_undegraded":"2023-10-06T04:37:27.005105+0000","last_fullsized":"2023-10-06T04:37:27.005105+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:23.847066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010028+0000","last_change":"2023-10-06T04:37:16.546270+0000","last_active":"2023-10-06T04:37:27.010028+0000","last_peered":"2023-10-06T04:37:27.010028+0000","last_clean":"2023-10-06T04:37:27.010028+0000","last_became_active":"2023-10-06T04:37:16.545969+0000","last_became_peered":"2023-10-06T04:37:16.545969+0000","last_unstale":"2023-10-06T04:37:27.010028+0000","last_undegraded":"2023-10-06T04:37:27.010028+0000","last_fullsized":"2023-10-06T04:37:27.010028+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:37.190837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":31,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009929+0000","last_change":"2023-10-06T04:36:11.184460+0000","last_active":"2023-10-06T04:37:27.009929+0000","last_peered":"2023-10-06T04:37:27.009929+0000","last_clean":"2023-10-06T04:37:27.009929+0000","last_became_active":"2023-10-06T04:36:11.184119+0000","last_became_peered":"2023-10-06T04:36:11.184119+0000","last_unstale":"2023-10-06T04:37:27.009929+0000","last_undegraded":"2023-10-06T04:37:27.009929+0000","last_fullsized":"2023-10-06T04:37:27.009929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:37.026121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":179,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.004768+0000","last_change":"2023-10-06T04:36:12.183155+0000","last_active":"2023-10-06T04:37:27.004768+0000","last_peered":"2023-10-06T04:37:27.004768+0000","last_clean":"2023-10-06T04:37:27.004768+0000","last_became_active":"2023-10-06T04:36:12.182903+0000","last_became_peered":"2023-10-06T04:36:12.182903+0000","last_unstale":"2023-10-06T04:37:27.004768+0000","last_undegraded":"2023-10-06T04:37:27.004768+0000","last_fullsized":"2023-10-06T04:37:27.004768+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:11.171104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:11.171104+0000","last_clean_scrub_stamp":"2023-10-06T04:36:11.171104+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:38:54.323364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":2,"reported_epoch":45,"state":"creating+activating","last_fresh":"2023-10-06T04:37:29.783254+0000","last_change":"2023-10-06T04:37:29.783380+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:29.783254+0000","last_undegraded":"2023-10-06T04:37:29.783254+0000","last_fullsized":"2023-10-06T04:37:29.783254+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:00:47.460409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"38'9","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010189+0000","last_change":"2023-10-06T04:37:17.537793+0000","last_active":"2023-10-06T04:37:27.010189+0000","last_peered":"2023-10-06T04:37:27.010189+0000","last_clean":"2023-10-06T04:37:27.010189+0000","last_became_active":"2023-10-06T04:37:17.537503+0000","last_became_peered":"2023-10-06T04:37:17.537503+0000","last_unstale":"2023-10-06T04:37:27.010189+0000","last_undegraded":"2023-10-06T04:37:27.010189+0000","last_fullsized":"2023-10-06T04:37:27.010189+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:19.011564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.005224+0000","last_change":"2023-10-06T04:37:16.545879+0000","last_active":"2023-10-06T04:37:27.005224+0000","last_peered":"2023-10-06T04:37:27.005224+0000","last_clean":"2023-10-06T04:37:27.005224+0000","last_became_active":"2023-10-06T04:37:16.545603+0000","last_became_peered":"2023-10-06T04:37:16.545603+0000","last_unstale":"2023-10-06T04:37:27.005224+0000","last_undegraded":"2023-10-06T04:37:27.005224+0000","last_fullsized":"2023-10-06T04:37:27.005224+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:40.207039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":30,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.004883+0000","last_change":"2023-10-06T04:36:11.193056+0000","last_active":"2023-10-06T04:37:27.004883+0000","last_peered":"2023-10-06T04:37:27.004883+0000","last_clean":"2023-10-06T04:37:27.004883+0000","last_became_active":"2023-10-06T04:36:11.192712+0000","last_became_peered":"2023-10-06T04:36:11.192712+0000","last_unstale":"2023-10-06T04:37:27.004883+0000","last_undegraded":"2023-10-06T04:37:27.004883+0000","last_fullsized":"2023-10-06T04:37:27.004883+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:00.008654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.776857+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:13.574637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"38'7","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010402+0000","last_change":"2023-10-06T04:37:17.547978+0000","last_active":"2023-10-06T04:37:27.010402+0000","last_peered":"2023-10-06T04:37:27.010402+0000","last_clean":"2023-10-06T04:37:27.010402+0000","last_became_active":"2023-10-06T04:37:17.547342+0000","last_became_peered":"2023-10-06T04:37:17.547342+0000","last_unstale":"2023-10-06T04:37:27.010402+0000","last_undegraded":"2023-10-06T04:37:27.010402+0000","last_fullsized":"2023-10-06T04:37:27.010402+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:12.970309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"39'3","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010279+0000","last_change":"2023-10-06T04:37:16.544363+0000","last_active":"2023-10-06T04:37:27.010279+0000","last_peered":"2023-10-06T04:37:27.010279+0000","last_clean":"2023-10-06T04:37:27.010279+0000","last_became_active":"2023-10-06T04:37:16.544100+0000","last_became_peered":"2023-10-06T04:37:16.544100+0000","last_unstale":"2023-10-06T04:37:27.010279+0000","last_undegraded":"2023-10-06T04:37:27.010279+0000","last_fullsized":"2023-10-06T04:37:27.010279+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:24.703451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":30,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.004660+0000","last_change":"2023-10-06T04:36:11.192701+0000","last_active":"2023-10-06T04:37:27.004660+0000","last_peered":"2023-10-06T04:37:27.004660+0000","last_clean":"2023-10-06T04:37:27.004660+0000","last_became_active":"2023-10-06T04:36:11.192335+0000","last_became_peered":"2023-10-06T04:36:11.192335+0000","last_unstale":"2023-10-06T04:37:27.004660+0000","last_undegraded":"2023-10-06T04:37:27.004660+0000","last_fullsized":"2023-10-06T04:37:27.004660+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:18.643570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.782838+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:57.475670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"38'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010179+0000","last_change":"2023-10-06T04:37:17.551353+0000","last_active":"2023-10-06T04:37:27.010179+0000","last_peered":"2023-10-06T04:37:27.010179+0000","last_clean":"2023-10-06T04:37:27.010179+0000","last_became_active":"2023-10-06T04:37:17.550655+0000","last_became_peered":"2023-10-06T04:37:17.550655+0000","last_unstale":"2023-10-06T04:37:27.010179+0000","last_undegraded":"2023-10-06T04:37:27.010179+0000","last_fullsized":"2023-10-06T04:37:27.010179+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:37.951996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"39'3","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.012650+0000","last_change":"2023-10-06T04:37:16.541672+0000","last_active":"2023-10-06T04:37:27.012650+0000","last_peered":"2023-10-06T04:37:27.012650+0000","last_clean":"2023-10-06T04:37:27.012650+0000","last_became_active":"2023-10-06T04:37:16.541369+0000","last_became_peered":"2023-10-06T04:37:16.541369+0000","last_unstale":"2023-10-06T04:37:27.012650+0000","last_undegraded":"2023-10-06T04:37:27.012650+0000","last_fullsized":"2023-10-06T04:37:27.012650+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:34.644455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":31,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009672+0000","last_change":"2023-10-06T04:36:11.193497+0000","last_active":"2023-10-06T04:37:27.009672+0000","last_peered":"2023-10-06T04:37:27.009672+0000","last_clean":"2023-10-06T04:37:27.009672+0000","last_became_active":"2023-10-06T04:36:11.193215+0000","last_became_peered":"2023-10-06T04:36:11.193215+0000","last_unstale":"2023-10-06T04:37:27.009672+0000","last_undegraded":"2023-10-06T04:37:27.009672+0000","last_fullsized":"2023-10-06T04:37:27.009672+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:07.497987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":2,"reported_epoch":45,"state":"creating+activating","last_fresh":"2023-10-06T04:37:29.782182+0000","last_change":"2023-10-06T04:37:29.782296+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:29.782182+0000","last_undegraded":"2023-10-06T04:37:29.782182+0000","last_fullsized":"2023-10-06T04:37:29.782182+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:48.194911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"38'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009383+0000","last_change":"2023-10-06T04:37:17.548282+0000","last_active":"2023-10-06T04:37:27.009383+0000","last_peered":"2023-10-06T04:37:27.009383+0000","last_clean":"2023-10-06T04:37:27.009383+0000","last_became_active":"2023-10-06T04:37:17.548037+0000","last_became_peered":"2023-10-06T04:37:17.548037+0000","last_unstale":"2023-10-06T04:37:27.009383+0000","last_undegraded":"2023-10-06T04:37:27.009383+0000","last_fullsized":"2023-10-06T04:37:27.009383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:44:56.161035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009537+0000","last_change":"2023-10-06T04:37:16.539573+0000","last_active":"2023-10-06T04:37:27.009537+0000","last_peered":"2023-10-06T04:37:27.009537+0000","last_clean":"2023-10-06T04:37:27.009537+0000","last_became_active":"2023-10-06T04:37:16.539271+0000","last_became_peered":"2023-10-06T04:37:16.539271+0000","last_unstale":"2023-10-06T04:37:27.009537+0000","last_undegraded":"2023-10-06T04:37:27.009537+0000","last_fullsized":"2023-10-06T04:37:27.009537+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:06:23.075116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010044+0000","last_change":"2023-10-06T04:36:11.193111+0000","last_active":"2023-10-06T04:37:27.010044+0000","last_peered":"2023-10-06T04:37:27.010044+0000","last_clean":"2023-10-06T04:37:27.010044+0000","last_became_active":"2023-10-06T04:36:11.192836+0000","last_became_peered":"2023-10-06T04:36:11.192836+0000","last_unstale":"2023-10-06T04:37:27.010044+0000","last_undegraded":"2023-10-06T04:37:27.010044+0000","last_fullsized":"2023-10-06T04:37:27.010044+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:19.938716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781463+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:25.262954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"38'5","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779612+0000","last_change":"2023-10-06T04:37:17.546750+0000","last_active":"2023-10-06T04:37:26.779612+0000","last_peered":"2023-10-06T04:37:26.779612+0000","last_clean":"2023-10-06T04:37:26.779612+0000","last_became_active":"2023-10-06T04:37:17.546467+0000","last_became_peered":"2023-10-06T04:37:17.546467+0000","last_unstale":"2023-10-06T04:37:26.779612+0000","last_undegraded":"2023-10-06T04:37:26.779612+0000","last_fullsized":"2023-10-06T04:37:26.779612+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:58.928454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009752+0000","last_change":"2023-10-06T04:37:16.544678+0000","last_active":"2023-10-06T04:37:27.009752+0000","last_peered":"2023-10-06T04:37:27.009752+0000","last_clean":"2023-10-06T04:37:27.009752+0000","last_became_active":"2023-10-06T04:37:16.541041+0000","last_became_peered":"2023-10-06T04:37:16.541041+0000","last_unstale":"2023-10-06T04:37:27.009752+0000","last_undegraded":"2023-10-06T04:37:27.009752+0000","last_fullsized":"2023-10-06T04:37:27.009752+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:15:48.328371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010333+0000","last_change":"2023-10-06T04:36:11.182804+0000","last_active":"2023-10-06T04:37:27.010333+0000","last_peered":"2023-10-06T04:37:27.010333+0000","last_clean":"2023-10-06T04:37:27.010333+0000","last_became_active":"2023-10-06T04:36:11.182575+0000","last_became_peered":"2023-10-06T04:36:11.182575+0000","last_unstale":"2023-10-06T04:37:27.010333+0000","last_undegraded":"2023-10-06T04:37:27.010333+0000","last_fullsized":"2023-10-06T04:37:27.010333+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:07.497987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":504,"ondisk_log_size":504,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":93,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298368,"kb_used_data":1080,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073472,"statfs":{"total":96636764160,"available":96331235328,"internally_reserved":0,"allocated":1105920,"data_stored":826104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.50600000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.57099999999999995}]},{"osd":2,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.625}]},{"osd":3,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.55800000000000005}]},{"osd":4,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.58099999999999996}]},{"osd":5,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.45900000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.47099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301884,"kb_used_data":4596,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94069956,"statfs":{"total":96636764160,"available":96327634944,"internally_reserved":0,"allocated":4706304,"data_stored":4430040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":10.045999999999999,"5min":10.045999999999999,"15min":10.045999999999999},"last":0.57699999999999996}]},{"osd":1,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":10.125999999999999,"5min":10.125999999999999,"15min":10.125999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.60499999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":10.238,"5min":10.238,"15min":10.238},"last":0.59699999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":4.4870000000000001,"5min":4.4870000000000001,"15min":4.4870000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":10.393000000000001,"5min":10.393000000000001,"15min":10.393000000000001},"last":0.626}]},{"osd":4,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.40400000000000003}]},{"osd":5,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.377},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.39000000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.434},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.34300000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298368,"kb_used_data":1080,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073472,"statfs":{"total":96636764160,"available":96331235328,"internally_reserved":0,"allocated":1105920,"data_stored":826104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.38700000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.307}]},{"osd":3,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.28699999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.60099999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.61399999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.628}]},{"osd":7,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.65700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301880,"kb_used_data":4592,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94069960,"statfs":{"total":96636764160,"available":96327639040,"internally_reserved":0,"allocated":4702208,"data_stored":4429062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.443,"5min":0.443,"15min":0.443},"last":0.312}]},{"osd":2,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.28999999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.42399999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.73399999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.68700000000000006}]},{"osd":7,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.629},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.66500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297784,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074056,"statfs":{"total":96636764160,"available":96331833344,"internally_reserved":0,"allocated":507904,"data_stored":234758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.432}]},{"osd":1,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.35899999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.378}]},{"osd":4,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.47099999999999997}]},{"osd":5,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.495}]},{"osd":6,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.628},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.64800000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.58299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297784,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074056,"statfs":{"total":96636764160,"available":96331833344,"internally_reserved":0,"allocated":507904,"data_stored":234758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.318},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.442,"5min":0.442,"15min":0.442},"last":0.29199999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.436,"5min":0.436,"15min":0.436},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.27700000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.35399999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.1070000000000002,"5min":2.1070000000000002,"15min":2.1070000000000002},"last":0.51900000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":0.497},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.55200000000000005}]},{"osd":6,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.63},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.54300000000000004}]},{"osd":7,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.52900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299836,"kb_used_data":2548,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072004,"statfs":{"total":96636764160,"available":96329732096,"internally_reserved":0,"allocated":2609152,"data_stored":2332888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":4.2919999999999998,"5min":4.2919999999999998,"15min":4.2919999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.317}]},{"osd":1,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":4.3520000000000003,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":0.34999999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.54400000000000004}]},{"osd":3,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.501}]},{"osd":5,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.38800000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.44},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.59599999999999997}]},{"osd":7,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.623}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299836,"kb_used_data":2548,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072004,"statfs":{"total":96636764160,"available":96329732096,"internally_reserved":0,"allocated":2609152,"data_stored":2332888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.42499999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.40100000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.372},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.48999999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.54400000000000004}]},{"osd":4,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.501}]},{"osd":6,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.51100000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.52400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:37:33.897 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:37:34.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.047+0000 7f7eb8f63700 1 Processor -- start 2023-10-06T04:37:34.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.047+0000 7f7eb8f63700 1 -- start start 2023-10-06T04:37:34.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.048+0000 7f7eb8f63700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7eb40d0aa0 0x7f7eb41649b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:34.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.048+0000 7f7eb8f63700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb40cc4c0 con 0x7f7eb40cb360 2023-10-06T04:37:34.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.048+0000 7f7eb8f63700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb40cb8b0 con 0x7f7eb40af680 2023-10-06T04:37:34.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.048+0000 7f7eb8f63700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb415d460 con 0x7f7eb40d0aa0 2023-10-06T04:37:34.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.048+0000 7f7eb1d9b700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f7eb40cb360 0x7f7eb40d0390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46234/0 (socket says 172.21.15.8:46234) 2023-10-06T04:37:34.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.048+0000 7f7eb1d9b700 1 -- 172.21.15.8:0/1274064894 learned_addr learned my addr 172.21.15.8:0/1274064894 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:34.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.048+0000 7f7eb159a700 1 -- 172.21.15.8:0/1274064894 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2678475631 0 0) 0x7f7eb40cc4c0 con 0x7f7eb40cb360 2023-10-06T04:37:34.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.048+0000 7f7eb159a700 1 -- 172.21.15.8:0/1274064894 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ea0003570 con 0x7f7eb40cb360 2023-10-06T04:37:34.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.048+0000 7f7eb2d9d700 1 --2- 172.21.15.8:0/1274064894 >> v2:172.21.15.184:3300/0 conn(0x7f7eb40d0aa0 0x7f7eb41649b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:34.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.048+0000 7f7eb159a700 1 -- 172.21.15.8:0/1274064894 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 964071450 0 0) 0x7f7ea0003570 con 0x7f7eb40cb360 2023-10-06T04:37:34.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.048+0000 7f7eb159a700 1 -- 172.21.15.8:0/1274064894 >> v2:172.21.15.184:3300/0 conn(0x7f7eb40d0aa0 msgr2=0x7f7eb41649b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:34.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.048+0000 7f7eb159a700 1 --2- 172.21.15.8:0/1274064894 >> v2:172.21.15.184:3300/0 conn(0x7f7eb40d0aa0 0x7f7eb41649b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:34.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.048+0000 7f7eb159a700 1 -- 172.21.15.8:0/1274064894 >> v1:172.21.15.184:6789/0 conn(0x7f7eb40af680 legacy=0x7f7eb415e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:34.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.048+0000 7f7eb159a700 1 -- 172.21.15.8:0/1274064894 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb40cbb90 con 0x7f7eb40cb360 2023-10-06T04:37:34.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.048+0000 7f7eb159a700 1 -- 172.21.15.8:0/1274064894 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7f7e9c001470 con 0x7f7eb40cb360 2023-10-06T04:37:34.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.048+0000 7f7eb159a700 1 -- 172.21.15.8:0/1274064894 >> v1:172.21.15.8:6789/0 conn(0x7f7eb40cb360 legacy=0x7f7eb40d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:34.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.048+0000 7f7eb159a700 1 --2- 172.21.15.8:0/1274064894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ea0003a60 0x7f7ea0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:34.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.048+0000 7f7eb159a700 1 --2- 172.21.15.8:0/1274064894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ea0004810 0x7f7ea0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:34.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.048+0000 7f7eb159a700 1 --2- 172.21.15.8:0/1274064894 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ea00051c0 0x7f7ea000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:34.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.048+0000 7f7eb159a700 1 -- 172.21.15.8:0/1274064894 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb415d460 con 0x7f7ea0003a60 2023-10-06T04:37:34.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.048+0000 7f7eb159a700 1 -- 172.21.15.8:0/1274064894 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea000c0d0 con 0x7f7ea0004810 2023-10-06T04:37:34.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.048+0000 7f7eb159a700 1 -- 172.21.15.8:0/1274064894 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea000c290 con 0x7f7ea00051c0 2023-10-06T04:37:34.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.049+0000 7f7eb259c700 1 --2- 172.21.15.8:0/1274064894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ea0003a60 0x7f7ea0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:34.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.049+0000 7f7eb1d9b700 1 --2- 172.21.15.8:0/1274064894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ea0004810 0x7f7ea0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:34.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.049+0000 7f7eb2d9d700 1 --2- 172.21.15.8:0/1274064894 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ea00051c0 0x7f7ea000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:34.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.049+0000 7f7eb259c700 1 -- 172.21.15.8:0/1274064894 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ea00051c0 msgr2=0x7f7ea000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:34.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.049+0000 7f7eb259c700 1 --2- 172.21.15.8:0/1274064894 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ea00051c0 0x7f7ea000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:34.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.049+0000 7f7eb259c700 1 -- 172.21.15.8:0/1274064894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ea0004810 msgr2=0x7f7ea0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:34.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.049+0000 7f7eb259c700 1 --2- 172.21.15.8:0/1274064894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ea0004810 0x7f7ea0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:34.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.049+0000 7f7eb259c700 1 -- 172.21.15.8:0/1274064894 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea0003570 con 0x7f7ea0003a60 2023-10-06T04:37:34.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.049+0000 7f7eb2d9d700 1 -- 172.21.15.8:0/1274064894 reap_dead start 2023-10-06T04:37:34.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.049+0000 7f7eb259c700 1 --2- 172.21.15.8:0/1274064894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ea0003a60 0x7f7ea0003e70 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7eac0018b0 tx=0x7f7eac007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d72aab37081c05 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:34.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.049+0000 7f7eb159a700 1 -- 172.21.15.8:0/1274064894 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac012420 con 0x7f7ea0003a60 2023-10-06T04:37:34.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.049+0000 7f7eb159a700 1 -- 172.21.15.8:0/1274064894 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eac0125a0 con 0x7f7ea0003a60 2023-10-06T04:37:34.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.049+0000 7f7eb159a700 1 -- 172.21.15.8:0/1274064894 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac012960 con 0x7f7ea0003a60 2023-10-06T04:37:34.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.050+0000 7f7eb8f63700 1 -- 172.21.15.8:0/1274064894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ea0003a60 msgr2=0x7f7ea0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:34.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.050+0000 7f7eb8f63700 1 --2- 172.21.15.8:0/1274064894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ea0003a60 0x7f7ea0003e70 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7eac0018b0 tx=0x7f7eac007d30 comp rx=0 tx=0).stop 2023-10-06T04:37:34.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.050+0000 7f7eb8f63700 1 -- 172.21.15.8:0/1274064894 shutdown_connections 2023-10-06T04:37:34.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.050+0000 7f7eb8f63700 1 --2- 172.21.15.8:0/1274064894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ea0003a60 0x7f7ea0003e70 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:34.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.050+0000 7f7eb8f63700 1 -- 172.21.15.8:0/1274064894 >> 172.21.15.8:0/1274064894 conn(0x7f7eb40633d0 msgr2=0x7f7eb40637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:34.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.050+0000 7f7eb8f63700 1 -- 172.21.15.8:0/1274064894 shutdown_connections 2023-10-06T04:37:34.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.050+0000 7f7eb8f63700 1 -- 172.21.15.8:0/1274064894 wait complete. 2023-10-06T04:37:34.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.051+0000 7f7eb8f63700 1 Processor -- start 2023-10-06T04:37:34.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.051+0000 7f7eb8f63700 1 -- start start 2023-10-06T04:37:34.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.052+0000 7f7eb8f63700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ea0003a60 0x7f7eb40c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:34.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.052+0000 7f7eb8f63700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7eb4157120 0x7f7eb40c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:34.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.052+0000 7f7eb8f63700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7eb40ca280 0x7f7eb40c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:34.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.052+0000 7f7eb8f63700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb40ca700 con 0x7f7eb40ca280 2023-10-06T04:37:34.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.052+0000 7f7eb8f63700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb40c84c0 con 0x7f7ea0003a60 2023-10-06T04:37:34.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.052+0000 7f7eb8f63700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb4157570 con 0x7f7eb4157120 2023-10-06T04:37:34.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.052+0000 7f7eb2d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7eb40ca280 0x7f7eb40c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:34.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.052+0000 7f7eb2d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7eb40ca280 0x7f7eb40c5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33548/0 (socket says 172.21.15.8:33548) 2023-10-06T04:37:34.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.052+0000 7f7eb2d9d700 1 -- 172.21.15.8:0/417940968 learned_addr learned my addr 172.21.15.8:0/417940968 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:34.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.052+0000 7f7eb259c700 1 --2- 172.21.15.8:0/417940968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ea0003a60 0x7f7eb40c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:34.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.052+0000 7f7eb1d9b700 1 --2- 172.21.15.8:0/417940968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7eb4157120 0x7f7eb40c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:34.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.052+0000 7f7eb2d9d700 1 -- 172.21.15.8:0/417940968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7eb4157120 msgr2=0x7f7eb40c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:34.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.052+0000 7f7eb2d9d700 1 --2- 172.21.15.8:0/417940968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7eb4157120 0x7f7eb40c9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:34.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.052+0000 7f7eb2d9d700 1 -- 172.21.15.8:0/417940968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ea0003a60 msgr2=0x7f7eb40c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:34.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.052+0000 7f7eb2d9d700 1 --2- 172.21.15.8:0/417940968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ea0003a60 0x7f7eb40c94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:34.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.052+0000 7f7eb2d9d700 1 -- 172.21.15.8:0/417940968 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb40c9020 con 0x7f7eb40ca280 2023-10-06T04:37:34.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.052+0000 7f7eb2d9d700 1 --2- 172.21.15.8:0/417940968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7eb40ca280 0x7f7eb40c5cb0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7eb40cb120 tx=0x7f7ea400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:34.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.052+0000 7f7eaa7fc700 1 -- 172.21.15.8:0/417940968 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea400e040 con 0x7f7eb40ca280 2023-10-06T04:37:34.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.052+0000 7f7eaa7fc700 1 -- 172.21.15.8:0/417940968 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea400f040 con 0x7f7eb40ca280 2023-10-06T04:37:34.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.052+0000 7f7eb8f63700 1 -- 172.21.15.8:0/417940968 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb40c86f0 con 0x7f7eb40ca280 2023-10-06T04:37:34.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.052+0000 7f7eaa7fc700 1 -- 172.21.15.8:0/417940968 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea400fdc0 con 0x7f7eb40ca280 2023-10-06T04:37:34.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.053+0000 7f7eb8f63700 1 -- 172.21.15.8:0/417940968 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb40c8cb0 con 0x7f7eb40ca280 2023-10-06T04:37:34.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.054+0000 7f7eb8f63700 1 -- 172.21.15.8:0/417940968 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb40c91b0 con 0x7f7eb40ca280 2023-10-06T04:37:34.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.054+0000 7f7eaa7fc700 1 -- 172.21.15.8:0/417940968 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7ea4015640 con 0x7f7eb40ca280 2023-10-06T04:37:34.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.054+0000 7f7eaa7fc700 1 --2- 172.21.15.8:0/417940968 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7e94066f60 0x7f7e94069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:34.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.054+0000 7f7eaa7fc700 1 -- 172.21.15.8:0/417940968 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7f7ea4084fc0 con 0x7f7eb40ca280 2023-10-06T04:37:34.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.054+0000 7f7eb259c700 1 --2- 172.21.15.8:0/417940968 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7e94066f60 0x7f7e94069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:34.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.055+0000 7f7eb259c700 1 --2- 172.21.15.8:0/417940968 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7e94066f60 0x7f7e94069410 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7eac001690 tx=0x7f7eac015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:34.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.059+0000 7f7eaa7fc700 1 -- 172.21.15.8:0/417940968 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ea4051e30 con 0x7f7eb40ca280 2023-10-06T04:37:34.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.248+0000 7f7eb8f63700 1 -- 172.21.15.8:0/417940968 --> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7eb4071550 con 0x7f7e94066f60 2023-10-06T04:37:34.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.259+0000 7f7eaa7fc700 1 -- 172.21.15.8:0/417940968 <== mgr.4105 v2:172.21.15.184:6832/90283 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+391385 (secure 0 0 0) 0x7f7eb4071550 con 0x7f7e94066f60 2023-10-06T04:37:34.265 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:34.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.263+0000 7f7eb8f63700 1 -- 172.21.15.8:0/417940968 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7e94066f60 msgr2=0x7f7e94069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:34.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.263+0000 7f7eb8f63700 1 --2- 172.21.15.8:0/417940968 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7e94066f60 0x7f7e94069410 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7eac001690 tx=0x7f7eac015000 comp rx=0 tx=0).stop 2023-10-06T04:37:34.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.263+0000 7f7eb8f63700 1 -- 172.21.15.8:0/417940968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7eb40ca280 msgr2=0x7f7eb40c5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:34.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.263+0000 7f7eb8f63700 1 --2- 172.21.15.8:0/417940968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7eb40ca280 0x7f7eb40c5cb0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7eb40cb120 tx=0x7f7ea400b040 comp rx=0 tx=0).stop 2023-10-06T04:37:34.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.263+0000 7f7eb8f63700 1 -- 172.21.15.8:0/417940968 shutdown_connections 2023-10-06T04:37:34.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.263+0000 7f7eb8f63700 1 --2- 172.21.15.8:0/417940968 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7e94066f60 0x7f7e94069410 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:34.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.263+0000 7f7eb8f63700 1 --2- 172.21.15.8:0/417940968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7eb40ca280 0x7f7eb40c5cb0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:34.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.263+0000 7f7eb8f63700 1 --2- 172.21.15.8:0/417940968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ea0003a60 0x7f7eb40c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:34.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.263+0000 7f7eb8f63700 1 --2- 172.21.15.8:0/417940968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7eb4157120 0x7f7eb40c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:34.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.263+0000 7f7eb8f63700 1 -- 172.21.15.8:0/417940968 >> 172.21.15.8:0/417940968 conn(0x7f7eb40633d0 msgr2=0x7f7eb415a210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:34.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.263+0000 7f7eb8f63700 1 -- 172.21.15.8:0/417940968 shutdown_connections 2023-10-06T04:37:34.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.263+0000 7f7eb8f63700 1 -- 172.21.15.8:0/417940968 wait complete. 2023-10-06T04:37:34.269 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-06T04:37:34.277 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2023-10-06T04:37:32.649456+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6881824,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":100,"num_write":256,"num_write_kb":8601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":703,"ondisk_log_size":703,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":216,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2395740,"kb_used_data":17436,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752578980,"statfs":{"total":773094113280,"available":770640875520,"internally_reserved":0,"allocated":17854464,"data_stored":15646602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11726,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":45,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.870682"},"pg_stats":[{"pgid":"7.3f","version":"38'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.003905+0000","last_change":"2023-10-06T04:37:17.540825+0000","last_active":"2023-10-06T04:37:27.003905+0000","last_peered":"2023-10-06T04:37:27.003905+0000","last_clean":"2023-10-06T04:37:27.003905+0000","last_became_active":"2023-10-06T04:37:17.540537+0000","last_became_peered":"2023-10-06T04:37:17.540537+0000","last_unstale":"2023-10-06T04:37:27.003905+0000","last_undegraded":"2023-10-06T04:37:27.003905+0000","last_fullsized":"2023-10-06T04:37:27.003905+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:27.083777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"38'4","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010044+0000","last_change":"2023-10-06T04:37:17.550627+0000","last_active":"2023-10-06T04:37:27.010044+0000","last_peered":"2023-10-06T04:37:27.010044+0000","last_clean":"2023-10-06T04:37:27.010044+0000","last_became_active":"2023-10-06T04:37:17.550395+0000","last_became_peered":"2023-10-06T04:37:17.550395+0000","last_unstale":"2023-10-06T04:37:27.010044+0000","last_undegraded":"2023-10-06T04:37:27.010044+0000","last_fullsized":"2023-10-06T04:37:27.010044+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:49.714446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"38'7","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779750+0000","last_change":"2023-10-06T04:37:17.541131+0000","last_active":"2023-10-06T04:37:26.779750+0000","last_peered":"2023-10-06T04:37:26.779750+0000","last_clean":"2023-10-06T04:37:26.779750+0000","last_became_active":"2023-10-06T04:37:17.540816+0000","last_became_peered":"2023-10-06T04:37:17.540816+0000","last_unstale":"2023-10-06T04:37:26.779750+0000","last_undegraded":"2023-10-06T04:37:26.779750+0000","last_fullsized":"2023-10-06T04:37:26.779750+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:32:45.542874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"38'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010129+0000","last_change":"2023-10-06T04:37:17.545649+0000","last_active":"2023-10-06T04:37:27.010129+0000","last_peered":"2023-10-06T04:37:27.010129+0000","last_clean":"2023-10-06T04:37:27.010129+0000","last_became_active":"2023-10-06T04:37:17.545155+0000","last_became_peered":"2023-10-06T04:37:17.545155+0000","last_unstale":"2023-10-06T04:37:27.010129+0000","last_undegraded":"2023-10-06T04:37:27.010129+0000","last_fullsized":"2023-10-06T04:37:27.010129+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:09.823506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"38'4","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010286+0000","last_change":"2023-10-06T04:37:17.545451+0000","last_active":"2023-10-06T04:37:27.010286+0000","last_peered":"2023-10-06T04:37:27.010286+0000","last_clean":"2023-10-06T04:37:27.010286+0000","last_became_active":"2023-10-06T04:37:17.545135+0000","last_became_peered":"2023-10-06T04:37:17.545135+0000","last_unstale":"2023-10-06T04:37:27.010286+0000","last_undegraded":"2023-10-06T04:37:27.010286+0000","last_fullsized":"2023-10-06T04:37:27.010286+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:44.628778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"38'6","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.011289+0000","last_change":"2023-10-06T04:37:17.545054+0000","last_active":"2023-10-06T04:37:27.011289+0000","last_peered":"2023-10-06T04:37:27.011289+0000","last_clean":"2023-10-06T04:37:27.011289+0000","last_became_active":"2023-10-06T04:37:17.544822+0000","last_became_peered":"2023-10-06T04:37:17.544822+0000","last_unstale":"2023-10-06T04:37:27.011289+0000","last_undegraded":"2023-10-06T04:37:27.011289+0000","last_fullsized":"2023-10-06T04:37:27.011289+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:28:51.824521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"38'5","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.004522+0000","last_change":"2023-10-06T04:37:17.548819+0000","last_active":"2023-10-06T04:37:27.004522+0000","last_peered":"2023-10-06T04:37:27.004522+0000","last_clean":"2023-10-06T04:37:27.004522+0000","last_became_active":"2023-10-06T04:37:17.548629+0000","last_became_peered":"2023-10-06T04:37:17.548629+0000","last_unstale":"2023-10-06T04:37:27.004522+0000","last_undegraded":"2023-10-06T04:37:27.004522+0000","last_fullsized":"2023-10-06T04:37:27.004522+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:04.973984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"38'9","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009297+0000","last_change":"2023-10-06T04:37:17.547124+0000","last_active":"2023-10-06T04:37:27.009297+0000","last_peered":"2023-10-06T04:37:27.009297+0000","last_clean":"2023-10-06T04:37:27.009297+0000","last_became_active":"2023-10-06T04:37:17.546879+0000","last_became_peered":"2023-10-06T04:37:17.546879+0000","last_unstale":"2023-10-06T04:37:27.009297+0000","last_undegraded":"2023-10-06T04:37:27.009297+0000","last_fullsized":"2023-10-06T04:37:27.009297+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:45.225371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"38'11","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009694+0000","last_change":"2023-10-06T04:37:17.537910+0000","last_active":"2023-10-06T04:37:27.009694+0000","last_peered":"2023-10-06T04:37:27.009694+0000","last_clean":"2023-10-06T04:37:27.009694+0000","last_became_active":"2023-10-06T04:37:17.535864+0000","last_became_peered":"2023-10-06T04:37:17.535864+0000","last_unstale":"2023-10-06T04:37:27.009694+0000","last_undegraded":"2023-10-06T04:37:27.009694+0000","last_fullsized":"2023-10-06T04:37:27.009694+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:58.928454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"38'15","reported_seq":28,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010318+0000","last_change":"2023-10-06T04:37:17.548489+0000","last_active":"2023-10-06T04:37:27.010318+0000","last_peered":"2023-10-06T04:37:27.010318+0000","last_clean":"2023-10-06T04:37:27.010318+0000","last_became_active":"2023-10-06T04:37:17.547714+0000","last_became_peered":"2023-10-06T04:37:17.547714+0000","last_unstale":"2023-10-06T04:37:27.010318+0000","last_undegraded":"2023-10-06T04:37:27.010318+0000","last_fullsized":"2023-10-06T04:37:27.010318+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:56.687459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"38'6","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009488+0000","last_change":"2023-10-06T04:37:17.544501+0000","last_active":"2023-10-06T04:37:27.009488+0000","last_peered":"2023-10-06T04:37:27.009488+0000","last_clean":"2023-10-06T04:37:27.009488+0000","last_became_active":"2023-10-06T04:37:17.541822+0000","last_became_peered":"2023-10-06T04:37:17.541822+0000","last_unstale":"2023-10-06T04:37:27.009488+0000","last_undegraded":"2023-10-06T04:37:27.009488+0000","last_fullsized":"2023-10-06T04:37:27.009488+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:32:45.542874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"38'7","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009885+0000","last_change":"2023-10-06T04:37:17.545538+0000","last_active":"2023-10-06T04:37:27.009885+0000","last_peered":"2023-10-06T04:37:27.009885+0000","last_clean":"2023-10-06T04:37:27.009885+0000","last_became_active":"2023-10-06T04:37:17.545027+0000","last_became_peered":"2023-10-06T04:37:17.545027+0000","last_unstale":"2023-10-06T04:37:27.009885+0000","last_undegraded":"2023-10-06T04:37:27.009885+0000","last_fullsized":"2023-10-06T04:37:27.009885+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:23.847066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"38'10","reported_seq":23,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:37:28.775107+0000","last_change":"2023-10-06T04:37:17.541986+0000","last_active":"2023-10-06T04:37:28.775107+0000","last_peered":"2023-10-06T04:37:28.775107+0000","last_clean":"2023-10-06T04:37:28.775107+0000","last_became_active":"2023-10-06T04:37:17.541707+0000","last_became_peered":"2023-10-06T04:37:17.541707+0000","last_unstale":"2023-10-06T04:37:28.775107+0000","last_undegraded":"2023-10-06T04:37:28.775107+0000","last_fullsized":"2023-10-06T04:37:28.775107+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:25.707658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"38'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009443+0000","last_change":"2023-10-06T04:37:17.536298+0000","last_active":"2023-10-06T04:37:27.009443+0000","last_peered":"2023-10-06T04:37:27.009443+0000","last_clean":"2023-10-06T04:37:27.009443+0000","last_became_active":"2023-10-06T04:37:17.535937+0000","last_became_peered":"2023-10-06T04:37:17.535937+0000","last_unstale":"2023-10-06T04:37:27.009443+0000","last_undegraded":"2023-10-06T04:37:27.009443+0000","last_fullsized":"2023-10-06T04:37:27.009443+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:01.324339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"38'7","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010623+0000","last_change":"2023-10-06T04:37:17.538786+0000","last_active":"2023-10-06T04:37:27.010623+0000","last_peered":"2023-10-06T04:37:27.010623+0000","last_clean":"2023-10-06T04:37:27.010623+0000","last_became_active":"2023-10-06T04:37:17.538493+0000","last_became_peered":"2023-10-06T04:37:17.538493+0000","last_unstale":"2023-10-06T04:37:27.010623+0000","last_undegraded":"2023-10-06T04:37:27.010623+0000","last_fullsized":"2023-10-06T04:37:27.010623+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:09.823506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"38'9","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009207+0000","last_change":"2023-10-06T04:37:17.552277+0000","last_active":"2023-10-06T04:37:27.009207+0000","last_peered":"2023-10-06T04:37:27.009207+0000","last_clean":"2023-10-06T04:37:27.009207+0000","last_became_active":"2023-10-06T04:37:17.552001+0000","last_became_peered":"2023-10-06T04:37:17.552001+0000","last_unstale":"2023-10-06T04:37:27.009207+0000","last_undegraded":"2023-10-06T04:37:27.009207+0000","last_fullsized":"2023-10-06T04:37:27.009207+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:41.211245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"38'9","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779847+0000","last_change":"2023-10-06T04:37:17.547373+0000","last_active":"2023-10-06T04:37:26.779847+0000","last_peered":"2023-10-06T04:37:26.779847+0000","last_clean":"2023-10-06T04:37:26.779847+0000","last_became_active":"2023-10-06T04:37:17.547103+0000","last_became_peered":"2023-10-06T04:37:17.547103+0000","last_unstale":"2023-10-06T04:37:26.779847+0000","last_undegraded":"2023-10-06T04:37:26.779847+0000","last_fullsized":"2023-10-06T04:37:26.779847+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:09.823506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"38'10","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779780+0000","last_change":"2023-10-06T04:37:17.554683+0000","last_active":"2023-10-06T04:37:26.779780+0000","last_peered":"2023-10-06T04:37:26.779780+0000","last_clean":"2023-10-06T04:37:26.779780+0000","last_became_active":"2023-10-06T04:37:17.554412+0000","last_became_peered":"2023-10-06T04:37:17.554412+0000","last_unstale":"2023-10-06T04:37:26.779780+0000","last_undegraded":"2023-10-06T04:37:26.779780+0000","last_fullsized":"2023-10-06T04:37:26.779780+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:56.687459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"38'7","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009419+0000","last_change":"2023-10-06T04:37:17.551197+0000","last_active":"2023-10-06T04:37:27.009419+0000","last_peered":"2023-10-06T04:37:27.009419+0000","last_clean":"2023-10-06T04:37:27.009419+0000","last_became_active":"2023-10-06T04:37:17.550633+0000","last_became_peered":"2023-10-06T04:37:17.550633+0000","last_unstale":"2023-10-06T04:37:27.009419+0000","last_undegraded":"2023-10-06T04:37:27.009419+0000","last_fullsized":"2023-10-06T04:37:27.009419+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:25.707658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"38'8","reported_seq":21,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:37:28.775146+0000","last_change":"2023-10-06T04:37:17.541139+0000","last_active":"2023-10-06T04:37:28.775146+0000","last_peered":"2023-10-06T04:37:28.775146+0000","last_clean":"2023-10-06T04:37:28.775146+0000","last_became_active":"2023-10-06T04:37:17.540844+0000","last_became_peered":"2023-10-06T04:37:17.540844+0000","last_unstale":"2023-10-06T04:37:28.775146+0000","last_undegraded":"2023-10-06T04:37:28.775146+0000","last_fullsized":"2023-10-06T04:37:28.775146+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:40.800271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"38'11","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.011635+0000","last_change":"2023-10-06T04:37:17.546023+0000","last_active":"2023-10-06T04:37:27.011635+0000","last_peered":"2023-10-06T04:37:27.011635+0000","last_clean":"2023-10-06T04:37:27.011635+0000","last_became_active":"2023-10-06T04:37:17.545428+0000","last_became_peered":"2023-10-06T04:37:17.545428+0000","last_unstale":"2023-10-06T04:37:27.011635+0000","last_undegraded":"2023-10-06T04:37:27.011635+0000","last_fullsized":"2023-10-06T04:37:27.011635+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:52.574192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"38'9","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009573+0000","last_change":"2023-10-06T04:37:17.546918+0000","last_active":"2023-10-06T04:37:27.009573+0000","last_peered":"2023-10-06T04:37:27.009573+0000","last_clean":"2023-10-06T04:37:27.009573+0000","last_became_active":"2023-10-06T04:37:17.546562+0000","last_became_peered":"2023-10-06T04:37:17.546562+0000","last_unstale":"2023-10-06T04:37:27.009573+0000","last_undegraded":"2023-10-06T04:37:27.009573+0000","last_fullsized":"2023-10-06T04:37:27.009573+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:18.119835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"38'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009254+0000","last_change":"2023-10-06T04:37:17.549490+0000","last_active":"2023-10-06T04:37:27.009254+0000","last_peered":"2023-10-06T04:37:27.009254+0000","last_clean":"2023-10-06T04:37:27.009254+0000","last_became_active":"2023-10-06T04:37:17.549294+0000","last_became_peered":"2023-10-06T04:37:17.549294+0000","last_unstale":"2023-10-06T04:37:27.009254+0000","last_undegraded":"2023-10-06T04:37:27.009254+0000","last_fullsized":"2023-10-06T04:37:27.009254+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:50.973957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"38'6","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009221+0000","last_change":"2023-10-06T04:37:17.548512+0000","last_active":"2023-10-06T04:37:27.009221+0000","last_peered":"2023-10-06T04:37:27.009221+0000","last_clean":"2023-10-06T04:37:27.009221+0000","last_became_active":"2023-10-06T04:37:17.547910+0000","last_became_peered":"2023-10-06T04:37:17.547910+0000","last_unstale":"2023-10-06T04:37:27.009221+0000","last_undegraded":"2023-10-06T04:37:27.009221+0000","last_fullsized":"2023-10-06T04:37:27.009221+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:15:49.332577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"38'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010270+0000","last_change":"2023-10-06T04:37:17.551312+0000","last_active":"2023-10-06T04:37:27.010270+0000","last_peered":"2023-10-06T04:37:27.010270+0000","last_clean":"2023-10-06T04:37:27.010270+0000","last_became_active":"2023-10-06T04:37:17.550973+0000","last_became_peered":"2023-10-06T04:37:17.550973+0000","last_unstale":"2023-10-06T04:37:27.010270+0000","last_undegraded":"2023-10-06T04:37:27.010270+0000","last_fullsized":"2023-10-06T04:37:27.010270+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:40.800271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"38'15","reported_seq":28,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:37:28.775234+0000","last_change":"2023-10-06T04:37:17.542441+0000","last_active":"2023-10-06T04:37:28.775234+0000","last_peered":"2023-10-06T04:37:28.775234+0000","last_clean":"2023-10-06T04:37:28.775234+0000","last_became_active":"2023-10-06T04:37:17.542184+0000","last_became_peered":"2023-10-06T04:37:17.542184+0000","last_unstale":"2023-10-06T04:37:28.775234+0000","last_undegraded":"2023-10-06T04:37:28.775234+0000","last_fullsized":"2023-10-06T04:37:28.775234+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:57.066657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"38'6","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779729+0000","last_change":"2023-10-06T04:37:17.546567+0000","last_active":"2023-10-06T04:37:26.779729+0000","last_peered":"2023-10-06T04:37:26.779729+0000","last_clean":"2023-10-06T04:37:26.779729+0000","last_became_active":"2023-10-06T04:37:17.546294+0000","last_became_peered":"2023-10-06T04:37:17.546294+0000","last_unstale":"2023-10-06T04:37:26.779729+0000","last_undegraded":"2023-10-06T04:37:26.779729+0000","last_fullsized":"2023-10-06T04:37:26.779729+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:19.011564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"38'4","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009688+0000","last_change":"2023-10-06T04:37:17.545684+0000","last_active":"2023-10-06T04:37:27.009688+0000","last_peered":"2023-10-06T04:37:27.009688+0000","last_clean":"2023-10-06T04:37:27.009688+0000","last_became_active":"2023-10-06T04:37:17.545341+0000","last_became_peered":"2023-10-06T04:37:17.545341+0000","last_unstale":"2023-10-06T04:37:27.009688+0000","last_undegraded":"2023-10-06T04:37:27.009688+0000","last_fullsized":"2023-10-06T04:37:27.009688+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:04.973984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"38'7","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009408+0000","last_change":"2023-10-06T04:37:17.551198+0000","last_active":"2023-10-06T04:37:27.009408+0000","last_peered":"2023-10-06T04:37:27.009408+0000","last_clean":"2023-10-06T04:37:27.009408+0000","last_became_active":"2023-10-06T04:37:17.550871+0000","last_became_peered":"2023-10-06T04:37:17.550871+0000","last_unstale":"2023-10-06T04:37:27.009408+0000","last_undegraded":"2023-10-06T04:37:27.009408+0000","last_fullsized":"2023-10-06T04:37:27.009408+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:43.463619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"38'8","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779635+0000","last_change":"2023-10-06T04:37:17.544638+0000","last_active":"2023-10-06T04:37:26.779635+0000","last_peered":"2023-10-06T04:37:26.779635+0000","last_clean":"2023-10-06T04:37:26.779635+0000","last_became_active":"2023-10-06T04:37:17.544358+0000","last_became_peered":"2023-10-06T04:37:17.544358+0000","last_unstale":"2023-10-06T04:37:26.779635+0000","last_undegraded":"2023-10-06T04:37:26.779635+0000","last_fullsized":"2023-10-06T04:37:26.779635+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:16.140442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"38'12","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010754+0000","last_change":"2023-10-06T04:37:17.547875+0000","last_active":"2023-10-06T04:37:27.010754+0000","last_peered":"2023-10-06T04:37:27.010754+0000","last_clean":"2023-10-06T04:37:27.010754+0000","last_became_active":"2023-10-06T04:37:17.547504+0000","last_became_peered":"2023-10-06T04:37:17.547504+0000","last_unstale":"2023-10-06T04:37:27.010754+0000","last_undegraded":"2023-10-06T04:37:27.010754+0000","last_fullsized":"2023-10-06T04:37:27.010754+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:37.661915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"38'9","reported_seq":22,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:37:28.775022+0000","last_change":"2023-10-06T04:37:17.535486+0000","last_active":"2023-10-06T04:37:28.775022+0000","last_peered":"2023-10-06T04:37:28.775022+0000","last_clean":"2023-10-06T04:37:28.775022+0000","last_became_active":"2023-10-06T04:37:17.535215+0000","last_became_peered":"2023-10-06T04:37:17.535215+0000","last_unstale":"2023-10-06T04:37:28.775022+0000","last_undegraded":"2023-10-06T04:37:28.775022+0000","last_fullsized":"2023-10-06T04:37:28.775022+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:01.221591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781623+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:49.912213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"38'5","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009428+0000","last_change":"2023-10-06T04:37:17.540682+0000","last_active":"2023-10-06T04:37:27.009428+0000","last_peered":"2023-10-06T04:37:27.009428+0000","last_clean":"2023-10-06T04:37:27.009428+0000","last_became_active":"2023-10-06T04:37:17.540340+0000","last_became_peered":"2023-10-06T04:37:17.540340+0000","last_unstale":"2023-10-06T04:37:27.009428+0000","last_undegraded":"2023-10-06T04:37:27.009428+0000","last_fullsized":"2023-10-06T04:37:27.009428+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:57.066657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"39'8","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.012800+0000","last_change":"2023-10-06T04:37:16.539316+0000","last_active":"2023-10-06T04:37:27.012800+0000","last_peered":"2023-10-06T04:37:27.012800+0000","last_clean":"2023-10-06T04:37:27.012800+0000","last_became_active":"2023-10-06T04:37:16.538848+0000","last_became_peered":"2023-10-06T04:37:16.538848+0000","last_unstale":"2023-10-06T04:37:27.012800+0000","last_undegraded":"2023-10-06T04:37:27.012800+0000","last_fullsized":"2023-10-06T04:37:27.012800+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:44:55.156828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.780190+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:29:04.074820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"38'6","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010134+0000","last_change":"2023-10-06T04:37:17.549963+0000","last_active":"2023-10-06T04:37:27.010134+0000","last_peered":"2023-10-06T04:37:27.010134+0000","last_clean":"2023-10-06T04:37:27.010134+0000","last_became_active":"2023-10-06T04:37:17.545289+0000","last_became_peered":"2023-10-06T04:37:17.545289+0000","last_unstale":"2023-10-06T04:37:27.010134+0000","last_undegraded":"2023-10-06T04:37:27.010134+0000","last_fullsized":"2023-10-06T04:37:27.010134+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:01.221591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"37'1","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779943+0000","last_change":"2023-10-06T04:37:16.539806+0000","last_active":"2023-10-06T04:37:26.779943+0000","last_peered":"2023-10-06T04:37:26.779943+0000","last_clean":"2023-10-06T04:37:26.779943+0000","last_became_active":"2023-10-06T04:37:16.539514+0000","last_became_peered":"2023-10-06T04:37:16.539514+0000","last_unstale":"2023-10-06T04:37:26.779943+0000","last_undegraded":"2023-10-06T04:37:26.779943+0000","last_fullsized":"2023-10-06T04:37:26.779943+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:48.710239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":2,"reported_epoch":45,"state":"creating+activating","last_fresh":"2023-10-06T04:37:29.782949+0000","last_change":"2023-10-06T04:37:29.783069+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:29.782949+0000","last_undegraded":"2023-10-06T04:37:29.782949+0000","last_fullsized":"2023-10-06T04:37:29.782949+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:59.689245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"38'9","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009806+0000","last_change":"2023-10-06T04:37:17.549931+0000","last_active":"2023-10-06T04:37:27.009806+0000","last_peered":"2023-10-06T04:37:27.009806+0000","last_clean":"2023-10-06T04:37:27.009806+0000","last_became_active":"2023-10-06T04:37:17.549668+0000","last_became_peered":"2023-10-06T04:37:17.549668+0000","last_unstale":"2023-10-06T04:37:27.009806+0000","last_undegraded":"2023-10-06T04:37:27.009806+0000","last_fullsized":"2023-10-06T04:37:27.009806+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:27.083777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"39'3","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010418+0000","last_change":"2023-10-06T04:37:16.546111+0000","last_active":"2023-10-06T04:37:27.010418+0000","last_peered":"2023-10-06T04:37:27.010418+0000","last_clean":"2023-10-06T04:37:27.010418+0000","last_became_active":"2023-10-06T04:37:16.545811+0000","last_became_peered":"2023-10-06T04:37:16.545811+0000","last_unstale":"2023-10-06T04:37:27.010418+0000","last_undegraded":"2023-10-06T04:37:27.010418+0000","last_fullsized":"2023-10-06T04:37:27.010418+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:30.574778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.776912+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:04:11.178752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"38'15","reported_seq":28,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010260+0000","last_change":"2023-10-06T04:37:17.546138+0000","last_active":"2023-10-06T04:37:27.010260+0000","last_peered":"2023-10-06T04:37:27.010260+0000","last_clean":"2023-10-06T04:37:27.010260+0000","last_became_active":"2023-10-06T04:37:17.545845+0000","last_became_peered":"2023-10-06T04:37:17.545845+0000","last_unstale":"2023-10-06T04:37:27.010260+0000","last_undegraded":"2023-10-06T04:37:27.010260+0000","last_fullsized":"2023-10-06T04:37:27.010260+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:25.707658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"39'3","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.004858+0000","last_change":"2023-10-06T04:37:16.545947+0000","last_active":"2023-10-06T04:37:27.004858+0000","last_peered":"2023-10-06T04:37:27.004858+0000","last_clean":"2023-10-06T04:37:27.004858+0000","last_became_active":"2023-10-06T04:37:16.545700+0000","last_became_peered":"2023-10-06T04:37:16.545700+0000","last_unstale":"2023-10-06T04:37:27.004858+0000","last_undegraded":"2023-10-06T04:37:27.004858+0000","last_fullsized":"2023-10-06T04:37:27.004858+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:56.062450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.780593+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:57.475670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"38'7","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779634+0000","last_change":"2023-10-06T04:37:17.543400+0000","last_active":"2023-10-06T04:37:26.779634+0000","last_peered":"2023-10-06T04:37:26.779634+0000","last_clean":"2023-10-06T04:37:26.779634+0000","last_became_active":"2023-10-06T04:37:17.543132+0000","last_became_peered":"2023-10-06T04:37:17.543132+0000","last_unstale":"2023-10-06T04:37:26.779634+0000","last_undegraded":"2023-10-06T04:37:26.779634+0000","last_fullsized":"2023-10-06T04:37:26.779634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:50:28.268338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"37'1","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.011758+0000","last_change":"2023-10-06T04:37:16.541989+0000","last_active":"2023-10-06T04:37:27.011758+0000","last_peered":"2023-10-06T04:37:27.011758+0000","last_clean":"2023-10-06T04:37:27.011758+0000","last_became_active":"2023-10-06T04:37:16.541684+0000","last_became_peered":"2023-10-06T04:37:16.541684+0000","last_unstale":"2023-10-06T04:37:27.011758+0000","last_undegraded":"2023-10-06T04:37:27.011758+0000","last_fullsized":"2023-10-06T04:37:27.011758+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:13.019515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.779525+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:44:04.529543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"38'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009900+0000","last_change":"2023-10-06T04:37:17.546677+0000","last_active":"2023-10-06T04:37:27.009900+0000","last_peered":"2023-10-06T04:37:27.009900+0000","last_clean":"2023-10-06T04:37:27.009900+0000","last_became_active":"2023-10-06T04:37:17.546151+0000","last_became_peered":"2023-10-06T04:37:17.546151+0000","last_unstale":"2023-10-06T04:37:27.009900+0000","last_undegraded":"2023-10-06T04:37:27.009900+0000","last_fullsized":"2023-10-06T04:37:27.009900+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:16.140442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"37'1","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779812+0000","last_change":"2023-10-06T04:37:16.545939+0000","last_active":"2023-10-06T04:37:26.779812+0000","last_peered":"2023-10-06T04:37:26.779812+0000","last_clean":"2023-10-06T04:37:26.779812+0000","last_became_active":"2023-10-06T04:37:16.545722+0000","last_became_peered":"2023-10-06T04:37:16.545722+0000","last_unstale":"2023-10-06T04:37:26.779812+0000","last_undegraded":"2023-10-06T04:37:26.779812+0000","last_fullsized":"2023-10-06T04:37:26.779812+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:22.842860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781194+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:04.824490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"38'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009417+0000","last_change":"2023-10-06T04:37:17.547055+0000","last_active":"2023-10-06T04:37:27.009417+0000","last_peered":"2023-10-06T04:37:27.009417+0000","last_clean":"2023-10-06T04:37:27.009417+0000","last_became_active":"2023-10-06T04:37:17.546777+0000","last_became_peered":"2023-10-06T04:37:17.546777+0000","last_unstale":"2023-10-06T04:37:27.009417+0000","last_undegraded":"2023-10-06T04:37:27.009417+0000","last_fullsized":"2023-10-06T04:37:27.009417+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:28:51.824521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009578+0000","last_change":"2023-10-06T04:37:16.544251+0000","last_active":"2023-10-06T04:37:27.009578+0000","last_peered":"2023-10-06T04:37:27.009578+0000","last_clean":"2023-10-06T04:37:27.009578+0000","last_became_active":"2023-10-06T04:37:16.543853+0000","last_became_peered":"2023-10-06T04:37:16.543853+0000","last_unstale":"2023-10-06T04:37:27.009578+0000","last_undegraded":"2023-10-06T04:37:27.009578+0000","last_fullsized":"2023-10-06T04:37:27.009578+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:00.217384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":2,"reported_epoch":45,"state":"creating+activating","last_fresh":"2023-10-06T04:37:29.780968+0000","last_change":"2023-10-06T04:37:29.781107+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:29.780968+0000","last_undegraded":"2023-10-06T04:37:29.780968+0000","last_fullsized":"2023-10-06T04:37:29.780968+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:38:07.292570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"38'10","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009367+0000","last_change":"2023-10-06T04:37:17.550653+0000","last_active":"2023-10-06T04:37:27.009367+0000","last_peered":"2023-10-06T04:37:27.009367+0000","last_clean":"2023-10-06T04:37:27.009367+0000","last_became_active":"2023-10-06T04:37:17.550308+0000","last_became_peered":"2023-10-06T04:37:17.550308+0000","last_unstale":"2023-10-06T04:37:27.009367+0000","last_undegraded":"2023-10-06T04:37:27.009367+0000","last_fullsized":"2023-10-06T04:37:27.009367+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:06:24.079323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009535+0000","last_change":"2023-10-06T04:37:16.539539+0000","last_active":"2023-10-06T04:37:27.009535+0000","last_peered":"2023-10-06T04:37:27.009535+0000","last_clean":"2023-10-06T04:37:27.009535+0000","last_became_active":"2023-10-06T04:37:16.536276+0000","last_became_peered":"2023-10-06T04:37:16.536276+0000","last_unstale":"2023-10-06T04:37:27.009535+0000","last_undegraded":"2023-10-06T04:37:27.009535+0000","last_fullsized":"2023-10-06T04:37:27.009535+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:23.725665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781025+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:00:08.937757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"38'10","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779872+0000","last_change":"2023-10-06T04:37:17.547330+0000","last_active":"2023-10-06T04:37:26.779872+0000","last_peered":"2023-10-06T04:37:26.779872+0000","last_clean":"2023-10-06T04:37:26.779872+0000","last_became_active":"2023-10-06T04:37:17.547088+0000","last_became_peered":"2023-10-06T04:37:17.547088+0000","last_unstale":"2023-10-06T04:37:26.779872+0000","last_undegraded":"2023-10-06T04:37:26.779872+0000","last_fullsized":"2023-10-06T04:37:26.779872+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:12.970309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779917+0000","last_change":"2023-10-06T04:37:16.543071+0000","last_active":"2023-10-06T04:37:26.779917+0000","last_peered":"2023-10-06T04:37:26.779917+0000","last_clean":"2023-10-06T04:37:26.779917+0000","last_became_active":"2023-10-06T04:37:16.542755+0000","last_became_peered":"2023-10-06T04:37:16.542755+0000","last_unstale":"2023-10-06T04:37:26.779917+0000","last_undegraded":"2023-10-06T04:37:26.779917+0000","last_fullsized":"2023-10-06T04:37:26.779917+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:03.969778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.779740+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:05:06.685138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"38'9","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.004023+0000","last_change":"2023-10-06T04:37:17.546184+0000","last_active":"2023-10-06T04:37:27.004023+0000","last_peered":"2023-10-06T04:37:27.004023+0000","last_clean":"2023-10-06T04:37:27.004023+0000","last_became_active":"2023-10-06T04:37:17.545899+0000","last_became_peered":"2023-10-06T04:37:17.545899+0000","last_unstale":"2023-10-06T04:37:27.004023+0000","last_undegraded":"2023-10-06T04:37:27.004023+0000","last_fullsized":"2023-10-06T04:37:27.004023+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:35.648661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010409+0000","last_change":"2023-10-06T04:37:16.539739+0000","last_active":"2023-10-06T04:37:27.010409+0000","last_peered":"2023-10-06T04:37:27.010409+0000","last_clean":"2023-10-06T04:37:27.010409+0000","last_became_active":"2023-10-06T04:37:16.539470+0000","last_became_peered":"2023-10-06T04:37:16.539470+0000","last_unstale":"2023-10-06T04:37:27.010409+0000","last_undegraded":"2023-10-06T04:37:27.010409+0000","last_fullsized":"2023-10-06T04:37:27.010409+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:23.078870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.779529+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:01.912316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"38'11","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.012346+0000","last_change":"2023-10-06T04:37:17.543287+0000","last_active":"2023-10-06T04:37:27.012346+0000","last_peered":"2023-10-06T04:37:27.012346+0000","last_clean":"2023-10-06T04:37:27.012346+0000","last_became_active":"2023-10-06T04:37:17.543018+0000","last_became_peered":"2023-10-06T04:37:17.543018+0000","last_unstale":"2023-10-06T04:37:27.012346+0000","last_undegraded":"2023-10-06T04:37:27.012346+0000","last_fullsized":"2023-10-06T04:37:27.012346+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:18.119835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"39'5","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.005169+0000","last_change":"2023-10-06T04:37:16.545863+0000","last_active":"2023-10-06T04:37:27.005169+0000","last_peered":"2023-10-06T04:37:27.005169+0000","last_clean":"2023-10-06T04:37:27.005169+0000","last_became_active":"2023-10-06T04:37:16.545563+0000","last_became_peered":"2023-10-06T04:37:16.545563+0000","last_unstale":"2023-10-06T04:37:27.005169+0000","last_undegraded":"2023-10-06T04:37:27.005169+0000","last_fullsized":"2023-10-06T04:37:27.005169+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:36.947789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781442+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:05:06.685138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"38'6","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.005042+0000","last_change":"2023-10-06T04:37:17.541763+0000","last_active":"2023-10-06T04:37:27.005042+0000","last_peered":"2023-10-06T04:37:27.005042+0000","last_clean":"2023-10-06T04:37:27.005042+0000","last_became_active":"2023-10-06T04:37:17.541287+0000","last_became_peered":"2023-10-06T04:37:17.541287+0000","last_unstale":"2023-10-06T04:37:27.005042+0000","last_undegraded":"2023-10-06T04:37:27.005042+0000","last_fullsized":"2023-10-06T04:37:27.005042+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:34.429052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"39'23","reported_seq":37,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:37:28.775230+0000","last_change":"2023-10-06T04:37:16.538841+0000","last_active":"2023-10-06T04:37:28.775230+0000","last_peered":"2023-10-06T04:37:28.775230+0000","last_clean":"2023-10-06T04:37:28.775230+0000","last_became_active":"2023-10-06T04:37:16.538555+0000","last_became_peered":"2023-10-06T04:37:16.538555+0000","last_unstale":"2023-10-06T04:37:28.775230+0000","last_undegraded":"2023-10-06T04:37:28.775230+0000","last_fullsized":"2023-10-06T04:37:28.775230+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:01:56.504476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781750+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:51.489837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"38'10","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009545+0000","last_change":"2023-10-06T04:37:17.554238+0000","last_active":"2023-10-06T04:37:27.009545+0000","last_peered":"2023-10-06T04:37:27.009545+0000","last_clean":"2023-10-06T04:37:27.009545+0000","last_became_active":"2023-10-06T04:37:17.553995+0000","last_became_peered":"2023-10-06T04:37:17.553995+0000","last_unstale":"2023-10-06T04:37:27.009545+0000","last_undegraded":"2023-10-06T04:37:27.009545+0000","last_fullsized":"2023-10-06T04:37:27.009545+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:57.066657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"39'5","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.012000+0000","last_change":"2023-10-06T04:37:16.545424+0000","last_active":"2023-10-06T04:37:27.012000+0000","last_peered":"2023-10-06T04:37:27.012000+0000","last_clean":"2023-10-06T04:37:27.012000+0000","last_became_active":"2023-10-06T04:37:16.545158+0000","last_became_peered":"2023-10-06T04:37:16.545158+0000","last_unstale":"2023-10-06T04:37:27.012000+0000","last_undegraded":"2023-10-06T04:37:27.012000+0000","last_fullsized":"2023-10-06T04:37:27.012000+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:03.969778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781643+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:30.370133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"38'15","reported_seq":28,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009983+0000","last_change":"2023-10-06T04:37:17.543599+0000","last_active":"2023-10-06T04:37:27.009983+0000","last_peered":"2023-10-06T04:37:27.009983+0000","last_clean":"2023-10-06T04:37:27.009983+0000","last_became_active":"2023-10-06T04:37:17.543271+0000","last_became_peered":"2023-10-06T04:37:17.543271+0000","last_unstale":"2023-10-06T04:37:27.009983+0000","last_undegraded":"2023-10-06T04:37:27.009983+0000","last_fullsized":"2023-10-06T04:37:27.009983+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:37.661915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.004892+0000","last_change":"2023-10-06T04:37:16.541456+0000","last_active":"2023-10-06T04:37:27.004892+0000","last_peered":"2023-10-06T04:37:27.004892+0000","last_clean":"2023-10-06T04:37:27.004892+0000","last_became_active":"2023-10-06T04:37:16.541189+0000","last_became_peered":"2023-10-06T04:37:16.541189+0000","last_unstale":"2023-10-06T04:37:27.004892+0000","last_undegraded":"2023-10-06T04:37:27.004892+0000","last_fullsized":"2023-10-06T04:37:27.004892+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:23.078870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781759+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:07.671768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"38'6","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010461+0000","last_change":"2023-10-06T04:37:17.541658+0000","last_active":"2023-10-06T04:37:27.010461+0000","last_peered":"2023-10-06T04:37:27.010461+0000","last_clean":"2023-10-06T04:37:27.010461+0000","last_became_active":"2023-10-06T04:37:17.541349+0000","last_became_peered":"2023-10-06T04:37:17.541349+0000","last_unstale":"2023-10-06T04:37:27.010461+0000","last_undegraded":"2023-10-06T04:37:27.010461+0000","last_fullsized":"2023-10-06T04:37:27.010461+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:56.687459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010952+0000","last_change":"2023-10-06T04:37:16.545596+0000","last_active":"2023-10-06T04:37:27.010952+0000","last_peered":"2023-10-06T04:37:27.010952+0000","last_clean":"2023-10-06T04:37:27.010952+0000","last_became_active":"2023-10-06T04:37:16.545334+0000","last_became_peered":"2023-10-06T04:37:16.545334+0000","last_unstale":"2023-10-06T04:37:27.010952+0000","last_undegraded":"2023-10-06T04:37:27.010952+0000","last_fullsized":"2023-10-06T04:37:27.010952+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:26.079570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":2,"reported_epoch":45,"state":"creating+activating","last_fresh":"2023-10-06T04:37:29.781315+0000","last_change":"2023-10-06T04:37:29.781451+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:29.781315+0000","last_undegraded":"2023-10-06T04:37:29.781315+0000","last_fullsized":"2023-10-06T04:37:29.781315+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:19:45.702967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"38'6","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.004641+0000","last_change":"2023-10-06T04:37:17.552402+0000","last_active":"2023-10-06T04:37:27.004641+0000","last_peered":"2023-10-06T04:37:27.004641+0000","last_clean":"2023-10-06T04:37:27.004641+0000","last_became_active":"2023-10-06T04:37:17.552167+0000","last_became_peered":"2023-10-06T04:37:17.552167+0000","last_unstale":"2023-10-06T04:37:27.004641+0000","last_undegraded":"2023-10-06T04:37:27.004641+0000","last_fullsized":"2023-10-06T04:37:27.004641+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:14.023722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"39'15","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009650+0000","last_change":"2023-10-06T04:37:16.545180+0000","last_active":"2023-10-06T04:37:27.009650+0000","last_peered":"2023-10-06T04:37:27.009650+0000","last_clean":"2023-10-06T04:37:27.009650+0000","last_became_active":"2023-10-06T04:37:16.544707+0000","last_became_peered":"2023-10-06T04:37:16.544707+0000","last_unstale":"2023-10-06T04:37:27.009650+0000","last_undegraded":"2023-10-06T04:37:27.009650+0000","last_fullsized":"2023-10-06T04:37:27.009650+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:49.969750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.784527+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:03:50.233469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"38'5","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:37:28.775240+0000","last_change":"2023-10-06T04:37:17.545469+0000","last_active":"2023-10-06T04:37:28.775240+0000","last_peered":"2023-10-06T04:37:28.775240+0000","last_clean":"2023-10-06T04:37:28.775240+0000","last_became_active":"2023-10-06T04:37:17.545212+0000","last_became_peered":"2023-10-06T04:37:17.545212+0000","last_unstale":"2023-10-06T04:37:28.775240+0000","last_undegraded":"2023-10-06T04:37:28.775240+0000","last_fullsized":"2023-10-06T04:37:28.775240+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:41.211245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"39'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:37:28.775128+0000","last_change":"2023-10-06T04:37:16.537956+0000","last_active":"2023-10-06T04:37:28.775128+0000","last_peered":"2023-10-06T04:37:28.775128+0000","last_clean":"2023-10-06T04:37:28.775128+0000","last_became_active":"2023-10-06T04:37:16.537733+0000","last_became_peered":"2023-10-06T04:37:16.537733+0000","last_unstale":"2023-10-06T04:37:28.775128+0000","last_undegraded":"2023-10-06T04:37:28.775128+0000","last_fullsized":"2023-10-06T04:37:28.775128+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:26:53.482793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":2,"reported_epoch":45,"state":"creating+activating","last_fresh":"2023-10-06T04:37:29.781336+0000","last_change":"2023-10-06T04:37:29.781477+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:29.781336+0000","last_undegraded":"2023-10-06T04:37:29.781336+0000","last_fullsized":"2023-10-06T04:37:29.781336+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:20.831560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":["3","5"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"38'9","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009765+0000","last_change":"2023-10-06T04:37:17.540242+0000","last_active":"2023-10-06T04:37:27.009765+0000","last_peered":"2023-10-06T04:37:27.009765+0000","last_clean":"2023-10-06T04:37:27.009765+0000","last_became_active":"2023-10-06T04:37:17.539986+0000","last_became_peered":"2023-10-06T04:37:17.539986+0000","last_unstale":"2023-10-06T04:37:27.009765+0000","last_undegraded":"2023-10-06T04:37:27.009765+0000","last_fullsized":"2023-10-06T04:37:27.009765+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:50:28.268338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"39'3","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779857+0000","last_change":"2023-10-06T04:37:16.541934+0000","last_active":"2023-10-06T04:37:26.779857+0000","last_peered":"2023-10-06T04:37:26.779857+0000","last_clean":"2023-10-06T04:37:26.779857+0000","last_became_active":"2023-10-06T04:37:16.539725+0000","last_became_peered":"2023-10-06T04:37:16.539725+0000","last_unstale":"2023-10-06T04:37:26.779857+0000","last_undegraded":"2023-10-06T04:37:26.779857+0000","last_fullsized":"2023-10-06T04:37:26.779857+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:44:55.156828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.783668+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:58.515292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"38'6","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010154+0000","last_change":"2023-10-06T04:37:17.550239+0000","last_active":"2023-10-06T04:37:27.010154+0000","last_peered":"2023-10-06T04:37:27.010154+0000","last_clean":"2023-10-06T04:37:27.010154+0000","last_became_active":"2023-10-06T04:37:17.549997+0000","last_became_peered":"2023-10-06T04:37:17.549997+0000","last_unstale":"2023-10-06T04:37:27.010154+0000","last_undegraded":"2023-10-06T04:37:27.010154+0000","last_fullsized":"2023-10-06T04:37:27.010154+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:24.083076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"39'2","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009726+0000","last_change":"2023-10-06T04:37:16.544014+0000","last_active":"2023-10-06T04:37:27.009726+0000","last_peered":"2023-10-06T04:37:27.009726+0000","last_clean":"2023-10-06T04:37:27.009726+0000","last_became_active":"2023-10-06T04:37:16.543718+0000","last_became_peered":"2023-10-06T04:37:16.543718+0000","last_unstale":"2023-10-06T04:37:27.009726+0000","last_undegraded":"2023-10-06T04:37:27.009726+0000","last_fullsized":"2023-10-06T04:37:27.009726+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:39.796065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.779491+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:10:36.939764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"38'7","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009967+0000","last_change":"2023-10-06T04:37:17.551493+0000","last_active":"2023-10-06T04:37:27.009967+0000","last_peered":"2023-10-06T04:37:27.009967+0000","last_clean":"2023-10-06T04:37:27.009967+0000","last_became_active":"2023-10-06T04:37:17.550988+0000","last_became_peered":"2023-10-06T04:37:17.550988+0000","last_unstale":"2023-10-06T04:37:27.009967+0000","last_undegraded":"2023-10-06T04:37:27.009967+0000","last_fullsized":"2023-10-06T04:37:27.009967+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:33.731628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.012579+0000","last_change":"2023-10-06T04:37:16.537845+0000","last_active":"2023-10-06T04:37:27.012579+0000","last_peered":"2023-10-06T04:37:27.012579+0000","last_clean":"2023-10-06T04:37:27.012579+0000","last_became_active":"2023-10-06T04:37:16.537568+0000","last_became_peered":"2023-10-06T04:37:16.537568+0000","last_unstale":"2023-10-06T04:37:27.012579+0000","last_undegraded":"2023-10-06T04:37:27.012579+0000","last_fullsized":"2023-10-06T04:37:27.012579+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:43.624572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.776912+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:32:57.793172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"38'5","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.011164+0000","last_change":"2023-10-06T04:37:17.538502+0000","last_active":"2023-10-06T04:37:27.011164+0000","last_peered":"2023-10-06T04:37:27.011164+0000","last_clean":"2023-10-06T04:37:27.011164+0000","last_became_active":"2023-10-06T04:37:17.538215+0000","last_became_peered":"2023-10-06T04:37:17.538215+0000","last_unstale":"2023-10-06T04:37:27.011164+0000","last_undegraded":"2023-10-06T04:37:27.011164+0000","last_fullsized":"2023-10-06T04:37:27.011164+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:45.225371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"39'4","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.012118+0000","last_change":"2023-10-06T04:37:16.540351+0000","last_active":"2023-10-06T04:37:27.012118+0000","last_peered":"2023-10-06T04:37:27.012118+0000","last_clean":"2023-10-06T04:37:27.012118+0000","last_became_active":"2023-10-06T04:37:16.539257+0000","last_became_peered":"2023-10-06T04:37:16.539257+0000","last_unstale":"2023-10-06T04:37:27.012118+0000","last_undegraded":"2023-10-06T04:37:27.012118+0000","last_fullsized":"2023-10-06T04:37:27.012118+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:33.424846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781178+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:31.261862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"38'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009845+0000","last_change":"2023-10-06T04:37:17.546443+0000","last_active":"2023-10-06T04:37:27.009845+0000","last_peered":"2023-10-06T04:37:27.009845+0000","last_clean":"2023-10-06T04:37:27.009845+0000","last_became_active":"2023-10-06T04:37:17.546233+0000","last_became_peered":"2023-10-06T04:37:17.546233+0000","last_unstale":"2023-10-06T04:37:27.009845+0000","last_undegraded":"2023-10-06T04:37:27.009845+0000","last_fullsized":"2023-10-06T04:37:27.009845+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:41.211245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009787+0000","last_change":"2023-10-06T04:37:16.545188+0000","last_active":"2023-10-06T04:37:27.009787+0000","last_peered":"2023-10-06T04:37:27.009787+0000","last_clean":"2023-10-06T04:37:27.009787+0000","last_became_active":"2023-10-06T04:37:16.544735+0000","last_became_peered":"2023-10-06T04:37:16.544735+0000","last_unstale":"2023-10-06T04:37:27.009787+0000","last_undegraded":"2023-10-06T04:37:27.009787+0000","last_fullsized":"2023-10-06T04:37:27.009787+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:56.062450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.784055+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:49.503329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"38'9","reported_seq":22,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:37:28.775026+0000","last_change":"2023-10-06T04:37:17.544085+0000","last_active":"2023-10-06T04:37:28.775026+0000","last_peered":"2023-10-06T04:37:28.775026+0000","last_clean":"2023-10-06T04:37:28.775026+0000","last_became_active":"2023-10-06T04:37:17.543802+0000","last_became_peered":"2023-10-06T04:37:17.543802+0000","last_unstale":"2023-10-06T04:37:28.775026+0000","last_undegraded":"2023-10-06T04:37:28.775026+0000","last_fullsized":"2023-10-06T04:37:28.775026+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:31.578985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010008+0000","last_change":"2023-10-06T04:37:16.539674+0000","last_active":"2023-10-06T04:37:27.010008+0000","last_peered":"2023-10-06T04:37:27.010008+0000","last_clean":"2023-10-06T04:37:27.010008+0000","last_became_active":"2023-10-06T04:37:16.539399+0000","last_became_peered":"2023-10-06T04:37:16.539399+0000","last_unstale":"2023-10-06T04:37:27.010008+0000","last_undegraded":"2023-10-06T04:37:27.010008+0000","last_fullsized":"2023-10-06T04:37:27.010008+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:36.947789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.782348+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:14:52.399101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"38'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010119+0000","last_change":"2023-10-06T04:37:17.536857+0000","last_active":"2023-10-06T04:37:27.010119+0000","last_peered":"2023-10-06T04:37:27.010119+0000","last_clean":"2023-10-06T04:37:27.010119+0000","last_became_active":"2023-10-06T04:37:17.536593+0000","last_became_peered":"2023-10-06T04:37:17.536593+0000","last_unstale":"2023-10-06T04:37:27.010119+0000","last_undegraded":"2023-10-06T04:37:27.010119+0000","last_fullsized":"2023-10-06T04:37:27.010119+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:37.253030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.004474+0000","last_change":"2023-10-06T04:37:16.541430+0000","last_active":"2023-10-06T04:37:27.004474+0000","last_peered":"2023-10-06T04:37:27.004474+0000","last_clean":"2023-10-06T04:37:27.004474+0000","last_became_active":"2023-10-06T04:37:16.541211+0000","last_became_peered":"2023-10-06T04:37:16.541211+0000","last_unstale":"2023-10-06T04:37:27.004474+0000","last_undegraded":"2023-10-06T04:37:27.004474+0000","last_fullsized":"2023-10-06T04:37:27.004474+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:15:48.328371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781549+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:23.375847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"38'7","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.011879+0000","last_change":"2023-10-06T04:37:17.541674+0000","last_active":"2023-10-06T04:37:27.011879+0000","last_peered":"2023-10-06T04:37:27.011879+0000","last_clean":"2023-10-06T04:37:27.011879+0000","last_became_active":"2023-10-06T04:37:17.541397+0000","last_became_peered":"2023-10-06T04:37:17.541397+0000","last_unstale":"2023-10-06T04:37:27.011879+0000","last_undegraded":"2023-10-06T04:37:27.011879+0000","last_fullsized":"2023-10-06T04:37:27.011879+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:19.011564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779727+0000","last_change":"2023-10-06T04:37:16.539297+0000","last_active":"2023-10-06T04:37:26.779727+0000","last_peered":"2023-10-06T04:37:26.779727+0000","last_clean":"2023-10-06T04:37:26.779727+0000","last_became_active":"2023-10-06T04:37:16.538921+0000","last_became_peered":"2023-10-06T04:37:16.538921+0000","last_unstale":"2023-10-06T04:37:26.779727+0000","last_undegraded":"2023-10-06T04:37:26.779727+0000","last_fullsized":"2023-10-06T04:37:26.779727+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:26.079570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":35,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779801+0000","last_change":"2023-10-06T04:36:11.192215+0000","last_active":"2023-10-06T04:37:26.779801+0000","last_peered":"2023-10-06T04:37:26.779801+0000","last_clean":"2023-10-06T04:37:26.779801+0000","last_became_active":"2023-10-06T04:36:11.191953+0000","last_became_peered":"2023-10-06T04:36:11.191953+0000","last_unstale":"2023-10-06T04:37:26.779801+0000","last_undegraded":"2023-10-06T04:37:26.779801+0000","last_fullsized":"2023-10-06T04:37:26.779801+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:37.026121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.783158+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:29:04.074820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"38'8","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.011406+0000","last_change":"2023-10-06T04:37:17.536572+0000","last_active":"2023-10-06T04:37:27.011406+0000","last_peered":"2023-10-06T04:37:27.011406+0000","last_clean":"2023-10-06T04:37:27.011406+0000","last_became_active":"2023-10-06T04:37:17.536250+0000","last_became_peered":"2023-10-06T04:37:17.536250+0000","last_unstale":"2023-10-06T04:37:27.011406+0000","last_undegraded":"2023-10-06T04:37:27.011406+0000","last_fullsized":"2023-10-06T04:37:27.011406+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:16.140442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.005195+0000","last_change":"2023-10-06T04:37:16.542301+0000","last_active":"2023-10-06T04:37:27.005195+0000","last_peered":"2023-10-06T04:37:27.005195+0000","last_clean":"2023-10-06T04:37:27.005195+0000","last_became_active":"2023-10-06T04:37:16.541967+0000","last_became_peered":"2023-10-06T04:37:16.541967+0000","last_unstale":"2023-10-06T04:37:27.005195+0000","last_undegraded":"2023-10-06T04:37:27.005195+0000","last_fullsized":"2023-10-06T04:37:27.005195+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:24.703451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":32,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.012571+0000","last_change":"2023-10-06T04:36:11.184555+0000","last_active":"2023-10-06T04:37:27.012571+0000","last_peered":"2023-10-06T04:37:27.012571+0000","last_clean":"2023-10-06T04:37:27.012571+0000","last_became_active":"2023-10-06T04:36:11.184229+0000","last_became_peered":"2023-10-06T04:36:11.184229+0000","last_unstale":"2023-10-06T04:37:27.012571+0000","last_undegraded":"2023-10-06T04:37:27.012571+0000","last_fullsized":"2023-10-06T04:37:27.012571+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:19.938716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.785119+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:47:25.866319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"38'5","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.005105+0000","last_change":"2023-10-06T04:37:17.548551+0000","last_active":"2023-10-06T04:37:27.005105+0000","last_peered":"2023-10-06T04:37:27.005105+0000","last_clean":"2023-10-06T04:37:27.005105+0000","last_became_active":"2023-10-06T04:37:17.548252+0000","last_became_peered":"2023-10-06T04:37:17.548252+0000","last_unstale":"2023-10-06T04:37:27.005105+0000","last_undegraded":"2023-10-06T04:37:27.005105+0000","last_fullsized":"2023-10-06T04:37:27.005105+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:23.847066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010028+0000","last_change":"2023-10-06T04:37:16.546270+0000","last_active":"2023-10-06T04:37:27.010028+0000","last_peered":"2023-10-06T04:37:27.010028+0000","last_clean":"2023-10-06T04:37:27.010028+0000","last_became_active":"2023-10-06T04:37:16.545969+0000","last_became_peered":"2023-10-06T04:37:16.545969+0000","last_unstale":"2023-10-06T04:37:27.010028+0000","last_undegraded":"2023-10-06T04:37:27.010028+0000","last_fullsized":"2023-10-06T04:37:27.010028+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:37.190837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":31,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009929+0000","last_change":"2023-10-06T04:36:11.184460+0000","last_active":"2023-10-06T04:37:27.009929+0000","last_peered":"2023-10-06T04:37:27.009929+0000","last_clean":"2023-10-06T04:37:27.009929+0000","last_became_active":"2023-10-06T04:36:11.184119+0000","last_became_peered":"2023-10-06T04:36:11.184119+0000","last_unstale":"2023-10-06T04:37:27.009929+0000","last_undegraded":"2023-10-06T04:37:27.009929+0000","last_fullsized":"2023-10-06T04:37:27.009929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:37.026121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":179,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.004768+0000","last_change":"2023-10-06T04:36:12.183155+0000","last_active":"2023-10-06T04:37:27.004768+0000","last_peered":"2023-10-06T04:37:27.004768+0000","last_clean":"2023-10-06T04:37:27.004768+0000","last_became_active":"2023-10-06T04:36:12.182903+0000","last_became_peered":"2023-10-06T04:36:12.182903+0000","last_unstale":"2023-10-06T04:37:27.004768+0000","last_undegraded":"2023-10-06T04:37:27.004768+0000","last_fullsized":"2023-10-06T04:37:27.004768+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:11.171104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:11.171104+0000","last_clean_scrub_stamp":"2023-10-06T04:36:11.171104+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:38:54.323364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":2,"reported_epoch":45,"state":"creating+activating","last_fresh":"2023-10-06T04:37:29.783254+0000","last_change":"2023-10-06T04:37:29.783380+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:29.783254+0000","last_undegraded":"2023-10-06T04:37:29.783254+0000","last_fullsized":"2023-10-06T04:37:29.783254+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:00:47.460409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"38'9","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010189+0000","last_change":"2023-10-06T04:37:17.537793+0000","last_active":"2023-10-06T04:37:27.010189+0000","last_peered":"2023-10-06T04:37:27.010189+0000","last_clean":"2023-10-06T04:37:27.010189+0000","last_became_active":"2023-10-06T04:37:17.537503+0000","last_became_peered":"2023-10-06T04:37:17.537503+0000","last_unstale":"2023-10-06T04:37:27.010189+0000","last_undegraded":"2023-10-06T04:37:27.010189+0000","last_fullsized":"2023-10-06T04:37:27.010189+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:19.011564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.005224+0000","last_change":"2023-10-06T04:37:16.545879+0000","last_active":"2023-10-06T04:37:27.005224+0000","last_peered":"2023-10-06T04:37:27.005224+0000","last_clean":"2023-10-06T04:37:27.005224+0000","last_became_active":"2023-10-06T04:37:16.545603+0000","last_became_peered":"2023-10-06T04:37:16.545603+0000","last_unstale":"2023-10-06T04:37:27.005224+0000","last_undegraded":"2023-10-06T04:37:27.005224+0000","last_fullsized":"2023-10-06T04:37:27.005224+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:40.207039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":30,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.004883+0000","last_change":"2023-10-06T04:36:11.193056+0000","last_active":"2023-10-06T04:37:27.004883+0000","last_peered":"2023-10-06T04:37:27.004883+0000","last_clean":"2023-10-06T04:37:27.004883+0000","last_became_active":"2023-10-06T04:36:11.192712+0000","last_became_peered":"2023-10-06T04:36:11.192712+0000","last_unstale":"2023-10-06T04:37:27.004883+0000","last_undegraded":"2023-10-06T04:37:27.004883+0000","last_fullsized":"2023-10-06T04:37:27.004883+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:00.008654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.776857+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:13.574637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"38'7","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010402+0000","last_change":"2023-10-06T04:37:17.547978+0000","last_active":"2023-10-06T04:37:27.010402+0000","last_peered":"2023-10-06T04:37:27.010402+0000","last_clean":"2023-10-06T04:37:27.010402+0000","last_became_active":"2023-10-06T04:37:17.547342+0000","last_became_peered":"2023-10-06T04:37:17.547342+0000","last_unstale":"2023-10-06T04:37:27.010402+0000","last_undegraded":"2023-10-06T04:37:27.010402+0000","last_fullsized":"2023-10-06T04:37:27.010402+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:12.970309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"39'3","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010279+0000","last_change":"2023-10-06T04:37:16.544363+0000","last_active":"2023-10-06T04:37:27.010279+0000","last_peered":"2023-10-06T04:37:27.010279+0000","last_clean":"2023-10-06T04:37:27.010279+0000","last_became_active":"2023-10-06T04:37:16.544100+0000","last_became_peered":"2023-10-06T04:37:16.544100+0000","last_unstale":"2023-10-06T04:37:27.010279+0000","last_undegraded":"2023-10-06T04:37:27.010279+0000","last_fullsized":"2023-10-06T04:37:27.010279+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:24.703451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":30,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.004660+0000","last_change":"2023-10-06T04:36:11.192701+0000","last_active":"2023-10-06T04:37:27.004660+0000","last_peered":"2023-10-06T04:37:27.004660+0000","last_clean":"2023-10-06T04:37:27.004660+0000","last_became_active":"2023-10-06T04:36:11.192335+0000","last_became_peered":"2023-10-06T04:36:11.192335+0000","last_unstale":"2023-10-06T04:37:27.004660+0000","last_undegraded":"2023-10-06T04:37:27.004660+0000","last_fullsized":"2023-10-06T04:37:27.004660+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:18.643570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.782838+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:57.475670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"38'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010179+0000","last_change":"2023-10-06T04:37:17.551353+0000","last_active":"2023-10-06T04:37:27.010179+0000","last_peered":"2023-10-06T04:37:27.010179+0000","last_clean":"2023-10-06T04:37:27.010179+0000","last_became_active":"2023-10-06T04:37:17.550655+0000","last_became_peered":"2023-10-06T04:37:17.550655+0000","last_unstale":"2023-10-06T04:37:27.010179+0000","last_undegraded":"2023-10-06T04:37:27.010179+0000","last_fullsized":"2023-10-06T04:37:27.010179+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:37.951996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"39'3","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.012650+0000","last_change":"2023-10-06T04:37:16.541672+0000","last_active":"2023-10-06T04:37:27.012650+0000","last_peered":"2023-10-06T04:37:27.012650+0000","last_clean":"2023-10-06T04:37:27.012650+0000","last_became_active":"2023-10-06T04:37:16.541369+0000","last_became_peered":"2023-10-06T04:37:16.541369+0000","last_unstale":"2023-10-06T04:37:27.012650+0000","last_undegraded":"2023-10-06T04:37:27.012650+0000","last_fullsized":"2023-10-06T04:37:27.012650+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:34.644455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":31,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009672+0000","last_change":"2023-10-06T04:36:11.193497+0000","last_active":"2023-10-06T04:37:27.009672+0000","last_peered":"2023-10-06T04:37:27.009672+0000","last_clean":"2023-10-06T04:37:27.009672+0000","last_became_active":"2023-10-06T04:36:11.193215+0000","last_became_peered":"2023-10-06T04:36:11.193215+0000","last_unstale":"2023-10-06T04:37:27.009672+0000","last_undegraded":"2023-10-06T04:37:27.009672+0000","last_fullsized":"2023-10-06T04:37:27.009672+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:07.497987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":2,"reported_epoch":45,"state":"creating+activating","last_fresh":"2023-10-06T04:37:29.782182+0000","last_change":"2023-10-06T04:37:29.782296+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:29.782182+0000","last_undegraded":"2023-10-06T04:37:29.782182+0000","last_fullsized":"2023-10-06T04:37:29.782182+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:48.194911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"38'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009383+0000","last_change":"2023-10-06T04:37:17.548282+0000","last_active":"2023-10-06T04:37:27.009383+0000","last_peered":"2023-10-06T04:37:27.009383+0000","last_clean":"2023-10-06T04:37:27.009383+0000","last_became_active":"2023-10-06T04:37:17.548037+0000","last_became_peered":"2023-10-06T04:37:17.548037+0000","last_unstale":"2023-10-06T04:37:27.009383+0000","last_undegraded":"2023-10-06T04:37:27.009383+0000","last_fullsized":"2023-10-06T04:37:27.009383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:44:56.161035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009537+0000","last_change":"2023-10-06T04:37:16.539573+0000","last_active":"2023-10-06T04:37:27.009537+0000","last_peered":"2023-10-06T04:37:27.009537+0000","last_clean":"2023-10-06T04:37:27.009537+0000","last_became_active":"2023-10-06T04:37:16.539271+0000","last_became_peered":"2023-10-06T04:37:16.539271+0000","last_unstale":"2023-10-06T04:37:27.009537+0000","last_undegraded":"2023-10-06T04:37:27.009537+0000","last_fullsized":"2023-10-06T04:37:27.009537+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:06:23.075116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010044+0000","last_change":"2023-10-06T04:36:11.193111+0000","last_active":"2023-10-06T04:37:27.010044+0000","last_peered":"2023-10-06T04:37:27.010044+0000","last_clean":"2023-10-06T04:37:27.010044+0000","last_became_active":"2023-10-06T04:36:11.192836+0000","last_became_peered":"2023-10-06T04:36:11.192836+0000","last_unstale":"2023-10-06T04:37:27.010044+0000","last_undegraded":"2023-10-06T04:37:27.010044+0000","last_fullsized":"2023-10-06T04:37:27.010044+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:19.938716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781463+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:25.262954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"38'5","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779612+0000","last_change":"2023-10-06T04:37:17.546750+0000","last_active":"2023-10-06T04:37:26.779612+0000","last_peered":"2023-10-06T04:37:26.779612+0000","last_clean":"2023-10-06T04:37:26.779612+0000","last_became_active":"2023-10-06T04:37:17.546467+0000","last_became_peered":"2023-10-06T04:37:17.546467+0000","last_unstale":"2023-10-06T04:37:26.779612+0000","last_undegraded":"2023-10-06T04:37:26.779612+0000","last_fullsized":"2023-10-06T04:37:26.779612+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:58.928454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009752+0000","last_change":"2023-10-06T04:37:16.544678+0000","last_active":"2023-10-06T04:37:27.009752+0000","last_peered":"2023-10-06T04:37:27.009752+0000","last_clean":"2023-10-06T04:37:27.009752+0000","last_became_active":"2023-10-06T04:37:16.541041+0000","last_became_peered":"2023-10-06T04:37:16.541041+0000","last_unstale":"2023-10-06T04:37:27.009752+0000","last_undegraded":"2023-10-06T04:37:27.009752+0000","last_fullsized":"2023-10-06T04:37:27.009752+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:15:48.328371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010333+0000","last_change":"2023-10-06T04:36:11.182804+0000","last_active":"2023-10-06T04:37:27.010333+0000","last_peered":"2023-10-06T04:37:27.010333+0000","last_clean":"2023-10-06T04:37:27.010333+0000","last_became_active":"2023-10-06T04:36:11.182575+0000","last_became_peered":"2023-10-06T04:36:11.182575+0000","last_unstale":"2023-10-06T04:37:27.010333+0000","last_undegraded":"2023-10-06T04:37:27.010333+0000","last_fullsized":"2023-10-06T04:37:27.010333+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:07.497987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":504,"ondisk_log_size":504,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":93,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298368,"kb_used_data":1080,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073472,"statfs":{"total":96636764160,"available":96331235328,"internally_reserved":0,"allocated":1105920,"data_stored":826104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.50600000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.57099999999999995}]},{"osd":2,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.625}]},{"osd":3,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.55800000000000005}]},{"osd":4,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.58099999999999996}]},{"osd":5,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.45900000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.47099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301884,"kb_used_data":4596,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94069956,"statfs":{"total":96636764160,"available":96327634944,"internally_reserved":0,"allocated":4706304,"data_stored":4430040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":10.045999999999999,"5min":10.045999999999999,"15min":10.045999999999999},"last":0.57699999999999996}]},{"osd":1,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":10.125999999999999,"5min":10.125999999999999,"15min":10.125999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.60499999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":10.238,"5min":10.238,"15min":10.238},"last":0.59699999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":4.4870000000000001,"5min":4.4870000000000001,"15min":4.4870000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":10.393000000000001,"5min":10.393000000000001,"15min":10.393000000000001},"last":0.626}]},{"osd":4,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.40400000000000003}]},{"osd":5,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.377},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.39000000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.434},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.34300000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298368,"kb_used_data":1080,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073472,"statfs":{"total":96636764160,"available":96331235328,"internally_reserved":0,"allocated":1105920,"data_stored":826104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.38700000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.307}]},{"osd":3,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.28699999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.60099999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.61399999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.628}]},{"osd":7,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.65700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301880,"kb_used_data":4592,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94069960,"statfs":{"total":96636764160,"available":96327639040,"internally_reserved":0,"allocated":4702208,"data_stored":4429062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.443,"5min":0.443,"15min":0.443},"last":0.312}]},{"osd":2,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.28999999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.42399999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.73399999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.68700000000000006}]},{"osd":7,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.629},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.66500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297784,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074056,"statfs":{"total":96636764160,"available":96331833344,"internally_reserved":0,"allocated":507904,"data_stored":234758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.432}]},{"osd":1,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.35899999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.378}]},{"osd":4,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.47099999999999997}]},{"osd":5,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.495}]},{"osd":6,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.628},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.64800000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.58299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297784,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074056,"statfs":{"total":96636764160,"available":96331833344,"internally_reserved":0,"allocated":507904,"data_stored":234758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.318},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.442,"5min":0.442,"15min":0.442},"last":0.29199999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.436,"5min":0.436,"15min":0.436},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.27700000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.35399999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.1070000000000002,"5min":2.1070000000000002,"15min":2.1070000000000002},"last":0.51900000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":0.497},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.55200000000000005}]},{"osd":6,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.63},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.54300000000000004}]},{"osd":7,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.52900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299836,"kb_used_data":2548,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072004,"statfs":{"total":96636764160,"available":96329732096,"internally_reserved":0,"allocated":2609152,"data_stored":2332888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":4.2919999999999998,"5min":4.2919999999999998,"15min":4.2919999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.317}]},{"osd":1,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":4.3520000000000003,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":0.34999999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.54400000000000004}]},{"osd":3,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.501}]},{"osd":5,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.38800000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.44},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.59599999999999997}]},{"osd":7,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.623}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299836,"kb_used_data":2548,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072004,"statfs":{"total":96636764160,"available":96329732096,"internally_reserved":0,"allocated":2609152,"data_stored":2332888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.42499999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.40100000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.372},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.48999999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.54400000000000004}]},{"osd":4,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.501}]},{"osd":6,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.51100000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.52400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:37:34.285 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:37:34.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.435+0000 7f44742b9700 1 Processor -- start 2023-10-06T04:37:34.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.435+0000 7f44742b9700 1 -- start start 2023-10-06T04:37:34.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.436+0000 7f44742b9700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f446c1597e0 0x7f446c15e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:34.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.436+0000 7f44742b9700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f446c0685e0 0x7f446c068a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:34.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.436+0000 7f44742b9700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f446c15db90 con 0x7f446c0aaae0 2023-10-06T04:37:34.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.436+0000 7f44742b9700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f446c15e560 con 0x7f446c1597e0 2023-10-06T04:37:34.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.436+0000 7f44742b9700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446c068fa0 con 0x7f446c0685e0 2023-10-06T04:37:34.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.437+0000 7f4472055700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f446c1597e0 0x7f446c15e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:34.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.437+0000 7f4471854700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f446c0685e0 0x7f446c068a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:34.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.437+0000 7f4472055700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f446c1597e0 0x7f446c15e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.8:33388/0 (socket says 172.21.15.8:33388) 2023-10-06T04:37:34.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.437+0000 7f4471854700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f446c0685e0 0x7f446c068a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.8:44304/0 (socket says 172.21.15.8:44304) 2023-10-06T04:37:34.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.437+0000 7f4472856700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f446c0aaae0 0x7f446c0aaf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.8:36368/0 (socket says 172.21.15.8:36368) 2023-10-06T04:37:34.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.437+0000 7f4472055700 1 -- 172.21.15.8:0/3701073045 learned_addr learned my addr 172.21.15.8:0/3701073045 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:34.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.437+0000 7f4472055700 1 -- 172.21.15.8:0/3701073045 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f446c0685e0 msgr2=0x7f446c068a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:34.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.437+0000 7f4472055700 1 --2- 172.21.15.8:0/3701073045 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f446c0685e0 0x7f446c068a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:34.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.437+0000 7f4472055700 1 -- 172.21.15.8:0/3701073045 >> v1:172.21.15.184:6789/0 conn(0x7f446c0aaae0 legacy=0x7f446c0aaf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:34.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.437+0000 7f4472055700 1 -- 172.21.15.8:0/3701073045 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446c0acec0 con 0x7f446c1597e0 2023-10-06T04:37:34.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.437+0000 7f4471053700 1 -- 172.21.15.8:0/3701073045 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1166478710 0 0) 0x7f446c15db90 con 0x7f446c0aaae0 2023-10-06T04:37:34.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.437+0000 7f4472055700 1 --2- 172.21.15.8:0/3701073045 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f446c1597e0 0x7f446c15e020 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f445c009f50 tx=0x7f445c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e87be9729c5b3cc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:34.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.438+0000 7f4471053700 1 -- 172.21.15.8:0/3701073045 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c00e070 con 0x7f446c1597e0 2023-10-06T04:37:34.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.438+0000 7f4471053700 1 -- 172.21.15.8:0/3701073045 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445c00b9c0 con 0x7f446c1597e0 2023-10-06T04:37:34.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.438+0000 7f4471053700 1 -- 172.21.15.8:0/3701073045 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c0092e0 con 0x7f446c1597e0 2023-10-06T04:37:34.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.438+0000 7f44742b9700 1 -- 172.21.15.8:0/3701073045 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f446c1597e0 msgr2=0x7f446c15e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:34.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.438+0000 7f44742b9700 1 --2- 172.21.15.8:0/3701073045 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f446c1597e0 0x7f446c15e020 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f445c009f50 tx=0x7f445c009840 comp rx=0 tx=0).stop 2023-10-06T04:37:34.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.438+0000 7f44742b9700 1 -- 172.21.15.8:0/3701073045 shutdown_connections 2023-10-06T04:37:34.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.438+0000 7f44742b9700 1 --2- 172.21.15.8:0/3701073045 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f446c1597e0 0x7f446c15e020 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:34.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.438+0000 7f44742b9700 1 --2- 172.21.15.8:0/3701073045 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f446c0685e0 0x7f446c068a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:34.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.438+0000 7f44742b9700 1 -- 172.21.15.8:0/3701073045 >> 172.21.15.8:0/3701073045 conn(0x7f446c06dd50 msgr2=0x7f446c06e150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:34.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.438+0000 7f44742b9700 1 -- 172.21.15.8:0/3701073045 shutdown_connections 2023-10-06T04:37:34.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.438+0000 7f44742b9700 1 -- 172.21.15.8:0/3701073045 wait complete. 2023-10-06T04:37:34.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.439+0000 7f44742b9700 1 Processor -- start 2023-10-06T04:37:34.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.439+0000 7f44742b9700 1 -- start start 2023-10-06T04:37:34.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.440+0000 7f44742b9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f446c0685e0 0x7f446c0cb780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:34.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.440+0000 7f44742b9700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f446c0aaae0 0x7f446c0ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:34.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.440+0000 7f44742b9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f446c1597e0 0x7f446c147dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:34.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.440+0000 7f44742b9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c0af660 con 0x7f446c0685e0 2023-10-06T04:37:34.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.440+0000 7f44742b9700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c0af940 con 0x7f446c1597e0 2023-10-06T04:37:34.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.440+0000 7f44742b9700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446c0ca7d0 con 0x7f446c0aaae0 2023-10-06T04:37:34.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.440+0000 7f4472055700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f446c0685e0 0x7f446c0cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:34.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.440+0000 7f4472055700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f446c0685e0 0x7f446c0cb780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54330/0 (socket says 172.21.15.8:54330) 2023-10-06T04:37:34.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.440+0000 7f4472055700 1 -- 172.21.15.8:0/1266446559 learned_addr learned my addr 172.21.15.8:0/1266446559 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:34.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.440+0000 7f4472856700 1 --2- 172.21.15.8:0/1266446559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f446c1597e0 0x7f446c147dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:34.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.440+0000 7f4471854700 1 --2- 172.21.15.8:0/1266446559 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f446c0aaae0 0x7f446c0ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:34.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.440+0000 7f4472055700 1 -- 172.21.15.8:0/1266446559 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f446c0aaae0 msgr2=0x7f446c0ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:34.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.440+0000 7f4472055700 1 --2- 172.21.15.8:0/1266446559 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f446c0aaae0 0x7f446c0ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:34.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.440+0000 7f4472055700 1 -- 172.21.15.8:0/1266446559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f446c1597e0 msgr2=0x7f446c147dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:34.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.440+0000 7f4472055700 1 --2- 172.21.15.8:0/1266446559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f446c1597e0 0x7f446c147dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:34.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.440+0000 7f4472055700 1 -- 172.21.15.8:0/1266446559 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445c009ae0 con 0x7f446c0685e0 2023-10-06T04:37:34.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.441+0000 7f4472055700 1 --2- 172.21.15.8:0/1266446559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f446c0685e0 0x7f446c0cb780 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f445c009880 tx=0x7f445c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:34.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.441+0000 7f446a7fc700 1 -- 172.21.15.8:0/1266446559 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c008ad0 con 0x7f446c0685e0 2023-10-06T04:37:34.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.441+0000 7f446a7fc700 1 -- 172.21.15.8:0/1266446559 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445c008c50 con 0x7f446c0685e0 2023-10-06T04:37:34.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.441+0000 7f44742b9700 1 -- 172.21.15.8:0/1266446559 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f446c0caa70 con 0x7f446c0685e0 2023-10-06T04:37:34.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.441+0000 7f446a7fc700 1 -- 172.21.15.8:0/1266446559 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c026460 con 0x7f446c0685e0 2023-10-06T04:37:34.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.441+0000 7f44742b9700 1 -- 172.21.15.8:0/1266446559 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f446c0cb030 con 0x7f446c0685e0 2023-10-06T04:37:34.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.442+0000 7f44742b9700 1 -- 172.21.15.8:0/1266446559 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f446c071550 con 0x7f446c0685e0 2023-10-06T04:37:34.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.442+0000 7f446a7fc700 1 -- 172.21.15.8:0/1266446559 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f445c003040 con 0x7f446c0685e0 2023-10-06T04:37:34.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.443+0000 7f446a7fc700 1 --2- 172.21.15.8:0/1266446559 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4458066f30 0x7f44580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:34.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.443+0000 7f446a7fc700 1 -- 172.21.15.8:0/1266446559 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7f445c0867c0 con 0x7f446c0685e0 2023-10-06T04:37:34.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.443+0000 7f4471854700 1 --2- 172.21.15.8:0/1266446559 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4458066f30 0x7f44580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:34.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.443+0000 7f4471854700 1 --2- 172.21.15.8:0/1266446559 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4458066f30 0x7f44580693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f446c0cb3c0 tx=0x7f4460008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:34.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.447+0000 7f446a7fc700 1 -- 172.21.15.8:0/1266446559 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f445c053570 con 0x7f446c0685e0 2023-10-06T04:37:34.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.636+0000 7f44742b9700 1 -- 172.21.15.8:0/1266446559 --> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f446c0aa6b0 con 0x7f4458066f30 2023-10-06T04:37:34.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.646+0000 7f446a7fc700 1 -- 172.21.15.8:0/1266446559 <== mgr.4105 v2:172.21.15.184:6832/90283 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+391385 (secure 0 0 0) 0x7f446c0aa6b0 con 0x7f4458066f30 2023-10-06T04:37:34.653 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:34.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.650+0000 7f44742b9700 1 -- 172.21.15.8:0/1266446559 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4458066f30 msgr2=0x7f44580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:34.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.650+0000 7f44742b9700 1 --2- 172.21.15.8:0/1266446559 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4458066f30 0x7f44580693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f446c0cb3c0 tx=0x7f4460008040 comp rx=0 tx=0).stop 2023-10-06T04:37:34.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.650+0000 7f44742b9700 1 -- 172.21.15.8:0/1266446559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f446c0685e0 msgr2=0x7f446c0cb780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:34.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.650+0000 7f44742b9700 1 --2- 172.21.15.8:0/1266446559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f446c0685e0 0x7f446c0cb780 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f445c009880 tx=0x7f445c018000 comp rx=0 tx=0).stop 2023-10-06T04:37:34.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.650+0000 7f44742b9700 1 -- 172.21.15.8:0/1266446559 shutdown_connections 2023-10-06T04:37:34.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.650+0000 7f44742b9700 1 --2- 172.21.15.8:0/1266446559 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4458066f30 0x7f44580693e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:34.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.650+0000 7f44742b9700 1 --2- 172.21.15.8:0/1266446559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f446c1597e0 0x7f446c147dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:34.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.650+0000 7f44742b9700 1 --2- 172.21.15.8:0/1266446559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f446c0685e0 0x7f446c0cb780 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:34.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.650+0000 7f44742b9700 1 --2- 172.21.15.8:0/1266446559 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f446c0aaae0 0x7f446c0ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:34.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.650+0000 7f44742b9700 1 -- 172.21.15.8:0/1266446559 >> 172.21.15.8:0/1266446559 conn(0x7f446c06dd50 msgr2=0x7f446c0ac130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:34.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.650+0000 7f44742b9700 1 -- 172.21.15.8:0/1266446559 shutdown_connections 2023-10-06T04:37:34.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.650+0000 7f44742b9700 1 -- 172.21.15.8:0/1266446559 wait complete. 2023-10-06T04:37:34.657 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-06T04:37:34.663 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2023-10-06T04:37:32.649456+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6881824,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":100,"num_write":256,"num_write_kb":8601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":703,"ondisk_log_size":703,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":216,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2395740,"kb_used_data":17436,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752578980,"statfs":{"total":773094113280,"available":770640875520,"internally_reserved":0,"allocated":17854464,"data_stored":15646602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11726,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":45,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.870682"},"pg_stats":[{"pgid":"7.3f","version":"38'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.003905+0000","last_change":"2023-10-06T04:37:17.540825+0000","last_active":"2023-10-06T04:37:27.003905+0000","last_peered":"2023-10-06T04:37:27.003905+0000","last_clean":"2023-10-06T04:37:27.003905+0000","last_became_active":"2023-10-06T04:37:17.540537+0000","last_became_peered":"2023-10-06T04:37:17.540537+0000","last_unstale":"2023-10-06T04:37:27.003905+0000","last_undegraded":"2023-10-06T04:37:27.003905+0000","last_fullsized":"2023-10-06T04:37:27.003905+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:27.083777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"38'4","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010044+0000","last_change":"2023-10-06T04:37:17.550627+0000","last_active":"2023-10-06T04:37:27.010044+0000","last_peered":"2023-10-06T04:37:27.010044+0000","last_clean":"2023-10-06T04:37:27.010044+0000","last_became_active":"2023-10-06T04:37:17.550395+0000","last_became_peered":"2023-10-06T04:37:17.550395+0000","last_unstale":"2023-10-06T04:37:27.010044+0000","last_undegraded":"2023-10-06T04:37:27.010044+0000","last_fullsized":"2023-10-06T04:37:27.010044+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:49.714446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"38'7","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779750+0000","last_change":"2023-10-06T04:37:17.541131+0000","last_active":"2023-10-06T04:37:26.779750+0000","last_peered":"2023-10-06T04:37:26.779750+0000","last_clean":"2023-10-06T04:37:26.779750+0000","last_became_active":"2023-10-06T04:37:17.540816+0000","last_became_peered":"2023-10-06T04:37:17.540816+0000","last_unstale":"2023-10-06T04:37:26.779750+0000","last_undegraded":"2023-10-06T04:37:26.779750+0000","last_fullsized":"2023-10-06T04:37:26.779750+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:32:45.542874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"38'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010129+0000","last_change":"2023-10-06T04:37:17.545649+0000","last_active":"2023-10-06T04:37:27.010129+0000","last_peered":"2023-10-06T04:37:27.010129+0000","last_clean":"2023-10-06T04:37:27.010129+0000","last_became_active":"2023-10-06T04:37:17.545155+0000","last_became_peered":"2023-10-06T04:37:17.545155+0000","last_unstale":"2023-10-06T04:37:27.010129+0000","last_undegraded":"2023-10-06T04:37:27.010129+0000","last_fullsized":"2023-10-06T04:37:27.010129+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:09.823506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"38'4","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010286+0000","last_change":"2023-10-06T04:37:17.545451+0000","last_active":"2023-10-06T04:37:27.010286+0000","last_peered":"2023-10-06T04:37:27.010286+0000","last_clean":"2023-10-06T04:37:27.010286+0000","last_became_active":"2023-10-06T04:37:17.545135+0000","last_became_peered":"2023-10-06T04:37:17.545135+0000","last_unstale":"2023-10-06T04:37:27.010286+0000","last_undegraded":"2023-10-06T04:37:27.010286+0000","last_fullsized":"2023-10-06T04:37:27.010286+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:44.628778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"38'6","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.011289+0000","last_change":"2023-10-06T04:37:17.545054+0000","last_active":"2023-10-06T04:37:27.011289+0000","last_peered":"2023-10-06T04:37:27.011289+0000","last_clean":"2023-10-06T04:37:27.011289+0000","last_became_active":"2023-10-06T04:37:17.544822+0000","last_became_peered":"2023-10-06T04:37:17.544822+0000","last_unstale":"2023-10-06T04:37:27.011289+0000","last_undegraded":"2023-10-06T04:37:27.011289+0000","last_fullsized":"2023-10-06T04:37:27.011289+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:28:51.824521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"38'5","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.004522+0000","last_change":"2023-10-06T04:37:17.548819+0000","last_active":"2023-10-06T04:37:27.004522+0000","last_peered":"2023-10-06T04:37:27.004522+0000","last_clean":"2023-10-06T04:37:27.004522+0000","last_became_active":"2023-10-06T04:37:17.548629+0000","last_became_peered":"2023-10-06T04:37:17.548629+0000","last_unstale":"2023-10-06T04:37:27.004522+0000","last_undegraded":"2023-10-06T04:37:27.004522+0000","last_fullsized":"2023-10-06T04:37:27.004522+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:04.973984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"38'9","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009297+0000","last_change":"2023-10-06T04:37:17.547124+0000","last_active":"2023-10-06T04:37:27.009297+0000","last_peered":"2023-10-06T04:37:27.009297+0000","last_clean":"2023-10-06T04:37:27.009297+0000","last_became_active":"2023-10-06T04:37:17.546879+0000","last_became_peered":"2023-10-06T04:37:17.546879+0000","last_unstale":"2023-10-06T04:37:27.009297+0000","last_undegraded":"2023-10-06T04:37:27.009297+0000","last_fullsized":"2023-10-06T04:37:27.009297+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:45.225371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"38'11","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009694+0000","last_change":"2023-10-06T04:37:17.537910+0000","last_active":"2023-10-06T04:37:27.009694+0000","last_peered":"2023-10-06T04:37:27.009694+0000","last_clean":"2023-10-06T04:37:27.009694+0000","last_became_active":"2023-10-06T04:37:17.535864+0000","last_became_peered":"2023-10-06T04:37:17.535864+0000","last_unstale":"2023-10-06T04:37:27.009694+0000","last_undegraded":"2023-10-06T04:37:27.009694+0000","last_fullsized":"2023-10-06T04:37:27.009694+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:58.928454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"38'15","reported_seq":28,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010318+0000","last_change":"2023-10-06T04:37:17.548489+0000","last_active":"2023-10-06T04:37:27.010318+0000","last_peered":"2023-10-06T04:37:27.010318+0000","last_clean":"2023-10-06T04:37:27.010318+0000","last_became_active":"2023-10-06T04:37:17.547714+0000","last_became_peered":"2023-10-06T04:37:17.547714+0000","last_unstale":"2023-10-06T04:37:27.010318+0000","last_undegraded":"2023-10-06T04:37:27.010318+0000","last_fullsized":"2023-10-06T04:37:27.010318+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:56.687459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"38'6","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009488+0000","last_change":"2023-10-06T04:37:17.544501+0000","last_active":"2023-10-06T04:37:27.009488+0000","last_peered":"2023-10-06T04:37:27.009488+0000","last_clean":"2023-10-06T04:37:27.009488+0000","last_became_active":"2023-10-06T04:37:17.541822+0000","last_became_peered":"2023-10-06T04:37:17.541822+0000","last_unstale":"2023-10-06T04:37:27.009488+0000","last_undegraded":"2023-10-06T04:37:27.009488+0000","last_fullsized":"2023-10-06T04:37:27.009488+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:32:45.542874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"38'7","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009885+0000","last_change":"2023-10-06T04:37:17.545538+0000","last_active":"2023-10-06T04:37:27.009885+0000","last_peered":"2023-10-06T04:37:27.009885+0000","last_clean":"2023-10-06T04:37:27.009885+0000","last_became_active":"2023-10-06T04:37:17.545027+0000","last_became_peered":"2023-10-06T04:37:17.545027+0000","last_unstale":"2023-10-06T04:37:27.009885+0000","last_undegraded":"2023-10-06T04:37:27.009885+0000","last_fullsized":"2023-10-06T04:37:27.009885+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:23.847066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"38'10","reported_seq":23,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:37:28.775107+0000","last_change":"2023-10-06T04:37:17.541986+0000","last_active":"2023-10-06T04:37:28.775107+0000","last_peered":"2023-10-06T04:37:28.775107+0000","last_clean":"2023-10-06T04:37:28.775107+0000","last_became_active":"2023-10-06T04:37:17.541707+0000","last_became_peered":"2023-10-06T04:37:17.541707+0000","last_unstale":"2023-10-06T04:37:28.775107+0000","last_undegraded":"2023-10-06T04:37:28.775107+0000","last_fullsized":"2023-10-06T04:37:28.775107+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:25.707658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"38'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009443+0000","last_change":"2023-10-06T04:37:17.536298+0000","last_active":"2023-10-06T04:37:27.009443+0000","last_peered":"2023-10-06T04:37:27.009443+0000","last_clean":"2023-10-06T04:37:27.009443+0000","last_became_active":"2023-10-06T04:37:17.535937+0000","last_became_peered":"2023-10-06T04:37:17.535937+0000","last_unstale":"2023-10-06T04:37:27.009443+0000","last_undegraded":"2023-10-06T04:37:27.009443+0000","last_fullsized":"2023-10-06T04:37:27.009443+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:01.324339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"38'7","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010623+0000","last_change":"2023-10-06T04:37:17.538786+0000","last_active":"2023-10-06T04:37:27.010623+0000","last_peered":"2023-10-06T04:37:27.010623+0000","last_clean":"2023-10-06T04:37:27.010623+0000","last_became_active":"2023-10-06T04:37:17.538493+0000","last_became_peered":"2023-10-06T04:37:17.538493+0000","last_unstale":"2023-10-06T04:37:27.010623+0000","last_undegraded":"2023-10-06T04:37:27.010623+0000","last_fullsized":"2023-10-06T04:37:27.010623+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:09.823506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"38'9","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009207+0000","last_change":"2023-10-06T04:37:17.552277+0000","last_active":"2023-10-06T04:37:27.009207+0000","last_peered":"2023-10-06T04:37:27.009207+0000","last_clean":"2023-10-06T04:37:27.009207+0000","last_became_active":"2023-10-06T04:37:17.552001+0000","last_became_peered":"2023-10-06T04:37:17.552001+0000","last_unstale":"2023-10-06T04:37:27.009207+0000","last_undegraded":"2023-10-06T04:37:27.009207+0000","last_fullsized":"2023-10-06T04:37:27.009207+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:41.211245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"38'9","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779847+0000","last_change":"2023-10-06T04:37:17.547373+0000","last_active":"2023-10-06T04:37:26.779847+0000","last_peered":"2023-10-06T04:37:26.779847+0000","last_clean":"2023-10-06T04:37:26.779847+0000","last_became_active":"2023-10-06T04:37:17.547103+0000","last_became_peered":"2023-10-06T04:37:17.547103+0000","last_unstale":"2023-10-06T04:37:26.779847+0000","last_undegraded":"2023-10-06T04:37:26.779847+0000","last_fullsized":"2023-10-06T04:37:26.779847+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:09.823506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"38'10","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779780+0000","last_change":"2023-10-06T04:37:17.554683+0000","last_active":"2023-10-06T04:37:26.779780+0000","last_peered":"2023-10-06T04:37:26.779780+0000","last_clean":"2023-10-06T04:37:26.779780+0000","last_became_active":"2023-10-06T04:37:17.554412+0000","last_became_peered":"2023-10-06T04:37:17.554412+0000","last_unstale":"2023-10-06T04:37:26.779780+0000","last_undegraded":"2023-10-06T04:37:26.779780+0000","last_fullsized":"2023-10-06T04:37:26.779780+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:56.687459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"38'7","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009419+0000","last_change":"2023-10-06T04:37:17.551197+0000","last_active":"2023-10-06T04:37:27.009419+0000","last_peered":"2023-10-06T04:37:27.009419+0000","last_clean":"2023-10-06T04:37:27.009419+0000","last_became_active":"2023-10-06T04:37:17.550633+0000","last_became_peered":"2023-10-06T04:37:17.550633+0000","last_unstale":"2023-10-06T04:37:27.009419+0000","last_undegraded":"2023-10-06T04:37:27.009419+0000","last_fullsized":"2023-10-06T04:37:27.009419+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:25.707658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"38'8","reported_seq":21,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:37:28.775146+0000","last_change":"2023-10-06T04:37:17.541139+0000","last_active":"2023-10-06T04:37:28.775146+0000","last_peered":"2023-10-06T04:37:28.775146+0000","last_clean":"2023-10-06T04:37:28.775146+0000","last_became_active":"2023-10-06T04:37:17.540844+0000","last_became_peered":"2023-10-06T04:37:17.540844+0000","last_unstale":"2023-10-06T04:37:28.775146+0000","last_undegraded":"2023-10-06T04:37:28.775146+0000","last_fullsized":"2023-10-06T04:37:28.775146+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:40.800271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"38'11","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.011635+0000","last_change":"2023-10-06T04:37:17.546023+0000","last_active":"2023-10-06T04:37:27.011635+0000","last_peered":"2023-10-06T04:37:27.011635+0000","last_clean":"2023-10-06T04:37:27.011635+0000","last_became_active":"2023-10-06T04:37:17.545428+0000","last_became_peered":"2023-10-06T04:37:17.545428+0000","last_unstale":"2023-10-06T04:37:27.011635+0000","last_undegraded":"2023-10-06T04:37:27.011635+0000","last_fullsized":"2023-10-06T04:37:27.011635+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:52.574192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"38'9","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009573+0000","last_change":"2023-10-06T04:37:17.546918+0000","last_active":"2023-10-06T04:37:27.009573+0000","last_peered":"2023-10-06T04:37:27.009573+0000","last_clean":"2023-10-06T04:37:27.009573+0000","last_became_active":"2023-10-06T04:37:17.546562+0000","last_became_peered":"2023-10-06T04:37:17.546562+0000","last_unstale":"2023-10-06T04:37:27.009573+0000","last_undegraded":"2023-10-06T04:37:27.009573+0000","last_fullsized":"2023-10-06T04:37:27.009573+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:18.119835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"38'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009254+0000","last_change":"2023-10-06T04:37:17.549490+0000","last_active":"2023-10-06T04:37:27.009254+0000","last_peered":"2023-10-06T04:37:27.009254+0000","last_clean":"2023-10-06T04:37:27.009254+0000","last_became_active":"2023-10-06T04:37:17.549294+0000","last_became_peered":"2023-10-06T04:37:17.549294+0000","last_unstale":"2023-10-06T04:37:27.009254+0000","last_undegraded":"2023-10-06T04:37:27.009254+0000","last_fullsized":"2023-10-06T04:37:27.009254+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:50.973957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"38'6","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009221+0000","last_change":"2023-10-06T04:37:17.548512+0000","last_active":"2023-10-06T04:37:27.009221+0000","last_peered":"2023-10-06T04:37:27.009221+0000","last_clean":"2023-10-06T04:37:27.009221+0000","last_became_active":"2023-10-06T04:37:17.547910+0000","last_became_peered":"2023-10-06T04:37:17.547910+0000","last_unstale":"2023-10-06T04:37:27.009221+0000","last_undegraded":"2023-10-06T04:37:27.009221+0000","last_fullsized":"2023-10-06T04:37:27.009221+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:15:49.332577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"38'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010270+0000","last_change":"2023-10-06T04:37:17.551312+0000","last_active":"2023-10-06T04:37:27.010270+0000","last_peered":"2023-10-06T04:37:27.010270+0000","last_clean":"2023-10-06T04:37:27.010270+0000","last_became_active":"2023-10-06T04:37:17.550973+0000","last_became_peered":"2023-10-06T04:37:17.550973+0000","last_unstale":"2023-10-06T04:37:27.010270+0000","last_undegraded":"2023-10-06T04:37:27.010270+0000","last_fullsized":"2023-10-06T04:37:27.010270+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:40.800271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"38'15","reported_seq":28,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:37:28.775234+0000","last_change":"2023-10-06T04:37:17.542441+0000","last_active":"2023-10-06T04:37:28.775234+0000","last_peered":"2023-10-06T04:37:28.775234+0000","last_clean":"2023-10-06T04:37:28.775234+0000","last_became_active":"2023-10-06T04:37:17.542184+0000","last_became_peered":"2023-10-06T04:37:17.542184+0000","last_unstale":"2023-10-06T04:37:28.775234+0000","last_undegraded":"2023-10-06T04:37:28.775234+0000","last_fullsized":"2023-10-06T04:37:28.775234+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:57.066657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"38'6","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779729+0000","last_change":"2023-10-06T04:37:17.546567+0000","last_active":"2023-10-06T04:37:26.779729+0000","last_peered":"2023-10-06T04:37:26.779729+0000","last_clean":"2023-10-06T04:37:26.779729+0000","last_became_active":"2023-10-06T04:37:17.546294+0000","last_became_peered":"2023-10-06T04:37:17.546294+0000","last_unstale":"2023-10-06T04:37:26.779729+0000","last_undegraded":"2023-10-06T04:37:26.779729+0000","last_fullsized":"2023-10-06T04:37:26.779729+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:19.011564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"38'4","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009688+0000","last_change":"2023-10-06T04:37:17.545684+0000","last_active":"2023-10-06T04:37:27.009688+0000","last_peered":"2023-10-06T04:37:27.009688+0000","last_clean":"2023-10-06T04:37:27.009688+0000","last_became_active":"2023-10-06T04:37:17.545341+0000","last_became_peered":"2023-10-06T04:37:17.545341+0000","last_unstale":"2023-10-06T04:37:27.009688+0000","last_undegraded":"2023-10-06T04:37:27.009688+0000","last_fullsized":"2023-10-06T04:37:27.009688+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:04.973984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"38'7","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009408+0000","last_change":"2023-10-06T04:37:17.551198+0000","last_active":"2023-10-06T04:37:27.009408+0000","last_peered":"2023-10-06T04:37:27.009408+0000","last_clean":"2023-10-06T04:37:27.009408+0000","last_became_active":"2023-10-06T04:37:17.550871+0000","last_became_peered":"2023-10-06T04:37:17.550871+0000","last_unstale":"2023-10-06T04:37:27.009408+0000","last_undegraded":"2023-10-06T04:37:27.009408+0000","last_fullsized":"2023-10-06T04:37:27.009408+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:43.463619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"38'8","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779635+0000","last_change":"2023-10-06T04:37:17.544638+0000","last_active":"2023-10-06T04:37:26.779635+0000","last_peered":"2023-10-06T04:37:26.779635+0000","last_clean":"2023-10-06T04:37:26.779635+0000","last_became_active":"2023-10-06T04:37:17.544358+0000","last_became_peered":"2023-10-06T04:37:17.544358+0000","last_unstale":"2023-10-06T04:37:26.779635+0000","last_undegraded":"2023-10-06T04:37:26.779635+0000","last_fullsized":"2023-10-06T04:37:26.779635+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:16.140442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"38'12","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010754+0000","last_change":"2023-10-06T04:37:17.547875+0000","last_active":"2023-10-06T04:37:27.010754+0000","last_peered":"2023-10-06T04:37:27.010754+0000","last_clean":"2023-10-06T04:37:27.010754+0000","last_became_active":"2023-10-06T04:37:17.547504+0000","last_became_peered":"2023-10-06T04:37:17.547504+0000","last_unstale":"2023-10-06T04:37:27.010754+0000","last_undegraded":"2023-10-06T04:37:27.010754+0000","last_fullsized":"2023-10-06T04:37:27.010754+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:37.661915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"38'9","reported_seq":22,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:37:28.775022+0000","last_change":"2023-10-06T04:37:17.535486+0000","last_active":"2023-10-06T04:37:28.775022+0000","last_peered":"2023-10-06T04:37:28.775022+0000","last_clean":"2023-10-06T04:37:28.775022+0000","last_became_active":"2023-10-06T04:37:17.535215+0000","last_became_peered":"2023-10-06T04:37:17.535215+0000","last_unstale":"2023-10-06T04:37:28.775022+0000","last_undegraded":"2023-10-06T04:37:28.775022+0000","last_fullsized":"2023-10-06T04:37:28.775022+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:01.221591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781623+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:49.912213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"38'5","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009428+0000","last_change":"2023-10-06T04:37:17.540682+0000","last_active":"2023-10-06T04:37:27.009428+0000","last_peered":"2023-10-06T04:37:27.009428+0000","last_clean":"2023-10-06T04:37:27.009428+0000","last_became_active":"2023-10-06T04:37:17.540340+0000","last_became_peered":"2023-10-06T04:37:17.540340+0000","last_unstale":"2023-10-06T04:37:27.009428+0000","last_undegraded":"2023-10-06T04:37:27.009428+0000","last_fullsized":"2023-10-06T04:37:27.009428+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:57.066657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"39'8","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.012800+0000","last_change":"2023-10-06T04:37:16.539316+0000","last_active":"2023-10-06T04:37:27.012800+0000","last_peered":"2023-10-06T04:37:27.012800+0000","last_clean":"2023-10-06T04:37:27.012800+0000","last_became_active":"2023-10-06T04:37:16.538848+0000","last_became_peered":"2023-10-06T04:37:16.538848+0000","last_unstale":"2023-10-06T04:37:27.012800+0000","last_undegraded":"2023-10-06T04:37:27.012800+0000","last_fullsized":"2023-10-06T04:37:27.012800+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:44:55.156828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.780190+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:29:04.074820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"38'6","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010134+0000","last_change":"2023-10-06T04:37:17.549963+0000","last_active":"2023-10-06T04:37:27.010134+0000","last_peered":"2023-10-06T04:37:27.010134+0000","last_clean":"2023-10-06T04:37:27.010134+0000","last_became_active":"2023-10-06T04:37:17.545289+0000","last_became_peered":"2023-10-06T04:37:17.545289+0000","last_unstale":"2023-10-06T04:37:27.010134+0000","last_undegraded":"2023-10-06T04:37:27.010134+0000","last_fullsized":"2023-10-06T04:37:27.010134+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:01.221591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"37'1","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779943+0000","last_change":"2023-10-06T04:37:16.539806+0000","last_active":"2023-10-06T04:37:26.779943+0000","last_peered":"2023-10-06T04:37:26.779943+0000","last_clean":"2023-10-06T04:37:26.779943+0000","last_became_active":"2023-10-06T04:37:16.539514+0000","last_became_peered":"2023-10-06T04:37:16.539514+0000","last_unstale":"2023-10-06T04:37:26.779943+0000","last_undegraded":"2023-10-06T04:37:26.779943+0000","last_fullsized":"2023-10-06T04:37:26.779943+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:48.710239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":2,"reported_epoch":45,"state":"creating+activating","last_fresh":"2023-10-06T04:37:29.782949+0000","last_change":"2023-10-06T04:37:29.783069+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:29.782949+0000","last_undegraded":"2023-10-06T04:37:29.782949+0000","last_fullsized":"2023-10-06T04:37:29.782949+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:59.689245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"38'9","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009806+0000","last_change":"2023-10-06T04:37:17.549931+0000","last_active":"2023-10-06T04:37:27.009806+0000","last_peered":"2023-10-06T04:37:27.009806+0000","last_clean":"2023-10-06T04:37:27.009806+0000","last_became_active":"2023-10-06T04:37:17.549668+0000","last_became_peered":"2023-10-06T04:37:17.549668+0000","last_unstale":"2023-10-06T04:37:27.009806+0000","last_undegraded":"2023-10-06T04:37:27.009806+0000","last_fullsized":"2023-10-06T04:37:27.009806+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:27.083777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"39'3","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010418+0000","last_change":"2023-10-06T04:37:16.546111+0000","last_active":"2023-10-06T04:37:27.010418+0000","last_peered":"2023-10-06T04:37:27.010418+0000","last_clean":"2023-10-06T04:37:27.010418+0000","last_became_active":"2023-10-06T04:37:16.545811+0000","last_became_peered":"2023-10-06T04:37:16.545811+0000","last_unstale":"2023-10-06T04:37:27.010418+0000","last_undegraded":"2023-10-06T04:37:27.010418+0000","last_fullsized":"2023-10-06T04:37:27.010418+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:30.574778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.776912+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:04:11.178752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"38'15","reported_seq":28,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010260+0000","last_change":"2023-10-06T04:37:17.546138+0000","last_active":"2023-10-06T04:37:27.010260+0000","last_peered":"2023-10-06T04:37:27.010260+0000","last_clean":"2023-10-06T04:37:27.010260+0000","last_became_active":"2023-10-06T04:37:17.545845+0000","last_became_peered":"2023-10-06T04:37:17.545845+0000","last_unstale":"2023-10-06T04:37:27.010260+0000","last_undegraded":"2023-10-06T04:37:27.010260+0000","last_fullsized":"2023-10-06T04:37:27.010260+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:25.707658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"39'3","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.004858+0000","last_change":"2023-10-06T04:37:16.545947+0000","last_active":"2023-10-06T04:37:27.004858+0000","last_peered":"2023-10-06T04:37:27.004858+0000","last_clean":"2023-10-06T04:37:27.004858+0000","last_became_active":"2023-10-06T04:37:16.545700+0000","last_became_peered":"2023-10-06T04:37:16.545700+0000","last_unstale":"2023-10-06T04:37:27.004858+0000","last_undegraded":"2023-10-06T04:37:27.004858+0000","last_fullsized":"2023-10-06T04:37:27.004858+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:56.062450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.780593+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:57.475670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"38'7","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779634+0000","last_change":"2023-10-06T04:37:17.543400+0000","last_active":"2023-10-06T04:37:26.779634+0000","last_peered":"2023-10-06T04:37:26.779634+0000","last_clean":"2023-10-06T04:37:26.779634+0000","last_became_active":"2023-10-06T04:37:17.543132+0000","last_became_peered":"2023-10-06T04:37:17.543132+0000","last_unstale":"2023-10-06T04:37:26.779634+0000","last_undegraded":"2023-10-06T04:37:26.779634+0000","last_fullsized":"2023-10-06T04:37:26.779634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:50:28.268338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"37'1","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.011758+0000","last_change":"2023-10-06T04:37:16.541989+0000","last_active":"2023-10-06T04:37:27.011758+0000","last_peered":"2023-10-06T04:37:27.011758+0000","last_clean":"2023-10-06T04:37:27.011758+0000","last_became_active":"2023-10-06T04:37:16.541684+0000","last_became_peered":"2023-10-06T04:37:16.541684+0000","last_unstale":"2023-10-06T04:37:27.011758+0000","last_undegraded":"2023-10-06T04:37:27.011758+0000","last_fullsized":"2023-10-06T04:37:27.011758+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:13.019515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.779525+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:44:04.529543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"38'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009900+0000","last_change":"2023-10-06T04:37:17.546677+0000","last_active":"2023-10-06T04:37:27.009900+0000","last_peered":"2023-10-06T04:37:27.009900+0000","last_clean":"2023-10-06T04:37:27.009900+0000","last_became_active":"2023-10-06T04:37:17.546151+0000","last_became_peered":"2023-10-06T04:37:17.546151+0000","last_unstale":"2023-10-06T04:37:27.009900+0000","last_undegraded":"2023-10-06T04:37:27.009900+0000","last_fullsized":"2023-10-06T04:37:27.009900+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:16.140442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"37'1","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779812+0000","last_change":"2023-10-06T04:37:16.545939+0000","last_active":"2023-10-06T04:37:26.779812+0000","last_peered":"2023-10-06T04:37:26.779812+0000","last_clean":"2023-10-06T04:37:26.779812+0000","last_became_active":"2023-10-06T04:37:16.545722+0000","last_became_peered":"2023-10-06T04:37:16.545722+0000","last_unstale":"2023-10-06T04:37:26.779812+0000","last_undegraded":"2023-10-06T04:37:26.779812+0000","last_fullsized":"2023-10-06T04:37:26.779812+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:22.842860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781194+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:04.824490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"38'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009417+0000","last_change":"2023-10-06T04:37:17.547055+0000","last_active":"2023-10-06T04:37:27.009417+0000","last_peered":"2023-10-06T04:37:27.009417+0000","last_clean":"2023-10-06T04:37:27.009417+0000","last_became_active":"2023-10-06T04:37:17.546777+0000","last_became_peered":"2023-10-06T04:37:17.546777+0000","last_unstale":"2023-10-06T04:37:27.009417+0000","last_undegraded":"2023-10-06T04:37:27.009417+0000","last_fullsized":"2023-10-06T04:37:27.009417+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:28:51.824521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009578+0000","last_change":"2023-10-06T04:37:16.544251+0000","last_active":"2023-10-06T04:37:27.009578+0000","last_peered":"2023-10-06T04:37:27.009578+0000","last_clean":"2023-10-06T04:37:27.009578+0000","last_became_active":"2023-10-06T04:37:16.543853+0000","last_became_peered":"2023-10-06T04:37:16.543853+0000","last_unstale":"2023-10-06T04:37:27.009578+0000","last_undegraded":"2023-10-06T04:37:27.009578+0000","last_fullsized":"2023-10-06T04:37:27.009578+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:00.217384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":2,"reported_epoch":45,"state":"creating+activating","last_fresh":"2023-10-06T04:37:29.780968+0000","last_change":"2023-10-06T04:37:29.781107+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:29.780968+0000","last_undegraded":"2023-10-06T04:37:29.780968+0000","last_fullsized":"2023-10-06T04:37:29.780968+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:38:07.292570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"38'10","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009367+0000","last_change":"2023-10-06T04:37:17.550653+0000","last_active":"2023-10-06T04:37:27.009367+0000","last_peered":"2023-10-06T04:37:27.009367+0000","last_clean":"2023-10-06T04:37:27.009367+0000","last_became_active":"2023-10-06T04:37:17.550308+0000","last_became_peered":"2023-10-06T04:37:17.550308+0000","last_unstale":"2023-10-06T04:37:27.009367+0000","last_undegraded":"2023-10-06T04:37:27.009367+0000","last_fullsized":"2023-10-06T04:37:27.009367+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:06:24.079323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009535+0000","last_change":"2023-10-06T04:37:16.539539+0000","last_active":"2023-10-06T04:37:27.009535+0000","last_peered":"2023-10-06T04:37:27.009535+0000","last_clean":"2023-10-06T04:37:27.009535+0000","last_became_active":"2023-10-06T04:37:16.536276+0000","last_became_peered":"2023-10-06T04:37:16.536276+0000","last_unstale":"2023-10-06T04:37:27.009535+0000","last_undegraded":"2023-10-06T04:37:27.009535+0000","last_fullsized":"2023-10-06T04:37:27.009535+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:23.725665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781025+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:00:08.937757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"38'10","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779872+0000","last_change":"2023-10-06T04:37:17.547330+0000","last_active":"2023-10-06T04:37:26.779872+0000","last_peered":"2023-10-06T04:37:26.779872+0000","last_clean":"2023-10-06T04:37:26.779872+0000","last_became_active":"2023-10-06T04:37:17.547088+0000","last_became_peered":"2023-10-06T04:37:17.547088+0000","last_unstale":"2023-10-06T04:37:26.779872+0000","last_undegraded":"2023-10-06T04:37:26.779872+0000","last_fullsized":"2023-10-06T04:37:26.779872+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:12.970309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779917+0000","last_change":"2023-10-06T04:37:16.543071+0000","last_active":"2023-10-06T04:37:26.779917+0000","last_peered":"2023-10-06T04:37:26.779917+0000","last_clean":"2023-10-06T04:37:26.779917+0000","last_became_active":"2023-10-06T04:37:16.542755+0000","last_became_peered":"2023-10-06T04:37:16.542755+0000","last_unstale":"2023-10-06T04:37:26.779917+0000","last_undegraded":"2023-10-06T04:37:26.779917+0000","last_fullsized":"2023-10-06T04:37:26.779917+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:03.969778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.779740+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:05:06.685138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"38'9","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.004023+0000","last_change":"2023-10-06T04:37:17.546184+0000","last_active":"2023-10-06T04:37:27.004023+0000","last_peered":"2023-10-06T04:37:27.004023+0000","last_clean":"2023-10-06T04:37:27.004023+0000","last_became_active":"2023-10-06T04:37:17.545899+0000","last_became_peered":"2023-10-06T04:37:17.545899+0000","last_unstale":"2023-10-06T04:37:27.004023+0000","last_undegraded":"2023-10-06T04:37:27.004023+0000","last_fullsized":"2023-10-06T04:37:27.004023+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:35.648661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010409+0000","last_change":"2023-10-06T04:37:16.539739+0000","last_active":"2023-10-06T04:37:27.010409+0000","last_peered":"2023-10-06T04:37:27.010409+0000","last_clean":"2023-10-06T04:37:27.010409+0000","last_became_active":"2023-10-06T04:37:16.539470+0000","last_became_peered":"2023-10-06T04:37:16.539470+0000","last_unstale":"2023-10-06T04:37:27.010409+0000","last_undegraded":"2023-10-06T04:37:27.010409+0000","last_fullsized":"2023-10-06T04:37:27.010409+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:23.078870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.779529+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:01.912316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"38'11","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.012346+0000","last_change":"2023-10-06T04:37:17.543287+0000","last_active":"2023-10-06T04:37:27.012346+0000","last_peered":"2023-10-06T04:37:27.012346+0000","last_clean":"2023-10-06T04:37:27.012346+0000","last_became_active":"2023-10-06T04:37:17.543018+0000","last_became_peered":"2023-10-06T04:37:17.543018+0000","last_unstale":"2023-10-06T04:37:27.012346+0000","last_undegraded":"2023-10-06T04:37:27.012346+0000","last_fullsized":"2023-10-06T04:37:27.012346+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:18.119835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"39'5","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.005169+0000","last_change":"2023-10-06T04:37:16.545863+0000","last_active":"2023-10-06T04:37:27.005169+0000","last_peered":"2023-10-06T04:37:27.005169+0000","last_clean":"2023-10-06T04:37:27.005169+0000","last_became_active":"2023-10-06T04:37:16.545563+0000","last_became_peered":"2023-10-06T04:37:16.545563+0000","last_unstale":"2023-10-06T04:37:27.005169+0000","last_undegraded":"2023-10-06T04:37:27.005169+0000","last_fullsized":"2023-10-06T04:37:27.005169+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:36.947789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781442+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:05:06.685138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"38'6","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.005042+0000","last_change":"2023-10-06T04:37:17.541763+0000","last_active":"2023-10-06T04:37:27.005042+0000","last_peered":"2023-10-06T04:37:27.005042+0000","last_clean":"2023-10-06T04:37:27.005042+0000","last_became_active":"2023-10-06T04:37:17.541287+0000","last_became_peered":"2023-10-06T04:37:17.541287+0000","last_unstale":"2023-10-06T04:37:27.005042+0000","last_undegraded":"2023-10-06T04:37:27.005042+0000","last_fullsized":"2023-10-06T04:37:27.005042+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:34.429052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"39'23","reported_seq":37,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:37:28.775230+0000","last_change":"2023-10-06T04:37:16.538841+0000","last_active":"2023-10-06T04:37:28.775230+0000","last_peered":"2023-10-06T04:37:28.775230+0000","last_clean":"2023-10-06T04:37:28.775230+0000","last_became_active":"2023-10-06T04:37:16.538555+0000","last_became_peered":"2023-10-06T04:37:16.538555+0000","last_unstale":"2023-10-06T04:37:28.775230+0000","last_undegraded":"2023-10-06T04:37:28.775230+0000","last_fullsized":"2023-10-06T04:37:28.775230+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:01:56.504476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781750+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:51.489837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"38'10","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009545+0000","last_change":"2023-10-06T04:37:17.554238+0000","last_active":"2023-10-06T04:37:27.009545+0000","last_peered":"2023-10-06T04:37:27.009545+0000","last_clean":"2023-10-06T04:37:27.009545+0000","last_became_active":"2023-10-06T04:37:17.553995+0000","last_became_peered":"2023-10-06T04:37:17.553995+0000","last_unstale":"2023-10-06T04:37:27.009545+0000","last_undegraded":"2023-10-06T04:37:27.009545+0000","last_fullsized":"2023-10-06T04:37:27.009545+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:57.066657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"39'5","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.012000+0000","last_change":"2023-10-06T04:37:16.545424+0000","last_active":"2023-10-06T04:37:27.012000+0000","last_peered":"2023-10-06T04:37:27.012000+0000","last_clean":"2023-10-06T04:37:27.012000+0000","last_became_active":"2023-10-06T04:37:16.545158+0000","last_became_peered":"2023-10-06T04:37:16.545158+0000","last_unstale":"2023-10-06T04:37:27.012000+0000","last_undegraded":"2023-10-06T04:37:27.012000+0000","last_fullsized":"2023-10-06T04:37:27.012000+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:03.969778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781643+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:30.370133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"38'15","reported_seq":28,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009983+0000","last_change":"2023-10-06T04:37:17.543599+0000","last_active":"2023-10-06T04:37:27.009983+0000","last_peered":"2023-10-06T04:37:27.009983+0000","last_clean":"2023-10-06T04:37:27.009983+0000","last_became_active":"2023-10-06T04:37:17.543271+0000","last_became_peered":"2023-10-06T04:37:17.543271+0000","last_unstale":"2023-10-06T04:37:27.009983+0000","last_undegraded":"2023-10-06T04:37:27.009983+0000","last_fullsized":"2023-10-06T04:37:27.009983+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:37.661915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.004892+0000","last_change":"2023-10-06T04:37:16.541456+0000","last_active":"2023-10-06T04:37:27.004892+0000","last_peered":"2023-10-06T04:37:27.004892+0000","last_clean":"2023-10-06T04:37:27.004892+0000","last_became_active":"2023-10-06T04:37:16.541189+0000","last_became_peered":"2023-10-06T04:37:16.541189+0000","last_unstale":"2023-10-06T04:37:27.004892+0000","last_undegraded":"2023-10-06T04:37:27.004892+0000","last_fullsized":"2023-10-06T04:37:27.004892+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:23.078870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781759+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:07.671768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"38'6","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010461+0000","last_change":"2023-10-06T04:37:17.541658+0000","last_active":"2023-10-06T04:37:27.010461+0000","last_peered":"2023-10-06T04:37:27.010461+0000","last_clean":"2023-10-06T04:37:27.010461+0000","last_became_active":"2023-10-06T04:37:17.541349+0000","last_became_peered":"2023-10-06T04:37:17.541349+0000","last_unstale":"2023-10-06T04:37:27.010461+0000","last_undegraded":"2023-10-06T04:37:27.010461+0000","last_fullsized":"2023-10-06T04:37:27.010461+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:56.687459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010952+0000","last_change":"2023-10-06T04:37:16.545596+0000","last_active":"2023-10-06T04:37:27.010952+0000","last_peered":"2023-10-06T04:37:27.010952+0000","last_clean":"2023-10-06T04:37:27.010952+0000","last_became_active":"2023-10-06T04:37:16.545334+0000","last_became_peered":"2023-10-06T04:37:16.545334+0000","last_unstale":"2023-10-06T04:37:27.010952+0000","last_undegraded":"2023-10-06T04:37:27.010952+0000","last_fullsized":"2023-10-06T04:37:27.010952+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:26.079570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":2,"reported_epoch":45,"state":"creating+activating","last_fresh":"2023-10-06T04:37:29.781315+0000","last_change":"2023-10-06T04:37:29.781451+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:29.781315+0000","last_undegraded":"2023-10-06T04:37:29.781315+0000","last_fullsized":"2023-10-06T04:37:29.781315+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:19:45.702967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"38'6","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.004641+0000","last_change":"2023-10-06T04:37:17.552402+0000","last_active":"2023-10-06T04:37:27.004641+0000","last_peered":"2023-10-06T04:37:27.004641+0000","last_clean":"2023-10-06T04:37:27.004641+0000","last_became_active":"2023-10-06T04:37:17.552167+0000","last_became_peered":"2023-10-06T04:37:17.552167+0000","last_unstale":"2023-10-06T04:37:27.004641+0000","last_undegraded":"2023-10-06T04:37:27.004641+0000","last_fullsized":"2023-10-06T04:37:27.004641+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:14.023722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"39'15","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009650+0000","last_change":"2023-10-06T04:37:16.545180+0000","last_active":"2023-10-06T04:37:27.009650+0000","last_peered":"2023-10-06T04:37:27.009650+0000","last_clean":"2023-10-06T04:37:27.009650+0000","last_became_active":"2023-10-06T04:37:16.544707+0000","last_became_peered":"2023-10-06T04:37:16.544707+0000","last_unstale":"2023-10-06T04:37:27.009650+0000","last_undegraded":"2023-10-06T04:37:27.009650+0000","last_fullsized":"2023-10-06T04:37:27.009650+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:49.969750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.784527+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:03:50.233469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"38'5","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:37:28.775240+0000","last_change":"2023-10-06T04:37:17.545469+0000","last_active":"2023-10-06T04:37:28.775240+0000","last_peered":"2023-10-06T04:37:28.775240+0000","last_clean":"2023-10-06T04:37:28.775240+0000","last_became_active":"2023-10-06T04:37:17.545212+0000","last_became_peered":"2023-10-06T04:37:17.545212+0000","last_unstale":"2023-10-06T04:37:28.775240+0000","last_undegraded":"2023-10-06T04:37:28.775240+0000","last_fullsized":"2023-10-06T04:37:28.775240+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:41.211245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"39'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:37:28.775128+0000","last_change":"2023-10-06T04:37:16.537956+0000","last_active":"2023-10-06T04:37:28.775128+0000","last_peered":"2023-10-06T04:37:28.775128+0000","last_clean":"2023-10-06T04:37:28.775128+0000","last_became_active":"2023-10-06T04:37:16.537733+0000","last_became_peered":"2023-10-06T04:37:16.537733+0000","last_unstale":"2023-10-06T04:37:28.775128+0000","last_undegraded":"2023-10-06T04:37:28.775128+0000","last_fullsized":"2023-10-06T04:37:28.775128+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:26:53.482793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":2,"reported_epoch":45,"state":"creating+activating","last_fresh":"2023-10-06T04:37:29.781336+0000","last_change":"2023-10-06T04:37:29.781477+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:29.781336+0000","last_undegraded":"2023-10-06T04:37:29.781336+0000","last_fullsized":"2023-10-06T04:37:29.781336+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:20.831560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":["3","5"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"38'9","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009765+0000","last_change":"2023-10-06T04:37:17.540242+0000","last_active":"2023-10-06T04:37:27.009765+0000","last_peered":"2023-10-06T04:37:27.009765+0000","last_clean":"2023-10-06T04:37:27.009765+0000","last_became_active":"2023-10-06T04:37:17.539986+0000","last_became_peered":"2023-10-06T04:37:17.539986+0000","last_unstale":"2023-10-06T04:37:27.009765+0000","last_undegraded":"2023-10-06T04:37:27.009765+0000","last_fullsized":"2023-10-06T04:37:27.009765+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:50:28.268338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"39'3","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779857+0000","last_change":"2023-10-06T04:37:16.541934+0000","last_active":"2023-10-06T04:37:26.779857+0000","last_peered":"2023-10-06T04:37:26.779857+0000","last_clean":"2023-10-06T04:37:26.779857+0000","last_became_active":"2023-10-06T04:37:16.539725+0000","last_became_peered":"2023-10-06T04:37:16.539725+0000","last_unstale":"2023-10-06T04:37:26.779857+0000","last_undegraded":"2023-10-06T04:37:26.779857+0000","last_fullsized":"2023-10-06T04:37:26.779857+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:44:55.156828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.783668+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:58.515292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"38'6","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010154+0000","last_change":"2023-10-06T04:37:17.550239+0000","last_active":"2023-10-06T04:37:27.010154+0000","last_peered":"2023-10-06T04:37:27.010154+0000","last_clean":"2023-10-06T04:37:27.010154+0000","last_became_active":"2023-10-06T04:37:17.549997+0000","last_became_peered":"2023-10-06T04:37:17.549997+0000","last_unstale":"2023-10-06T04:37:27.010154+0000","last_undegraded":"2023-10-06T04:37:27.010154+0000","last_fullsized":"2023-10-06T04:37:27.010154+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:24.083076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"39'2","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009726+0000","last_change":"2023-10-06T04:37:16.544014+0000","last_active":"2023-10-06T04:37:27.009726+0000","last_peered":"2023-10-06T04:37:27.009726+0000","last_clean":"2023-10-06T04:37:27.009726+0000","last_became_active":"2023-10-06T04:37:16.543718+0000","last_became_peered":"2023-10-06T04:37:16.543718+0000","last_unstale":"2023-10-06T04:37:27.009726+0000","last_undegraded":"2023-10-06T04:37:27.009726+0000","last_fullsized":"2023-10-06T04:37:27.009726+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:39.796065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.779491+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:10:36.939764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"38'7","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009967+0000","last_change":"2023-10-06T04:37:17.551493+0000","last_active":"2023-10-06T04:37:27.009967+0000","last_peered":"2023-10-06T04:37:27.009967+0000","last_clean":"2023-10-06T04:37:27.009967+0000","last_became_active":"2023-10-06T04:37:17.550988+0000","last_became_peered":"2023-10-06T04:37:17.550988+0000","last_unstale":"2023-10-06T04:37:27.009967+0000","last_undegraded":"2023-10-06T04:37:27.009967+0000","last_fullsized":"2023-10-06T04:37:27.009967+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:33.731628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.012579+0000","last_change":"2023-10-06T04:37:16.537845+0000","last_active":"2023-10-06T04:37:27.012579+0000","last_peered":"2023-10-06T04:37:27.012579+0000","last_clean":"2023-10-06T04:37:27.012579+0000","last_became_active":"2023-10-06T04:37:16.537568+0000","last_became_peered":"2023-10-06T04:37:16.537568+0000","last_unstale":"2023-10-06T04:37:27.012579+0000","last_undegraded":"2023-10-06T04:37:27.012579+0000","last_fullsized":"2023-10-06T04:37:27.012579+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:43.624572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.776912+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:32:57.793172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"38'5","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.011164+0000","last_change":"2023-10-06T04:37:17.538502+0000","last_active":"2023-10-06T04:37:27.011164+0000","last_peered":"2023-10-06T04:37:27.011164+0000","last_clean":"2023-10-06T04:37:27.011164+0000","last_became_active":"2023-10-06T04:37:17.538215+0000","last_became_peered":"2023-10-06T04:37:17.538215+0000","last_unstale":"2023-10-06T04:37:27.011164+0000","last_undegraded":"2023-10-06T04:37:27.011164+0000","last_fullsized":"2023-10-06T04:37:27.011164+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:45.225371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"39'4","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.012118+0000","last_change":"2023-10-06T04:37:16.540351+0000","last_active":"2023-10-06T04:37:27.012118+0000","last_peered":"2023-10-06T04:37:27.012118+0000","last_clean":"2023-10-06T04:37:27.012118+0000","last_became_active":"2023-10-06T04:37:16.539257+0000","last_became_peered":"2023-10-06T04:37:16.539257+0000","last_unstale":"2023-10-06T04:37:27.012118+0000","last_undegraded":"2023-10-06T04:37:27.012118+0000","last_fullsized":"2023-10-06T04:37:27.012118+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:33.424846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781178+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:31.261862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"38'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009845+0000","last_change":"2023-10-06T04:37:17.546443+0000","last_active":"2023-10-06T04:37:27.009845+0000","last_peered":"2023-10-06T04:37:27.009845+0000","last_clean":"2023-10-06T04:37:27.009845+0000","last_became_active":"2023-10-06T04:37:17.546233+0000","last_became_peered":"2023-10-06T04:37:17.546233+0000","last_unstale":"2023-10-06T04:37:27.009845+0000","last_undegraded":"2023-10-06T04:37:27.009845+0000","last_fullsized":"2023-10-06T04:37:27.009845+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:41.211245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009787+0000","last_change":"2023-10-06T04:37:16.545188+0000","last_active":"2023-10-06T04:37:27.009787+0000","last_peered":"2023-10-06T04:37:27.009787+0000","last_clean":"2023-10-06T04:37:27.009787+0000","last_became_active":"2023-10-06T04:37:16.544735+0000","last_became_peered":"2023-10-06T04:37:16.544735+0000","last_unstale":"2023-10-06T04:37:27.009787+0000","last_undegraded":"2023-10-06T04:37:27.009787+0000","last_fullsized":"2023-10-06T04:37:27.009787+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:56.062450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.784055+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:49.503329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"38'9","reported_seq":22,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:37:28.775026+0000","last_change":"2023-10-06T04:37:17.544085+0000","last_active":"2023-10-06T04:37:28.775026+0000","last_peered":"2023-10-06T04:37:28.775026+0000","last_clean":"2023-10-06T04:37:28.775026+0000","last_became_active":"2023-10-06T04:37:17.543802+0000","last_became_peered":"2023-10-06T04:37:17.543802+0000","last_unstale":"2023-10-06T04:37:28.775026+0000","last_undegraded":"2023-10-06T04:37:28.775026+0000","last_fullsized":"2023-10-06T04:37:28.775026+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:31.578985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010008+0000","last_change":"2023-10-06T04:37:16.539674+0000","last_active":"2023-10-06T04:37:27.010008+0000","last_peered":"2023-10-06T04:37:27.010008+0000","last_clean":"2023-10-06T04:37:27.010008+0000","last_became_active":"2023-10-06T04:37:16.539399+0000","last_became_peered":"2023-10-06T04:37:16.539399+0000","last_unstale":"2023-10-06T04:37:27.010008+0000","last_undegraded":"2023-10-06T04:37:27.010008+0000","last_fullsized":"2023-10-06T04:37:27.010008+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:36.947789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.782348+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:14:52.399101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"38'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010119+0000","last_change":"2023-10-06T04:37:17.536857+0000","last_active":"2023-10-06T04:37:27.010119+0000","last_peered":"2023-10-06T04:37:27.010119+0000","last_clean":"2023-10-06T04:37:27.010119+0000","last_became_active":"2023-10-06T04:37:17.536593+0000","last_became_peered":"2023-10-06T04:37:17.536593+0000","last_unstale":"2023-10-06T04:37:27.010119+0000","last_undegraded":"2023-10-06T04:37:27.010119+0000","last_fullsized":"2023-10-06T04:37:27.010119+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:37.253030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.004474+0000","last_change":"2023-10-06T04:37:16.541430+0000","last_active":"2023-10-06T04:37:27.004474+0000","last_peered":"2023-10-06T04:37:27.004474+0000","last_clean":"2023-10-06T04:37:27.004474+0000","last_became_active":"2023-10-06T04:37:16.541211+0000","last_became_peered":"2023-10-06T04:37:16.541211+0000","last_unstale":"2023-10-06T04:37:27.004474+0000","last_undegraded":"2023-10-06T04:37:27.004474+0000","last_fullsized":"2023-10-06T04:37:27.004474+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:15:48.328371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781549+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:23.375847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"38'7","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.011879+0000","last_change":"2023-10-06T04:37:17.541674+0000","last_active":"2023-10-06T04:37:27.011879+0000","last_peered":"2023-10-06T04:37:27.011879+0000","last_clean":"2023-10-06T04:37:27.011879+0000","last_became_active":"2023-10-06T04:37:17.541397+0000","last_became_peered":"2023-10-06T04:37:17.541397+0000","last_unstale":"2023-10-06T04:37:27.011879+0000","last_undegraded":"2023-10-06T04:37:27.011879+0000","last_fullsized":"2023-10-06T04:37:27.011879+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:19.011564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779727+0000","last_change":"2023-10-06T04:37:16.539297+0000","last_active":"2023-10-06T04:37:26.779727+0000","last_peered":"2023-10-06T04:37:26.779727+0000","last_clean":"2023-10-06T04:37:26.779727+0000","last_became_active":"2023-10-06T04:37:16.538921+0000","last_became_peered":"2023-10-06T04:37:16.538921+0000","last_unstale":"2023-10-06T04:37:26.779727+0000","last_undegraded":"2023-10-06T04:37:26.779727+0000","last_fullsized":"2023-10-06T04:37:26.779727+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:26.079570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":35,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779801+0000","last_change":"2023-10-06T04:36:11.192215+0000","last_active":"2023-10-06T04:37:26.779801+0000","last_peered":"2023-10-06T04:37:26.779801+0000","last_clean":"2023-10-06T04:37:26.779801+0000","last_became_active":"2023-10-06T04:36:11.191953+0000","last_became_peered":"2023-10-06T04:36:11.191953+0000","last_unstale":"2023-10-06T04:37:26.779801+0000","last_undegraded":"2023-10-06T04:37:26.779801+0000","last_fullsized":"2023-10-06T04:37:26.779801+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:37.026121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.783158+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:29:04.074820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"38'8","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.011406+0000","last_change":"2023-10-06T04:37:17.536572+0000","last_active":"2023-10-06T04:37:27.011406+0000","last_peered":"2023-10-06T04:37:27.011406+0000","last_clean":"2023-10-06T04:37:27.011406+0000","last_became_active":"2023-10-06T04:37:17.536250+0000","last_became_peered":"2023-10-06T04:37:17.536250+0000","last_unstale":"2023-10-06T04:37:27.011406+0000","last_undegraded":"2023-10-06T04:37:27.011406+0000","last_fullsized":"2023-10-06T04:37:27.011406+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:16.140442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.005195+0000","last_change":"2023-10-06T04:37:16.542301+0000","last_active":"2023-10-06T04:37:27.005195+0000","last_peered":"2023-10-06T04:37:27.005195+0000","last_clean":"2023-10-06T04:37:27.005195+0000","last_became_active":"2023-10-06T04:37:16.541967+0000","last_became_peered":"2023-10-06T04:37:16.541967+0000","last_unstale":"2023-10-06T04:37:27.005195+0000","last_undegraded":"2023-10-06T04:37:27.005195+0000","last_fullsized":"2023-10-06T04:37:27.005195+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:24.703451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":32,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.012571+0000","last_change":"2023-10-06T04:36:11.184555+0000","last_active":"2023-10-06T04:37:27.012571+0000","last_peered":"2023-10-06T04:37:27.012571+0000","last_clean":"2023-10-06T04:37:27.012571+0000","last_became_active":"2023-10-06T04:36:11.184229+0000","last_became_peered":"2023-10-06T04:36:11.184229+0000","last_unstale":"2023-10-06T04:37:27.012571+0000","last_undegraded":"2023-10-06T04:37:27.012571+0000","last_fullsized":"2023-10-06T04:37:27.012571+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:19.938716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.785119+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:47:25.866319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"38'5","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.005105+0000","last_change":"2023-10-06T04:37:17.548551+0000","last_active":"2023-10-06T04:37:27.005105+0000","last_peered":"2023-10-06T04:37:27.005105+0000","last_clean":"2023-10-06T04:37:27.005105+0000","last_became_active":"2023-10-06T04:37:17.548252+0000","last_became_peered":"2023-10-06T04:37:17.548252+0000","last_unstale":"2023-10-06T04:37:27.005105+0000","last_undegraded":"2023-10-06T04:37:27.005105+0000","last_fullsized":"2023-10-06T04:37:27.005105+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:23.847066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010028+0000","last_change":"2023-10-06T04:37:16.546270+0000","last_active":"2023-10-06T04:37:27.010028+0000","last_peered":"2023-10-06T04:37:27.010028+0000","last_clean":"2023-10-06T04:37:27.010028+0000","last_became_active":"2023-10-06T04:37:16.545969+0000","last_became_peered":"2023-10-06T04:37:16.545969+0000","last_unstale":"2023-10-06T04:37:27.010028+0000","last_undegraded":"2023-10-06T04:37:27.010028+0000","last_fullsized":"2023-10-06T04:37:27.010028+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:37.190837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":31,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009929+0000","last_change":"2023-10-06T04:36:11.184460+0000","last_active":"2023-10-06T04:37:27.009929+0000","last_peered":"2023-10-06T04:37:27.009929+0000","last_clean":"2023-10-06T04:37:27.009929+0000","last_became_active":"2023-10-06T04:36:11.184119+0000","last_became_peered":"2023-10-06T04:36:11.184119+0000","last_unstale":"2023-10-06T04:37:27.009929+0000","last_undegraded":"2023-10-06T04:37:27.009929+0000","last_fullsized":"2023-10-06T04:37:27.009929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:37.026121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":179,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.004768+0000","last_change":"2023-10-06T04:36:12.183155+0000","last_active":"2023-10-06T04:37:27.004768+0000","last_peered":"2023-10-06T04:37:27.004768+0000","last_clean":"2023-10-06T04:37:27.004768+0000","last_became_active":"2023-10-06T04:36:12.182903+0000","last_became_peered":"2023-10-06T04:36:12.182903+0000","last_unstale":"2023-10-06T04:37:27.004768+0000","last_undegraded":"2023-10-06T04:37:27.004768+0000","last_fullsized":"2023-10-06T04:37:27.004768+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:11.171104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:11.171104+0000","last_clean_scrub_stamp":"2023-10-06T04:36:11.171104+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:38:54.323364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":2,"reported_epoch":45,"state":"creating+activating","last_fresh":"2023-10-06T04:37:29.783254+0000","last_change":"2023-10-06T04:37:29.783380+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:29.783254+0000","last_undegraded":"2023-10-06T04:37:29.783254+0000","last_fullsized":"2023-10-06T04:37:29.783254+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:00:47.460409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"38'9","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010189+0000","last_change":"2023-10-06T04:37:17.537793+0000","last_active":"2023-10-06T04:37:27.010189+0000","last_peered":"2023-10-06T04:37:27.010189+0000","last_clean":"2023-10-06T04:37:27.010189+0000","last_became_active":"2023-10-06T04:37:17.537503+0000","last_became_peered":"2023-10-06T04:37:17.537503+0000","last_unstale":"2023-10-06T04:37:27.010189+0000","last_undegraded":"2023-10-06T04:37:27.010189+0000","last_fullsized":"2023-10-06T04:37:27.010189+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:19.011564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.005224+0000","last_change":"2023-10-06T04:37:16.545879+0000","last_active":"2023-10-06T04:37:27.005224+0000","last_peered":"2023-10-06T04:37:27.005224+0000","last_clean":"2023-10-06T04:37:27.005224+0000","last_became_active":"2023-10-06T04:37:16.545603+0000","last_became_peered":"2023-10-06T04:37:16.545603+0000","last_unstale":"2023-10-06T04:37:27.005224+0000","last_undegraded":"2023-10-06T04:37:27.005224+0000","last_fullsized":"2023-10-06T04:37:27.005224+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:40.207039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":30,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.004883+0000","last_change":"2023-10-06T04:36:11.193056+0000","last_active":"2023-10-06T04:37:27.004883+0000","last_peered":"2023-10-06T04:37:27.004883+0000","last_clean":"2023-10-06T04:37:27.004883+0000","last_became_active":"2023-10-06T04:36:11.192712+0000","last_became_peered":"2023-10-06T04:36:11.192712+0000","last_unstale":"2023-10-06T04:37:27.004883+0000","last_undegraded":"2023-10-06T04:37:27.004883+0000","last_fullsized":"2023-10-06T04:37:27.004883+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:00.008654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.776857+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:13.574637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"38'7","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010402+0000","last_change":"2023-10-06T04:37:17.547978+0000","last_active":"2023-10-06T04:37:27.010402+0000","last_peered":"2023-10-06T04:37:27.010402+0000","last_clean":"2023-10-06T04:37:27.010402+0000","last_became_active":"2023-10-06T04:37:17.547342+0000","last_became_peered":"2023-10-06T04:37:17.547342+0000","last_unstale":"2023-10-06T04:37:27.010402+0000","last_undegraded":"2023-10-06T04:37:27.010402+0000","last_fullsized":"2023-10-06T04:37:27.010402+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:12.970309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"39'3","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010279+0000","last_change":"2023-10-06T04:37:16.544363+0000","last_active":"2023-10-06T04:37:27.010279+0000","last_peered":"2023-10-06T04:37:27.010279+0000","last_clean":"2023-10-06T04:37:27.010279+0000","last_became_active":"2023-10-06T04:37:16.544100+0000","last_became_peered":"2023-10-06T04:37:16.544100+0000","last_unstale":"2023-10-06T04:37:27.010279+0000","last_undegraded":"2023-10-06T04:37:27.010279+0000","last_fullsized":"2023-10-06T04:37:27.010279+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:24.703451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":30,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.004660+0000","last_change":"2023-10-06T04:36:11.192701+0000","last_active":"2023-10-06T04:37:27.004660+0000","last_peered":"2023-10-06T04:37:27.004660+0000","last_clean":"2023-10-06T04:37:27.004660+0000","last_became_active":"2023-10-06T04:36:11.192335+0000","last_became_peered":"2023-10-06T04:36:11.192335+0000","last_unstale":"2023-10-06T04:37:27.004660+0000","last_undegraded":"2023-10-06T04:37:27.004660+0000","last_fullsized":"2023-10-06T04:37:27.004660+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:18.643570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.782838+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:57.475670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"38'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010179+0000","last_change":"2023-10-06T04:37:17.551353+0000","last_active":"2023-10-06T04:37:27.010179+0000","last_peered":"2023-10-06T04:37:27.010179+0000","last_clean":"2023-10-06T04:37:27.010179+0000","last_became_active":"2023-10-06T04:37:17.550655+0000","last_became_peered":"2023-10-06T04:37:17.550655+0000","last_unstale":"2023-10-06T04:37:27.010179+0000","last_undegraded":"2023-10-06T04:37:27.010179+0000","last_fullsized":"2023-10-06T04:37:27.010179+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:37.951996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"39'3","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.012650+0000","last_change":"2023-10-06T04:37:16.541672+0000","last_active":"2023-10-06T04:37:27.012650+0000","last_peered":"2023-10-06T04:37:27.012650+0000","last_clean":"2023-10-06T04:37:27.012650+0000","last_became_active":"2023-10-06T04:37:16.541369+0000","last_became_peered":"2023-10-06T04:37:16.541369+0000","last_unstale":"2023-10-06T04:37:27.012650+0000","last_undegraded":"2023-10-06T04:37:27.012650+0000","last_fullsized":"2023-10-06T04:37:27.012650+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:34.644455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":31,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009672+0000","last_change":"2023-10-06T04:36:11.193497+0000","last_active":"2023-10-06T04:37:27.009672+0000","last_peered":"2023-10-06T04:37:27.009672+0000","last_clean":"2023-10-06T04:37:27.009672+0000","last_became_active":"2023-10-06T04:36:11.193215+0000","last_became_peered":"2023-10-06T04:36:11.193215+0000","last_unstale":"2023-10-06T04:37:27.009672+0000","last_undegraded":"2023-10-06T04:37:27.009672+0000","last_fullsized":"2023-10-06T04:37:27.009672+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:07.497987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":2,"reported_epoch":45,"state":"creating+activating","last_fresh":"2023-10-06T04:37:29.782182+0000","last_change":"2023-10-06T04:37:29.782296+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:29.782182+0000","last_undegraded":"2023-10-06T04:37:29.782182+0000","last_fullsized":"2023-10-06T04:37:29.782182+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:48.194911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"38'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009383+0000","last_change":"2023-10-06T04:37:17.548282+0000","last_active":"2023-10-06T04:37:27.009383+0000","last_peered":"2023-10-06T04:37:27.009383+0000","last_clean":"2023-10-06T04:37:27.009383+0000","last_became_active":"2023-10-06T04:37:17.548037+0000","last_became_peered":"2023-10-06T04:37:17.548037+0000","last_unstale":"2023-10-06T04:37:27.009383+0000","last_undegraded":"2023-10-06T04:37:27.009383+0000","last_fullsized":"2023-10-06T04:37:27.009383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:44:56.161035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009537+0000","last_change":"2023-10-06T04:37:16.539573+0000","last_active":"2023-10-06T04:37:27.009537+0000","last_peered":"2023-10-06T04:37:27.009537+0000","last_clean":"2023-10-06T04:37:27.009537+0000","last_became_active":"2023-10-06T04:37:16.539271+0000","last_became_peered":"2023-10-06T04:37:16.539271+0000","last_unstale":"2023-10-06T04:37:27.009537+0000","last_undegraded":"2023-10-06T04:37:27.009537+0000","last_fullsized":"2023-10-06T04:37:27.009537+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:06:23.075116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010044+0000","last_change":"2023-10-06T04:36:11.193111+0000","last_active":"2023-10-06T04:37:27.010044+0000","last_peered":"2023-10-06T04:37:27.010044+0000","last_clean":"2023-10-06T04:37:27.010044+0000","last_became_active":"2023-10-06T04:36:11.192836+0000","last_became_peered":"2023-10-06T04:36:11.192836+0000","last_unstale":"2023-10-06T04:37:27.010044+0000","last_undegraded":"2023-10-06T04:37:27.010044+0000","last_fullsized":"2023-10-06T04:37:27.010044+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:19.938716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781463+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:25.262954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"38'5","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779612+0000","last_change":"2023-10-06T04:37:17.546750+0000","last_active":"2023-10-06T04:37:26.779612+0000","last_peered":"2023-10-06T04:37:26.779612+0000","last_clean":"2023-10-06T04:37:26.779612+0000","last_became_active":"2023-10-06T04:37:17.546467+0000","last_became_peered":"2023-10-06T04:37:17.546467+0000","last_unstale":"2023-10-06T04:37:26.779612+0000","last_undegraded":"2023-10-06T04:37:26.779612+0000","last_fullsized":"2023-10-06T04:37:26.779612+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:58.928454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009752+0000","last_change":"2023-10-06T04:37:16.544678+0000","last_active":"2023-10-06T04:37:27.009752+0000","last_peered":"2023-10-06T04:37:27.009752+0000","last_clean":"2023-10-06T04:37:27.009752+0000","last_became_active":"2023-10-06T04:37:16.541041+0000","last_became_peered":"2023-10-06T04:37:16.541041+0000","last_unstale":"2023-10-06T04:37:27.009752+0000","last_undegraded":"2023-10-06T04:37:27.009752+0000","last_fullsized":"2023-10-06T04:37:27.009752+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:15:48.328371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010333+0000","last_change":"2023-10-06T04:36:11.182804+0000","last_active":"2023-10-06T04:37:27.010333+0000","last_peered":"2023-10-06T04:37:27.010333+0000","last_clean":"2023-10-06T04:37:27.010333+0000","last_became_active":"2023-10-06T04:36:11.182575+0000","last_became_peered":"2023-10-06T04:36:11.182575+0000","last_unstale":"2023-10-06T04:37:27.010333+0000","last_undegraded":"2023-10-06T04:37:27.010333+0000","last_fullsized":"2023-10-06T04:37:27.010333+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:07.497987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":504,"ondisk_log_size":504,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":93,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298368,"kb_used_data":1080,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073472,"statfs":{"total":96636764160,"available":96331235328,"internally_reserved":0,"allocated":1105920,"data_stored":826104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.50600000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.57099999999999995}]},{"osd":2,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.625}]},{"osd":3,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.55800000000000005}]},{"osd":4,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.58099999999999996}]},{"osd":5,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.45900000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.47099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301884,"kb_used_data":4596,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94069956,"statfs":{"total":96636764160,"available":96327634944,"internally_reserved":0,"allocated":4706304,"data_stored":4430040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":10.045999999999999,"5min":10.045999999999999,"15min":10.045999999999999},"last":0.57699999999999996}]},{"osd":1,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":10.125999999999999,"5min":10.125999999999999,"15min":10.125999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.60499999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":10.238,"5min":10.238,"15min":10.238},"last":0.59699999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":4.4870000000000001,"5min":4.4870000000000001,"15min":4.4870000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":10.393000000000001,"5min":10.393000000000001,"15min":10.393000000000001},"last":0.626}]},{"osd":4,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.40400000000000003}]},{"osd":5,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.377},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.39000000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.434},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.34300000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298368,"kb_used_data":1080,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073472,"statfs":{"total":96636764160,"available":96331235328,"internally_reserved":0,"allocated":1105920,"data_stored":826104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.38700000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.307}]},{"osd":3,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.28699999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.60099999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.61399999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.628}]},{"osd":7,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.65700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301880,"kb_used_data":4592,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94069960,"statfs":{"total":96636764160,"available":96327639040,"internally_reserved":0,"allocated":4702208,"data_stored":4429062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.443,"5min":0.443,"15min":0.443},"last":0.312}]},{"osd":2,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.28999999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.42399999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.73399999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.68700000000000006}]},{"osd":7,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.629},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.66500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297784,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074056,"statfs":{"total":96636764160,"available":96331833344,"internally_reserved":0,"allocated":507904,"data_stored":234758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.432}]},{"osd":1,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.35899999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.378}]},{"osd":4,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.47099999999999997}]},{"osd":5,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.495}]},{"osd":6,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.628},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.64800000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.58299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297784,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074056,"statfs":{"total":96636764160,"available":96331833344,"internally_reserved":0,"allocated":507904,"data_stored":234758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.318},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.442,"5min":0.442,"15min":0.442},"last":0.29199999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.436,"5min":0.436,"15min":0.436},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.27700000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.35399999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.1070000000000002,"5min":2.1070000000000002,"15min":2.1070000000000002},"last":0.51900000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":0.497},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.55200000000000005}]},{"osd":6,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.63},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.54300000000000004}]},{"osd":7,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.52900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299836,"kb_used_data":2548,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072004,"statfs":{"total":96636764160,"available":96329732096,"internally_reserved":0,"allocated":2609152,"data_stored":2332888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":4.2919999999999998,"5min":4.2919999999999998,"15min":4.2919999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.317}]},{"osd":1,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":4.3520000000000003,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":0.34999999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.54400000000000004}]},{"osd":3,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.501}]},{"osd":5,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.38800000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.44},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.59599999999999997}]},{"osd":7,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.623}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299836,"kb_used_data":2548,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072004,"statfs":{"total":96636764160,"available":96329732096,"internally_reserved":0,"allocated":2609152,"data_stored":2332888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.42499999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.40100000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.372},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.48999999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.54400000000000004}]},{"osd":4,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.501}]},{"osd":6,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.51100000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.52400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:37:34.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2023-10-06T04:37:34.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:37:28.769918+0000', 'last_change': '2023-10-06T04:37:28.781623+0000', 'last_active': '2023-10-06T04:37:28.769918+0000', 'last_peered': '2023-10-06T04:37:28.769918+0000', 'last_clean': '2023-10-06T04:37:28.769918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:37:28.769918+0000', 'last_undegraded': '2023-10-06T04:37:28.769918+0000', 'last_fullsized': '2023-10-06T04:37:28.769918+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_clean_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:09:49.912213+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T04:37:34.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2023-10-06T04:37:34.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:37:28.769918+0000', 'last_change': '2023-10-06T04:37:28.780190+0000', 'last_active': '2023-10-06T04:37:28.769918+0000', 'last_peered': '2023-10-06T04:37:28.769918+0000', 'last_clean': '2023-10-06T04:37:28.769918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:37:28.769918+0000', 'last_undegraded': '2023-10-06T04:37:28.769918+0000', 'last_fullsized': '2023-10-06T04:37:28.769918+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_clean_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:29:04.074820+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T04:37:34.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2023-10-06T04:37:34.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 45, 'state': 'creating+activating', 'last_fresh': '2023-10-06T04:37:29.782949+0000', 'last_change': '2023-10-06T04:37:29.783069+0000', 'last_active': '2023-10-06T04:37:28.769918+0000', 'last_peered': '2023-10-06T04:37:28.769918+0000', 'last_clean': '2023-10-06T04:37:28.769918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:37:29.782949+0000', 'last_undegraded': '2023-10-06T04:37:29.782949+0000', 'last_fullsized': '2023-10-06T04:37:29.782949+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_clean_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:46:59.689245+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': ['3', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T04:37:34.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2023-10-06T04:37:34.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:37:28.769918+0000', 'last_change': '2023-10-06T04:37:28.776912+0000', 'last_active': '2023-10-06T04:37:28.769918+0000', 'last_peered': '2023-10-06T04:37:28.769918+0000', 'last_clean': '2023-10-06T04:37:28.769918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:37:28.769918+0000', 'last_undegraded': '2023-10-06T04:37:28.769918+0000', 'last_fullsized': '2023-10-06T04:37:28.769918+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_clean_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:04:11.178752+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T04:37:34.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2023-10-06T04:37:34.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:37:28.769918+0000', 'last_change': '2023-10-06T04:37:28.780593+0000', 'last_active': '2023-10-06T04:37:28.769918+0000', 'last_peered': '2023-10-06T04:37:28.769918+0000', 'last_clean': '2023-10-06T04:37:28.769918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:37:28.769918+0000', 'last_undegraded': '2023-10-06T04:37:28.769918+0000', 'last_fullsized': '2023-10-06T04:37:28.769918+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_clean_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:29:57.475670+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T04:37:34.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2023-10-06T04:37:34.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:37:28.769918+0000', 'last_change': '2023-10-06T04:37:28.779525+0000', 'last_active': '2023-10-06T04:37:28.769918+0000', 'last_peered': '2023-10-06T04:37:28.769918+0000', 'last_clean': '2023-10-06T04:37:28.769918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:37:28.769918+0000', 'last_undegraded': '2023-10-06T04:37:28.769918+0000', 'last_fullsized': '2023-10-06T04:37:28.769918+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_clean_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:44:04.529543+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T04:37:34.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.17 is not active+clean 2023-10-06T04:37:34.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:37:28.769918+0000', 'last_change': '2023-10-06T04:37:28.781194+0000', 'last_active': '2023-10-06T04:37:28.769918+0000', 'last_peered': '2023-10-06T04:37:28.769918+0000', 'last_clean': '2023-10-06T04:37:28.769918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:37:28.769918+0000', 'last_undegraded': '2023-10-06T04:37:28.769918+0000', 'last_fullsized': '2023-10-06T04:37:28.769918+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_clean_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:45:04.824490+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T04:37:34.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2023-10-06T04:37:34.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 45, 'state': 'creating+activating', 'last_fresh': '2023-10-06T04:37:29.780968+0000', 'last_change': '2023-10-06T04:37:29.781107+0000', 'last_active': '2023-10-06T04:37:28.769918+0000', 'last_peered': '2023-10-06T04:37:28.769918+0000', 'last_clean': '2023-10-06T04:37:28.769918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:37:29.780968+0000', 'last_undegraded': '2023-10-06T04:37:29.780968+0000', 'last_fullsized': '2023-10-06T04:37:29.780968+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_clean_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:38:07.292570+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': ['3', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T04:37:34.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.19 is not active+clean 2023-10-06T04:37:34.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:37:28.769918+0000', 'last_change': '2023-10-06T04:37:28.781025+0000', 'last_active': '2023-10-06T04:37:28.769918+0000', 'last_peered': '2023-10-06T04:37:28.769918+0000', 'last_clean': '2023-10-06T04:37:28.769918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:37:28.769918+0000', 'last_undegraded': '2023-10-06T04:37:28.769918+0000', 'last_fullsized': '2023-10-06T04:37:28.769918+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_clean_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:00:08.937757+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T04:37:34.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2023-10-06T04:37:34.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:37:28.769918+0000', 'last_change': '2023-10-06T04:37:28.779740+0000', 'last_active': '2023-10-06T04:37:28.769918+0000', 'last_peered': '2023-10-06T04:37:28.769918+0000', 'last_clean': '2023-10-06T04:37:28.769918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:37:28.769918+0000', 'last_undegraded': '2023-10-06T04:37:28.769918+0000', 'last_fullsized': '2023-10-06T04:37:28.769918+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_clean_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:05:06.685138+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T04:37:34.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2023-10-06T04:37:34.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:37:28.769918+0000', 'last_change': '2023-10-06T04:37:28.779529+0000', 'last_active': '2023-10-06T04:37:28.769918+0000', 'last_peered': '2023-10-06T04:37:28.769918+0000', 'last_clean': '2023-10-06T04:37:28.769918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:37:28.769918+0000', 'last_undegraded': '2023-10-06T04:37:28.769918+0000', 'last_fullsized': '2023-10-06T04:37:28.769918+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_clean_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:53:01.912316+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T04:37:34.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2023-10-06T04:37:34.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:37:28.769918+0000', 'last_change': '2023-10-06T04:37:28.781442+0000', 'last_active': '2023-10-06T04:37:28.769918+0000', 'last_peered': '2023-10-06T04:37:28.769918+0000', 'last_clean': '2023-10-06T04:37:28.769918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:37:28.769918+0000', 'last_undegraded': '2023-10-06T04:37:28.769918+0000', 'last_fullsized': '2023-10-06T04:37:28.769918+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_clean_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:05:06.685138+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T04:37:34.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2023-10-06T04:37:34.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:37:28.769918+0000', 'last_change': '2023-10-06T04:37:28.781750+0000', 'last_active': '2023-10-06T04:37:28.769918+0000', 'last_peered': '2023-10-06T04:37:28.769918+0000', 'last_clean': '2023-10-06T04:37:28.769918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:37:28.769918+0000', 'last_undegraded': '2023-10-06T04:37:28.769918+0000', 'last_fullsized': '2023-10-06T04:37:28.769918+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_clean_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:06:51.489837+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T04:37:34.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2023-10-06T04:37:34.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:37:28.769918+0000', 'last_change': '2023-10-06T04:37:28.781643+0000', 'last_active': '2023-10-06T04:37:28.769918+0000', 'last_peered': '2023-10-06T04:37:28.769918+0000', 'last_clean': '2023-10-06T04:37:28.769918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:37:28.769918+0000', 'last_undegraded': '2023-10-06T04:37:28.769918+0000', 'last_fullsized': '2023-10-06T04:37:28.769918+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_clean_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:24:30.370133+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T04:37:34.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2023-10-06T04:37:34.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:37:28.769918+0000', 'last_change': '2023-10-06T04:37:28.781759+0000', 'last_active': '2023-10-06T04:37:28.769918+0000', 'last_peered': '2023-10-06T04:37:28.769918+0000', 'last_clean': '2023-10-06T04:37:28.769918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:37:28.769918+0000', 'last_undegraded': '2023-10-06T04:37:28.769918+0000', 'last_fullsized': '2023-10-06T04:37:28.769918+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_clean_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:09:07.671768+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T04:37:34.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2023-10-06T04:37:34.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 45, 'state': 'creating+activating', 'last_fresh': '2023-10-06T04:37:29.781315+0000', 'last_change': '2023-10-06T04:37:29.781451+0000', 'last_active': '2023-10-06T04:37:28.769918+0000', 'last_peered': '2023-10-06T04:37:28.769918+0000', 'last_clean': '2023-10-06T04:37:28.769918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:37:29.781315+0000', 'last_undegraded': '2023-10-06T04:37:29.781315+0000', 'last_fullsized': '2023-10-06T04:37:29.781315+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_clean_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:19:45.702967+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': ['3', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T04:37:34.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2023-10-06T04:37:34.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:37:28.769918+0000', 'last_change': '2023-10-06T04:37:28.784527+0000', 'last_active': '2023-10-06T04:37:28.769918+0000', 'last_peered': '2023-10-06T04:37:28.769918+0000', 'last_clean': '2023-10-06T04:37:28.769918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:37:28.769918+0000', 'last_undegraded': '2023-10-06T04:37:28.769918+0000', 'last_fullsized': '2023-10-06T04:37:28.769918+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_clean_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:03:50.233469+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T04:37:34.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2023-10-06T04:37:34.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 45, 'state': 'creating+activating', 'last_fresh': '2023-10-06T04:37:29.781336+0000', 'last_change': '2023-10-06T04:37:29.781477+0000', 'last_active': '2023-10-06T04:37:28.769918+0000', 'last_peered': '2023-10-06T04:37:28.769918+0000', 'last_clean': '2023-10-06T04:37:28.769918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:37:29.781336+0000', 'last_undegraded': '2023-10-06T04:37:29.781336+0000', 'last_fullsized': '2023-10-06T04:37:29.781336+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_clean_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:19:20.831560+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': ['3', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T04:37:34.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2023-10-06T04:37:34.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:37:28.769918+0000', 'last_change': '2023-10-06T04:37:28.783668+0000', 'last_active': '2023-10-06T04:37:28.769918+0000', 'last_peered': '2023-10-06T04:37:28.769918+0000', 'last_clean': '2023-10-06T04:37:28.769918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:37:28.769918+0000', 'last_undegraded': '2023-10-06T04:37:28.769918+0000', 'last_fullsized': '2023-10-06T04:37:28.769918+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_clean_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:31:58.515292+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T04:37:34.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2023-10-06T04:37:34.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:37:28.769918+0000', 'last_change': '2023-10-06T04:37:28.779491+0000', 'last_active': '2023-10-06T04:37:28.769918+0000', 'last_peered': '2023-10-06T04:37:28.769918+0000', 'last_clean': '2023-10-06T04:37:28.769918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:37:28.769918+0000', 'last_undegraded': '2023-10-06T04:37:28.769918+0000', 'last_fullsized': '2023-10-06T04:37:28.769918+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_clean_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:10:36.939764+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T04:37:34.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2023-10-06T04:37:34.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:37:28.769918+0000', 'last_change': '2023-10-06T04:37:28.776912+0000', 'last_active': '2023-10-06T04:37:28.769918+0000', 'last_peered': '2023-10-06T04:37:28.769918+0000', 'last_clean': '2023-10-06T04:37:28.769918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:37:28.769918+0000', 'last_undegraded': '2023-10-06T04:37:28.769918+0000', 'last_fullsized': '2023-10-06T04:37:28.769918+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_clean_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:32:57.793172+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T04:37:34.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2023-10-06T04:37:34.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:37:28.769918+0000', 'last_change': '2023-10-06T04:37:28.781178+0000', 'last_active': '2023-10-06T04:37:28.769918+0000', 'last_peered': '2023-10-06T04:37:28.769918+0000', 'last_clean': '2023-10-06T04:37:28.769918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:37:28.769918+0000', 'last_undegraded': '2023-10-06T04:37:28.769918+0000', 'last_fullsized': '2023-10-06T04:37:28.769918+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_clean_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:50:31.261862+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T04:37:34.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2023-10-06T04:37:34.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:37:28.769918+0000', 'last_change': '2023-10-06T04:37:28.784055+0000', 'last_active': '2023-10-06T04:37:28.769918+0000', 'last_peered': '2023-10-06T04:37:28.769918+0000', 'last_clean': '2023-10-06T04:37:28.769918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:37:28.769918+0000', 'last_undegraded': '2023-10-06T04:37:28.769918+0000', 'last_fullsized': '2023-10-06T04:37:28.769918+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_clean_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:35:49.503329+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T04:37:34.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2023-10-06T04:37:34.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:37:28.769918+0000', 'last_change': '2023-10-06T04:37:28.782348+0000', 'last_active': '2023-10-06T04:37:28.769918+0000', 'last_peered': '2023-10-06T04:37:28.769918+0000', 'last_clean': '2023-10-06T04:37:28.769918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:37:28.769918+0000', 'last_undegraded': '2023-10-06T04:37:28.769918+0000', 'last_fullsized': '2023-10-06T04:37:28.769918+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_clean_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:14:52.399101+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T04:37:34.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2023-10-06T04:37:34.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:37:28.769918+0000', 'last_change': '2023-10-06T04:37:28.781549+0000', 'last_active': '2023-10-06T04:37:28.769918+0000', 'last_peered': '2023-10-06T04:37:28.769918+0000', 'last_clean': '2023-10-06T04:37:28.769918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:37:28.769918+0000', 'last_undegraded': '2023-10-06T04:37:28.769918+0000', 'last_fullsized': '2023-10-06T04:37:28.769918+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_clean_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:19:23.375847+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T04:37:34.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2023-10-06T04:37:34.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:37:28.769918+0000', 'last_change': '2023-10-06T04:37:28.783158+0000', 'last_active': '2023-10-06T04:37:28.769918+0000', 'last_peered': '2023-10-06T04:37:28.769918+0000', 'last_clean': '2023-10-06T04:37:28.769918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:37:28.769918+0000', 'last_undegraded': '2023-10-06T04:37:28.769918+0000', 'last_fullsized': '2023-10-06T04:37:28.769918+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_clean_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:29:04.074820+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T04:37:34.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2023-10-06T04:37:34.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:37:28.769918+0000', 'last_change': '2023-10-06T04:37:28.785119+0000', 'last_active': '2023-10-06T04:37:28.769918+0000', 'last_peered': '2023-10-06T04:37:28.769918+0000', 'last_clean': '2023-10-06T04:37:28.769918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:37:28.769918+0000', 'last_undegraded': '2023-10-06T04:37:28.769918+0000', 'last_fullsized': '2023-10-06T04:37:28.769918+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_clean_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:47:25.866319+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T04:37:34.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2023-10-06T04:37:34.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 45, 'state': 'creating+activating', 'last_fresh': '2023-10-06T04:37:29.783254+0000', 'last_change': '2023-10-06T04:37:29.783380+0000', 'last_active': '2023-10-06T04:37:28.769918+0000', 'last_peered': '2023-10-06T04:37:28.769918+0000', 'last_clean': '2023-10-06T04:37:28.769918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:37:29.783254+0000', 'last_undegraded': '2023-10-06T04:37:29.783254+0000', 'last_fullsized': '2023-10-06T04:37:29.783254+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_clean_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:00:47.460409+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': ['3', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T04:37:34.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2023-10-06T04:37:34.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:37:28.769918+0000', 'last_change': '2023-10-06T04:37:28.776857+0000', 'last_active': '2023-10-06T04:37:28.769918+0000', 'last_peered': '2023-10-06T04:37:28.769918+0000', 'last_clean': '2023-10-06T04:37:28.769918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:37:28.769918+0000', 'last_undegraded': '2023-10-06T04:37:28.769918+0000', 'last_fullsized': '2023-10-06T04:37:28.769918+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_clean_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:39:13.574637+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T04:37:34.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2023-10-06T04:37:34.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:37:28.769918+0000', 'last_change': '2023-10-06T04:37:28.782838+0000', 'last_active': '2023-10-06T04:37:28.769918+0000', 'last_peered': '2023-10-06T04:37:28.769918+0000', 'last_clean': '2023-10-06T04:37:28.769918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:37:28.769918+0000', 'last_undegraded': '2023-10-06T04:37:28.769918+0000', 'last_fullsized': '2023-10-06T04:37:28.769918+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_clean_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:29:57.475670+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T04:37:34.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2023-10-06T04:37:34.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 45, 'state': 'creating+activating', 'last_fresh': '2023-10-06T04:37:29.782182+0000', 'last_change': '2023-10-06T04:37:29.782296+0000', 'last_active': '2023-10-06T04:37:28.769918+0000', 'last_peered': '2023-10-06T04:37:28.769918+0000', 'last_clean': '2023-10-06T04:37:28.769918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:37:29.782182+0000', 'last_undegraded': '2023-10-06T04:37:29.782182+0000', 'last_fullsized': '2023-10-06T04:37:29.782182+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_clean_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:32:48.194911+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': ['3', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T04:37:34.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2023-10-06T04:37:34.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:37:28.769918+0000', 'last_change': '2023-10-06T04:37:28.781463+0000', 'last_active': '2023-10-06T04:37:28.769918+0000', 'last_peered': '2023-10-06T04:37:28.769918+0000', 'last_clean': '2023-10-06T04:37:28.769918+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:37:28.769918+0000', 'last_undegraded': '2023-10-06T04:37:28.769918+0000', 'last_fullsized': '2023-10-06T04:37:28.769918+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'last_clean_scrub_stamp': '2023-10-06T04:37:28.769918+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:42:25.262954+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T04:37:34.681 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T04:37:34.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.821+0000 7fcd9590e700 1 Processor -- start 2023-10-06T04:37:34.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.821+0000 7fcd9590e700 1 -- start start 2023-10-06T04:37:34.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.822+0000 7fcd9590e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd90153740 0x7fcd90153b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:34.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.822+0000 7fcd9590e700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fcd9015d8e0 0x7fcd900696c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:34.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.822+0000 7fcd9590e700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd9015d170 con 0x7fcd9015a7b0 2023-10-06T04:37:34.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.822+0000 7fcd9590e700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd900ca990 con 0x7fcd9015d8e0 2023-10-06T04:37:34.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.822+0000 7fcd9590e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd900cac70 con 0x7fcd90153740 2023-10-06T04:37:34.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.822+0000 7fcd9510d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fcd9015d8e0 0x7fcd900696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:34.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.822+0000 7fcd8ffff700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fcd9015a7b0 0x7fcd900cfa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:51876/0 (socket says 172.21.15.8:51876) 2023-10-06T04:37:34.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.822+0000 7fcd8ffff700 1 -- 172.21.15.8:0/1909339398 learned_addr learned my addr 172.21.15.8:0/1909339398 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:34.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.822+0000 7fcd9510d700 1 -- 172.21.15.8:0/1909339398 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd90153740 msgr2=0x7fcd90153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:34.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.822+0000 7fcd9490c700 1 --2- 172.21.15.8:0/1909339398 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd90153740 0x7fcd90153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:34.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.822+0000 7fcd9510d700 1 --2- 172.21.15.8:0/1909339398 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd90153740 0x7fcd90153b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:34.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.822+0000 7fcd8f7fe700 1 -- 172.21.15.8:0/1909339398 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1468281572 0 0) 0x7fcd9015d170 con 0x7fcd9015a7b0 2023-10-06T04:37:34.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.822+0000 7fcd9510d700 1 -- 172.21.15.8:0/1909339398 >> v1:172.21.15.8:6789/0 conn(0x7fcd9015a7b0 legacy=0x7fcd900cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:34.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.822+0000 7fcd9510d700 1 -- 172.21.15.8:0/1909339398 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd900caf50 con 0x7fcd9015d8e0 2023-10-06T04:37:34.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.823+0000 7fcd9510d700 1 --2- 172.21.15.8:0/1909339398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd9015d8e0 0x7fcd900696c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fcd88009e60 tx=0x7fcd88009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d4b63f26bf25813 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:34.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.823+0000 7fcd8f7fe700 1 -- 172.21.15.8:0/1909339398 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8800e070 con 0x7fcd9015d8e0 2023-10-06T04:37:34.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.823+0000 7fcd8f7fe700 1 -- 172.21.15.8:0/1909339398 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8800bc30 con 0x7fcd9015d8e0 2023-10-06T04:37:34.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.823+0000 7fcd8f7fe700 1 -- 172.21.15.8:0/1909339398 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd88012430 con 0x7fcd9015d8e0 2023-10-06T04:37:34.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.823+0000 7fcd9590e700 1 -- 172.21.15.8:0/1909339398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd9015d8e0 msgr2=0x7fcd900696c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:34.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.823+0000 7fcd9590e700 1 --2- 172.21.15.8:0/1909339398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd9015d8e0 0x7fcd900696c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fcd88009e60 tx=0x7fcd88009780 comp rx=0 tx=0).stop 2023-10-06T04:37:34.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.823+0000 7fcd9590e700 1 -- 172.21.15.8:0/1909339398 shutdown_connections 2023-10-06T04:37:34.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.823+0000 7fcd9590e700 1 --2- 172.21.15.8:0/1909339398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd9015d8e0 0x7fcd900696c0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:34.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.823+0000 7fcd9590e700 1 --2- 172.21.15.8:0/1909339398 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd90153740 0x7fcd90153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:34.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.823+0000 7fcd9590e700 1 -- 172.21.15.8:0/1909339398 >> 172.21.15.8:0/1909339398 conn(0x7fcd900d02b0 msgr2=0x7fcd900d06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:34.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.823+0000 7fcd9590e700 1 -- 172.21.15.8:0/1909339398 shutdown_connections 2023-10-06T04:37:34.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.823+0000 7fcd9590e700 1 -- 172.21.15.8:0/1909339398 wait complete. 2023-10-06T04:37:34.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.824+0000 7fcd9590e700 1 Processor -- start 2023-10-06T04:37:34.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.825+0000 7fcd9590e700 1 -- start start 2023-10-06T04:37:34.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.825+0000 7fcd9590e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd90153740 0x7fcd90151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:34.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.825+0000 7fcd9590e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd9015a7b0 0x7fcd9015dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:34.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.825+0000 7fcd9590e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd9015d8e0 0x7fcd900c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:34.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.825+0000 7fcd9590e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9015ee80 con 0x7fcd9015d8e0 2023-10-06T04:37:34.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.825+0000 7fcd9590e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd900b3c60 con 0x7fcd90153740 2023-10-06T04:37:34.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.825+0000 7fcd9590e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd900b4200 con 0x7fcd9015a7b0 2023-10-06T04:37:34.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.825+0000 7fcd9510d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd9015d8e0 0x7fcd900c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:34.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.825+0000 7fcd9510d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd9015d8e0 0x7fcd900c5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54346/0 (socket says 172.21.15.8:54346) 2023-10-06T04:37:34.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.825+0000 7fcd9510d700 1 -- 172.21.15.8:0/3685561965 learned_addr learned my addr 172.21.15.8:0/3685561965 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:34.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.826+0000 7fcd8ffff700 1 --2- 172.21.15.8:0/3685561965 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd9015a7b0 0x7fcd9015dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:34.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.826+0000 7fcd9490c700 1 --2- 172.21.15.8:0/3685561965 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd90153740 0x7fcd90151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:34.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.826+0000 7fcd9510d700 1 -- 172.21.15.8:0/3685561965 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd9015a7b0 msgr2=0x7fcd9015dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:34.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.826+0000 7fcd9510d700 1 --2- 172.21.15.8:0/3685561965 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd9015a7b0 0x7fcd9015dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:34.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.826+0000 7fcd9510d700 1 -- 172.21.15.8:0/3685561965 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd90153740 msgr2=0x7fcd90151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:34.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.826+0000 7fcd9510d700 1 --2- 172.21.15.8:0/3685561965 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd90153740 0x7fcd90151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:34.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.826+0000 7fcd9510d700 1 -- 172.21.15.8:0/3685561965 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd88009a20 con 0x7fcd9015d8e0 2023-10-06T04:37:34.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.826+0000 7fcd9490c700 1 --2- 172.21.15.8:0/3685561965 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd90153740 0x7fcd90151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:34.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.826+0000 7fcd9510d700 1 --2- 172.21.15.8:0/3685561965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd9015d8e0 0x7fcd900c5050 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fcd900894c0 tx=0x7fcd88019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:34.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.826+0000 7fcd8cff9700 1 -- 172.21.15.8:0/3685561965 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8801d630 con 0x7fcd9015d8e0 2023-10-06T04:37:34.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.826+0000 7fcd8cff9700 1 -- 172.21.15.8:0/3685561965 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8801d7b0 con 0x7fcd9015d8e0 2023-10-06T04:37:34.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.826+0000 7fcd9590e700 1 -- 172.21.15.8:0/3685561965 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd9015e8c0 con 0x7fcd9015d8e0 2023-10-06T04:37:34.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.826+0000 7fcd8cff9700 1 -- 172.21.15.8:0/3685561965 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8801db70 con 0x7fcd9015d8e0 2023-10-06T04:37:34.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.826+0000 7fcd9590e700 1 -- 172.21.15.8:0/3685561965 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd900b3e90 con 0x7fcd9015d8e0 2023-10-06T04:37:34.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.827+0000 7fcd9590e700 1 -- 172.21.15.8:0/3685561965 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd9004c380 con 0x7fcd9015d8e0 2023-10-06T04:37:34.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.828+0000 7fcd8cff9700 1 -- 172.21.15.8:0/3685561965 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcd88024070 con 0x7fcd9015d8e0 2023-10-06T04:37:34.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.828+0000 7fcd8cff9700 1 --2- 172.21.15.8:0/3685561965 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fcd74066f30 0x7fcd740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:34.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.828+0000 7fcd8cff9700 1 -- 172.21.15.8:0/3685561965 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7fcd88087400 con 0x7fcd9015d8e0 2023-10-06T04:37:34.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.828+0000 7fcd9490c700 1 --2- 172.21.15.8:0/3685561965 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fcd74066f30 0x7fcd740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:34.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.829+0000 7fcd9490c700 1 --2- 172.21.15.8:0/3685561965 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fcd74066f30 0x7fcd740693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcd900ce190 tx=0x7fcd84008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:34.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:34.833+0000 7fcd8cff9700 1 -- 172.21.15.8:0/3685561965 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd880541b0 con 0x7fcd9015d8e0 2023-10-06T04:37:35.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.104+0000 7fcd9590e700 1 -- 172.21.15.8:0/3685561965 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fcd900b4340 con 0x7fcd9015d8e0 2023-10-06T04:37:35.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.105+0000 7fcd8cff9700 1 -- 172.21.15.8:0/3685561965 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1787 (secure 0 0 0) 0x7fcd880577d0 con 0x7fcd9015d8e0 2023-10-06T04:37:35.106 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:35.106 INFO:teuthology.orchestra.run.smithi008.stdout:{"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","health":{"status":"HEALTH_ERR","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"2 filesystems are degraded","count":2},"muted":false},"MDS_ALL_DOWN":{"severity":"HEALTH_ERR","summary":{"message":"2 filesystems are offline","count":2},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":96,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":46,"num_osds":8,"num_up_osds":8,"osd_up_since":1696566969,"num_in_osds":8,"osd_in_since":1696566961,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105},{"state_name":"creating+peering","count":26},{"state_name":"creating+activating","count":6}],"num_pgs":137,"num_pools":5,"num_objects":4,"data_bytes":6881824,"bytes_used":2453237760,"bytes_avail":770640875520,"bytes_total":773094113280,"inactive_pgs_ratio":0.23357664048671722,"read_bytes_sec":0,"write_bytes_sec":2729,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":23,"id":2,"up":0,"in":1,"max":1,"id":3,"up":0,"in":1,"max":1,"by_rank":[],"up:standby":4,"failed":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-10-06T04:37:26.647839+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T04:37:35.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.106+0000 7fcd9590e700 1 -- 172.21.15.8:0/3685561965 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fcd74066f30 msgr2=0x7fcd740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:35.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.107+0000 7fcd9590e700 1 --2- 172.21.15.8:0/3685561965 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fcd74066f30 0x7fcd740693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcd900ce190 tx=0x7fcd84008040 comp rx=0 tx=0).stop 2023-10-06T04:37:35.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.107+0000 7fcd9590e700 1 -- 172.21.15.8:0/3685561965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd9015d8e0 msgr2=0x7fcd900c5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:35.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.107+0000 7fcd9590e700 1 --2- 172.21.15.8:0/3685561965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd9015d8e0 0x7fcd900c5050 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fcd900894c0 tx=0x7fcd88019000 comp rx=0 tx=0).stop 2023-10-06T04:37:35.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.107+0000 7fcd9590e700 1 -- 172.21.15.8:0/3685561965 shutdown_connections 2023-10-06T04:37:35.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.107+0000 7fcd9590e700 1 --2- 172.21.15.8:0/3685561965 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fcd74066f30 0x7fcd740693e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:35.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.107+0000 7fcd9590e700 1 --2- 172.21.15.8:0/3685561965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd9015d8e0 0x7fcd900c5050 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:35.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.107+0000 7fcd9590e700 1 --2- 172.21.15.8:0/3685561965 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd90153740 0x7fcd90151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:35.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.107+0000 7fcd9590e700 1 --2- 172.21.15.8:0/3685561965 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd9015a7b0 0x7fcd9015dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:35.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.107+0000 7fcd9590e700 1 -- 172.21.15.8:0/3685561965 >> 172.21.15.8:0/3685561965 conn(0x7fcd900d02b0 msgr2=0x7fcd90068190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:35.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.107+0000 7fcd9590e700 1 -- 172.21.15.8:0/3685561965 shutdown_connections 2023-10-06T04:37:35.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.107+0000 7fcd9590e700 1 -- 172.21.15.8:0/3685561965 wait complete. 2023-10-06T04:37:35.120 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T04:37:35.120 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:37:35.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.237+0000 7f242cc81700 1 Processor -- start 2023-10-06T04:37:35.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.237+0000 7f242cc81700 1 -- start start 2023-10-06T04:37:35.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.238+0000 7f242cc81700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24281571b0 0x7f2428157580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:35.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.238+0000 7f242cc81700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24280cd4d0 con 0x7f24280b1cf0 2023-10-06T04:37:35.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.238+0000 7f242cc81700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24280ccc30 con 0x7f24280cc070 2023-10-06T04:37:35.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.238+0000 7f242cc81700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24280ccf10 con 0x7f24281571b0 2023-10-06T04:37:35.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.238+0000 7f2426d9d700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f24280b1cf0 0x7f24280b2eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:51884/0 (socket says 172.21.15.8:51884) 2023-10-06T04:37:35.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.238+0000 7f2426d9d700 1 -- 172.21.15.8:0/1426541764 learned_addr learned my addr 172.21.15.8:0/1426541764 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:35.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.239+0000 7f242659c700 1 --2- 172.21.15.8:0/1426541764 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24281571b0 0x7f2428157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:35.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.239+0000 7f242559a700 1 -- 172.21.15.8:0/1426541764 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 467991929 0 0) 0x7f24280cd4d0 con 0x7f24280b1cf0 2023-10-06T04:37:35.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.239+0000 7f242559a700 1 -- 172.21.15.8:0/1426541764 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2414003570 con 0x7f24280b1cf0 2023-10-06T04:37:35.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.239+0000 7f242559a700 1 -- 172.21.15.8:0/1426541764 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3264403436 0 0) 0x7f2414003570 con 0x7f24280b1cf0 2023-10-06T04:37:35.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.239+0000 7f242559a700 1 -- 172.21.15.8:0/1426541764 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24281571b0 msgr2=0x7f2428157580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:35.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.239+0000 7f242559a700 1 --2- 172.21.15.8:0/1426541764 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24281571b0 0x7f2428157580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:35.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.239+0000 7f242559a700 1 -- 172.21.15.8:0/1426541764 >> v1:172.21.15.184:6789/0 conn(0x7f24280cc070 legacy=0x7f24280b15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:35.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.239+0000 7f242559a700 1 -- 172.21.15.8:0/1426541764 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24280cd1f0 con 0x7f24280b1cf0 2023-10-06T04:37:35.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.239+0000 7f242559a700 1 -- 172.21.15.8:0/1426541764 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7f2418001470 con 0x7f24280b1cf0 2023-10-06T04:37:35.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.239+0000 7f242559a700 1 -- 172.21.15.8:0/1426541764 >> v1:172.21.15.8:6789/0 conn(0x7f24280b1cf0 legacy=0x7f24280b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:35.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.239+0000 7f242559a700 1 --2- 172.21.15.8:0/1426541764 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2414003a90 0x7f2414003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:35.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.239+0000 7f242559a700 1 --2- 172.21.15.8:0/1426541764 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24281571b0 0x7f2414004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:35.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.239+0000 7f242559a700 1 --2- 172.21.15.8:0/1426541764 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2414004d50 0x7f24140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:35.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.239+0000 7f242559a700 1 -- 172.21.15.8:0/1426541764 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24280ccf10 con 0x7f2414004d50 2023-10-06T04:37:35.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.239+0000 7f242559a700 1 -- 172.21.15.8:0/1426541764 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241400bb10 con 0x7f2414003a90 2023-10-06T04:37:35.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.239+0000 7f242559a700 1 -- 172.21.15.8:0/1426541764 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f241400bcd0 con 0x7f24281571b0 2023-10-06T04:37:35.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.239+0000 7f2426d9d700 1 --2- 172.21.15.8:0/1426541764 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2414004d50 0x7f24140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:35.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.239+0000 7f242659c700 1 --2- 172.21.15.8:0/1426541764 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2414003a90 0x7f2414003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:35.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.239+0000 7f2425d9b700 1 --2- 172.21.15.8:0/1426541764 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24281571b0 0x7f2414004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:35.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.239+0000 7f2426d9d700 1 -- 172.21.15.8:0/1426541764 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24281571b0 msgr2=0x7f2414004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:35.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.239+0000 7f2426d9d700 1 --2- 172.21.15.8:0/1426541764 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24281571b0 0x7f2414004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:35.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.239+0000 7f2426d9d700 1 -- 172.21.15.8:0/1426541764 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2414003a90 msgr2=0x7f2414003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:35.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.239+0000 7f2426d9d700 1 --2- 172.21.15.8:0/1426541764 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2414003a90 0x7f2414003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:35.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.239+0000 7f2426d9d700 1 -- 172.21.15.8:0/1426541764 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2414003570 con 0x7f2414004d50 2023-10-06T04:37:35.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.240+0000 7f2426d9d700 1 --2- 172.21.15.8:0/1426541764 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2414004d50 0x7f24140051c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f24280b10c0 tx=0x7f2418001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e647baf3456f00f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:35.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.240+0000 7f242559a700 1 -- 172.21.15.8:0/1426541764 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241800cb60 con 0x7f2414004d50 2023-10-06T04:37:35.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.240+0000 7f242559a700 1 -- 172.21.15.8:0/1426541764 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241800ccc0 con 0x7f2414004d50 2023-10-06T04:37:35.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.240+0000 7f242559a700 1 -- 172.21.15.8:0/1426541764 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2418005b70 con 0x7f2414004d50 2023-10-06T04:37:35.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.240+0000 7f242cc81700 1 -- 172.21.15.8:0/1426541764 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2414004d50 msgr2=0x7f24140051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:35.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.240+0000 7f242cc81700 1 --2- 172.21.15.8:0/1426541764 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2414004d50 0x7f24140051c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f24280b10c0 tx=0x7f2418001df0 comp rx=0 tx=0).stop 2023-10-06T04:37:35.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.240+0000 7f2426d9d700 1 -- 172.21.15.8:0/1426541764 reap_dead start 2023-10-06T04:37:35.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.240+0000 7f242cc81700 1 -- 172.21.15.8:0/1426541764 shutdown_connections 2023-10-06T04:37:35.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.240+0000 7f242cc81700 1 -- 172.21.15.8:0/1426541764 >> 172.21.15.8:0/1426541764 conn(0x7f24280675d0 msgr2=0x7f24280679d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:35.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.240+0000 7f242cc81700 1 -- 172.21.15.8:0/1426541764 shutdown_connections 2023-10-06T04:37:35.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.240+0000 7f242cc81700 1 -- 172.21.15.8:0/1426541764 wait complete. 2023-10-06T04:37:35.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.241+0000 7f242cc81700 1 Processor -- start 2023-10-06T04:37:35.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.242+0000 7f242cc81700 1 -- start start 2023-10-06T04:37:35.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.242+0000 7f242cc81700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2414004d50 0x7f242814d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:35.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.242+0000 7f242cc81700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f242814aac0 0x7f242814a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:35.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.242+0000 7f242cc81700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2428150d10 0x7f2428151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:35.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.242+0000 7f242cc81700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24281516c0 con 0x7f242814aac0 2023-10-06T04:37:35.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.242+0000 7f242cc81700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2428167eb0 con 0x7f2428150d10 2023-10-06T04:37:35.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.242+0000 7f242cc81700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f242814a8e0 con 0x7f2414004d50 2023-10-06T04:37:35.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.242+0000 7f2425d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f242814aac0 0x7f242814a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:35.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.242+0000 7f2425d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f242814aac0 0x7f242814a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54354/0 (socket says 172.21.15.8:54354) 2023-10-06T04:37:35.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.242+0000 7f2425d9b700 1 -- 172.21.15.8:0/835418100 learned_addr learned my addr 172.21.15.8:0/835418100 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:35.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.243+0000 7f242659c700 1 --2- 172.21.15.8:0/835418100 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2414004d50 0x7f242814d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:35.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.243+0000 7f2426d9d700 1 --2- 172.21.15.8:0/835418100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2428150d10 0x7f2428151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:35.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.243+0000 7f2425d9b700 1 -- 172.21.15.8:0/835418100 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2414004d50 msgr2=0x7f242814d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:35.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.243+0000 7f2425d9b700 1 --2- 172.21.15.8:0/835418100 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2414004d50 0x7f242814d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:35.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.243+0000 7f2425d9b700 1 -- 172.21.15.8:0/835418100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2428150d10 msgr2=0x7f2428151180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:35.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.243+0000 7f2425d9b700 1 --2- 172.21.15.8:0/835418100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2428150d10 0x7f2428151180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:35.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.243+0000 7f2425d9b700 1 -- 172.21.15.8:0/835418100 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24281672e0 con 0x7f242814aac0 2023-10-06T04:37:35.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.243+0000 7f2425d9b700 1 --2- 172.21.15.8:0/835418100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f242814aac0 0x7f242814a3a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2410002ab0 tx=0x7f2410007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:35.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.243+0000 7f241e7fc700 1 -- 172.21.15.8:0/835418100 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241000f9a0 con 0x7f242814aac0 2023-10-06T04:37:35.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.243+0000 7f241e7fc700 1 -- 172.21.15.8:0/835418100 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241000fb00 con 0x7f242814aac0 2023-10-06T04:37:35.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.243+0000 7f242cc81700 1 -- 172.21.15.8:0/835418100 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2428167580 con 0x7f242814aac0 2023-10-06T04:37:35.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.243+0000 7f241e7fc700 1 -- 172.21.15.8:0/835418100 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241000fec0 con 0x7f242814aac0 2023-10-06T04:37:35.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.243+0000 7f242cc81700 1 -- 172.21.15.8:0/835418100 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2428167b40 con 0x7f242814aac0 2023-10-06T04:37:35.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.244+0000 7f242cc81700 1 -- 172.21.15.8:0/835418100 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2428168060 con 0x7f242814aac0 2023-10-06T04:37:35.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.244+0000 7f241e7fc700 1 -- 172.21.15.8:0/835418100 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2410013600 con 0x7f242814aac0 2023-10-06T04:37:35.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.245+0000 7f241e7fc700 1 --2- 172.21.15.8:0/835418100 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2408066f00 0x7f24080693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:35.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.245+0000 7f241e7fc700 1 -- 172.21.15.8:0/835418100 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7f2410085110 con 0x7f242814aac0 2023-10-06T04:37:35.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.245+0000 7f242659c700 1 --2- 172.21.15.8:0/835418100 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2408066f00 0x7f24080693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:35.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.246+0000 7f242659c700 1 --2- 172.21.15.8:0/835418100 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2408066f00 0x7f24080693b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2420009fd0 tx=0x7f242000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:35.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.249+0000 7f241e7fc700 1 -- 172.21.15.8:0/835418100 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2428168060 con 0x7f242814aac0 2023-10-06T04:37:35.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.436+0000 7f242cc81700 1 -- 172.21.15.8:0/835418100 --> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2428168020 con 0x7f2408066f00 2023-10-06T04:37:35.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.447+0000 7f241e7fc700 1 -- 172.21.15.8:0/835418100 <== mgr.4105 v2:172.21.15.184:6832/90283 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+391385 (secure 0 0 0) 0x7f2428168020 con 0x7f2408066f00 2023-10-06T04:37:35.453 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:35.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.450+0000 7f242cc81700 1 -- 172.21.15.8:0/835418100 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2408066f00 msgr2=0x7f24080693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:35.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.450+0000 7f242cc81700 1 --2- 172.21.15.8:0/835418100 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2408066f00 0x7f24080693b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2420009fd0 tx=0x7f242000b040 comp rx=0 tx=0).stop 2023-10-06T04:37:35.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.450+0000 7f242cc81700 1 -- 172.21.15.8:0/835418100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f242814aac0 msgr2=0x7f242814a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:35.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.450+0000 7f242cc81700 1 --2- 172.21.15.8:0/835418100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f242814aac0 0x7f242814a3a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2410002ab0 tx=0x7f2410007d10 comp rx=0 tx=0).stop 2023-10-06T04:37:35.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.450+0000 7f242cc81700 1 -- 172.21.15.8:0/835418100 shutdown_connections 2023-10-06T04:37:35.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.450+0000 7f242cc81700 1 --2- 172.21.15.8:0/835418100 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2408066f00 0x7f24080693b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:35.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.450+0000 7f242cc81700 1 --2- 172.21.15.8:0/835418100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2428150d10 0x7f2428151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:35.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.450+0000 7f242cc81700 1 --2- 172.21.15.8:0/835418100 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2414004d50 0x7f242814d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:35.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.450+0000 7f242cc81700 1 --2- 172.21.15.8:0/835418100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f242814aac0 0x7f242814a3a0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:35.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.450+0000 7f242cc81700 1 -- 172.21.15.8:0/835418100 >> 172.21.15.8:0/835418100 conn(0x7f24280675d0 msgr2=0x7f2428156480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:35.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.450+0000 7f242cc81700 1 -- 172.21.15.8:0/835418100 shutdown_connections 2023-10-06T04:37:35.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:35.450+0000 7f242cc81700 1 -- 172.21.15.8:0/835418100 wait complete. 2023-10-06T04:37:35.457 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-06T04:37:35.464 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2023-10-06T04:37:34.650031+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6881824,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":100,"num_write":256,"num_write_kb":8601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":703,"ondisk_log_size":703,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":216,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2395740,"kb_used_data":17436,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752578980,"statfs":{"total":773094113280,"available":770640875520,"internally_reserved":0,"allocated":17854464,"data_stored":15646602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11726,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":45,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001687"},"pg_stats":[{"pgid":"7.3f","version":"38'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.003905+0000","last_change":"2023-10-06T04:37:17.540825+0000","last_active":"2023-10-06T04:37:27.003905+0000","last_peered":"2023-10-06T04:37:27.003905+0000","last_clean":"2023-10-06T04:37:27.003905+0000","last_became_active":"2023-10-06T04:37:17.540537+0000","last_became_peered":"2023-10-06T04:37:17.540537+0000","last_unstale":"2023-10-06T04:37:27.003905+0000","last_undegraded":"2023-10-06T04:37:27.003905+0000","last_fullsized":"2023-10-06T04:37:27.003905+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:27.083777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"38'4","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010044+0000","last_change":"2023-10-06T04:37:17.550627+0000","last_active":"2023-10-06T04:37:27.010044+0000","last_peered":"2023-10-06T04:37:27.010044+0000","last_clean":"2023-10-06T04:37:27.010044+0000","last_became_active":"2023-10-06T04:37:17.550395+0000","last_became_peered":"2023-10-06T04:37:17.550395+0000","last_unstale":"2023-10-06T04:37:27.010044+0000","last_undegraded":"2023-10-06T04:37:27.010044+0000","last_fullsized":"2023-10-06T04:37:27.010044+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:49.714446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"38'7","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779750+0000","last_change":"2023-10-06T04:37:17.541131+0000","last_active":"2023-10-06T04:37:26.779750+0000","last_peered":"2023-10-06T04:37:26.779750+0000","last_clean":"2023-10-06T04:37:26.779750+0000","last_became_active":"2023-10-06T04:37:17.540816+0000","last_became_peered":"2023-10-06T04:37:17.540816+0000","last_unstale":"2023-10-06T04:37:26.779750+0000","last_undegraded":"2023-10-06T04:37:26.779750+0000","last_fullsized":"2023-10-06T04:37:26.779750+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:32:45.542874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"38'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010129+0000","last_change":"2023-10-06T04:37:17.545649+0000","last_active":"2023-10-06T04:37:27.010129+0000","last_peered":"2023-10-06T04:37:27.010129+0000","last_clean":"2023-10-06T04:37:27.010129+0000","last_became_active":"2023-10-06T04:37:17.545155+0000","last_became_peered":"2023-10-06T04:37:17.545155+0000","last_unstale":"2023-10-06T04:37:27.010129+0000","last_undegraded":"2023-10-06T04:37:27.010129+0000","last_fullsized":"2023-10-06T04:37:27.010129+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:09.823506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"38'4","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010286+0000","last_change":"2023-10-06T04:37:17.545451+0000","last_active":"2023-10-06T04:37:27.010286+0000","last_peered":"2023-10-06T04:37:27.010286+0000","last_clean":"2023-10-06T04:37:27.010286+0000","last_became_active":"2023-10-06T04:37:17.545135+0000","last_became_peered":"2023-10-06T04:37:17.545135+0000","last_unstale":"2023-10-06T04:37:27.010286+0000","last_undegraded":"2023-10-06T04:37:27.010286+0000","last_fullsized":"2023-10-06T04:37:27.010286+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:44.628778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"38'6","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.011289+0000","last_change":"2023-10-06T04:37:17.545054+0000","last_active":"2023-10-06T04:37:27.011289+0000","last_peered":"2023-10-06T04:37:27.011289+0000","last_clean":"2023-10-06T04:37:27.011289+0000","last_became_active":"2023-10-06T04:37:17.544822+0000","last_became_peered":"2023-10-06T04:37:17.544822+0000","last_unstale":"2023-10-06T04:37:27.011289+0000","last_undegraded":"2023-10-06T04:37:27.011289+0000","last_fullsized":"2023-10-06T04:37:27.011289+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:28:51.824521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"38'5","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.004522+0000","last_change":"2023-10-06T04:37:17.548819+0000","last_active":"2023-10-06T04:37:27.004522+0000","last_peered":"2023-10-06T04:37:27.004522+0000","last_clean":"2023-10-06T04:37:27.004522+0000","last_became_active":"2023-10-06T04:37:17.548629+0000","last_became_peered":"2023-10-06T04:37:17.548629+0000","last_unstale":"2023-10-06T04:37:27.004522+0000","last_undegraded":"2023-10-06T04:37:27.004522+0000","last_fullsized":"2023-10-06T04:37:27.004522+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:04.973984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"38'9","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009297+0000","last_change":"2023-10-06T04:37:17.547124+0000","last_active":"2023-10-06T04:37:27.009297+0000","last_peered":"2023-10-06T04:37:27.009297+0000","last_clean":"2023-10-06T04:37:27.009297+0000","last_became_active":"2023-10-06T04:37:17.546879+0000","last_became_peered":"2023-10-06T04:37:17.546879+0000","last_unstale":"2023-10-06T04:37:27.009297+0000","last_undegraded":"2023-10-06T04:37:27.009297+0000","last_fullsized":"2023-10-06T04:37:27.009297+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:45.225371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"38'11","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009694+0000","last_change":"2023-10-06T04:37:17.537910+0000","last_active":"2023-10-06T04:37:27.009694+0000","last_peered":"2023-10-06T04:37:27.009694+0000","last_clean":"2023-10-06T04:37:27.009694+0000","last_became_active":"2023-10-06T04:37:17.535864+0000","last_became_peered":"2023-10-06T04:37:17.535864+0000","last_unstale":"2023-10-06T04:37:27.009694+0000","last_undegraded":"2023-10-06T04:37:27.009694+0000","last_fullsized":"2023-10-06T04:37:27.009694+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:58.928454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"38'15","reported_seq":28,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010318+0000","last_change":"2023-10-06T04:37:17.548489+0000","last_active":"2023-10-06T04:37:27.010318+0000","last_peered":"2023-10-06T04:37:27.010318+0000","last_clean":"2023-10-06T04:37:27.010318+0000","last_became_active":"2023-10-06T04:37:17.547714+0000","last_became_peered":"2023-10-06T04:37:17.547714+0000","last_unstale":"2023-10-06T04:37:27.010318+0000","last_undegraded":"2023-10-06T04:37:27.010318+0000","last_fullsized":"2023-10-06T04:37:27.010318+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:56.687459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"38'6","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009488+0000","last_change":"2023-10-06T04:37:17.544501+0000","last_active":"2023-10-06T04:37:27.009488+0000","last_peered":"2023-10-06T04:37:27.009488+0000","last_clean":"2023-10-06T04:37:27.009488+0000","last_became_active":"2023-10-06T04:37:17.541822+0000","last_became_peered":"2023-10-06T04:37:17.541822+0000","last_unstale":"2023-10-06T04:37:27.009488+0000","last_undegraded":"2023-10-06T04:37:27.009488+0000","last_fullsized":"2023-10-06T04:37:27.009488+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:32:45.542874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"38'7","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009885+0000","last_change":"2023-10-06T04:37:17.545538+0000","last_active":"2023-10-06T04:37:27.009885+0000","last_peered":"2023-10-06T04:37:27.009885+0000","last_clean":"2023-10-06T04:37:27.009885+0000","last_became_active":"2023-10-06T04:37:17.545027+0000","last_became_peered":"2023-10-06T04:37:17.545027+0000","last_unstale":"2023-10-06T04:37:27.009885+0000","last_undegraded":"2023-10-06T04:37:27.009885+0000","last_fullsized":"2023-10-06T04:37:27.009885+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:23.847066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"38'10","reported_seq":23,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:37:28.775107+0000","last_change":"2023-10-06T04:37:17.541986+0000","last_active":"2023-10-06T04:37:28.775107+0000","last_peered":"2023-10-06T04:37:28.775107+0000","last_clean":"2023-10-06T04:37:28.775107+0000","last_became_active":"2023-10-06T04:37:17.541707+0000","last_became_peered":"2023-10-06T04:37:17.541707+0000","last_unstale":"2023-10-06T04:37:28.775107+0000","last_undegraded":"2023-10-06T04:37:28.775107+0000","last_fullsized":"2023-10-06T04:37:28.775107+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:25.707658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"38'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009443+0000","last_change":"2023-10-06T04:37:17.536298+0000","last_active":"2023-10-06T04:37:27.009443+0000","last_peered":"2023-10-06T04:37:27.009443+0000","last_clean":"2023-10-06T04:37:27.009443+0000","last_became_active":"2023-10-06T04:37:17.535937+0000","last_became_peered":"2023-10-06T04:37:17.535937+0000","last_unstale":"2023-10-06T04:37:27.009443+0000","last_undegraded":"2023-10-06T04:37:27.009443+0000","last_fullsized":"2023-10-06T04:37:27.009443+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:01.324339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"38'7","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010623+0000","last_change":"2023-10-06T04:37:17.538786+0000","last_active":"2023-10-06T04:37:27.010623+0000","last_peered":"2023-10-06T04:37:27.010623+0000","last_clean":"2023-10-06T04:37:27.010623+0000","last_became_active":"2023-10-06T04:37:17.538493+0000","last_became_peered":"2023-10-06T04:37:17.538493+0000","last_unstale":"2023-10-06T04:37:27.010623+0000","last_undegraded":"2023-10-06T04:37:27.010623+0000","last_fullsized":"2023-10-06T04:37:27.010623+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:09.823506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"38'9","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009207+0000","last_change":"2023-10-06T04:37:17.552277+0000","last_active":"2023-10-06T04:37:27.009207+0000","last_peered":"2023-10-06T04:37:27.009207+0000","last_clean":"2023-10-06T04:37:27.009207+0000","last_became_active":"2023-10-06T04:37:17.552001+0000","last_became_peered":"2023-10-06T04:37:17.552001+0000","last_unstale":"2023-10-06T04:37:27.009207+0000","last_undegraded":"2023-10-06T04:37:27.009207+0000","last_fullsized":"2023-10-06T04:37:27.009207+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:41.211245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"38'9","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779847+0000","last_change":"2023-10-06T04:37:17.547373+0000","last_active":"2023-10-06T04:37:26.779847+0000","last_peered":"2023-10-06T04:37:26.779847+0000","last_clean":"2023-10-06T04:37:26.779847+0000","last_became_active":"2023-10-06T04:37:17.547103+0000","last_became_peered":"2023-10-06T04:37:17.547103+0000","last_unstale":"2023-10-06T04:37:26.779847+0000","last_undegraded":"2023-10-06T04:37:26.779847+0000","last_fullsized":"2023-10-06T04:37:26.779847+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:09.823506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"38'10","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779780+0000","last_change":"2023-10-06T04:37:17.554683+0000","last_active":"2023-10-06T04:37:26.779780+0000","last_peered":"2023-10-06T04:37:26.779780+0000","last_clean":"2023-10-06T04:37:26.779780+0000","last_became_active":"2023-10-06T04:37:17.554412+0000","last_became_peered":"2023-10-06T04:37:17.554412+0000","last_unstale":"2023-10-06T04:37:26.779780+0000","last_undegraded":"2023-10-06T04:37:26.779780+0000","last_fullsized":"2023-10-06T04:37:26.779780+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:56.687459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"38'7","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009419+0000","last_change":"2023-10-06T04:37:17.551197+0000","last_active":"2023-10-06T04:37:27.009419+0000","last_peered":"2023-10-06T04:37:27.009419+0000","last_clean":"2023-10-06T04:37:27.009419+0000","last_became_active":"2023-10-06T04:37:17.550633+0000","last_became_peered":"2023-10-06T04:37:17.550633+0000","last_unstale":"2023-10-06T04:37:27.009419+0000","last_undegraded":"2023-10-06T04:37:27.009419+0000","last_fullsized":"2023-10-06T04:37:27.009419+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:25.707658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"38'8","reported_seq":21,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:37:28.775146+0000","last_change":"2023-10-06T04:37:17.541139+0000","last_active":"2023-10-06T04:37:28.775146+0000","last_peered":"2023-10-06T04:37:28.775146+0000","last_clean":"2023-10-06T04:37:28.775146+0000","last_became_active":"2023-10-06T04:37:17.540844+0000","last_became_peered":"2023-10-06T04:37:17.540844+0000","last_unstale":"2023-10-06T04:37:28.775146+0000","last_undegraded":"2023-10-06T04:37:28.775146+0000","last_fullsized":"2023-10-06T04:37:28.775146+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:40.800271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"38'11","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.011635+0000","last_change":"2023-10-06T04:37:17.546023+0000","last_active":"2023-10-06T04:37:27.011635+0000","last_peered":"2023-10-06T04:37:27.011635+0000","last_clean":"2023-10-06T04:37:27.011635+0000","last_became_active":"2023-10-06T04:37:17.545428+0000","last_became_peered":"2023-10-06T04:37:17.545428+0000","last_unstale":"2023-10-06T04:37:27.011635+0000","last_undegraded":"2023-10-06T04:37:27.011635+0000","last_fullsized":"2023-10-06T04:37:27.011635+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:52.574192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"38'9","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009573+0000","last_change":"2023-10-06T04:37:17.546918+0000","last_active":"2023-10-06T04:37:27.009573+0000","last_peered":"2023-10-06T04:37:27.009573+0000","last_clean":"2023-10-06T04:37:27.009573+0000","last_became_active":"2023-10-06T04:37:17.546562+0000","last_became_peered":"2023-10-06T04:37:17.546562+0000","last_unstale":"2023-10-06T04:37:27.009573+0000","last_undegraded":"2023-10-06T04:37:27.009573+0000","last_fullsized":"2023-10-06T04:37:27.009573+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:18.119835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"38'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009254+0000","last_change":"2023-10-06T04:37:17.549490+0000","last_active":"2023-10-06T04:37:27.009254+0000","last_peered":"2023-10-06T04:37:27.009254+0000","last_clean":"2023-10-06T04:37:27.009254+0000","last_became_active":"2023-10-06T04:37:17.549294+0000","last_became_peered":"2023-10-06T04:37:17.549294+0000","last_unstale":"2023-10-06T04:37:27.009254+0000","last_undegraded":"2023-10-06T04:37:27.009254+0000","last_fullsized":"2023-10-06T04:37:27.009254+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:50.973957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"38'6","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009221+0000","last_change":"2023-10-06T04:37:17.548512+0000","last_active":"2023-10-06T04:37:27.009221+0000","last_peered":"2023-10-06T04:37:27.009221+0000","last_clean":"2023-10-06T04:37:27.009221+0000","last_became_active":"2023-10-06T04:37:17.547910+0000","last_became_peered":"2023-10-06T04:37:17.547910+0000","last_unstale":"2023-10-06T04:37:27.009221+0000","last_undegraded":"2023-10-06T04:37:27.009221+0000","last_fullsized":"2023-10-06T04:37:27.009221+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:15:49.332577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"38'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010270+0000","last_change":"2023-10-06T04:37:17.551312+0000","last_active":"2023-10-06T04:37:27.010270+0000","last_peered":"2023-10-06T04:37:27.010270+0000","last_clean":"2023-10-06T04:37:27.010270+0000","last_became_active":"2023-10-06T04:37:17.550973+0000","last_became_peered":"2023-10-06T04:37:17.550973+0000","last_unstale":"2023-10-06T04:37:27.010270+0000","last_undegraded":"2023-10-06T04:37:27.010270+0000","last_fullsized":"2023-10-06T04:37:27.010270+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:40.800271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"38'15","reported_seq":28,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:37:28.775234+0000","last_change":"2023-10-06T04:37:17.542441+0000","last_active":"2023-10-06T04:37:28.775234+0000","last_peered":"2023-10-06T04:37:28.775234+0000","last_clean":"2023-10-06T04:37:28.775234+0000","last_became_active":"2023-10-06T04:37:17.542184+0000","last_became_peered":"2023-10-06T04:37:17.542184+0000","last_unstale":"2023-10-06T04:37:28.775234+0000","last_undegraded":"2023-10-06T04:37:28.775234+0000","last_fullsized":"2023-10-06T04:37:28.775234+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:57.066657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"38'6","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779729+0000","last_change":"2023-10-06T04:37:17.546567+0000","last_active":"2023-10-06T04:37:26.779729+0000","last_peered":"2023-10-06T04:37:26.779729+0000","last_clean":"2023-10-06T04:37:26.779729+0000","last_became_active":"2023-10-06T04:37:17.546294+0000","last_became_peered":"2023-10-06T04:37:17.546294+0000","last_unstale":"2023-10-06T04:37:26.779729+0000","last_undegraded":"2023-10-06T04:37:26.779729+0000","last_fullsized":"2023-10-06T04:37:26.779729+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:19.011564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"38'4","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009688+0000","last_change":"2023-10-06T04:37:17.545684+0000","last_active":"2023-10-06T04:37:27.009688+0000","last_peered":"2023-10-06T04:37:27.009688+0000","last_clean":"2023-10-06T04:37:27.009688+0000","last_became_active":"2023-10-06T04:37:17.545341+0000","last_became_peered":"2023-10-06T04:37:17.545341+0000","last_unstale":"2023-10-06T04:37:27.009688+0000","last_undegraded":"2023-10-06T04:37:27.009688+0000","last_fullsized":"2023-10-06T04:37:27.009688+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:04.973984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"38'7","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009408+0000","last_change":"2023-10-06T04:37:17.551198+0000","last_active":"2023-10-06T04:37:27.009408+0000","last_peered":"2023-10-06T04:37:27.009408+0000","last_clean":"2023-10-06T04:37:27.009408+0000","last_became_active":"2023-10-06T04:37:17.550871+0000","last_became_peered":"2023-10-06T04:37:17.550871+0000","last_unstale":"2023-10-06T04:37:27.009408+0000","last_undegraded":"2023-10-06T04:37:27.009408+0000","last_fullsized":"2023-10-06T04:37:27.009408+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:43.463619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"38'8","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779635+0000","last_change":"2023-10-06T04:37:17.544638+0000","last_active":"2023-10-06T04:37:26.779635+0000","last_peered":"2023-10-06T04:37:26.779635+0000","last_clean":"2023-10-06T04:37:26.779635+0000","last_became_active":"2023-10-06T04:37:17.544358+0000","last_became_peered":"2023-10-06T04:37:17.544358+0000","last_unstale":"2023-10-06T04:37:26.779635+0000","last_undegraded":"2023-10-06T04:37:26.779635+0000","last_fullsized":"2023-10-06T04:37:26.779635+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:16.140442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"38'12","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010754+0000","last_change":"2023-10-06T04:37:17.547875+0000","last_active":"2023-10-06T04:37:27.010754+0000","last_peered":"2023-10-06T04:37:27.010754+0000","last_clean":"2023-10-06T04:37:27.010754+0000","last_became_active":"2023-10-06T04:37:17.547504+0000","last_became_peered":"2023-10-06T04:37:17.547504+0000","last_unstale":"2023-10-06T04:37:27.010754+0000","last_undegraded":"2023-10-06T04:37:27.010754+0000","last_fullsized":"2023-10-06T04:37:27.010754+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:37.661915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"38'9","reported_seq":22,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:37:28.775022+0000","last_change":"2023-10-06T04:37:17.535486+0000","last_active":"2023-10-06T04:37:28.775022+0000","last_peered":"2023-10-06T04:37:28.775022+0000","last_clean":"2023-10-06T04:37:28.775022+0000","last_became_active":"2023-10-06T04:37:17.535215+0000","last_became_peered":"2023-10-06T04:37:17.535215+0000","last_unstale":"2023-10-06T04:37:28.775022+0000","last_undegraded":"2023-10-06T04:37:28.775022+0000","last_fullsized":"2023-10-06T04:37:28.775022+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:01.221591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781623+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:49.912213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"38'5","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009428+0000","last_change":"2023-10-06T04:37:17.540682+0000","last_active":"2023-10-06T04:37:27.009428+0000","last_peered":"2023-10-06T04:37:27.009428+0000","last_clean":"2023-10-06T04:37:27.009428+0000","last_became_active":"2023-10-06T04:37:17.540340+0000","last_became_peered":"2023-10-06T04:37:17.540340+0000","last_unstale":"2023-10-06T04:37:27.009428+0000","last_undegraded":"2023-10-06T04:37:27.009428+0000","last_fullsized":"2023-10-06T04:37:27.009428+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:57.066657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"39'8","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.012800+0000","last_change":"2023-10-06T04:37:16.539316+0000","last_active":"2023-10-06T04:37:27.012800+0000","last_peered":"2023-10-06T04:37:27.012800+0000","last_clean":"2023-10-06T04:37:27.012800+0000","last_became_active":"2023-10-06T04:37:16.538848+0000","last_became_peered":"2023-10-06T04:37:16.538848+0000","last_unstale":"2023-10-06T04:37:27.012800+0000","last_undegraded":"2023-10-06T04:37:27.012800+0000","last_fullsized":"2023-10-06T04:37:27.012800+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:44:55.156828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.780190+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:29:04.074820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"38'6","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010134+0000","last_change":"2023-10-06T04:37:17.549963+0000","last_active":"2023-10-06T04:37:27.010134+0000","last_peered":"2023-10-06T04:37:27.010134+0000","last_clean":"2023-10-06T04:37:27.010134+0000","last_became_active":"2023-10-06T04:37:17.545289+0000","last_became_peered":"2023-10-06T04:37:17.545289+0000","last_unstale":"2023-10-06T04:37:27.010134+0000","last_undegraded":"2023-10-06T04:37:27.010134+0000","last_fullsized":"2023-10-06T04:37:27.010134+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:01.221591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"37'1","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779943+0000","last_change":"2023-10-06T04:37:16.539806+0000","last_active":"2023-10-06T04:37:26.779943+0000","last_peered":"2023-10-06T04:37:26.779943+0000","last_clean":"2023-10-06T04:37:26.779943+0000","last_became_active":"2023-10-06T04:37:16.539514+0000","last_became_peered":"2023-10-06T04:37:16.539514+0000","last_unstale":"2023-10-06T04:37:26.779943+0000","last_undegraded":"2023-10-06T04:37:26.779943+0000","last_fullsized":"2023-10-06T04:37:26.779943+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:48.710239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":2,"reported_epoch":45,"state":"creating+activating","last_fresh":"2023-10-06T04:37:29.782949+0000","last_change":"2023-10-06T04:37:29.783069+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:29.782949+0000","last_undegraded":"2023-10-06T04:37:29.782949+0000","last_fullsized":"2023-10-06T04:37:29.782949+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:59.689245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"38'9","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009806+0000","last_change":"2023-10-06T04:37:17.549931+0000","last_active":"2023-10-06T04:37:27.009806+0000","last_peered":"2023-10-06T04:37:27.009806+0000","last_clean":"2023-10-06T04:37:27.009806+0000","last_became_active":"2023-10-06T04:37:17.549668+0000","last_became_peered":"2023-10-06T04:37:17.549668+0000","last_unstale":"2023-10-06T04:37:27.009806+0000","last_undegraded":"2023-10-06T04:37:27.009806+0000","last_fullsized":"2023-10-06T04:37:27.009806+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:27.083777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"39'3","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010418+0000","last_change":"2023-10-06T04:37:16.546111+0000","last_active":"2023-10-06T04:37:27.010418+0000","last_peered":"2023-10-06T04:37:27.010418+0000","last_clean":"2023-10-06T04:37:27.010418+0000","last_became_active":"2023-10-06T04:37:16.545811+0000","last_became_peered":"2023-10-06T04:37:16.545811+0000","last_unstale":"2023-10-06T04:37:27.010418+0000","last_undegraded":"2023-10-06T04:37:27.010418+0000","last_fullsized":"2023-10-06T04:37:27.010418+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:30.574778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.776912+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:04:11.178752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"38'15","reported_seq":28,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010260+0000","last_change":"2023-10-06T04:37:17.546138+0000","last_active":"2023-10-06T04:37:27.010260+0000","last_peered":"2023-10-06T04:37:27.010260+0000","last_clean":"2023-10-06T04:37:27.010260+0000","last_became_active":"2023-10-06T04:37:17.545845+0000","last_became_peered":"2023-10-06T04:37:17.545845+0000","last_unstale":"2023-10-06T04:37:27.010260+0000","last_undegraded":"2023-10-06T04:37:27.010260+0000","last_fullsized":"2023-10-06T04:37:27.010260+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:25.707658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"39'3","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.004858+0000","last_change":"2023-10-06T04:37:16.545947+0000","last_active":"2023-10-06T04:37:27.004858+0000","last_peered":"2023-10-06T04:37:27.004858+0000","last_clean":"2023-10-06T04:37:27.004858+0000","last_became_active":"2023-10-06T04:37:16.545700+0000","last_became_peered":"2023-10-06T04:37:16.545700+0000","last_unstale":"2023-10-06T04:37:27.004858+0000","last_undegraded":"2023-10-06T04:37:27.004858+0000","last_fullsized":"2023-10-06T04:37:27.004858+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:56.062450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.780593+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:57.475670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"38'7","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779634+0000","last_change":"2023-10-06T04:37:17.543400+0000","last_active":"2023-10-06T04:37:26.779634+0000","last_peered":"2023-10-06T04:37:26.779634+0000","last_clean":"2023-10-06T04:37:26.779634+0000","last_became_active":"2023-10-06T04:37:17.543132+0000","last_became_peered":"2023-10-06T04:37:17.543132+0000","last_unstale":"2023-10-06T04:37:26.779634+0000","last_undegraded":"2023-10-06T04:37:26.779634+0000","last_fullsized":"2023-10-06T04:37:26.779634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:50:28.268338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"37'1","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.011758+0000","last_change":"2023-10-06T04:37:16.541989+0000","last_active":"2023-10-06T04:37:27.011758+0000","last_peered":"2023-10-06T04:37:27.011758+0000","last_clean":"2023-10-06T04:37:27.011758+0000","last_became_active":"2023-10-06T04:37:16.541684+0000","last_became_peered":"2023-10-06T04:37:16.541684+0000","last_unstale":"2023-10-06T04:37:27.011758+0000","last_undegraded":"2023-10-06T04:37:27.011758+0000","last_fullsized":"2023-10-06T04:37:27.011758+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:13.019515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.779525+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:44:04.529543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"38'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009900+0000","last_change":"2023-10-06T04:37:17.546677+0000","last_active":"2023-10-06T04:37:27.009900+0000","last_peered":"2023-10-06T04:37:27.009900+0000","last_clean":"2023-10-06T04:37:27.009900+0000","last_became_active":"2023-10-06T04:37:17.546151+0000","last_became_peered":"2023-10-06T04:37:17.546151+0000","last_unstale":"2023-10-06T04:37:27.009900+0000","last_undegraded":"2023-10-06T04:37:27.009900+0000","last_fullsized":"2023-10-06T04:37:27.009900+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:16.140442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"37'1","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779812+0000","last_change":"2023-10-06T04:37:16.545939+0000","last_active":"2023-10-06T04:37:26.779812+0000","last_peered":"2023-10-06T04:37:26.779812+0000","last_clean":"2023-10-06T04:37:26.779812+0000","last_became_active":"2023-10-06T04:37:16.545722+0000","last_became_peered":"2023-10-06T04:37:16.545722+0000","last_unstale":"2023-10-06T04:37:26.779812+0000","last_undegraded":"2023-10-06T04:37:26.779812+0000","last_fullsized":"2023-10-06T04:37:26.779812+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:22.842860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781194+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:04.824490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"38'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009417+0000","last_change":"2023-10-06T04:37:17.547055+0000","last_active":"2023-10-06T04:37:27.009417+0000","last_peered":"2023-10-06T04:37:27.009417+0000","last_clean":"2023-10-06T04:37:27.009417+0000","last_became_active":"2023-10-06T04:37:17.546777+0000","last_became_peered":"2023-10-06T04:37:17.546777+0000","last_unstale":"2023-10-06T04:37:27.009417+0000","last_undegraded":"2023-10-06T04:37:27.009417+0000","last_fullsized":"2023-10-06T04:37:27.009417+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:28:51.824521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009578+0000","last_change":"2023-10-06T04:37:16.544251+0000","last_active":"2023-10-06T04:37:27.009578+0000","last_peered":"2023-10-06T04:37:27.009578+0000","last_clean":"2023-10-06T04:37:27.009578+0000","last_became_active":"2023-10-06T04:37:16.543853+0000","last_became_peered":"2023-10-06T04:37:16.543853+0000","last_unstale":"2023-10-06T04:37:27.009578+0000","last_undegraded":"2023-10-06T04:37:27.009578+0000","last_fullsized":"2023-10-06T04:37:27.009578+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:00.217384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":2,"reported_epoch":45,"state":"creating+activating","last_fresh":"2023-10-06T04:37:29.780968+0000","last_change":"2023-10-06T04:37:29.781107+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:29.780968+0000","last_undegraded":"2023-10-06T04:37:29.780968+0000","last_fullsized":"2023-10-06T04:37:29.780968+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:38:07.292570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"38'10","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009367+0000","last_change":"2023-10-06T04:37:17.550653+0000","last_active":"2023-10-06T04:37:27.009367+0000","last_peered":"2023-10-06T04:37:27.009367+0000","last_clean":"2023-10-06T04:37:27.009367+0000","last_became_active":"2023-10-06T04:37:17.550308+0000","last_became_peered":"2023-10-06T04:37:17.550308+0000","last_unstale":"2023-10-06T04:37:27.009367+0000","last_undegraded":"2023-10-06T04:37:27.009367+0000","last_fullsized":"2023-10-06T04:37:27.009367+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:06:24.079323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009535+0000","last_change":"2023-10-06T04:37:16.539539+0000","last_active":"2023-10-06T04:37:27.009535+0000","last_peered":"2023-10-06T04:37:27.009535+0000","last_clean":"2023-10-06T04:37:27.009535+0000","last_became_active":"2023-10-06T04:37:16.536276+0000","last_became_peered":"2023-10-06T04:37:16.536276+0000","last_unstale":"2023-10-06T04:37:27.009535+0000","last_undegraded":"2023-10-06T04:37:27.009535+0000","last_fullsized":"2023-10-06T04:37:27.009535+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:23.725665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781025+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:00:08.937757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"38'10","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779872+0000","last_change":"2023-10-06T04:37:17.547330+0000","last_active":"2023-10-06T04:37:26.779872+0000","last_peered":"2023-10-06T04:37:26.779872+0000","last_clean":"2023-10-06T04:37:26.779872+0000","last_became_active":"2023-10-06T04:37:17.547088+0000","last_became_peered":"2023-10-06T04:37:17.547088+0000","last_unstale":"2023-10-06T04:37:26.779872+0000","last_undegraded":"2023-10-06T04:37:26.779872+0000","last_fullsized":"2023-10-06T04:37:26.779872+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:12.970309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779917+0000","last_change":"2023-10-06T04:37:16.543071+0000","last_active":"2023-10-06T04:37:26.779917+0000","last_peered":"2023-10-06T04:37:26.779917+0000","last_clean":"2023-10-06T04:37:26.779917+0000","last_became_active":"2023-10-06T04:37:16.542755+0000","last_became_peered":"2023-10-06T04:37:16.542755+0000","last_unstale":"2023-10-06T04:37:26.779917+0000","last_undegraded":"2023-10-06T04:37:26.779917+0000","last_fullsized":"2023-10-06T04:37:26.779917+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:03.969778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.779740+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:05:06.685138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"38'9","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.004023+0000","last_change":"2023-10-06T04:37:17.546184+0000","last_active":"2023-10-06T04:37:27.004023+0000","last_peered":"2023-10-06T04:37:27.004023+0000","last_clean":"2023-10-06T04:37:27.004023+0000","last_became_active":"2023-10-06T04:37:17.545899+0000","last_became_peered":"2023-10-06T04:37:17.545899+0000","last_unstale":"2023-10-06T04:37:27.004023+0000","last_undegraded":"2023-10-06T04:37:27.004023+0000","last_fullsized":"2023-10-06T04:37:27.004023+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:35.648661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010409+0000","last_change":"2023-10-06T04:37:16.539739+0000","last_active":"2023-10-06T04:37:27.010409+0000","last_peered":"2023-10-06T04:37:27.010409+0000","last_clean":"2023-10-06T04:37:27.010409+0000","last_became_active":"2023-10-06T04:37:16.539470+0000","last_became_peered":"2023-10-06T04:37:16.539470+0000","last_unstale":"2023-10-06T04:37:27.010409+0000","last_undegraded":"2023-10-06T04:37:27.010409+0000","last_fullsized":"2023-10-06T04:37:27.010409+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:23.078870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.779529+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:01.912316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"38'11","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.012346+0000","last_change":"2023-10-06T04:37:17.543287+0000","last_active":"2023-10-06T04:37:27.012346+0000","last_peered":"2023-10-06T04:37:27.012346+0000","last_clean":"2023-10-06T04:37:27.012346+0000","last_became_active":"2023-10-06T04:37:17.543018+0000","last_became_peered":"2023-10-06T04:37:17.543018+0000","last_unstale":"2023-10-06T04:37:27.012346+0000","last_undegraded":"2023-10-06T04:37:27.012346+0000","last_fullsized":"2023-10-06T04:37:27.012346+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:18.119835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"39'5","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.005169+0000","last_change":"2023-10-06T04:37:16.545863+0000","last_active":"2023-10-06T04:37:27.005169+0000","last_peered":"2023-10-06T04:37:27.005169+0000","last_clean":"2023-10-06T04:37:27.005169+0000","last_became_active":"2023-10-06T04:37:16.545563+0000","last_became_peered":"2023-10-06T04:37:16.545563+0000","last_unstale":"2023-10-06T04:37:27.005169+0000","last_undegraded":"2023-10-06T04:37:27.005169+0000","last_fullsized":"2023-10-06T04:37:27.005169+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:36.947789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781442+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:05:06.685138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"38'6","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.005042+0000","last_change":"2023-10-06T04:37:17.541763+0000","last_active":"2023-10-06T04:37:27.005042+0000","last_peered":"2023-10-06T04:37:27.005042+0000","last_clean":"2023-10-06T04:37:27.005042+0000","last_became_active":"2023-10-06T04:37:17.541287+0000","last_became_peered":"2023-10-06T04:37:17.541287+0000","last_unstale":"2023-10-06T04:37:27.005042+0000","last_undegraded":"2023-10-06T04:37:27.005042+0000","last_fullsized":"2023-10-06T04:37:27.005042+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:34.429052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"39'23","reported_seq":37,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:37:28.775230+0000","last_change":"2023-10-06T04:37:16.538841+0000","last_active":"2023-10-06T04:37:28.775230+0000","last_peered":"2023-10-06T04:37:28.775230+0000","last_clean":"2023-10-06T04:37:28.775230+0000","last_became_active":"2023-10-06T04:37:16.538555+0000","last_became_peered":"2023-10-06T04:37:16.538555+0000","last_unstale":"2023-10-06T04:37:28.775230+0000","last_undegraded":"2023-10-06T04:37:28.775230+0000","last_fullsized":"2023-10-06T04:37:28.775230+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:01:56.504476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781750+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:51.489837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"38'10","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009545+0000","last_change":"2023-10-06T04:37:17.554238+0000","last_active":"2023-10-06T04:37:27.009545+0000","last_peered":"2023-10-06T04:37:27.009545+0000","last_clean":"2023-10-06T04:37:27.009545+0000","last_became_active":"2023-10-06T04:37:17.553995+0000","last_became_peered":"2023-10-06T04:37:17.553995+0000","last_unstale":"2023-10-06T04:37:27.009545+0000","last_undegraded":"2023-10-06T04:37:27.009545+0000","last_fullsized":"2023-10-06T04:37:27.009545+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:57.066657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"39'5","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.012000+0000","last_change":"2023-10-06T04:37:16.545424+0000","last_active":"2023-10-06T04:37:27.012000+0000","last_peered":"2023-10-06T04:37:27.012000+0000","last_clean":"2023-10-06T04:37:27.012000+0000","last_became_active":"2023-10-06T04:37:16.545158+0000","last_became_peered":"2023-10-06T04:37:16.545158+0000","last_unstale":"2023-10-06T04:37:27.012000+0000","last_undegraded":"2023-10-06T04:37:27.012000+0000","last_fullsized":"2023-10-06T04:37:27.012000+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:03.969778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781643+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:30.370133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"38'15","reported_seq":28,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009983+0000","last_change":"2023-10-06T04:37:17.543599+0000","last_active":"2023-10-06T04:37:27.009983+0000","last_peered":"2023-10-06T04:37:27.009983+0000","last_clean":"2023-10-06T04:37:27.009983+0000","last_became_active":"2023-10-06T04:37:17.543271+0000","last_became_peered":"2023-10-06T04:37:17.543271+0000","last_unstale":"2023-10-06T04:37:27.009983+0000","last_undegraded":"2023-10-06T04:37:27.009983+0000","last_fullsized":"2023-10-06T04:37:27.009983+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:37.661915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.004892+0000","last_change":"2023-10-06T04:37:16.541456+0000","last_active":"2023-10-06T04:37:27.004892+0000","last_peered":"2023-10-06T04:37:27.004892+0000","last_clean":"2023-10-06T04:37:27.004892+0000","last_became_active":"2023-10-06T04:37:16.541189+0000","last_became_peered":"2023-10-06T04:37:16.541189+0000","last_unstale":"2023-10-06T04:37:27.004892+0000","last_undegraded":"2023-10-06T04:37:27.004892+0000","last_fullsized":"2023-10-06T04:37:27.004892+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:23.078870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781759+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:07.671768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"38'6","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010461+0000","last_change":"2023-10-06T04:37:17.541658+0000","last_active":"2023-10-06T04:37:27.010461+0000","last_peered":"2023-10-06T04:37:27.010461+0000","last_clean":"2023-10-06T04:37:27.010461+0000","last_became_active":"2023-10-06T04:37:17.541349+0000","last_became_peered":"2023-10-06T04:37:17.541349+0000","last_unstale":"2023-10-06T04:37:27.010461+0000","last_undegraded":"2023-10-06T04:37:27.010461+0000","last_fullsized":"2023-10-06T04:37:27.010461+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:56.687459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010952+0000","last_change":"2023-10-06T04:37:16.545596+0000","last_active":"2023-10-06T04:37:27.010952+0000","last_peered":"2023-10-06T04:37:27.010952+0000","last_clean":"2023-10-06T04:37:27.010952+0000","last_became_active":"2023-10-06T04:37:16.545334+0000","last_became_peered":"2023-10-06T04:37:16.545334+0000","last_unstale":"2023-10-06T04:37:27.010952+0000","last_undegraded":"2023-10-06T04:37:27.010952+0000","last_fullsized":"2023-10-06T04:37:27.010952+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:26.079570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":2,"reported_epoch":45,"state":"creating+activating","last_fresh":"2023-10-06T04:37:29.781315+0000","last_change":"2023-10-06T04:37:29.781451+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:29.781315+0000","last_undegraded":"2023-10-06T04:37:29.781315+0000","last_fullsized":"2023-10-06T04:37:29.781315+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:19:45.702967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"38'6","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.004641+0000","last_change":"2023-10-06T04:37:17.552402+0000","last_active":"2023-10-06T04:37:27.004641+0000","last_peered":"2023-10-06T04:37:27.004641+0000","last_clean":"2023-10-06T04:37:27.004641+0000","last_became_active":"2023-10-06T04:37:17.552167+0000","last_became_peered":"2023-10-06T04:37:17.552167+0000","last_unstale":"2023-10-06T04:37:27.004641+0000","last_undegraded":"2023-10-06T04:37:27.004641+0000","last_fullsized":"2023-10-06T04:37:27.004641+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:14.023722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"39'15","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009650+0000","last_change":"2023-10-06T04:37:16.545180+0000","last_active":"2023-10-06T04:37:27.009650+0000","last_peered":"2023-10-06T04:37:27.009650+0000","last_clean":"2023-10-06T04:37:27.009650+0000","last_became_active":"2023-10-06T04:37:16.544707+0000","last_became_peered":"2023-10-06T04:37:16.544707+0000","last_unstale":"2023-10-06T04:37:27.009650+0000","last_undegraded":"2023-10-06T04:37:27.009650+0000","last_fullsized":"2023-10-06T04:37:27.009650+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:49.969750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.784527+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:03:50.233469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"38'5","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:37:28.775240+0000","last_change":"2023-10-06T04:37:17.545469+0000","last_active":"2023-10-06T04:37:28.775240+0000","last_peered":"2023-10-06T04:37:28.775240+0000","last_clean":"2023-10-06T04:37:28.775240+0000","last_became_active":"2023-10-06T04:37:17.545212+0000","last_became_peered":"2023-10-06T04:37:17.545212+0000","last_unstale":"2023-10-06T04:37:28.775240+0000","last_undegraded":"2023-10-06T04:37:28.775240+0000","last_fullsized":"2023-10-06T04:37:28.775240+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:41.211245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"39'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:37:28.775128+0000","last_change":"2023-10-06T04:37:16.537956+0000","last_active":"2023-10-06T04:37:28.775128+0000","last_peered":"2023-10-06T04:37:28.775128+0000","last_clean":"2023-10-06T04:37:28.775128+0000","last_became_active":"2023-10-06T04:37:16.537733+0000","last_became_peered":"2023-10-06T04:37:16.537733+0000","last_unstale":"2023-10-06T04:37:28.775128+0000","last_undegraded":"2023-10-06T04:37:28.775128+0000","last_fullsized":"2023-10-06T04:37:28.775128+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:26:53.482793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":2,"reported_epoch":45,"state":"creating+activating","last_fresh":"2023-10-06T04:37:29.781336+0000","last_change":"2023-10-06T04:37:29.781477+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:29.781336+0000","last_undegraded":"2023-10-06T04:37:29.781336+0000","last_fullsized":"2023-10-06T04:37:29.781336+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:20.831560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":["3","5"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"38'9","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009765+0000","last_change":"2023-10-06T04:37:17.540242+0000","last_active":"2023-10-06T04:37:27.009765+0000","last_peered":"2023-10-06T04:37:27.009765+0000","last_clean":"2023-10-06T04:37:27.009765+0000","last_became_active":"2023-10-06T04:37:17.539986+0000","last_became_peered":"2023-10-06T04:37:17.539986+0000","last_unstale":"2023-10-06T04:37:27.009765+0000","last_undegraded":"2023-10-06T04:37:27.009765+0000","last_fullsized":"2023-10-06T04:37:27.009765+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:50:28.268338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"39'3","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779857+0000","last_change":"2023-10-06T04:37:16.541934+0000","last_active":"2023-10-06T04:37:26.779857+0000","last_peered":"2023-10-06T04:37:26.779857+0000","last_clean":"2023-10-06T04:37:26.779857+0000","last_became_active":"2023-10-06T04:37:16.539725+0000","last_became_peered":"2023-10-06T04:37:16.539725+0000","last_unstale":"2023-10-06T04:37:26.779857+0000","last_undegraded":"2023-10-06T04:37:26.779857+0000","last_fullsized":"2023-10-06T04:37:26.779857+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:44:55.156828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.783668+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:58.515292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"38'6","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010154+0000","last_change":"2023-10-06T04:37:17.550239+0000","last_active":"2023-10-06T04:37:27.010154+0000","last_peered":"2023-10-06T04:37:27.010154+0000","last_clean":"2023-10-06T04:37:27.010154+0000","last_became_active":"2023-10-06T04:37:17.549997+0000","last_became_peered":"2023-10-06T04:37:17.549997+0000","last_unstale":"2023-10-06T04:37:27.010154+0000","last_undegraded":"2023-10-06T04:37:27.010154+0000","last_fullsized":"2023-10-06T04:37:27.010154+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:24.083076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"39'2","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009726+0000","last_change":"2023-10-06T04:37:16.544014+0000","last_active":"2023-10-06T04:37:27.009726+0000","last_peered":"2023-10-06T04:37:27.009726+0000","last_clean":"2023-10-06T04:37:27.009726+0000","last_became_active":"2023-10-06T04:37:16.543718+0000","last_became_peered":"2023-10-06T04:37:16.543718+0000","last_unstale":"2023-10-06T04:37:27.009726+0000","last_undegraded":"2023-10-06T04:37:27.009726+0000","last_fullsized":"2023-10-06T04:37:27.009726+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:39.796065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.779491+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:10:36.939764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"38'7","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009967+0000","last_change":"2023-10-06T04:37:17.551493+0000","last_active":"2023-10-06T04:37:27.009967+0000","last_peered":"2023-10-06T04:37:27.009967+0000","last_clean":"2023-10-06T04:37:27.009967+0000","last_became_active":"2023-10-06T04:37:17.550988+0000","last_became_peered":"2023-10-06T04:37:17.550988+0000","last_unstale":"2023-10-06T04:37:27.009967+0000","last_undegraded":"2023-10-06T04:37:27.009967+0000","last_fullsized":"2023-10-06T04:37:27.009967+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:33.731628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.012579+0000","last_change":"2023-10-06T04:37:16.537845+0000","last_active":"2023-10-06T04:37:27.012579+0000","last_peered":"2023-10-06T04:37:27.012579+0000","last_clean":"2023-10-06T04:37:27.012579+0000","last_became_active":"2023-10-06T04:37:16.537568+0000","last_became_peered":"2023-10-06T04:37:16.537568+0000","last_unstale":"2023-10-06T04:37:27.012579+0000","last_undegraded":"2023-10-06T04:37:27.012579+0000","last_fullsized":"2023-10-06T04:37:27.012579+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:43.624572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.776912+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:32:57.793172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"38'5","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.011164+0000","last_change":"2023-10-06T04:37:17.538502+0000","last_active":"2023-10-06T04:37:27.011164+0000","last_peered":"2023-10-06T04:37:27.011164+0000","last_clean":"2023-10-06T04:37:27.011164+0000","last_became_active":"2023-10-06T04:37:17.538215+0000","last_became_peered":"2023-10-06T04:37:17.538215+0000","last_unstale":"2023-10-06T04:37:27.011164+0000","last_undegraded":"2023-10-06T04:37:27.011164+0000","last_fullsized":"2023-10-06T04:37:27.011164+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:45.225371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"39'4","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.012118+0000","last_change":"2023-10-06T04:37:16.540351+0000","last_active":"2023-10-06T04:37:27.012118+0000","last_peered":"2023-10-06T04:37:27.012118+0000","last_clean":"2023-10-06T04:37:27.012118+0000","last_became_active":"2023-10-06T04:37:16.539257+0000","last_became_peered":"2023-10-06T04:37:16.539257+0000","last_unstale":"2023-10-06T04:37:27.012118+0000","last_undegraded":"2023-10-06T04:37:27.012118+0000","last_fullsized":"2023-10-06T04:37:27.012118+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:33.424846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781178+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:31.261862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"38'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009845+0000","last_change":"2023-10-06T04:37:17.546443+0000","last_active":"2023-10-06T04:37:27.009845+0000","last_peered":"2023-10-06T04:37:27.009845+0000","last_clean":"2023-10-06T04:37:27.009845+0000","last_became_active":"2023-10-06T04:37:17.546233+0000","last_became_peered":"2023-10-06T04:37:17.546233+0000","last_unstale":"2023-10-06T04:37:27.009845+0000","last_undegraded":"2023-10-06T04:37:27.009845+0000","last_fullsized":"2023-10-06T04:37:27.009845+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:41.211245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009787+0000","last_change":"2023-10-06T04:37:16.545188+0000","last_active":"2023-10-06T04:37:27.009787+0000","last_peered":"2023-10-06T04:37:27.009787+0000","last_clean":"2023-10-06T04:37:27.009787+0000","last_became_active":"2023-10-06T04:37:16.544735+0000","last_became_peered":"2023-10-06T04:37:16.544735+0000","last_unstale":"2023-10-06T04:37:27.009787+0000","last_undegraded":"2023-10-06T04:37:27.009787+0000","last_fullsized":"2023-10-06T04:37:27.009787+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:56.062450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.784055+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:49.503329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"38'9","reported_seq":22,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:37:28.775026+0000","last_change":"2023-10-06T04:37:17.544085+0000","last_active":"2023-10-06T04:37:28.775026+0000","last_peered":"2023-10-06T04:37:28.775026+0000","last_clean":"2023-10-06T04:37:28.775026+0000","last_became_active":"2023-10-06T04:37:17.543802+0000","last_became_peered":"2023-10-06T04:37:17.543802+0000","last_unstale":"2023-10-06T04:37:28.775026+0000","last_undegraded":"2023-10-06T04:37:28.775026+0000","last_fullsized":"2023-10-06T04:37:28.775026+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:31.578985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010008+0000","last_change":"2023-10-06T04:37:16.539674+0000","last_active":"2023-10-06T04:37:27.010008+0000","last_peered":"2023-10-06T04:37:27.010008+0000","last_clean":"2023-10-06T04:37:27.010008+0000","last_became_active":"2023-10-06T04:37:16.539399+0000","last_became_peered":"2023-10-06T04:37:16.539399+0000","last_unstale":"2023-10-06T04:37:27.010008+0000","last_undegraded":"2023-10-06T04:37:27.010008+0000","last_fullsized":"2023-10-06T04:37:27.010008+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:36.947789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.782348+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:14:52.399101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"38'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010119+0000","last_change":"2023-10-06T04:37:17.536857+0000","last_active":"2023-10-06T04:37:27.010119+0000","last_peered":"2023-10-06T04:37:27.010119+0000","last_clean":"2023-10-06T04:37:27.010119+0000","last_became_active":"2023-10-06T04:37:17.536593+0000","last_became_peered":"2023-10-06T04:37:17.536593+0000","last_unstale":"2023-10-06T04:37:27.010119+0000","last_undegraded":"2023-10-06T04:37:27.010119+0000","last_fullsized":"2023-10-06T04:37:27.010119+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:37.253030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.004474+0000","last_change":"2023-10-06T04:37:16.541430+0000","last_active":"2023-10-06T04:37:27.004474+0000","last_peered":"2023-10-06T04:37:27.004474+0000","last_clean":"2023-10-06T04:37:27.004474+0000","last_became_active":"2023-10-06T04:37:16.541211+0000","last_became_peered":"2023-10-06T04:37:16.541211+0000","last_unstale":"2023-10-06T04:37:27.004474+0000","last_undegraded":"2023-10-06T04:37:27.004474+0000","last_fullsized":"2023-10-06T04:37:27.004474+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:15:48.328371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781549+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:23.375847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"38'7","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.011879+0000","last_change":"2023-10-06T04:37:17.541674+0000","last_active":"2023-10-06T04:37:27.011879+0000","last_peered":"2023-10-06T04:37:27.011879+0000","last_clean":"2023-10-06T04:37:27.011879+0000","last_became_active":"2023-10-06T04:37:17.541397+0000","last_became_peered":"2023-10-06T04:37:17.541397+0000","last_unstale":"2023-10-06T04:37:27.011879+0000","last_undegraded":"2023-10-06T04:37:27.011879+0000","last_fullsized":"2023-10-06T04:37:27.011879+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:19.011564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779727+0000","last_change":"2023-10-06T04:37:16.539297+0000","last_active":"2023-10-06T04:37:26.779727+0000","last_peered":"2023-10-06T04:37:26.779727+0000","last_clean":"2023-10-06T04:37:26.779727+0000","last_became_active":"2023-10-06T04:37:16.538921+0000","last_became_peered":"2023-10-06T04:37:16.538921+0000","last_unstale":"2023-10-06T04:37:26.779727+0000","last_undegraded":"2023-10-06T04:37:26.779727+0000","last_fullsized":"2023-10-06T04:37:26.779727+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:26.079570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":35,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779801+0000","last_change":"2023-10-06T04:36:11.192215+0000","last_active":"2023-10-06T04:37:26.779801+0000","last_peered":"2023-10-06T04:37:26.779801+0000","last_clean":"2023-10-06T04:37:26.779801+0000","last_became_active":"2023-10-06T04:36:11.191953+0000","last_became_peered":"2023-10-06T04:36:11.191953+0000","last_unstale":"2023-10-06T04:37:26.779801+0000","last_undegraded":"2023-10-06T04:37:26.779801+0000","last_fullsized":"2023-10-06T04:37:26.779801+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:37.026121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.783158+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:29:04.074820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"38'8","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.011406+0000","last_change":"2023-10-06T04:37:17.536572+0000","last_active":"2023-10-06T04:37:27.011406+0000","last_peered":"2023-10-06T04:37:27.011406+0000","last_clean":"2023-10-06T04:37:27.011406+0000","last_became_active":"2023-10-06T04:37:17.536250+0000","last_became_peered":"2023-10-06T04:37:17.536250+0000","last_unstale":"2023-10-06T04:37:27.011406+0000","last_undegraded":"2023-10-06T04:37:27.011406+0000","last_fullsized":"2023-10-06T04:37:27.011406+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:16.140442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.005195+0000","last_change":"2023-10-06T04:37:16.542301+0000","last_active":"2023-10-06T04:37:27.005195+0000","last_peered":"2023-10-06T04:37:27.005195+0000","last_clean":"2023-10-06T04:37:27.005195+0000","last_became_active":"2023-10-06T04:37:16.541967+0000","last_became_peered":"2023-10-06T04:37:16.541967+0000","last_unstale":"2023-10-06T04:37:27.005195+0000","last_undegraded":"2023-10-06T04:37:27.005195+0000","last_fullsized":"2023-10-06T04:37:27.005195+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:24.703451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":32,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.012571+0000","last_change":"2023-10-06T04:36:11.184555+0000","last_active":"2023-10-06T04:37:27.012571+0000","last_peered":"2023-10-06T04:37:27.012571+0000","last_clean":"2023-10-06T04:37:27.012571+0000","last_became_active":"2023-10-06T04:36:11.184229+0000","last_became_peered":"2023-10-06T04:36:11.184229+0000","last_unstale":"2023-10-06T04:37:27.012571+0000","last_undegraded":"2023-10-06T04:37:27.012571+0000","last_fullsized":"2023-10-06T04:37:27.012571+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:19.938716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.785119+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:47:25.866319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"38'5","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.005105+0000","last_change":"2023-10-06T04:37:17.548551+0000","last_active":"2023-10-06T04:37:27.005105+0000","last_peered":"2023-10-06T04:37:27.005105+0000","last_clean":"2023-10-06T04:37:27.005105+0000","last_became_active":"2023-10-06T04:37:17.548252+0000","last_became_peered":"2023-10-06T04:37:17.548252+0000","last_unstale":"2023-10-06T04:37:27.005105+0000","last_undegraded":"2023-10-06T04:37:27.005105+0000","last_fullsized":"2023-10-06T04:37:27.005105+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:23.847066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010028+0000","last_change":"2023-10-06T04:37:16.546270+0000","last_active":"2023-10-06T04:37:27.010028+0000","last_peered":"2023-10-06T04:37:27.010028+0000","last_clean":"2023-10-06T04:37:27.010028+0000","last_became_active":"2023-10-06T04:37:16.545969+0000","last_became_peered":"2023-10-06T04:37:16.545969+0000","last_unstale":"2023-10-06T04:37:27.010028+0000","last_undegraded":"2023-10-06T04:37:27.010028+0000","last_fullsized":"2023-10-06T04:37:27.010028+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:37.190837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":31,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009929+0000","last_change":"2023-10-06T04:36:11.184460+0000","last_active":"2023-10-06T04:37:27.009929+0000","last_peered":"2023-10-06T04:37:27.009929+0000","last_clean":"2023-10-06T04:37:27.009929+0000","last_became_active":"2023-10-06T04:36:11.184119+0000","last_became_peered":"2023-10-06T04:36:11.184119+0000","last_unstale":"2023-10-06T04:37:27.009929+0000","last_undegraded":"2023-10-06T04:37:27.009929+0000","last_fullsized":"2023-10-06T04:37:27.009929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:37.026121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":179,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.004768+0000","last_change":"2023-10-06T04:36:12.183155+0000","last_active":"2023-10-06T04:37:27.004768+0000","last_peered":"2023-10-06T04:37:27.004768+0000","last_clean":"2023-10-06T04:37:27.004768+0000","last_became_active":"2023-10-06T04:36:12.182903+0000","last_became_peered":"2023-10-06T04:36:12.182903+0000","last_unstale":"2023-10-06T04:37:27.004768+0000","last_undegraded":"2023-10-06T04:37:27.004768+0000","last_fullsized":"2023-10-06T04:37:27.004768+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:11.171104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:11.171104+0000","last_clean_scrub_stamp":"2023-10-06T04:36:11.171104+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:38:54.323364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":2,"reported_epoch":45,"state":"creating+activating","last_fresh":"2023-10-06T04:37:29.783254+0000","last_change":"2023-10-06T04:37:29.783380+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:29.783254+0000","last_undegraded":"2023-10-06T04:37:29.783254+0000","last_fullsized":"2023-10-06T04:37:29.783254+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:00:47.460409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"38'9","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010189+0000","last_change":"2023-10-06T04:37:17.537793+0000","last_active":"2023-10-06T04:37:27.010189+0000","last_peered":"2023-10-06T04:37:27.010189+0000","last_clean":"2023-10-06T04:37:27.010189+0000","last_became_active":"2023-10-06T04:37:17.537503+0000","last_became_peered":"2023-10-06T04:37:17.537503+0000","last_unstale":"2023-10-06T04:37:27.010189+0000","last_undegraded":"2023-10-06T04:37:27.010189+0000","last_fullsized":"2023-10-06T04:37:27.010189+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:19.011564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.005224+0000","last_change":"2023-10-06T04:37:16.545879+0000","last_active":"2023-10-06T04:37:27.005224+0000","last_peered":"2023-10-06T04:37:27.005224+0000","last_clean":"2023-10-06T04:37:27.005224+0000","last_became_active":"2023-10-06T04:37:16.545603+0000","last_became_peered":"2023-10-06T04:37:16.545603+0000","last_unstale":"2023-10-06T04:37:27.005224+0000","last_undegraded":"2023-10-06T04:37:27.005224+0000","last_fullsized":"2023-10-06T04:37:27.005224+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:40.207039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":30,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.004883+0000","last_change":"2023-10-06T04:36:11.193056+0000","last_active":"2023-10-06T04:37:27.004883+0000","last_peered":"2023-10-06T04:37:27.004883+0000","last_clean":"2023-10-06T04:37:27.004883+0000","last_became_active":"2023-10-06T04:36:11.192712+0000","last_became_peered":"2023-10-06T04:36:11.192712+0000","last_unstale":"2023-10-06T04:37:27.004883+0000","last_undegraded":"2023-10-06T04:37:27.004883+0000","last_fullsized":"2023-10-06T04:37:27.004883+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:00.008654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.776857+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:13.574637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"38'7","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010402+0000","last_change":"2023-10-06T04:37:17.547978+0000","last_active":"2023-10-06T04:37:27.010402+0000","last_peered":"2023-10-06T04:37:27.010402+0000","last_clean":"2023-10-06T04:37:27.010402+0000","last_became_active":"2023-10-06T04:37:17.547342+0000","last_became_peered":"2023-10-06T04:37:17.547342+0000","last_unstale":"2023-10-06T04:37:27.010402+0000","last_undegraded":"2023-10-06T04:37:27.010402+0000","last_fullsized":"2023-10-06T04:37:27.010402+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:12.970309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"39'3","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010279+0000","last_change":"2023-10-06T04:37:16.544363+0000","last_active":"2023-10-06T04:37:27.010279+0000","last_peered":"2023-10-06T04:37:27.010279+0000","last_clean":"2023-10-06T04:37:27.010279+0000","last_became_active":"2023-10-06T04:37:16.544100+0000","last_became_peered":"2023-10-06T04:37:16.544100+0000","last_unstale":"2023-10-06T04:37:27.010279+0000","last_undegraded":"2023-10-06T04:37:27.010279+0000","last_fullsized":"2023-10-06T04:37:27.010279+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:24.703451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":30,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.004660+0000","last_change":"2023-10-06T04:36:11.192701+0000","last_active":"2023-10-06T04:37:27.004660+0000","last_peered":"2023-10-06T04:37:27.004660+0000","last_clean":"2023-10-06T04:37:27.004660+0000","last_became_active":"2023-10-06T04:36:11.192335+0000","last_became_peered":"2023-10-06T04:36:11.192335+0000","last_unstale":"2023-10-06T04:37:27.004660+0000","last_undegraded":"2023-10-06T04:37:27.004660+0000","last_fullsized":"2023-10-06T04:37:27.004660+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:18.643570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.782838+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:57.475670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"38'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010179+0000","last_change":"2023-10-06T04:37:17.551353+0000","last_active":"2023-10-06T04:37:27.010179+0000","last_peered":"2023-10-06T04:37:27.010179+0000","last_clean":"2023-10-06T04:37:27.010179+0000","last_became_active":"2023-10-06T04:37:17.550655+0000","last_became_peered":"2023-10-06T04:37:17.550655+0000","last_unstale":"2023-10-06T04:37:27.010179+0000","last_undegraded":"2023-10-06T04:37:27.010179+0000","last_fullsized":"2023-10-06T04:37:27.010179+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:37.951996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"39'3","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.012650+0000","last_change":"2023-10-06T04:37:16.541672+0000","last_active":"2023-10-06T04:37:27.012650+0000","last_peered":"2023-10-06T04:37:27.012650+0000","last_clean":"2023-10-06T04:37:27.012650+0000","last_became_active":"2023-10-06T04:37:16.541369+0000","last_became_peered":"2023-10-06T04:37:16.541369+0000","last_unstale":"2023-10-06T04:37:27.012650+0000","last_undegraded":"2023-10-06T04:37:27.012650+0000","last_fullsized":"2023-10-06T04:37:27.012650+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:34.644455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":31,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009672+0000","last_change":"2023-10-06T04:36:11.193497+0000","last_active":"2023-10-06T04:37:27.009672+0000","last_peered":"2023-10-06T04:37:27.009672+0000","last_clean":"2023-10-06T04:37:27.009672+0000","last_became_active":"2023-10-06T04:36:11.193215+0000","last_became_peered":"2023-10-06T04:36:11.193215+0000","last_unstale":"2023-10-06T04:37:27.009672+0000","last_undegraded":"2023-10-06T04:37:27.009672+0000","last_fullsized":"2023-10-06T04:37:27.009672+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:07.497987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":2,"reported_epoch":45,"state":"creating+activating","last_fresh":"2023-10-06T04:37:29.782182+0000","last_change":"2023-10-06T04:37:29.782296+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:29.782182+0000","last_undegraded":"2023-10-06T04:37:29.782182+0000","last_fullsized":"2023-10-06T04:37:29.782182+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:48.194911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"38'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009383+0000","last_change":"2023-10-06T04:37:17.548282+0000","last_active":"2023-10-06T04:37:27.009383+0000","last_peered":"2023-10-06T04:37:27.009383+0000","last_clean":"2023-10-06T04:37:27.009383+0000","last_became_active":"2023-10-06T04:37:17.548037+0000","last_became_peered":"2023-10-06T04:37:17.548037+0000","last_unstale":"2023-10-06T04:37:27.009383+0000","last_undegraded":"2023-10-06T04:37:27.009383+0000","last_fullsized":"2023-10-06T04:37:27.009383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:44:56.161035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009537+0000","last_change":"2023-10-06T04:37:16.539573+0000","last_active":"2023-10-06T04:37:27.009537+0000","last_peered":"2023-10-06T04:37:27.009537+0000","last_clean":"2023-10-06T04:37:27.009537+0000","last_became_active":"2023-10-06T04:37:16.539271+0000","last_became_peered":"2023-10-06T04:37:16.539271+0000","last_unstale":"2023-10-06T04:37:27.009537+0000","last_undegraded":"2023-10-06T04:37:27.009537+0000","last_fullsized":"2023-10-06T04:37:27.009537+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:06:23.075116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010044+0000","last_change":"2023-10-06T04:36:11.193111+0000","last_active":"2023-10-06T04:37:27.010044+0000","last_peered":"2023-10-06T04:37:27.010044+0000","last_clean":"2023-10-06T04:37:27.010044+0000","last_became_active":"2023-10-06T04:36:11.192836+0000","last_became_peered":"2023-10-06T04:36:11.192836+0000","last_unstale":"2023-10-06T04:37:27.010044+0000","last_undegraded":"2023-10-06T04:37:27.010044+0000","last_fullsized":"2023-10-06T04:37:27.010044+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:19.938716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:37:28.769918+0000","last_change":"2023-10-06T04:37:28.781463+0000","last_active":"2023-10-06T04:37:28.769918+0000","last_peered":"2023-10-06T04:37:28.769918+0000","last_clean":"2023-10-06T04:37:28.769918+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:37:28.769918+0000","last_undegraded":"2023-10-06T04:37:28.769918+0000","last_fullsized":"2023-10-06T04:37:28.769918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:25.262954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"38'5","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:26.779612+0000","last_change":"2023-10-06T04:37:17.546750+0000","last_active":"2023-10-06T04:37:26.779612+0000","last_peered":"2023-10-06T04:37:26.779612+0000","last_clean":"2023-10-06T04:37:26.779612+0000","last_became_active":"2023-10-06T04:37:17.546467+0000","last_became_peered":"2023-10-06T04:37:17.546467+0000","last_unstale":"2023-10-06T04:37:26.779612+0000","last_undegraded":"2023-10-06T04:37:26.779612+0000","last_fullsized":"2023-10-06T04:37:26.779612+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:58.928454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.009752+0000","last_change":"2023-10-06T04:37:16.544678+0000","last_active":"2023-10-06T04:37:27.009752+0000","last_peered":"2023-10-06T04:37:27.009752+0000","last_clean":"2023-10-06T04:37:27.009752+0000","last_became_active":"2023-10-06T04:37:16.541041+0000","last_became_peered":"2023-10-06T04:37:16.541041+0000","last_unstale":"2023-10-06T04:37:27.009752+0000","last_undegraded":"2023-10-06T04:37:27.009752+0000","last_fullsized":"2023-10-06T04:37:27.009752+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:15:48.328371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:37:27.010333+0000","last_change":"2023-10-06T04:36:11.182804+0000","last_active":"2023-10-06T04:37:27.010333+0000","last_peered":"2023-10-06T04:37:27.010333+0000","last_clean":"2023-10-06T04:37:27.010333+0000","last_became_active":"2023-10-06T04:36:11.182575+0000","last_became_peered":"2023-10-06T04:36:11.182575+0000","last_unstale":"2023-10-06T04:37:27.010333+0000","last_undegraded":"2023-10-06T04:37:27.010333+0000","last_fullsized":"2023-10-06T04:37:27.010333+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:07.497987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":504,"ondisk_log_size":504,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":93,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298368,"kb_used_data":1080,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073472,"statfs":{"total":96636764160,"available":96331235328,"internally_reserved":0,"allocated":1105920,"data_stored":826104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.50600000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.57099999999999995}]},{"osd":2,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.625}]},{"osd":3,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.55800000000000005}]},{"osd":4,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.58099999999999996}]},{"osd":5,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.45900000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.47099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301884,"kb_used_data":4596,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94069956,"statfs":{"total":96636764160,"available":96327634944,"internally_reserved":0,"allocated":4706304,"data_stored":4430040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":10.045999999999999,"5min":10.045999999999999,"15min":10.045999999999999},"last":0.57699999999999996}]},{"osd":1,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":10.125999999999999,"5min":10.125999999999999,"15min":10.125999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.60499999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":10.238,"5min":10.238,"15min":10.238},"last":0.59699999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":4.4870000000000001,"5min":4.4870000000000001,"15min":4.4870000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":10.393000000000001,"5min":10.393000000000001,"15min":10.393000000000001},"last":0.626}]},{"osd":4,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.40400000000000003}]},{"osd":5,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.377},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.39000000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.434},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.34300000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298368,"kb_used_data":1080,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073472,"statfs":{"total":96636764160,"available":96331235328,"internally_reserved":0,"allocated":1105920,"data_stored":826104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.38700000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.307}]},{"osd":3,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.28699999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.60099999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.61399999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.628}]},{"osd":7,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.65700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301880,"kb_used_data":4592,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94069960,"statfs":{"total":96636764160,"available":96327639040,"internally_reserved":0,"allocated":4702208,"data_stored":4429062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.443,"5min":0.443,"15min":0.443},"last":0.312}]},{"osd":2,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.28999999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.42399999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.73399999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.68700000000000006}]},{"osd":7,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.629},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.66500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297784,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074056,"statfs":{"total":96636764160,"available":96331833344,"internally_reserved":0,"allocated":507904,"data_stored":234758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.432}]},{"osd":1,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.35899999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.378}]},{"osd":4,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.47099999999999997}]},{"osd":5,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.495}]},{"osd":6,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.628},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.64800000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.58299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297784,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074056,"statfs":{"total":96636764160,"available":96331833344,"internally_reserved":0,"allocated":507904,"data_stored":234758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.318},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.442,"5min":0.442,"15min":0.442},"last":0.29199999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.436,"5min":0.436,"15min":0.436},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.27700000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.35399999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.1070000000000002,"5min":2.1070000000000002,"15min":2.1070000000000002},"last":0.51900000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":0.497},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.55200000000000005}]},{"osd":6,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.63},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.54300000000000004}]},{"osd":7,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.52900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299836,"kb_used_data":2548,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072004,"statfs":{"total":96636764160,"available":96329732096,"internally_reserved":0,"allocated":2609152,"data_stored":2332888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":4.2919999999999998,"5min":4.2919999999999998,"15min":4.2919999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.317}]},{"osd":1,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":4.3520000000000003,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":0.34999999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.54400000000000004}]},{"osd":3,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.501}]},{"osd":5,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.38800000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.44},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.59599999999999997}]},{"osd":7,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.623}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299836,"kb_used_data":2548,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072004,"statfs":{"total":96636764160,"available":96329732096,"internally_reserved":0,"allocated":2609152,"data_stored":2332888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.42499999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.40100000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.372},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.48999999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.54400000000000004}]},{"osd":4,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.501}]},{"osd":6,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.51100000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.52400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:37:38.472 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:37:38.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.604+0000 7fe4150c5700 1 Processor -- start 2023-10-06T04:37:38.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.604+0000 7fe4150c5700 1 -- start start 2023-10-06T04:37:38.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.605+0000 7fe4150c5700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe4100cb360 0x7fe4100d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:38.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.605+0000 7fe4150c5700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4100d08d0 0x7fe4100cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:38.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.605+0000 7fe4150c5700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4100cc4c0 con 0x7fe4100af680 2023-10-06T04:37:38.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.605+0000 7fe4150c5700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe41015d460 con 0x7fe4100cb360 2023-10-06T04:37:38.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.605+0000 7fe4150c5700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4100d0d20 con 0x7fe4100d08d0 2023-10-06T04:37:38.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.605+0000 7fe40e59c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe4100cb360 0x7fe4100d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:38.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.605+0000 7fe40f59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4100d08d0 0x7fe4100cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:38.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.605+0000 7fe40ed9d700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fe4100af680 0x7fe41015e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.8:36386/0 (socket says 172.21.15.8:36386) 2023-10-06T04:37:38.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.605+0000 7fe40ed9d700 1 -- 172.21.15.8:0/374361656 learned_addr learned my addr 172.21.15.8:0/374361656 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:38.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.606+0000 7fe40e59c700 1 -- 172.21.15.8:0/374361656 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4100d08d0 msgr2=0x7fe4100cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:38.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.606+0000 7fe40e59c700 1 --2- 172.21.15.8:0/374361656 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4100d08d0 0x7fe4100cc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:38.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.606+0000 7fe40e59c700 1 -- 172.21.15.8:0/374361656 >> v1:172.21.15.184:6789/0 conn(0x7fe4100af680 legacy=0x7fe41015e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:38.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.606+0000 7fe40e59c700 1 -- 172.21.15.8:0/374361656 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4100cb8b0 con 0x7fe4100cb360 2023-10-06T04:37:38.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.606+0000 7fe40e59c700 1 --2- 172.21.15.8:0/374361656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4100cb360 0x7fe4100d0390 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe3f80098e0 tx=0x7fe3f80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68789704e824e9da server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:38.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.606+0000 7fe40dd9b700 1 -- 172.21.15.8:0/374361656 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f800b640 con 0x7fe4100cb360 2023-10-06T04:37:38.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.606+0000 7fe40dd9b700 1 -- 172.21.15.8:0/374361656 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f800b7a0 con 0x7fe4100cb360 2023-10-06T04:37:38.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.606+0000 7fe40dd9b700 1 -- 172.21.15.8:0/374361656 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f800bb40 con 0x7fe4100cb360 2023-10-06T04:37:38.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.607+0000 7fe4150c5700 1 -- 172.21.15.8:0/374361656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4100cb360 msgr2=0x7fe4100d0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:38.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.607+0000 7fe4150c5700 1 --2- 172.21.15.8:0/374361656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4100cb360 0x7fe4100d0390 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe3f80098e0 tx=0x7fe3f80091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:38.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.607+0000 7fe4150c5700 1 -- 172.21.15.8:0/374361656 shutdown_connections 2023-10-06T04:37:38.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.607+0000 7fe4150c5700 1 --2- 172.21.15.8:0/374361656 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4100d08d0 0x7fe4100cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:38.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.607+0000 7fe4150c5700 1 --2- 172.21.15.8:0/374361656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4100cb360 0x7fe4100d0390 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:38.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.607+0000 7fe4150c5700 1 -- 172.21.15.8:0/374361656 >> 172.21.15.8:0/374361656 conn(0x7fe4100633d0 msgr2=0x7fe4100637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:38.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.607+0000 7fe4150c5700 1 -- 172.21.15.8:0/374361656 shutdown_connections 2023-10-06T04:37:38.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.607+0000 7fe4150c5700 1 -- 172.21.15.8:0/374361656 wait complete. 2023-10-06T04:37:38.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.608+0000 7fe4150c5700 1 Processor -- start 2023-10-06T04:37:38.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.608+0000 7fe4150c5700 1 -- start start 2023-10-06T04:37:38.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.609+0000 7fe4150c5700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4100af680 0x7fe410152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:38.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.609+0000 7fe4150c5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4100cb360 0x7fe41015e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:38.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.609+0000 7fe4150c5700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4100d08d0 0x7fe41015ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:38.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.609+0000 7fe4150c5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4101697a0 con 0x7fe4100cb360 2023-10-06T04:37:38.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.609+0000 7fe4150c5700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41015f5c0 con 0x7fe4100d08d0 2023-10-06T04:37:38.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.609+0000 7fe4150c5700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe410169fd0 con 0x7fe4100af680 2023-10-06T04:37:38.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.609+0000 7fe40e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4100cb360 0x7fe41015e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:38.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.609+0000 7fe40e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4100cb360 0x7fe41015e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54358/0 (socket says 172.21.15.8:54358) 2023-10-06T04:37:38.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.609+0000 7fe40e59c700 1 -- 172.21.15.8:0/725527890 learned_addr learned my addr 172.21.15.8:0/725527890 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:38.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.609+0000 7fe40ed9d700 1 --2- 172.21.15.8:0/725527890 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4100af680 0x7fe410152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:38.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.609+0000 7fe40f59e700 1 --2- 172.21.15.8:0/725527890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4100d08d0 0x7fe41015ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:38.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.609+0000 7fe40e59c700 1 -- 172.21.15.8:0/725527890 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4100af680 msgr2=0x7fe410152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:38.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.609+0000 7fe40e59c700 1 --2- 172.21.15.8:0/725527890 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4100af680 0x7fe410152c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:38.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.609+0000 7fe40e59c700 1 -- 172.21.15.8:0/725527890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4100d08d0 msgr2=0x7fe41015ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:38.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.609+0000 7fe40e59c700 1 --2- 172.21.15.8:0/725527890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4100d08d0 0x7fe41015ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:38.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.609+0000 7fe40e59c700 1 -- 172.21.15.8:0/725527890 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f8009420 con 0x7fe4100cb360 2023-10-06T04:37:38.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.610+0000 7fe40e59c700 1 --2- 172.21.15.8:0/725527890 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4100cb360 0x7fe41015e770 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe410063f80 tx=0x7fe3f8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:38.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.610+0000 7fe406ffd700 1 -- 172.21.15.8:0/725527890 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f801bc40 con 0x7fe4100cb360 2023-10-06T04:37:38.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.610+0000 7fe406ffd700 1 -- 172.21.15.8:0/725527890 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f801bda0 con 0x7fe4100cb360 2023-10-06T04:37:38.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.610+0000 7fe4150c5700 1 -- 172.21.15.8:0/725527890 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41015f2e0 con 0x7fe4100cb360 2023-10-06T04:37:38.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.610+0000 7fe406ffd700 1 -- 172.21.15.8:0/725527890 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f8011670 con 0x7fe4100cb360 2023-10-06T04:37:38.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.610+0000 7fe4150c5700 1 -- 172.21.15.8:0/725527890 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe410169c60 con 0x7fe4100cb360 2023-10-06T04:37:38.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.611+0000 7fe4150c5700 1 -- 172.21.15.8:0/725527890 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe410071550 con 0x7fe4100cb360 2023-10-06T04:37:38.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.611+0000 7fe406ffd700 1 -- 172.21.15.8:0/725527890 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe3f8011a20 con 0x7fe4100cb360 2023-10-06T04:37:38.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.612+0000 7fe406ffd700 1 --2- 172.21.15.8:0/725527890 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe3f0066f30 0x7fe3f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:38.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.612+0000 7fe406ffd700 1 -- 172.21.15.8:0/725527890 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7fe3f8086040 con 0x7fe4100cb360 2023-10-06T04:37:38.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.612+0000 7fe40ed9d700 1 --2- 172.21.15.8:0/725527890 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe3f0066f30 0x7fe3f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:38.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.612+0000 7fe40ed9d700 1 --2- 172.21.15.8:0/725527890 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe3f0066f30 0x7fe3f00693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe410069340 tx=0x7fe400001a10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:38.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.616+0000 7fe406ffd700 1 -- 172.21.15.8:0/725527890 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe3f8052df0 con 0x7fe4100cb360 2023-10-06T04:37:38.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.807+0000 7fe4150c5700 1 -- 172.21.15.8:0/725527890 --> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe41016a110 con 0x7fe3f0066f30 2023-10-06T04:37:38.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.819+0000 7fe406ffd700 1 -- 172.21.15.8:0/725527890 <== mgr.4105 v2:172.21.15.184:6832/90283 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+392951 (secure 0 0 0) 0x7fe41016a110 con 0x7fe3f0066f30 2023-10-06T04:37:38.825 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:38.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.822+0000 7fe4150c5700 1 -- 172.21.15.8:0/725527890 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe3f0066f30 msgr2=0x7fe3f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:38.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.822+0000 7fe4150c5700 1 --2- 172.21.15.8:0/725527890 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe3f0066f30 0x7fe3f00693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe410069340 tx=0x7fe400001a10 comp rx=0 tx=0).stop 2023-10-06T04:37:38.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.822+0000 7fe4150c5700 1 -- 172.21.15.8:0/725527890 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4100cb360 msgr2=0x7fe41015e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:38.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.822+0000 7fe4150c5700 1 --2- 172.21.15.8:0/725527890 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4100cb360 0x7fe41015e770 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe410063f80 tx=0x7fe3f8017000 comp rx=0 tx=0).stop 2023-10-06T04:37:38.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.823+0000 7fe4150c5700 1 -- 172.21.15.8:0/725527890 shutdown_connections 2023-10-06T04:37:38.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.823+0000 7fe4150c5700 1 --2- 172.21.15.8:0/725527890 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe3f0066f30 0x7fe3f00693e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:38.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.823+0000 7fe4150c5700 1 --2- 172.21.15.8:0/725527890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4100d08d0 0x7fe41015ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:38.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.823+0000 7fe4150c5700 1 --2- 172.21.15.8:0/725527890 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4100af680 0x7fe410152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:38.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.823+0000 7fe4150c5700 1 --2- 172.21.15.8:0/725527890 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4100cb360 0x7fe41015e770 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:38.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.823+0000 7fe4150c5700 1 -- 172.21.15.8:0/725527890 >> 172.21.15.8:0/725527890 conn(0x7fe4100633d0 msgr2=0x7fe4100cf8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:38.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.823+0000 7fe4150c5700 1 -- 172.21.15.8:0/725527890 shutdown_connections 2023-10-06T04:37:38.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.823+0000 7fe4150c5700 1 -- 172.21.15.8:0/725527890 wait complete. 2023-10-06T04:37:38.829 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-06T04:37:38.836 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2023-10-06T04:37:38.651214+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6881824,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":100,"num_write":256,"num_write_kb":8601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":703,"ondisk_log_size":703,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2395932,"kb_used_data":17628,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752578788,"statfs":{"total":773094113280,"available":770640678912,"internally_reserved":0,"allocated":18051072,"data_stored":15770618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11656,"num_objects":-15,"num_object_clones":0,"num_object_copies":-30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-15,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":33,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.874919"},"pg_stats":[{"pgid":"7.3f","version":"38'8","reported_seq":23,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.783219+0000","last_change":"2023-10-06T04:37:17.540825+0000","last_active":"2023-10-06T04:37:29.783219+0000","last_peered":"2023-10-06T04:37:29.783219+0000","last_clean":"2023-10-06T04:37:29.783219+0000","last_became_active":"2023-10-06T04:37:17.540537+0000","last_became_peered":"2023-10-06T04:37:17.540537+0000","last_unstale":"2023-10-06T04:37:29.783219+0000","last_undegraded":"2023-10-06T04:37:29.783219+0000","last_fullsized":"2023-10-06T04:37:29.783219+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:27.083777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"38'4","reported_seq":19,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.784166+0000","last_change":"2023-10-06T04:37:17.550627+0000","last_active":"2023-10-06T04:37:29.784166+0000","last_peered":"2023-10-06T04:37:29.784166+0000","last_clean":"2023-10-06T04:37:29.784166+0000","last_became_active":"2023-10-06T04:37:17.550395+0000","last_became_peered":"2023-10-06T04:37:17.550395+0000","last_unstale":"2023-10-06T04:37:29.784166+0000","last_undegraded":"2023-10-06T04:37:29.784166+0000","last_fullsized":"2023-10-06T04:37:29.784166+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:49.714446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"38'7","reported_seq":23,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.778790+0000","last_change":"2023-10-06T04:37:17.541131+0000","last_active":"2023-10-06T04:37:29.778790+0000","last_peered":"2023-10-06T04:37:29.778790+0000","last_clean":"2023-10-06T04:37:29.778790+0000","last_became_active":"2023-10-06T04:37:17.540816+0000","last_became_peered":"2023-10-06T04:37:17.540816+0000","last_unstale":"2023-10-06T04:37:29.778790+0000","last_undegraded":"2023-10-06T04:37:29.778790+0000","last_fullsized":"2023-10-06T04:37:29.778790+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:32:45.542874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"38'8","reported_seq":23,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.786930+0000","last_change":"2023-10-06T04:37:17.545649+0000","last_active":"2023-10-06T04:37:29.786930+0000","last_peered":"2023-10-06T04:37:29.786930+0000","last_clean":"2023-10-06T04:37:29.786930+0000","last_became_active":"2023-10-06T04:37:17.545155+0000","last_became_peered":"2023-10-06T04:37:17.545155+0000","last_unstale":"2023-10-06T04:37:29.786930+0000","last_undegraded":"2023-10-06T04:37:29.786930+0000","last_fullsized":"2023-10-06T04:37:29.786930+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:09.823506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"38'4","reported_seq":19,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.784869+0000","last_change":"2023-10-06T04:37:17.545451+0000","last_active":"2023-10-06T04:37:29.784869+0000","last_peered":"2023-10-06T04:37:29.784869+0000","last_clean":"2023-10-06T04:37:29.784869+0000","last_became_active":"2023-10-06T04:37:17.545135+0000","last_became_peered":"2023-10-06T04:37:17.545135+0000","last_unstale":"2023-10-06T04:37:29.784869+0000","last_undegraded":"2023-10-06T04:37:29.784869+0000","last_fullsized":"2023-10-06T04:37:29.784869+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:44.628778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"38'6","reported_seq":22,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.784569+0000","last_change":"2023-10-06T04:37:17.545054+0000","last_active":"2023-10-06T04:37:29.784569+0000","last_peered":"2023-10-06T04:37:29.784569+0000","last_clean":"2023-10-06T04:37:29.784569+0000","last_became_active":"2023-10-06T04:37:17.544822+0000","last_became_peered":"2023-10-06T04:37:17.544822+0000","last_unstale":"2023-10-06T04:37:29.784569+0000","last_undegraded":"2023-10-06T04:37:29.784569+0000","last_fullsized":"2023-10-06T04:37:29.784569+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:28:51.824521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"38'5","reported_seq":20,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.782172+0000","last_change":"2023-10-06T04:37:17.548819+0000","last_active":"2023-10-06T04:37:29.782172+0000","last_peered":"2023-10-06T04:37:29.782172+0000","last_clean":"2023-10-06T04:37:29.782172+0000","last_became_active":"2023-10-06T04:37:17.548629+0000","last_became_peered":"2023-10-06T04:37:17.548629+0000","last_unstale":"2023-10-06T04:37:29.782172+0000","last_undegraded":"2023-10-06T04:37:29.782172+0000","last_fullsized":"2023-10-06T04:37:29.782172+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:04.973984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"38'9","reported_seq":24,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.781080+0000","last_change":"2023-10-06T04:37:17.547124+0000","last_active":"2023-10-06T04:37:29.781080+0000","last_peered":"2023-10-06T04:37:29.781080+0000","last_clean":"2023-10-06T04:37:29.781080+0000","last_became_active":"2023-10-06T04:37:17.546879+0000","last_became_peered":"2023-10-06T04:37:17.546879+0000","last_unstale":"2023-10-06T04:37:29.781080+0000","last_undegraded":"2023-10-06T04:37:29.781080+0000","last_fullsized":"2023-10-06T04:37:29.781080+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:45.225371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"38'11","reported_seq":26,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.787928+0000","last_change":"2023-10-06T04:37:17.537910+0000","last_active":"2023-10-06T04:37:29.787928+0000","last_peered":"2023-10-06T04:37:29.787928+0000","last_clean":"2023-10-06T04:37:29.787928+0000","last_became_active":"2023-10-06T04:37:17.535864+0000","last_became_peered":"2023-10-06T04:37:17.535864+0000","last_unstale":"2023-10-06T04:37:29.787928+0000","last_undegraded":"2023-10-06T04:37:29.787928+0000","last_fullsized":"2023-10-06T04:37:29.787928+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:58.928454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"38'15","reported_seq":30,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.788081+0000","last_change":"2023-10-06T04:37:17.548489+0000","last_active":"2023-10-06T04:37:29.788081+0000","last_peered":"2023-10-06T04:37:29.788081+0000","last_clean":"2023-10-06T04:37:29.788081+0000","last_became_active":"2023-10-06T04:37:17.547714+0000","last_became_peered":"2023-10-06T04:37:17.547714+0000","last_unstale":"2023-10-06T04:37:29.788081+0000","last_undegraded":"2023-10-06T04:37:29.788081+0000","last_fullsized":"2023-10-06T04:37:29.788081+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:56.687459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"38'6","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.786801+0000","last_change":"2023-10-06T04:37:17.544501+0000","last_active":"2023-10-06T04:37:29.786801+0000","last_peered":"2023-10-06T04:37:29.786801+0000","last_clean":"2023-10-06T04:37:29.786801+0000","last_became_active":"2023-10-06T04:37:17.541822+0000","last_became_peered":"2023-10-06T04:37:17.541822+0000","last_unstale":"2023-10-06T04:37:29.786801+0000","last_undegraded":"2023-10-06T04:37:29.786801+0000","last_fullsized":"2023-10-06T04:37:29.786801+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:32:45.542874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"38'7","reported_seq":22,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.786813+0000","last_change":"2023-10-06T04:37:17.545538+0000","last_active":"2023-10-06T04:37:29.786813+0000","last_peered":"2023-10-06T04:37:29.786813+0000","last_clean":"2023-10-06T04:37:29.786813+0000","last_became_active":"2023-10-06T04:37:17.545027+0000","last_became_peered":"2023-10-06T04:37:17.545027+0000","last_unstale":"2023-10-06T04:37:29.786813+0000","last_undegraded":"2023-10-06T04:37:29.786813+0000","last_fullsized":"2023-10-06T04:37:29.786813+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:23.847066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"38'10","reported_seq":24,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.776953+0000","last_change":"2023-10-06T04:37:17.541986+0000","last_active":"2023-10-06T04:37:29.776953+0000","last_peered":"2023-10-06T04:37:29.776953+0000","last_clean":"2023-10-06T04:37:29.776953+0000","last_became_active":"2023-10-06T04:37:17.541707+0000","last_became_peered":"2023-10-06T04:37:17.541707+0000","last_unstale":"2023-10-06T04:37:29.776953+0000","last_undegraded":"2023-10-06T04:37:29.776953+0000","last_fullsized":"2023-10-06T04:37:29.776953+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:25.707658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"38'8","reported_seq":23,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.781737+0000","last_change":"2023-10-06T04:37:17.536298+0000","last_active":"2023-10-06T04:37:29.781737+0000","last_peered":"2023-10-06T04:37:29.781737+0000","last_clean":"2023-10-06T04:37:29.781737+0000","last_became_active":"2023-10-06T04:37:17.535937+0000","last_became_peered":"2023-10-06T04:37:17.535937+0000","last_unstale":"2023-10-06T04:37:29.781737+0000","last_undegraded":"2023-10-06T04:37:29.781737+0000","last_fullsized":"2023-10-06T04:37:29.781737+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:01.324339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"38'7","reported_seq":23,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.784067+0000","last_change":"2023-10-06T04:37:17.538786+0000","last_active":"2023-10-06T04:37:29.784067+0000","last_peered":"2023-10-06T04:37:29.784067+0000","last_clean":"2023-10-06T04:37:29.784067+0000","last_became_active":"2023-10-06T04:37:17.538493+0000","last_became_peered":"2023-10-06T04:37:17.538493+0000","last_unstale":"2023-10-06T04:37:29.784067+0000","last_undegraded":"2023-10-06T04:37:29.784067+0000","last_fullsized":"2023-10-06T04:37:29.784067+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:09.823506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"38'9","reported_seq":24,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.781367+0000","last_change":"2023-10-06T04:37:17.552277+0000","last_active":"2023-10-06T04:37:29.781367+0000","last_peered":"2023-10-06T04:37:29.781367+0000","last_clean":"2023-10-06T04:37:29.781367+0000","last_became_active":"2023-10-06T04:37:17.552001+0000","last_became_peered":"2023-10-06T04:37:17.552001+0000","last_unstale":"2023-10-06T04:37:29.781367+0000","last_undegraded":"2023-10-06T04:37:29.781367+0000","last_fullsized":"2023-10-06T04:37:29.781367+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:41.211245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"38'9","reported_seq":25,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.779363+0000","last_change":"2023-10-06T04:37:17.547373+0000","last_active":"2023-10-06T04:37:29.779363+0000","last_peered":"2023-10-06T04:37:29.779363+0000","last_clean":"2023-10-06T04:37:29.779363+0000","last_became_active":"2023-10-06T04:37:17.547103+0000","last_became_peered":"2023-10-06T04:37:17.547103+0000","last_unstale":"2023-10-06T04:37:29.779363+0000","last_undegraded":"2023-10-06T04:37:29.779363+0000","last_fullsized":"2023-10-06T04:37:29.779363+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:09.823506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"38'10","reported_seq":26,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.779206+0000","last_change":"2023-10-06T04:37:17.554683+0000","last_active":"2023-10-06T04:37:29.779206+0000","last_peered":"2023-10-06T04:37:29.779206+0000","last_clean":"2023-10-06T04:37:29.779206+0000","last_became_active":"2023-10-06T04:37:17.554412+0000","last_became_peered":"2023-10-06T04:37:17.554412+0000","last_unstale":"2023-10-06T04:37:29.779206+0000","last_undegraded":"2023-10-06T04:37:29.779206+0000","last_fullsized":"2023-10-06T04:37:29.779206+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:56.687459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"38'7","reported_seq":22,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.782113+0000","last_change":"2023-10-06T04:37:17.551197+0000","last_active":"2023-10-06T04:37:29.782113+0000","last_peered":"2023-10-06T04:37:29.782113+0000","last_clean":"2023-10-06T04:37:29.782113+0000","last_became_active":"2023-10-06T04:37:17.550633+0000","last_became_peered":"2023-10-06T04:37:17.550633+0000","last_unstale":"2023-10-06T04:37:29.782113+0000","last_undegraded":"2023-10-06T04:37:29.782113+0000","last_fullsized":"2023-10-06T04:37:29.782113+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:25.707658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"38'8","reported_seq":22,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.777017+0000","last_change":"2023-10-06T04:37:17.541139+0000","last_active":"2023-10-06T04:37:29.777017+0000","last_peered":"2023-10-06T04:37:29.777017+0000","last_clean":"2023-10-06T04:37:29.777017+0000","last_became_active":"2023-10-06T04:37:17.540844+0000","last_became_peered":"2023-10-06T04:37:17.540844+0000","last_unstale":"2023-10-06T04:37:29.777017+0000","last_undegraded":"2023-10-06T04:37:29.777017+0000","last_fullsized":"2023-10-06T04:37:29.777017+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:40.800271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"38'11","reported_seq":27,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.785253+0000","last_change":"2023-10-06T04:37:17.546023+0000","last_active":"2023-10-06T04:37:29.785253+0000","last_peered":"2023-10-06T04:37:29.785253+0000","last_clean":"2023-10-06T04:37:29.785253+0000","last_became_active":"2023-10-06T04:37:17.545428+0000","last_became_peered":"2023-10-06T04:37:17.545428+0000","last_unstale":"2023-10-06T04:37:29.785253+0000","last_undegraded":"2023-10-06T04:37:29.785253+0000","last_fullsized":"2023-10-06T04:37:29.785253+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:52.574192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"38'9","reported_seq":24,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.781857+0000","last_change":"2023-10-06T04:37:17.546918+0000","last_active":"2023-10-06T04:37:29.781857+0000","last_peered":"2023-10-06T04:37:29.781857+0000","last_clean":"2023-10-06T04:37:29.781857+0000","last_became_active":"2023-10-06T04:37:17.546562+0000","last_became_peered":"2023-10-06T04:37:17.546562+0000","last_unstale":"2023-10-06T04:37:29.781857+0000","last_undegraded":"2023-10-06T04:37:29.781857+0000","last_fullsized":"2023-10-06T04:37:29.781857+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:18.119835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"38'8","reported_seq":23,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.781317+0000","last_change":"2023-10-06T04:37:17.549490+0000","last_active":"2023-10-06T04:37:29.781317+0000","last_peered":"2023-10-06T04:37:29.781317+0000","last_clean":"2023-10-06T04:37:29.781317+0000","last_became_active":"2023-10-06T04:37:17.549294+0000","last_became_peered":"2023-10-06T04:37:17.549294+0000","last_unstale":"2023-10-06T04:37:29.781317+0000","last_undegraded":"2023-10-06T04:37:29.781317+0000","last_fullsized":"2023-10-06T04:37:29.781317+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:50.973957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"38'6","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.781465+0000","last_change":"2023-10-06T04:37:17.548512+0000","last_active":"2023-10-06T04:37:29.781465+0000","last_peered":"2023-10-06T04:37:29.781465+0000","last_clean":"2023-10-06T04:37:29.781465+0000","last_became_active":"2023-10-06T04:37:17.547910+0000","last_became_peered":"2023-10-06T04:37:17.547910+0000","last_unstale":"2023-10-06T04:37:29.781465+0000","last_undegraded":"2023-10-06T04:37:29.781465+0000","last_fullsized":"2023-10-06T04:37:29.781465+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:15:49.332577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"38'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.783599+0000","last_change":"2023-10-06T04:37:17.551312+0000","last_active":"2023-10-06T04:37:29.783599+0000","last_peered":"2023-10-06T04:37:29.783599+0000","last_clean":"2023-10-06T04:37:29.783599+0000","last_became_active":"2023-10-06T04:37:17.550973+0000","last_became_peered":"2023-10-06T04:37:17.550973+0000","last_unstale":"2023-10-06T04:37:29.783599+0000","last_undegraded":"2023-10-06T04:37:29.783599+0000","last_fullsized":"2023-10-06T04:37:29.783599+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:40.800271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"38'15","reported_seq":29,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.777115+0000","last_change":"2023-10-06T04:37:17.542441+0000","last_active":"2023-10-06T04:37:29.777115+0000","last_peered":"2023-10-06T04:37:29.777115+0000","last_clean":"2023-10-06T04:37:29.777115+0000","last_became_active":"2023-10-06T04:37:17.542184+0000","last_became_peered":"2023-10-06T04:37:17.542184+0000","last_unstale":"2023-10-06T04:37:29.777115+0000","last_undegraded":"2023-10-06T04:37:29.777115+0000","last_fullsized":"2023-10-06T04:37:29.777115+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:57.066657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"38'6","reported_seq":22,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.778778+0000","last_change":"2023-10-06T04:37:17.546567+0000","last_active":"2023-10-06T04:37:29.778778+0000","last_peered":"2023-10-06T04:37:29.778778+0000","last_clean":"2023-10-06T04:37:29.778778+0000","last_became_active":"2023-10-06T04:37:17.546294+0000","last_became_peered":"2023-10-06T04:37:17.546294+0000","last_unstale":"2023-10-06T04:37:29.778778+0000","last_undegraded":"2023-10-06T04:37:29.778778+0000","last_fullsized":"2023-10-06T04:37:29.778778+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:19.011564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"38'4","reported_seq":19,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.787024+0000","last_change":"2023-10-06T04:37:17.545684+0000","last_active":"2023-10-06T04:37:29.787024+0000","last_peered":"2023-10-06T04:37:29.787024+0000","last_clean":"2023-10-06T04:37:29.787024+0000","last_became_active":"2023-10-06T04:37:17.545341+0000","last_became_peered":"2023-10-06T04:37:17.545341+0000","last_unstale":"2023-10-06T04:37:29.787024+0000","last_undegraded":"2023-10-06T04:37:29.787024+0000","last_fullsized":"2023-10-06T04:37:29.787024+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:04.973984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"38'7","reported_seq":22,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.782097+0000","last_change":"2023-10-06T04:37:17.551198+0000","last_active":"2023-10-06T04:37:29.782097+0000","last_peered":"2023-10-06T04:37:29.782097+0000","last_clean":"2023-10-06T04:37:29.782097+0000","last_became_active":"2023-10-06T04:37:17.550871+0000","last_became_peered":"2023-10-06T04:37:17.550871+0000","last_unstale":"2023-10-06T04:37:29.782097+0000","last_undegraded":"2023-10-06T04:37:29.782097+0000","last_fullsized":"2023-10-06T04:37:29.782097+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:43.463619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"38'8","reported_seq":24,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.778720+0000","last_change":"2023-10-06T04:37:17.544638+0000","last_active":"2023-10-06T04:37:29.778720+0000","last_peered":"2023-10-06T04:37:29.778720+0000","last_clean":"2023-10-06T04:37:29.778720+0000","last_became_active":"2023-10-06T04:37:17.544358+0000","last_became_peered":"2023-10-06T04:37:17.544358+0000","last_unstale":"2023-10-06T04:37:29.778720+0000","last_undegraded":"2023-10-06T04:37:29.778720+0000","last_fullsized":"2023-10-06T04:37:29.778720+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:16.140442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"38'12","reported_seq":28,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.784162+0000","last_change":"2023-10-06T04:37:17.547875+0000","last_active":"2023-10-06T04:37:29.784162+0000","last_peered":"2023-10-06T04:37:29.784162+0000","last_clean":"2023-10-06T04:37:29.784162+0000","last_became_active":"2023-10-06T04:37:17.547504+0000","last_became_peered":"2023-10-06T04:37:17.547504+0000","last_unstale":"2023-10-06T04:37:29.784162+0000","last_undegraded":"2023-10-06T04:37:29.784162+0000","last_fullsized":"2023-10-06T04:37:29.784162+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:37.661915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"38'9","reported_seq":23,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.776903+0000","last_change":"2023-10-06T04:37:17.535486+0000","last_active":"2023-10-06T04:37:29.776903+0000","last_peered":"2023-10-06T04:37:29.776903+0000","last_clean":"2023-10-06T04:37:29.776903+0000","last_became_active":"2023-10-06T04:37:17.535215+0000","last_became_peered":"2023-10-06T04:37:17.535215+0000","last_unstale":"2023-10-06T04:37:29.776903+0000","last_undegraded":"2023-10-06T04:37:29.776903+0000","last_fullsized":"2023-10-06T04:37:29.776903+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:01.221591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.796058+0000","last_change":"2023-10-06T04:37:29.792507+0000","last_active":"2023-10-06T04:37:29.796058+0000","last_peered":"2023-10-06T04:37:29.796058+0000","last_clean":"2023-10-06T04:37:29.796058+0000","last_became_active":"2023-10-06T04:37:29.792243+0000","last_became_peered":"2023-10-06T04:37:29.792243+0000","last_unstale":"2023-10-06T04:37:29.796058+0000","last_undegraded":"2023-10-06T04:37:29.796058+0000","last_fullsized":"2023-10-06T04:37:29.796058+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:01.927910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"38'5","reported_seq":20,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.780237+0000","last_change":"2023-10-06T04:37:17.540682+0000","last_active":"2023-10-06T04:37:29.780237+0000","last_peered":"2023-10-06T04:37:29.780237+0000","last_clean":"2023-10-06T04:37:29.780237+0000","last_became_active":"2023-10-06T04:37:17.540340+0000","last_became_peered":"2023-10-06T04:37:17.540340+0000","last_unstale":"2023-10-06T04:37:29.780237+0000","last_undegraded":"2023-10-06T04:37:29.780237+0000","last_fullsized":"2023-10-06T04:37:29.780237+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:57.066657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"39'8","reported_seq":25,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.789051+0000","last_change":"2023-10-06T04:37:16.539316+0000","last_active":"2023-10-06T04:37:29.789051+0000","last_peered":"2023-10-06T04:37:29.789051+0000","last_clean":"2023-10-06T04:37:29.789051+0000","last_became_active":"2023-10-06T04:37:16.538848+0000","last_became_peered":"2023-10-06T04:37:16.538848+0000","last_unstale":"2023-10-06T04:37:29.789051+0000","last_undegraded":"2023-10-06T04:37:29.789051+0000","last_fullsized":"2023-10-06T04:37:29.789051+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:44:55.156828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.793592+0000","last_change":"2023-10-06T04:37:29.792622+0000","last_active":"2023-10-06T04:37:29.793592+0000","last_peered":"2023-10-06T04:37:29.793592+0000","last_clean":"2023-10-06T04:37:29.793592+0000","last_became_active":"2023-10-06T04:37:29.792365+0000","last_became_peered":"2023-10-06T04:37:29.792365+0000","last_unstale":"2023-10-06T04:37:29.793592+0000","last_undegraded":"2023-10-06T04:37:29.793592+0000","last_fullsized":"2023-10-06T04:37:29.793592+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:11.339882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"38'6","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.783305+0000","last_change":"2023-10-06T04:37:17.549963+0000","last_active":"2023-10-06T04:37:29.783305+0000","last_peered":"2023-10-06T04:37:29.783305+0000","last_clean":"2023-10-06T04:37:29.783305+0000","last_became_active":"2023-10-06T04:37:17.545289+0000","last_became_peered":"2023-10-06T04:37:17.545289+0000","last_unstale":"2023-10-06T04:37:29.783305+0000","last_undegraded":"2023-10-06T04:37:29.783305+0000","last_fullsized":"2023-10-06T04:37:29.783305+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:01.221591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"37'1","reported_seq":18,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.779565+0000","last_change":"2023-10-06T04:37:16.539806+0000","last_active":"2023-10-06T04:37:29.779565+0000","last_peered":"2023-10-06T04:37:29.779565+0000","last_clean":"2023-10-06T04:37:29.779565+0000","last_became_active":"2023-10-06T04:37:16.539514+0000","last_became_peered":"2023-10-06T04:37:16.539514+0000","last_unstale":"2023-10-06T04:37:29.779565+0000","last_undegraded":"2023-10-06T04:37:29.779565+0000","last_fullsized":"2023-10-06T04:37:29.779565+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:48.710239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.792052+0000","last_change":"2023-10-06T04:37:29.789131+0000","last_active":"2023-10-06T04:37:29.792052+0000","last_peered":"2023-10-06T04:37:29.792052+0000","last_clean":"2023-10-06T04:37:29.792052+0000","last_became_active":"2023-10-06T04:37:29.788887+0000","last_became_peered":"2023-10-06T04:37:29.788887+0000","last_unstale":"2023-10-06T04:37:29.792052+0000","last_undegraded":"2023-10-06T04:37:29.792052+0000","last_fullsized":"2023-10-06T04:37:29.792052+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:59.689245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"38'9","reported_seq":24,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.786915+0000","last_change":"2023-10-06T04:37:17.549931+0000","last_active":"2023-10-06T04:37:29.786915+0000","last_peered":"2023-10-06T04:37:29.786915+0000","last_clean":"2023-10-06T04:37:29.786915+0000","last_became_active":"2023-10-06T04:37:17.549668+0000","last_became_peered":"2023-10-06T04:37:17.549668+0000","last_unstale":"2023-10-06T04:37:29.786915+0000","last_undegraded":"2023-10-06T04:37:29.786915+0000","last_fullsized":"2023-10-06T04:37:29.786915+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:27.083777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"39'3","reported_seq":19,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.780050+0000","last_change":"2023-10-06T04:37:16.546111+0000","last_active":"2023-10-06T04:37:29.780050+0000","last_peered":"2023-10-06T04:37:29.780050+0000","last_clean":"2023-10-06T04:37:29.780050+0000","last_became_active":"2023-10-06T04:37:16.545811+0000","last_became_peered":"2023-10-06T04:37:16.545811+0000","last_unstale":"2023-10-06T04:37:29.780050+0000","last_undegraded":"2023-10-06T04:37:29.780050+0000","last_fullsized":"2023-10-06T04:37:29.780050+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:30.574778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.789781+0000","last_change":"2023-10-06T04:37:29.787484+0000","last_active":"2023-10-06T04:37:29.789781+0000","last_peered":"2023-10-06T04:37:29.789781+0000","last_clean":"2023-10-06T04:37:29.789781+0000","last_became_active":"2023-10-06T04:37:29.787194+0000","last_became_peered":"2023-10-06T04:37:29.787194+0000","last_unstale":"2023-10-06T04:37:29.789781+0000","last_undegraded":"2023-10-06T04:37:29.789781+0000","last_fullsized":"2023-10-06T04:37:29.789781+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:28.390740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"38'15","reported_seq":30,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.779875+0000","last_change":"2023-10-06T04:37:17.546138+0000","last_active":"2023-10-06T04:37:29.779875+0000","last_peered":"2023-10-06T04:37:29.779875+0000","last_clean":"2023-10-06T04:37:29.779875+0000","last_became_active":"2023-10-06T04:37:17.545845+0000","last_became_peered":"2023-10-06T04:37:17.545845+0000","last_unstale":"2023-10-06T04:37:29.779875+0000","last_undegraded":"2023-10-06T04:37:29.779875+0000","last_fullsized":"2023-10-06T04:37:29.779875+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:25.707658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"39'3","reported_seq":19,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.782592+0000","last_change":"2023-10-06T04:37:16.545947+0000","last_active":"2023-10-06T04:37:29.782592+0000","last_peered":"2023-10-06T04:37:29.782592+0000","last_clean":"2023-10-06T04:37:29.782592+0000","last_became_active":"2023-10-06T04:37:16.545700+0000","last_became_peered":"2023-10-06T04:37:16.545700+0000","last_unstale":"2023-10-06T04:37:29.782592+0000","last_undegraded":"2023-10-06T04:37:29.782592+0000","last_fullsized":"2023-10-06T04:37:29.782592+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:56.062450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.793343+0000","last_change":"2023-10-06T04:37:29.788067+0000","last_active":"2023-10-06T04:37:29.793343+0000","last_peered":"2023-10-06T04:37:29.793343+0000","last_clean":"2023-10-06T04:37:29.793343+0000","last_became_active":"2023-10-06T04:37:29.787806+0000","last_became_peered":"2023-10-06T04:37:29.787806+0000","last_unstale":"2023-10-06T04:37:29.793343+0000","last_undegraded":"2023-10-06T04:37:29.793343+0000","last_fullsized":"2023-10-06T04:37:29.793343+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:01.927910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"38'7","reported_seq":23,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.778844+0000","last_change":"2023-10-06T04:37:17.543400+0000","last_active":"2023-10-06T04:37:29.778844+0000","last_peered":"2023-10-06T04:37:29.778844+0000","last_clean":"2023-10-06T04:37:29.778844+0000","last_became_active":"2023-10-06T04:37:17.543132+0000","last_became_peered":"2023-10-06T04:37:17.543132+0000","last_unstale":"2023-10-06T04:37:29.778844+0000","last_undegraded":"2023-10-06T04:37:29.778844+0000","last_fullsized":"2023-10-06T04:37:29.778844+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:50:28.268338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"37'1","reported_seq":18,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.785328+0000","last_change":"2023-10-06T04:37:16.541989+0000","last_active":"2023-10-06T04:37:29.785328+0000","last_peered":"2023-10-06T04:37:29.785328+0000","last_clean":"2023-10-06T04:37:29.785328+0000","last_became_active":"2023-10-06T04:37:16.541684+0000","last_became_peered":"2023-10-06T04:37:16.541684+0000","last_unstale":"2023-10-06T04:37:29.785328+0000","last_undegraded":"2023-10-06T04:37:29.785328+0000","last_fullsized":"2023-10-06T04:37:29.785328+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:13.019515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.793832+0000","last_change":"2023-10-06T04:37:29.792181+0000","last_active":"2023-10-06T04:37:29.793832+0000","last_peered":"2023-10-06T04:37:29.793832+0000","last_clean":"2023-10-06T04:37:29.793832+0000","last_became_active":"2023-10-06T04:37:29.791916+0000","last_became_peered":"2023-10-06T04:37:29.791916+0000","last_unstale":"2023-10-06T04:37:29.793832+0000","last_undegraded":"2023-10-06T04:37:29.793832+0000","last_fullsized":"2023-10-06T04:37:29.793832+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:07.671768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"38'8","reported_seq":23,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.781402+0000","last_change":"2023-10-06T04:37:17.546677+0000","last_active":"2023-10-06T04:37:29.781402+0000","last_peered":"2023-10-06T04:37:29.781402+0000","last_clean":"2023-10-06T04:37:29.781402+0000","last_became_active":"2023-10-06T04:37:17.546151+0000","last_became_peered":"2023-10-06T04:37:17.546151+0000","last_unstale":"2023-10-06T04:37:29.781402+0000","last_undegraded":"2023-10-06T04:37:29.781402+0000","last_fullsized":"2023-10-06T04:37:29.781402+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:16.140442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"37'1","reported_seq":18,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.779046+0000","last_change":"2023-10-06T04:37:16.545939+0000","last_active":"2023-10-06T04:37:29.779046+0000","last_peered":"2023-10-06T04:37:29.779046+0000","last_clean":"2023-10-06T04:37:29.779046+0000","last_became_active":"2023-10-06T04:37:16.545722+0000","last_became_peered":"2023-10-06T04:37:16.545722+0000","last_unstale":"2023-10-06T04:37:29.779046+0000","last_undegraded":"2023-10-06T04:37:29.779046+0000","last_fullsized":"2023-10-06T04:37:29.779046+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:22.842860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.793574+0000","last_change":"2023-10-06T04:37:29.788770+0000","last_active":"2023-10-06T04:37:29.793574+0000","last_peered":"2023-10-06T04:37:29.793574+0000","last_clean":"2023-10-06T04:37:29.793574+0000","last_became_active":"2023-10-06T04:37:29.788517+0000","last_became_peered":"2023-10-06T04:37:29.788517+0000","last_unstale":"2023-10-06T04:37:29.793574+0000","last_undegraded":"2023-10-06T04:37:29.793574+0000","last_fullsized":"2023-10-06T04:37:29.793574+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:12.285051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"38'8","reported_seq":23,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.781193+0000","last_change":"2023-10-06T04:37:17.547055+0000","last_active":"2023-10-06T04:37:29.781193+0000","last_peered":"2023-10-06T04:37:29.781193+0000","last_clean":"2023-10-06T04:37:29.781193+0000","last_became_active":"2023-10-06T04:37:17.546777+0000","last_became_peered":"2023-10-06T04:37:17.546777+0000","last_unstale":"2023-10-06T04:37:29.781193+0000","last_undegraded":"2023-10-06T04:37:29.781193+0000","last_fullsized":"2023-10-06T04:37:29.781193+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:28:51.824521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.784737+0000","last_change":"2023-10-06T04:37:16.544251+0000","last_active":"2023-10-06T04:37:29.784737+0000","last_peered":"2023-10-06T04:37:29.784737+0000","last_clean":"2023-10-06T04:37:29.784737+0000","last_became_active":"2023-10-06T04:37:16.543853+0000","last_became_peered":"2023-10-06T04:37:16.543853+0000","last_unstale":"2023-10-06T04:37:29.784737+0000","last_undegraded":"2023-10-06T04:37:29.784737+0000","last_fullsized":"2023-10-06T04:37:29.784737+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:00.217384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.791942+0000","last_change":"2023-10-06T04:37:29.787068+0000","last_active":"2023-10-06T04:37:29.791942+0000","last_peered":"2023-10-06T04:37:29.791942+0000","last_clean":"2023-10-06T04:37:29.791942+0000","last_became_active":"2023-10-06T04:37:29.786767+0000","last_became_peered":"2023-10-06T04:37:29.786767+0000","last_unstale":"2023-10-06T04:37:29.791942+0000","last_undegraded":"2023-10-06T04:37:29.791942+0000","last_fullsized":"2023-10-06T04:37:29.791942+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:38:07.292570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"38'10","reported_seq":25,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.781659+0000","last_change":"2023-10-06T04:37:17.550653+0000","last_active":"2023-10-06T04:37:29.781659+0000","last_peered":"2023-10-06T04:37:29.781659+0000","last_clean":"2023-10-06T04:37:29.781659+0000","last_became_active":"2023-10-06T04:37:17.550308+0000","last_became_peered":"2023-10-06T04:37:17.550308+0000","last_unstale":"2023-10-06T04:37:29.781659+0000","last_undegraded":"2023-10-06T04:37:29.781659+0000","last_fullsized":"2023-10-06T04:37:29.781659+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:06:24.079323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.781296+0000","last_change":"2023-10-06T04:37:16.539539+0000","last_active":"2023-10-06T04:37:29.781296+0000","last_peered":"2023-10-06T04:37:29.781296+0000","last_clean":"2023-10-06T04:37:29.781296+0000","last_became_active":"2023-10-06T04:37:16.536276+0000","last_became_peered":"2023-10-06T04:37:16.536276+0000","last_unstale":"2023-10-06T04:37:29.781296+0000","last_undegraded":"2023-10-06T04:37:29.781296+0000","last_fullsized":"2023-10-06T04:37:29.781296+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:23.725665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.793113+0000","last_change":"2023-10-06T04:37:29.790898+0000","last_active":"2023-10-06T04:37:29.793113+0000","last_peered":"2023-10-06T04:37:29.793113+0000","last_clean":"2023-10-06T04:37:29.793113+0000","last_became_active":"2023-10-06T04:37:29.790621+0000","last_became_peered":"2023-10-06T04:37:29.790621+0000","last_unstale":"2023-10-06T04:37:29.793113+0000","last_undegraded":"2023-10-06T04:37:29.793113+0000","last_fullsized":"2023-10-06T04:37:29.793113+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:12.285051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"38'10","reported_seq":26,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.779416+0000","last_change":"2023-10-06T04:37:17.547330+0000","last_active":"2023-10-06T04:37:29.779416+0000","last_peered":"2023-10-06T04:37:29.779416+0000","last_clean":"2023-10-06T04:37:29.779416+0000","last_became_active":"2023-10-06T04:37:17.547088+0000","last_became_peered":"2023-10-06T04:37:17.547088+0000","last_unstale":"2023-10-06T04:37:29.779416+0000","last_undegraded":"2023-10-06T04:37:29.779416+0000","last_fullsized":"2023-10-06T04:37:29.779416+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:12.970309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.779568+0000","last_change":"2023-10-06T04:37:16.543071+0000","last_active":"2023-10-06T04:37:29.779568+0000","last_peered":"2023-10-06T04:37:29.779568+0000","last_clean":"2023-10-06T04:37:29.779568+0000","last_became_active":"2023-10-06T04:37:16.542755+0000","last_became_peered":"2023-10-06T04:37:16.542755+0000","last_unstale":"2023-10-06T04:37:29.779568+0000","last_undegraded":"2023-10-06T04:37:29.779568+0000","last_fullsized":"2023-10-06T04:37:29.779568+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:03.969778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.790082+0000","last_change":"2023-10-06T04:37:29.788015+0000","last_active":"2023-10-06T04:37:29.790082+0000","last_peered":"2023-10-06T04:37:29.790082+0000","last_clean":"2023-10-06T04:37:29.790082+0000","last_became_active":"2023-10-06T04:37:29.787731+0000","last_became_peered":"2023-10-06T04:37:29.787731+0000","last_unstale":"2023-10-06T04:37:29.790082+0000","last_undegraded":"2023-10-06T04:37:29.790082+0000","last_fullsized":"2023-10-06T04:37:29.790082+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:51.489837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"38'9","reported_seq":24,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.783325+0000","last_change":"2023-10-06T04:37:17.546184+0000","last_active":"2023-10-06T04:37:29.783325+0000","last_peered":"2023-10-06T04:37:29.783325+0000","last_clean":"2023-10-06T04:37:29.783325+0000","last_became_active":"2023-10-06T04:37:17.545899+0000","last_became_peered":"2023-10-06T04:37:17.545899+0000","last_unstale":"2023-10-06T04:37:29.783325+0000","last_undegraded":"2023-10-06T04:37:29.783325+0000","last_fullsized":"2023-10-06T04:37:29.783325+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:35.648661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.788254+0000","last_change":"2023-10-06T04:37:16.539739+0000","last_active":"2023-10-06T04:37:29.788254+0000","last_peered":"2023-10-06T04:37:29.788254+0000","last_clean":"2023-10-06T04:37:29.788254+0000","last_became_active":"2023-10-06T04:37:16.539470+0000","last_became_peered":"2023-10-06T04:37:16.539470+0000","last_unstale":"2023-10-06T04:37:29.788254+0000","last_undegraded":"2023-10-06T04:37:29.788254+0000","last_fullsized":"2023-10-06T04:37:29.788254+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:23.078870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.790047+0000","last_change":"2023-10-06T04:37:29.787613+0000","last_active":"2023-10-06T04:37:29.790047+0000","last_peered":"2023-10-06T04:37:29.790047+0000","last_clean":"2023-10-06T04:37:29.790047+0000","last_became_active":"2023-10-06T04:37:29.787365+0000","last_became_peered":"2023-10-06T04:37:29.787365+0000","last_unstale":"2023-10-06T04:37:29.790047+0000","last_undegraded":"2023-10-06T04:37:29.790047+0000","last_fullsized":"2023-10-06T04:37:29.790047+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:25.262954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"38'11","reported_seq":27,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.784851+0000","last_change":"2023-10-06T04:37:17.543287+0000","last_active":"2023-10-06T04:37:29.784851+0000","last_peered":"2023-10-06T04:37:29.784851+0000","last_clean":"2023-10-06T04:37:29.784851+0000","last_became_active":"2023-10-06T04:37:17.543018+0000","last_became_peered":"2023-10-06T04:37:17.543018+0000","last_unstale":"2023-10-06T04:37:29.784851+0000","last_undegraded":"2023-10-06T04:37:29.784851+0000","last_fullsized":"2023-10-06T04:37:29.784851+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:18.119835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"39'5","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.783136+0000","last_change":"2023-10-06T04:37:16.545863+0000","last_active":"2023-10-06T04:37:29.783136+0000","last_peered":"2023-10-06T04:37:29.783136+0000","last_clean":"2023-10-06T04:37:29.783136+0000","last_became_active":"2023-10-06T04:37:16.545563+0000","last_became_peered":"2023-10-06T04:37:16.545563+0000","last_unstale":"2023-10-06T04:37:29.783136+0000","last_undegraded":"2023-10-06T04:37:29.783136+0000","last_fullsized":"2023-10-06T04:37:29.783136+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:36.947789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.792062+0000","last_change":"2023-10-06T04:37:29.789628+0000","last_active":"2023-10-06T04:37:29.792062+0000","last_peered":"2023-10-06T04:37:29.792062+0000","last_clean":"2023-10-06T04:37:29.792062+0000","last_became_active":"2023-10-06T04:37:29.789314+0000","last_became_peered":"2023-10-06T04:37:29.789314+0000","last_unstale":"2023-10-06T04:37:29.792062+0000","last_undegraded":"2023-10-06T04:37:29.792062+0000","last_fullsized":"2023-10-06T04:37:29.792062+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:38:07.292570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"38'6","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.782938+0000","last_change":"2023-10-06T04:37:17.541763+0000","last_active":"2023-10-06T04:37:29.782938+0000","last_peered":"2023-10-06T04:37:29.782938+0000","last_clean":"2023-10-06T04:37:29.782938+0000","last_became_active":"2023-10-06T04:37:17.541287+0000","last_became_peered":"2023-10-06T04:37:17.541287+0000","last_unstale":"2023-10-06T04:37:29.782938+0000","last_undegraded":"2023-10-06T04:37:29.782938+0000","last_fullsized":"2023-10-06T04:37:29.782938+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:34.429052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"39'23","reported_seq":38,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.777114+0000","last_change":"2023-10-06T04:37:16.538841+0000","last_active":"2023-10-06T04:37:29.777114+0000","last_peered":"2023-10-06T04:37:29.777114+0000","last_clean":"2023-10-06T04:37:29.777114+0000","last_became_active":"2023-10-06T04:37:16.538555+0000","last_became_peered":"2023-10-06T04:37:16.538555+0000","last_unstale":"2023-10-06T04:37:29.777114+0000","last_undegraded":"2023-10-06T04:37:29.777114+0000","last_fullsized":"2023-10-06T04:37:29.777114+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:01:56.504476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.792260+0000","last_change":"2023-10-06T04:37:29.788972+0000","last_active":"2023-10-06T04:37:29.792260+0000","last_peered":"2023-10-06T04:37:29.792260+0000","last_clean":"2023-10-06T04:37:29.792260+0000","last_became_active":"2023-10-06T04:37:29.787754+0000","last_became_peered":"2023-10-06T04:37:29.787754+0000","last_unstale":"2023-10-06T04:37:29.792260+0000","last_undegraded":"2023-10-06T04:37:29.792260+0000","last_fullsized":"2023-10-06T04:37:29.792260+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:59.689245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"38'10","reported_seq":25,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.782341+0000","last_change":"2023-10-06T04:37:17.554238+0000","last_active":"2023-10-06T04:37:29.782341+0000","last_peered":"2023-10-06T04:37:29.782341+0000","last_clean":"2023-10-06T04:37:29.782341+0000","last_became_active":"2023-10-06T04:37:17.553995+0000","last_became_peered":"2023-10-06T04:37:17.553995+0000","last_unstale":"2023-10-06T04:37:29.782341+0000","last_undegraded":"2023-10-06T04:37:29.782341+0000","last_fullsized":"2023-10-06T04:37:29.782341+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:57.066657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"39'5","reported_seq":22,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.785495+0000","last_change":"2023-10-06T04:37:16.545424+0000","last_active":"2023-10-06T04:37:29.785495+0000","last_peered":"2023-10-06T04:37:29.785495+0000","last_clean":"2023-10-06T04:37:29.785495+0000","last_became_active":"2023-10-06T04:37:16.545158+0000","last_became_peered":"2023-10-06T04:37:16.545158+0000","last_unstale":"2023-10-06T04:37:29.785495+0000","last_undegraded":"2023-10-06T04:37:29.785495+0000","last_fullsized":"2023-10-06T04:37:29.785495+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:03.969778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.796002+0000","last_change":"2023-10-06T04:37:29.792101+0000","last_active":"2023-10-06T04:37:29.796002+0000","last_peered":"2023-10-06T04:37:29.796002+0000","last_clean":"2023-10-06T04:37:29.796002+0000","last_became_active":"2023-10-06T04:37:29.791663+0000","last_became_peered":"2023-10-06T04:37:29.791663+0000","last_unstale":"2023-10-06T04:37:29.796002+0000","last_undegraded":"2023-10-06T04:37:29.796002+0000","last_fullsized":"2023-10-06T04:37:29.796002+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:40.394210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"38'15","reported_seq":30,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.781518+0000","last_change":"2023-10-06T04:37:17.543599+0000","last_active":"2023-10-06T04:37:29.781518+0000","last_peered":"2023-10-06T04:37:29.781518+0000","last_clean":"2023-10-06T04:37:29.781518+0000","last_became_active":"2023-10-06T04:37:17.543271+0000","last_became_peered":"2023-10-06T04:37:17.543271+0000","last_unstale":"2023-10-06T04:37:29.781518+0000","last_undegraded":"2023-10-06T04:37:29.781518+0000","last_fullsized":"2023-10-06T04:37:29.781518+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:37.661915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.782524+0000","last_change":"2023-10-06T04:37:16.541456+0000","last_active":"2023-10-06T04:37:29.782524+0000","last_peered":"2023-10-06T04:37:29.782524+0000","last_clean":"2023-10-06T04:37:29.782524+0000","last_became_active":"2023-10-06T04:37:16.541189+0000","last_became_peered":"2023-10-06T04:37:16.541189+0000","last_unstale":"2023-10-06T04:37:29.782524+0000","last_undegraded":"2023-10-06T04:37:29.782524+0000","last_fullsized":"2023-10-06T04:37:29.782524+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:23.078870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.793809+0000","last_change":"2023-10-06T04:37:29.793261+0000","last_active":"2023-10-06T04:37:29.793809+0000","last_peered":"2023-10-06T04:37:29.793809+0000","last_clean":"2023-10-06T04:37:29.793809+0000","last_became_active":"2023-10-06T04:37:29.793030+0000","last_became_peered":"2023-10-06T04:37:29.793030+0000","last_unstale":"2023-10-06T04:37:29.793809+0000","last_undegraded":"2023-10-06T04:37:29.793809+0000","last_fullsized":"2023-10-06T04:37:29.793809+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:48.194911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"38'6","reported_seq":22,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.783960+0000","last_change":"2023-10-06T04:37:17.541658+0000","last_active":"2023-10-06T04:37:29.783960+0000","last_peered":"2023-10-06T04:37:29.783960+0000","last_clean":"2023-10-06T04:37:29.783960+0000","last_became_active":"2023-10-06T04:37:17.541349+0000","last_became_peered":"2023-10-06T04:37:17.541349+0000","last_unstale":"2023-10-06T04:37:29.783960+0000","last_undegraded":"2023-10-06T04:37:29.783960+0000","last_fullsized":"2023-10-06T04:37:29.783960+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:56.687459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.784309+0000","last_change":"2023-10-06T04:37:16.545596+0000","last_active":"2023-10-06T04:37:29.784309+0000","last_peered":"2023-10-06T04:37:29.784309+0000","last_clean":"2023-10-06T04:37:29.784309+0000","last_became_active":"2023-10-06T04:37:16.545334+0000","last_became_peered":"2023-10-06T04:37:16.545334+0000","last_unstale":"2023-10-06T04:37:29.784309+0000","last_undegraded":"2023-10-06T04:37:29.784309+0000","last_fullsized":"2023-10-06T04:37:29.784309+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:26.079570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.791962+0000","last_change":"2023-10-06T04:37:29.787081+0000","last_active":"2023-10-06T04:37:29.791962+0000","last_peered":"2023-10-06T04:37:29.791962+0000","last_clean":"2023-10-06T04:37:29.791962+0000","last_became_active":"2023-10-06T04:37:29.786749+0000","last_became_peered":"2023-10-06T04:37:29.786749+0000","last_unstale":"2023-10-06T04:37:29.791962+0000","last_undegraded":"2023-10-06T04:37:29.791962+0000","last_fullsized":"2023-10-06T04:37:29.791962+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:19:45.702967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"38'6","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.782288+0000","last_change":"2023-10-06T04:37:17.552402+0000","last_active":"2023-10-06T04:37:29.782288+0000","last_peered":"2023-10-06T04:37:29.782288+0000","last_clean":"2023-10-06T04:37:29.782288+0000","last_became_active":"2023-10-06T04:37:17.552167+0000","last_became_peered":"2023-10-06T04:37:17.552167+0000","last_unstale":"2023-10-06T04:37:29.782288+0000","last_undegraded":"2023-10-06T04:37:29.782288+0000","last_fullsized":"2023-10-06T04:37:29.782288+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:14.023722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"39'15","reported_seq":31,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.781387+0000","last_change":"2023-10-06T04:37:16.545180+0000","last_active":"2023-10-06T04:37:29.781387+0000","last_peered":"2023-10-06T04:37:29.781387+0000","last_clean":"2023-10-06T04:37:29.781387+0000","last_became_active":"2023-10-06T04:37:16.544707+0000","last_became_peered":"2023-10-06T04:37:16.544707+0000","last_unstale":"2023-10-06T04:37:29.781387+0000","last_undegraded":"2023-10-06T04:37:29.781387+0000","last_fullsized":"2023-10-06T04:37:29.781387+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:49.969750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.791546+0000","last_change":"2023-10-06T04:37:29.787061+0000","last_active":"2023-10-06T04:37:29.791546+0000","last_peered":"2023-10-06T04:37:29.791546+0000","last_clean":"2023-10-06T04:37:29.791546+0000","last_became_active":"2023-10-06T04:37:29.786825+0000","last_became_peered":"2023-10-06T04:37:29.786825+0000","last_unstale":"2023-10-06T04:37:29.791546+0000","last_undegraded":"2023-10-06T04:37:29.791546+0000","last_fullsized":"2023-10-06T04:37:29.791546+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:32:57.793172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"38'5","reported_seq":19,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.777135+0000","last_change":"2023-10-06T04:37:17.545469+0000","last_active":"2023-10-06T04:37:29.777135+0000","last_peered":"2023-10-06T04:37:29.777135+0000","last_clean":"2023-10-06T04:37:29.777135+0000","last_became_active":"2023-10-06T04:37:17.545212+0000","last_became_peered":"2023-10-06T04:37:17.545212+0000","last_unstale":"2023-10-06T04:37:29.777135+0000","last_undegraded":"2023-10-06T04:37:29.777135+0000","last_fullsized":"2023-10-06T04:37:29.777135+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:41.211245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"39'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.777273+0000","last_change":"2023-10-06T04:37:16.537956+0000","last_active":"2023-10-06T04:37:29.777273+0000","last_peered":"2023-10-06T04:37:29.777273+0000","last_clean":"2023-10-06T04:37:29.777273+0000","last_became_active":"2023-10-06T04:37:16.537733+0000","last_became_peered":"2023-10-06T04:37:16.537733+0000","last_unstale":"2023-10-06T04:37:29.777273+0000","last_undegraded":"2023-10-06T04:37:29.777273+0000","last_fullsized":"2023-10-06T04:37:29.777273+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:26:53.482793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.793500+0000","last_change":"2023-10-06T04:37:29.792996+0000","last_active":"2023-10-06T04:37:29.793500+0000","last_peered":"2023-10-06T04:37:29.793500+0000","last_clean":"2023-10-06T04:37:29.793500+0000","last_became_active":"2023-10-06T04:37:29.792730+0000","last_became_peered":"2023-10-06T04:37:29.792730+0000","last_unstale":"2023-10-06T04:37:29.793500+0000","last_undegraded":"2023-10-06T04:37:29.793500+0000","last_fullsized":"2023-10-06T04:37:29.793500+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:20.831560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"38'9","reported_seq":24,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.788214+0000","last_change":"2023-10-06T04:37:17.540242+0000","last_active":"2023-10-06T04:37:29.788214+0000","last_peered":"2023-10-06T04:37:29.788214+0000","last_clean":"2023-10-06T04:37:29.788214+0000","last_became_active":"2023-10-06T04:37:17.539986+0000","last_became_peered":"2023-10-06T04:37:17.539986+0000","last_unstale":"2023-10-06T04:37:29.788214+0000","last_undegraded":"2023-10-06T04:37:29.788214+0000","last_fullsized":"2023-10-06T04:37:29.788214+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:50:28.268338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"39'3","reported_seq":20,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.779307+0000","last_change":"2023-10-06T04:37:16.541934+0000","last_active":"2023-10-06T04:37:29.779307+0000","last_peered":"2023-10-06T04:37:29.779307+0000","last_clean":"2023-10-06T04:37:29.779307+0000","last_became_active":"2023-10-06T04:37:16.539725+0000","last_became_peered":"2023-10-06T04:37:16.539725+0000","last_unstale":"2023-10-06T04:37:29.779307+0000","last_undegraded":"2023-10-06T04:37:29.779307+0000","last_fullsized":"2023-10-06T04:37:29.779307+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:44:55.156828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.792134+0000","last_change":"2023-10-06T04:37:29.791370+0000","last_active":"2023-10-06T04:37:29.792134+0000","last_peered":"2023-10-06T04:37:29.792134+0000","last_clean":"2023-10-06T04:37:29.792134+0000","last_became_active":"2023-10-06T04:37:29.791083+0000","last_became_peered":"2023-10-06T04:37:29.791083+0000","last_unstale":"2023-10-06T04:37:29.792134+0000","last_undegraded":"2023-10-06T04:37:29.792134+0000","last_fullsized":"2023-10-06T04:37:29.792134+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:13.574637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"38'6","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.782490+0000","last_change":"2023-10-06T04:37:17.550239+0000","last_active":"2023-10-06T04:37:29.782490+0000","last_peered":"2023-10-06T04:37:29.782490+0000","last_clean":"2023-10-06T04:37:29.782490+0000","last_became_active":"2023-10-06T04:37:17.549997+0000","last_became_peered":"2023-10-06T04:37:17.549997+0000","last_unstale":"2023-10-06T04:37:29.782490+0000","last_undegraded":"2023-10-06T04:37:29.782490+0000","last_fullsized":"2023-10-06T04:37:29.782490+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:24.083076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"39'2","reported_seq":18,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.785847+0000","last_change":"2023-10-06T04:37:16.544014+0000","last_active":"2023-10-06T04:37:29.785847+0000","last_peered":"2023-10-06T04:37:29.785847+0000","last_clean":"2023-10-06T04:37:29.785847+0000","last_became_active":"2023-10-06T04:37:16.543718+0000","last_became_peered":"2023-10-06T04:37:16.543718+0000","last_unstale":"2023-10-06T04:37:29.785847+0000","last_undegraded":"2023-10-06T04:37:29.785847+0000","last_fullsized":"2023-10-06T04:37:29.785847+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:39.796065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.790074+0000","last_change":"2023-10-06T04:37:29.787423+0000","last_active":"2023-10-06T04:37:29.790074+0000","last_peered":"2023-10-06T04:37:29.790074+0000","last_clean":"2023-10-06T04:37:29.790074+0000","last_became_active":"2023-10-06T04:37:29.787124+0000","last_became_peered":"2023-10-06T04:37:29.787124+0000","last_unstale":"2023-10-06T04:37:29.790074+0000","last_undegraded":"2023-10-06T04:37:29.790074+0000","last_fullsized":"2023-10-06T04:37:29.790074+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:23.375847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"38'7","reported_seq":22,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.783203+0000","last_change":"2023-10-06T04:37:17.551493+0000","last_active":"2023-10-06T04:37:29.783203+0000","last_peered":"2023-10-06T04:37:29.783203+0000","last_clean":"2023-10-06T04:37:29.783203+0000","last_became_active":"2023-10-06T04:37:17.550988+0000","last_became_peered":"2023-10-06T04:37:17.550988+0000","last_unstale":"2023-10-06T04:37:29.783203+0000","last_undegraded":"2023-10-06T04:37:29.783203+0000","last_fullsized":"2023-10-06T04:37:29.783203+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:33.731628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.784999+0000","last_change":"2023-10-06T04:37:16.537845+0000","last_active":"2023-10-06T04:37:29.784999+0000","last_peered":"2023-10-06T04:37:29.784999+0000","last_clean":"2023-10-06T04:37:29.784999+0000","last_became_active":"2023-10-06T04:37:16.537568+0000","last_became_peered":"2023-10-06T04:37:16.537568+0000","last_unstale":"2023-10-06T04:37:29.784999+0000","last_undegraded":"2023-10-06T04:37:29.784999+0000","last_fullsized":"2023-10-06T04:37:29.784999+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:43.624572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.791656+0000","last_change":"2023-10-06T04:37:29.789170+0000","last_active":"2023-10-06T04:37:29.791656+0000","last_peered":"2023-10-06T04:37:29.791656+0000","last_clean":"2023-10-06T04:37:29.791656+0000","last_became_active":"2023-10-06T04:37:29.788907+0000","last_became_peered":"2023-10-06T04:37:29.788907+0000","last_unstale":"2023-10-06T04:37:29.791656+0000","last_undegraded":"2023-10-06T04:37:29.791656+0000","last_fullsized":"2023-10-06T04:37:29.791656+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:50:40.518636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"38'5","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.784475+0000","last_change":"2023-10-06T04:37:17.538502+0000","last_active":"2023-10-06T04:37:29.784475+0000","last_peered":"2023-10-06T04:37:29.784475+0000","last_clean":"2023-10-06T04:37:29.784475+0000","last_became_active":"2023-10-06T04:37:17.538215+0000","last_became_peered":"2023-10-06T04:37:17.538215+0000","last_unstale":"2023-10-06T04:37:29.784475+0000","last_undegraded":"2023-10-06T04:37:29.784475+0000","last_fullsized":"2023-10-06T04:37:29.784475+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:45.225371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"39'4","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.785576+0000","last_change":"2023-10-06T04:37:16.540351+0000","last_active":"2023-10-06T04:37:29.785576+0000","last_peered":"2023-10-06T04:37:29.785576+0000","last_clean":"2023-10-06T04:37:29.785576+0000","last_became_active":"2023-10-06T04:37:16.539257+0000","last_became_peered":"2023-10-06T04:37:16.539257+0000","last_unstale":"2023-10-06T04:37:29.785576+0000","last_undegraded":"2023-10-06T04:37:29.785576+0000","last_fullsized":"2023-10-06T04:37:29.785576+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:32:33.424846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.801679+0000","last_change":"2023-10-06T04:37:29.794254+0000","last_active":"2023-10-06T04:37:29.801679+0000","last_peered":"2023-10-06T04:37:29.801679+0000","last_clean":"2023-10-06T04:37:29.801679+0000","last_became_active":"2023-10-06T04:37:29.793944+0000","last_became_peered":"2023-10-06T04:37:29.793944+0000","last_unstale":"2023-10-06T04:37:29.801679+0000","last_undegraded":"2023-10-06T04:37:29.801679+0000","last_fullsized":"2023-10-06T04:37:29.801679+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:04.824490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"38'8","reported_seq":23,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.780619+0000","last_change":"2023-10-06T04:37:17.546443+0000","last_active":"2023-10-06T04:37:29.780619+0000","last_peered":"2023-10-06T04:37:29.780619+0000","last_clean":"2023-10-06T04:37:29.780619+0000","last_became_active":"2023-10-06T04:37:17.546233+0000","last_became_peered":"2023-10-06T04:37:17.546233+0000","last_unstale":"2023-10-06T04:37:29.780619+0000","last_undegraded":"2023-10-06T04:37:29.780619+0000","last_fullsized":"2023-10-06T04:37:29.780619+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:41.211245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.784116+0000","last_change":"2023-10-06T04:37:16.545188+0000","last_active":"2023-10-06T04:37:29.784116+0000","last_peered":"2023-10-06T04:37:29.784116+0000","last_clean":"2023-10-06T04:37:29.784116+0000","last_became_active":"2023-10-06T04:37:16.544735+0000","last_became_peered":"2023-10-06T04:37:16.544735+0000","last_unstale":"2023-10-06T04:37:29.784116+0000","last_undegraded":"2023-10-06T04:37:29.784116+0000","last_fullsized":"2023-10-06T04:37:29.784116+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:56.062450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.791763+0000","last_change":"2023-10-06T04:37:29.789831+0000","last_active":"2023-10-06T04:37:29.791763+0000","last_peered":"2023-10-06T04:37:29.791763+0000","last_clean":"2023-10-06T04:37:29.791763+0000","last_became_active":"2023-10-06T04:37:29.789560+0000","last_became_peered":"2023-10-06T04:37:29.789560+0000","last_unstale":"2023-10-06T04:37:29.791763+0000","last_undegraded":"2023-10-06T04:37:29.791763+0000","last_fullsized":"2023-10-06T04:37:29.791763+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:04:11.178752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"38'9","reported_seq":23,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.776885+0000","last_change":"2023-10-06T04:37:17.544085+0000","last_active":"2023-10-06T04:37:29.776885+0000","last_peered":"2023-10-06T04:37:29.776885+0000","last_clean":"2023-10-06T04:37:29.776885+0000","last_became_active":"2023-10-06T04:37:17.543802+0000","last_became_peered":"2023-10-06T04:37:17.543802+0000","last_unstale":"2023-10-06T04:37:29.776885+0000","last_undegraded":"2023-10-06T04:37:29.776885+0000","last_fullsized":"2023-10-06T04:37:29.776885+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:31.578985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.781071+0000","last_change":"2023-10-06T04:37:16.539674+0000","last_active":"2023-10-06T04:37:29.781071+0000","last_peered":"2023-10-06T04:37:29.781071+0000","last_clean":"2023-10-06T04:37:29.781071+0000","last_became_active":"2023-10-06T04:37:16.539399+0000","last_became_peered":"2023-10-06T04:37:16.539399+0000","last_unstale":"2023-10-06T04:37:29.781071+0000","last_undegraded":"2023-10-06T04:37:29.781071+0000","last_fullsized":"2023-10-06T04:37:29.781071+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:36.947789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.792369+0000","last_change":"2023-10-06T04:37:29.788406+0000","last_active":"2023-10-06T04:37:29.792369+0000","last_peered":"2023-10-06T04:37:29.792369+0000","last_clean":"2023-10-06T04:37:29.792369+0000","last_became_active":"2023-10-06T04:37:29.788015+0000","last_became_peered":"2023-10-06T04:37:29.788015+0000","last_unstale":"2023-10-06T04:37:29.792369+0000","last_undegraded":"2023-10-06T04:37:29.792369+0000","last_fullsized":"2023-10-06T04:37:29.792369+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:19:45.702967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"38'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.781203+0000","last_change":"2023-10-06T04:37:17.536857+0000","last_active":"2023-10-06T04:37:29.781203+0000","last_peered":"2023-10-06T04:37:29.781203+0000","last_clean":"2023-10-06T04:37:29.781203+0000","last_became_active":"2023-10-06T04:37:17.536593+0000","last_became_peered":"2023-10-06T04:37:17.536593+0000","last_unstale":"2023-10-06T04:37:29.781203+0000","last_undegraded":"2023-10-06T04:37:29.781203+0000","last_fullsized":"2023-10-06T04:37:29.781203+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:37.253030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.781452+0000","last_change":"2023-10-06T04:37:16.541430+0000","last_active":"2023-10-06T04:37:29.781452+0000","last_peered":"2023-10-06T04:37:29.781452+0000","last_clean":"2023-10-06T04:37:29.781452+0000","last_became_active":"2023-10-06T04:37:16.541211+0000","last_became_peered":"2023-10-06T04:37:16.541211+0000","last_unstale":"2023-10-06T04:37:29.781452+0000","last_undegraded":"2023-10-06T04:37:29.781452+0000","last_fullsized":"2023-10-06T04:37:29.781452+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:15:48.328371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.792291+0000","last_change":"2023-10-06T04:37:29.787899+0000","last_active":"2023-10-06T04:37:29.792291+0000","last_peered":"2023-10-06T04:37:29.792291+0000","last_clean":"2023-10-06T04:37:29.792291+0000","last_became_active":"2023-10-06T04:37:29.787580+0000","last_became_peered":"2023-10-06T04:37:29.787580+0000","last_unstale":"2023-10-06T04:37:29.792291+0000","last_undegraded":"2023-10-06T04:37:29.792291+0000","last_fullsized":"2023-10-06T04:37:29.792291+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:00:47.460409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"38'7","reported_seq":23,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.785411+0000","last_change":"2023-10-06T04:37:17.541674+0000","last_active":"2023-10-06T04:37:29.785411+0000","last_peered":"2023-10-06T04:37:29.785411+0000","last_clean":"2023-10-06T04:37:29.785411+0000","last_became_active":"2023-10-06T04:37:17.541397+0000","last_became_peered":"2023-10-06T04:37:17.541397+0000","last_unstale":"2023-10-06T04:37:29.785411+0000","last_undegraded":"2023-10-06T04:37:29.785411+0000","last_fullsized":"2023-10-06T04:37:29.785411+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:19.011564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.778940+0000","last_change":"2023-10-06T04:37:16.539297+0000","last_active":"2023-10-06T04:37:29.778940+0000","last_peered":"2023-10-06T04:37:29.778940+0000","last_clean":"2023-10-06T04:37:29.778940+0000","last_became_active":"2023-10-06T04:37:16.538921+0000","last_became_peered":"2023-10-06T04:37:16.538921+0000","last_unstale":"2023-10-06T04:37:29.778940+0000","last_undegraded":"2023-10-06T04:37:29.778940+0000","last_fullsized":"2023-10-06T04:37:29.778940+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:26.079570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":37,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.778875+0000","last_change":"2023-10-06T04:36:11.192215+0000","last_active":"2023-10-06T04:37:29.778875+0000","last_peered":"2023-10-06T04:37:29.778875+0000","last_clean":"2023-10-06T04:37:29.778875+0000","last_became_active":"2023-10-06T04:36:11.191953+0000","last_became_peered":"2023-10-06T04:36:11.191953+0000","last_unstale":"2023-10-06T04:37:29.778875+0000","last_undegraded":"2023-10-06T04:37:29.778875+0000","last_fullsized":"2023-10-06T04:37:29.778875+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:37.026121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.801619+0000","last_change":"2023-10-06T04:37:29.793266+0000","last_active":"2023-10-06T04:37:29.801619+0000","last_peered":"2023-10-06T04:37:29.801619+0000","last_clean":"2023-10-06T04:37:29.801619+0000","last_became_active":"2023-10-06T04:37:29.792995+0000","last_became_peered":"2023-10-06T04:37:29.792995+0000","last_unstale":"2023-10-06T04:37:29.801619+0000","last_undegraded":"2023-10-06T04:37:29.801619+0000","last_fullsized":"2023-10-06T04:37:29.801619+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:11.339882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"38'8","reported_seq":24,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.784659+0000","last_change":"2023-10-06T04:37:17.536572+0000","last_active":"2023-10-06T04:37:29.784659+0000","last_peered":"2023-10-06T04:37:29.784659+0000","last_clean":"2023-10-06T04:37:29.784659+0000","last_became_active":"2023-10-06T04:37:17.536250+0000","last_became_peered":"2023-10-06T04:37:17.536250+0000","last_unstale":"2023-10-06T04:37:29.784659+0000","last_undegraded":"2023-10-06T04:37:29.784659+0000","last_fullsized":"2023-10-06T04:37:29.784659+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:16.140442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.782656+0000","last_change":"2023-10-06T04:37:16.542301+0000","last_active":"2023-10-06T04:37:29.782656+0000","last_peered":"2023-10-06T04:37:29.782656+0000","last_clean":"2023-10-06T04:37:29.782656+0000","last_became_active":"2023-10-06T04:37:16.541967+0000","last_became_peered":"2023-10-06T04:37:16.541967+0000","last_unstale":"2023-10-06T04:37:29.782656+0000","last_undegraded":"2023-10-06T04:37:29.782656+0000","last_fullsized":"2023-10-06T04:37:29.782656+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:24.703451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":34,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.785065+0000","last_change":"2023-10-06T04:36:11.184555+0000","last_active":"2023-10-06T04:37:29.785065+0000","last_peered":"2023-10-06T04:37:29.785065+0000","last_clean":"2023-10-06T04:37:29.785065+0000","last_became_active":"2023-10-06T04:36:11.184229+0000","last_became_peered":"2023-10-06T04:36:11.184229+0000","last_unstale":"2023-10-06T04:37:29.785065+0000","last_undegraded":"2023-10-06T04:37:29.785065+0000","last_fullsized":"2023-10-06T04:37:29.785065+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:19.938716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.785773+0000","last_change":"2023-10-06T04:37:29.783473+0000","last_active":"2023-10-06T04:37:29.785773+0000","last_peered":"2023-10-06T04:37:29.785773+0000","last_clean":"2023-10-06T04:37:29.785773+0000","last_became_active":"2023-10-06T04:37:29.783204+0000","last_became_peered":"2023-10-06T04:37:29.783204+0000","last_unstale":"2023-10-06T04:37:29.785773+0000","last_undegraded":"2023-10-06T04:37:29.785773+0000","last_fullsized":"2023-10-06T04:37:29.785773+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:50:40.518636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"38'5","reported_seq":20,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.783066+0000","last_change":"2023-10-06T04:37:17.548551+0000","last_active":"2023-10-06T04:37:29.783066+0000","last_peered":"2023-10-06T04:37:29.783066+0000","last_clean":"2023-10-06T04:37:29.783066+0000","last_became_active":"2023-10-06T04:37:17.548252+0000","last_became_peered":"2023-10-06T04:37:17.548252+0000","last_unstale":"2023-10-06T04:37:29.783066+0000","last_undegraded":"2023-10-06T04:37:29.783066+0000","last_fullsized":"2023-10-06T04:37:29.783066+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:23.847066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.779585+0000","last_change":"2023-10-06T04:37:16.546270+0000","last_active":"2023-10-06T04:37:29.779585+0000","last_peered":"2023-10-06T04:37:29.779585+0000","last_clean":"2023-10-06T04:37:29.779585+0000","last_became_active":"2023-10-06T04:37:16.545969+0000","last_became_peered":"2023-10-06T04:37:16.545969+0000","last_unstale":"2023-10-06T04:37:29.779585+0000","last_undegraded":"2023-10-06T04:37:29.779585+0000","last_fullsized":"2023-10-06T04:37:29.779585+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:37.190837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":33,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.780705+0000","last_change":"2023-10-06T04:36:11.184460+0000","last_active":"2023-10-06T04:37:29.780705+0000","last_peered":"2023-10-06T04:37:29.780705+0000","last_clean":"2023-10-06T04:37:29.780705+0000","last_became_active":"2023-10-06T04:36:11.184119+0000","last_became_peered":"2023-10-06T04:36:11.184119+0000","last_unstale":"2023-10-06T04:37:29.780705+0000","last_undegraded":"2023-10-06T04:37:29.780705+0000","last_fullsized":"2023-10-06T04:37:29.780705+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:37.026121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":181,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.782439+0000","last_change":"2023-10-06T04:36:12.183155+0000","last_active":"2023-10-06T04:37:29.782439+0000","last_peered":"2023-10-06T04:37:29.782439+0000","last_clean":"2023-10-06T04:37:29.782439+0000","last_became_active":"2023-10-06T04:36:12.182903+0000","last_became_peered":"2023-10-06T04:36:12.182903+0000","last_unstale":"2023-10-06T04:37:29.782439+0000","last_undegraded":"2023-10-06T04:37:29.782439+0000","last_fullsized":"2023-10-06T04:37:29.782439+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:11.171104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:11.171104+0000","last_clean_scrub_stamp":"2023-10-06T04:36:11.171104+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:38:54.323364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.792070+0000","last_change":"2023-10-06T04:37:29.790670+0000","last_active":"2023-10-06T04:37:29.792070+0000","last_peered":"2023-10-06T04:37:29.792070+0000","last_clean":"2023-10-06T04:37:29.792070+0000","last_became_active":"2023-10-06T04:37:29.790393+0000","last_became_peered":"2023-10-06T04:37:29.790393+0000","last_unstale":"2023-10-06T04:37:29.792070+0000","last_undegraded":"2023-10-06T04:37:29.792070+0000","last_fullsized":"2023-10-06T04:37:29.792070+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:00:47.460409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"38'9","reported_seq":24,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.787057+0000","last_change":"2023-10-06T04:37:17.537793+0000","last_active":"2023-10-06T04:37:29.787057+0000","last_peered":"2023-10-06T04:37:29.787057+0000","last_clean":"2023-10-06T04:37:29.787057+0000","last_became_active":"2023-10-06T04:37:17.537503+0000","last_became_peered":"2023-10-06T04:37:17.537503+0000","last_unstale":"2023-10-06T04:37:29.787057+0000","last_undegraded":"2023-10-06T04:37:29.787057+0000","last_fullsized":"2023-10-06T04:37:29.787057+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:50:19.011564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.783173+0000","last_change":"2023-10-06T04:37:16.545879+0000","last_active":"2023-10-06T04:37:29.783173+0000","last_peered":"2023-10-06T04:37:29.783173+0000","last_clean":"2023-10-06T04:37:29.783173+0000","last_became_active":"2023-10-06T04:37:16.545603+0000","last_became_peered":"2023-10-06T04:37:16.545603+0000","last_unstale":"2023-10-06T04:37:29.783173+0000","last_undegraded":"2023-10-06T04:37:29.783173+0000","last_fullsized":"2023-10-06T04:37:29.783173+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:40.207039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":32,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.782621+0000","last_change":"2023-10-06T04:36:11.193056+0000","last_active":"2023-10-06T04:37:29.782621+0000","last_peered":"2023-10-06T04:37:29.782621+0000","last_clean":"2023-10-06T04:37:29.782621+0000","last_became_active":"2023-10-06T04:36:11.192712+0000","last_became_peered":"2023-10-06T04:36:11.192712+0000","last_unstale":"2023-10-06T04:37:29.782621+0000","last_undegraded":"2023-10-06T04:37:29.782621+0000","last_fullsized":"2023-10-06T04:37:29.782621+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:00.008654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.792391+0000","last_change":"2023-10-06T04:37:29.791207+0000","last_active":"2023-10-06T04:37:29.792391+0000","last_peered":"2023-10-06T04:37:29.792391+0000","last_clean":"2023-10-06T04:37:29.792391+0000","last_became_active":"2023-10-06T04:37:29.790962+0000","last_became_peered":"2023-10-06T04:37:29.790962+0000","last_unstale":"2023-10-06T04:37:29.792391+0000","last_undegraded":"2023-10-06T04:37:29.792391+0000","last_fullsized":"2023-10-06T04:37:29.792391+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:22.073804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"38'7","reported_seq":22,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.788217+0000","last_change":"2023-10-06T04:37:17.547978+0000","last_active":"2023-10-06T04:37:29.788217+0000","last_peered":"2023-10-06T04:37:29.788217+0000","last_clean":"2023-10-06T04:37:29.788217+0000","last_became_active":"2023-10-06T04:37:17.547342+0000","last_became_peered":"2023-10-06T04:37:17.547342+0000","last_unstale":"2023-10-06T04:37:29.788217+0000","last_undegraded":"2023-10-06T04:37:29.788217+0000","last_fullsized":"2023-10-06T04:37:29.788217+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:12.970309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"39'3","reported_seq":19,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.784170+0000","last_change":"2023-10-06T04:37:16.544363+0000","last_active":"2023-10-06T04:37:29.784170+0000","last_peered":"2023-10-06T04:37:29.784170+0000","last_clean":"2023-10-06T04:37:29.784170+0000","last_became_active":"2023-10-06T04:37:16.544100+0000","last_became_peered":"2023-10-06T04:37:16.544100+0000","last_unstale":"2023-10-06T04:37:29.784170+0000","last_undegraded":"2023-10-06T04:37:29.784170+0000","last_fullsized":"2023-10-06T04:37:29.784170+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:24.703451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":32,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.782346+0000","last_change":"2023-10-06T04:36:11.192701+0000","last_active":"2023-10-06T04:37:29.782346+0000","last_peered":"2023-10-06T04:37:29.782346+0000","last_clean":"2023-10-06T04:37:29.782346+0000","last_became_active":"2023-10-06T04:36:11.192335+0000","last_became_peered":"2023-10-06T04:36:11.192335+0000","last_unstale":"2023-10-06T04:37:29.782346+0000","last_undegraded":"2023-10-06T04:37:29.782346+0000","last_fullsized":"2023-10-06T04:37:29.782346+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:18.643570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.801690+0000","last_change":"2023-10-06T04:37:29.794470+0000","last_active":"2023-10-06T04:37:29.801690+0000","last_peered":"2023-10-06T04:37:29.801690+0000","last_clean":"2023-10-06T04:37:29.801690+0000","last_became_active":"2023-10-06T04:37:29.793956+0000","last_became_peered":"2023-10-06T04:37:29.793956+0000","last_unstale":"2023-10-06T04:37:29.801690+0000","last_undegraded":"2023-10-06T04:37:29.801690+0000","last_fullsized":"2023-10-06T04:37:29.801690+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:35.122716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"38'8","reported_seq":23,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.783413+0000","last_change":"2023-10-06T04:37:17.551353+0000","last_active":"2023-10-06T04:37:29.783413+0000","last_peered":"2023-10-06T04:37:29.783413+0000","last_clean":"2023-10-06T04:37:29.783413+0000","last_became_active":"2023-10-06T04:37:17.550655+0000","last_became_peered":"2023-10-06T04:37:17.550655+0000","last_unstale":"2023-10-06T04:37:29.783413+0000","last_undegraded":"2023-10-06T04:37:29.783413+0000","last_fullsized":"2023-10-06T04:37:29.783413+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:37.951996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"39'3","reported_seq":20,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.790948+0000","last_change":"2023-10-06T04:37:16.541672+0000","last_active":"2023-10-06T04:37:29.790948+0000","last_peered":"2023-10-06T04:37:29.790948+0000","last_clean":"2023-10-06T04:37:29.790948+0000","last_became_active":"2023-10-06T04:37:16.541369+0000","last_became_peered":"2023-10-06T04:37:16.541369+0000","last_unstale":"2023-10-06T04:37:29.790948+0000","last_undegraded":"2023-10-06T04:37:29.790948+0000","last_fullsized":"2023-10-06T04:37:29.790948+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:34.644455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":33,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.784818+0000","last_change":"2023-10-06T04:36:11.193497+0000","last_active":"2023-10-06T04:37:29.784818+0000","last_peered":"2023-10-06T04:37:29.784818+0000","last_clean":"2023-10-06T04:37:29.784818+0000","last_became_active":"2023-10-06T04:36:11.193215+0000","last_became_peered":"2023-10-06T04:36:11.193215+0000","last_unstale":"2023-10-06T04:37:29.784818+0000","last_undegraded":"2023-10-06T04:37:29.784818+0000","last_fullsized":"2023-10-06T04:37:29.784818+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:07.497987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.792005+0000","last_change":"2023-10-06T04:37:29.788741+0000","last_active":"2023-10-06T04:37:29.792005+0000","last_peered":"2023-10-06T04:37:29.792005+0000","last_clean":"2023-10-06T04:37:29.792005+0000","last_became_active":"2023-10-06T04:37:29.788474+0000","last_became_peered":"2023-10-06T04:37:29.788474+0000","last_unstale":"2023-10-06T04:37:29.792005+0000","last_undegraded":"2023-10-06T04:37:29.792005+0000","last_fullsized":"2023-10-06T04:37:29.792005+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:48.194911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"38'8","reported_seq":23,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.786311+0000","last_change":"2023-10-06T04:37:17.548282+0000","last_active":"2023-10-06T04:37:29.786311+0000","last_peered":"2023-10-06T04:37:29.786311+0000","last_clean":"2023-10-06T04:37:29.786311+0000","last_became_active":"2023-10-06T04:37:17.548037+0000","last_became_peered":"2023-10-06T04:37:17.548037+0000","last_unstale":"2023-10-06T04:37:29.786311+0000","last_undegraded":"2023-10-06T04:37:29.786311+0000","last_fullsized":"2023-10-06T04:37:29.786311+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:44:56.161035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.782301+0000","last_change":"2023-10-06T04:37:16.539573+0000","last_active":"2023-10-06T04:37:29.782301+0000","last_peered":"2023-10-06T04:37:29.782301+0000","last_clean":"2023-10-06T04:37:29.782301+0000","last_became_active":"2023-10-06T04:37:16.539271+0000","last_became_peered":"2023-10-06T04:37:16.539271+0000","last_unstale":"2023-10-06T04:37:29.782301+0000","last_undegraded":"2023-10-06T04:37:29.782301+0000","last_fullsized":"2023-10-06T04:37:29.782301+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:06:23.075116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":31,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.783257+0000","last_change":"2023-10-06T04:36:11.193111+0000","last_active":"2023-10-06T04:37:29.783257+0000","last_peered":"2023-10-06T04:37:29.783257+0000","last_clean":"2023-10-06T04:37:29.783257+0000","last_became_active":"2023-10-06T04:36:11.192836+0000","last_became_peered":"2023-10-06T04:36:11.192836+0000","last_unstale":"2023-10-06T04:37:29.783257+0000","last_undegraded":"2023-10-06T04:37:29.783257+0000","last_fullsized":"2023-10-06T04:37:29.783257+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:19.938716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.787754+0000","last_change":"2023-10-06T04:37:29.784741+0000","last_active":"2023-10-06T04:37:29.787754+0000","last_peered":"2023-10-06T04:37:29.787754+0000","last_clean":"2023-10-06T04:37:29.787754+0000","last_became_active":"2023-10-06T04:37:29.784482+0000","last_became_peered":"2023-10-06T04:37:29.784482+0000","last_unstale":"2023-10-06T04:37:29.787754+0000","last_undegraded":"2023-10-06T04:37:29.787754+0000","last_fullsized":"2023-10-06T04:37:29.787754+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:28.769918+0000","last_clean_scrub_stamp":"2023-10-06T04:37:28.769918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:03.238576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"38'5","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.778978+0000","last_change":"2023-10-06T04:37:17.546750+0000","last_active":"2023-10-06T04:37:29.778978+0000","last_peered":"2023-10-06T04:37:29.778978+0000","last_clean":"2023-10-06T04:37:29.778978+0000","last_became_active":"2023-10-06T04:37:17.546467+0000","last_became_peered":"2023-10-06T04:37:17.546467+0000","last_unstale":"2023-10-06T04:37:29.778978+0000","last_undegraded":"2023-10-06T04:37:29.778978+0000","last_fullsized":"2023-10-06T04:37:29.778978+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:16.519620+0000","last_clean_scrub_stamp":"2023-10-06T04:37:16.519620+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:58.928454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.781476+0000","last_change":"2023-10-06T04:37:16.544678+0000","last_active":"2023-10-06T04:37:29.781476+0000","last_peered":"2023-10-06T04:37:29.781476+0000","last_clean":"2023-10-06T04:37:29.781476+0000","last_became_active":"2023-10-06T04:37:16.541041+0000","last_became_peered":"2023-10-06T04:37:16.541041+0000","last_unstale":"2023-10-06T04:37:29.781476+0000","last_undegraded":"2023-10-06T04:37:29.781476+0000","last_fullsized":"2023-10-06T04:37:29.781476+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:37:15.515413+0000","last_clean_scrub_stamp":"2023-10-06T04:37:15.515413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:15:48.328371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":31,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:37:29.783685+0000","last_change":"2023-10-06T04:36:11.182804+0000","last_active":"2023-10-06T04:37:29.783685+0000","last_peered":"2023-10-06T04:37:29.783685+0000","last_clean":"2023-10-06T04:37:29.783685+0000","last_became_active":"2023-10-06T04:36:11.182575+0000","last_became_peered":"2023-10-06T04:36:11.182575+0000","last_unstale":"2023-10-06T04:37:29.783685+0000","last_undegraded":"2023-10-06T04:37:29.783685+0000","last_fullsized":"2023-10-06T04:37:29.783685+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:07.497987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":504,"ondisk_log_size":504,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":93,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298392,"kb_used_data":1104,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073448,"statfs":{"total":96636764160,"available":96331210752,"internally_reserved":0,"allocated":1130496,"data_stored":841606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.38300000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.63200000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.5},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.51800000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.48199999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.56899999999999995}]},{"osd":5,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.60099999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.53400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301908,"kb_used_data":4620,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94069932,"statfs":{"total":96636764160,"available":96327610368,"internally_reserved":0,"allocated":4730880,"data_stored":4445542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":10.045999999999999,"5min":10.045999999999999,"15min":10.045999999999999},"last":0.55300000000000005}]},{"osd":1,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":10.125999999999999,"5min":10.125999999999999,"15min":10.125999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.69099999999999995}]},{"osd":2,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":10.238,"5min":10.238,"15min":10.238},"last":0.70299999999999996}]},{"osd":3,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":4.4870000000000001,"5min":4.4870000000000001,"15min":4.4870000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":10.393000000000001,"5min":10.393000000000001,"15min":10.393000000000001},"last":0.57499999999999996}]},{"osd":4,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.67700000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.71799999999999997}]},{"osd":7,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.63},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.76300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298392,"kb_used_data":1104,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073448,"statfs":{"total":96636764160,"available":96331210752,"internally_reserved":0,"allocated":1130496,"data_stored":841606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.33900000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.371},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.35899999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.38600000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.93799999999999994}]},{"osd":5,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.89700000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.874},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.97899999999999998}]},{"osd":7,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.95699999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301904,"kb_used_data":4616,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94069936,"statfs":{"total":96636764160,"available":96327614464,"internally_reserved":0,"allocated":4726784,"data_stored":4444564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.443,"5min":0.443,"15min":0.443},"last":0.21299999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.34000000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.495},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.379}]},{"osd":4,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.46300000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.438},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.61599999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.59899999999999998}]},{"osd":7,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.65400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297808,"kb_used_data":520,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074032,"statfs":{"total":96636764160,"available":96331808768,"internally_reserved":0,"allocated":532480,"data_stored":250260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.33500000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.373}]},{"osd":3,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.32200000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.54000000000000004}]},{"osd":5,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.64700000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.60799999999999998}]},{"osd":7,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.625},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.56599999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297808,"kb_used_data":520,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074032,"statfs":{"total":96636764160,"available":96331808768,"internally_reserved":0,"allocated":532480,"data_stored":250260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.505},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.442,"5min":0.442,"15min":0.442},"last":0.40400000000000003}]},{"osd":1,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.436,"5min":0.436,"15min":0.436},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.45000000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.38}]},{"osd":4,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.1070000000000002,"5min":2.1070000000000002,"15min":2.1070000000000002},"last":0.54700000000000004}]},{"osd":5,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":0.625},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.63800000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.56000000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299860,"kb_used_data":2572,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071980,"statfs":{"total":96636764160,"available":96329707520,"internally_reserved":0,"allocated":2633728,"data_stored":2348390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":4.2919999999999998,"5min":4.2919999999999998,"15min":4.2919999999999998},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.64700000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":4.3520000000000003,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":0.56499999999999995}]},{"osd":2,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.62},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.76300000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.75}]},{"osd":5,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.60399999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.66100000000000003}]},{"osd":7,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.501},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.71099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299860,"kb_used_data":2572,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071980,"statfs":{"total":96636764160,"available":96329707520,"internally_reserved":0,"allocated":2633728,"data_stored":2348390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.308},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.44600000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.35299999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.42099999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.5}]},{"osd":4,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.40100000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.437}]},{"osd":7,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.55100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:37:38.844 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T04:37:38.844 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -s 2023-10-06T04:37:38.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.992+0000 7fbf1ddea700 1 Processor -- start 2023-10-06T04:37:38.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.992+0000 7fbf1ddea700 1 -- start start 2023-10-06T04:37:38.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.993+0000 7fbf1ddea700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fbf180cfe00 0x7fbf180ce070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:38.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.993+0000 7fbf1ddea700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbf18068ba0 0x7fbf180ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:38.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.993+0000 7fbf1ddea700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf180ceaf0 con 0x7fbf180af800 2023-10-06T04:37:38.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.993+0000 7fbf1ddea700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf18159d60 con 0x7fbf18068ba0 2023-10-06T04:37:38.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.993+0000 7fbf1ddea700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf180b1250 con 0x7fbf180cfe00 2023-10-06T04:37:38.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.993+0000 7fbf1d5e9700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbf18068ba0 0x7fbf180ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:38.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.993+0000 7fbf1cde8700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fbf180af800 0x7fbf18068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:51894/0 (socket says 172.21.15.8:51894) 2023-10-06T04:37:38.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.993+0000 7fbf1cde8700 1 -- 172.21.15.8:0/237216653 learned_addr learned my addr 172.21.15.8:0/237216653 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:38.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.993+0000 7fbf17fff700 1 --2- 172.21.15.8:0/237216653 >> v2:172.21.15.184:3300/0 conn(0x7fbf180cfe00 0x7fbf180ce070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:38.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.993+0000 7fbf1d5e9700 1 -- 172.21.15.8:0/237216653 >> v2:172.21.15.184:3300/0 conn(0x7fbf180cfe00 msgr2=0x7fbf180ce070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:38.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.993+0000 7fbf1d5e9700 1 --2- 172.21.15.8:0/237216653 >> v2:172.21.15.184:3300/0 conn(0x7fbf180cfe00 0x7fbf180ce070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:38.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.993+0000 7fbf1d5e9700 1 -- 172.21.15.8:0/237216653 >> v1:172.21.15.8:6789/0 conn(0x7fbf180af800 legacy=0x7fbf18068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:38.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.993+0000 7fbf1d5e9700 1 -- 172.21.15.8:0/237216653 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf180ced60 con 0x7fbf18068ba0 2023-10-06T04:37:38.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.993+0000 7fbf1d5e9700 1 --2- 172.21.15.8:0/237216653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf18068ba0 0x7fbf180ce5b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fbf18065350 tx=0x7fbf000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=427a01b22623de3d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:38.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.993+0000 7fbf177fe700 1 -- 172.21.15.8:0/237216653 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0000b6b0 con 0x7fbf18068ba0 2023-10-06T04:37:38.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.993+0000 7fbf177fe700 1 -- 172.21.15.8:0/237216653 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0000b810 con 0x7fbf18068ba0 2023-10-06T04:37:38.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.993+0000 7fbf177fe700 1 -- 172.21.15.8:0/237216653 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0000bbb0 con 0x7fbf18068ba0 2023-10-06T04:37:38.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.994+0000 7fbf1ddea700 1 -- 172.21.15.8:0/237216653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf18068ba0 msgr2=0x7fbf180ce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:38.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.994+0000 7fbf1ddea700 1 --2- 172.21.15.8:0/237216653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf18068ba0 0x7fbf180ce5b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fbf18065350 tx=0x7fbf000091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:38.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.994+0000 7fbf1ddea700 1 -- 172.21.15.8:0/237216653 shutdown_connections 2023-10-06T04:37:38.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.994+0000 7fbf1ddea700 1 --2- 172.21.15.8:0/237216653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf18068ba0 0x7fbf180ce5b0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:38.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.994+0000 7fbf1ddea700 1 --2- 172.21.15.8:0/237216653 >> v2:172.21.15.184:3300/0 conn(0x7fbf180cfe00 0x7fbf180ce070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:38.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.994+0000 7fbf1ddea700 1 -- 172.21.15.8:0/237216653 >> 172.21.15.8:0/237216653 conn(0x7fbf1806f790 msgr2=0x7fbf180d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:38.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.994+0000 7fbf1ddea700 1 -- 172.21.15.8:0/237216653 shutdown_connections 2023-10-06T04:37:38.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.994+0000 7fbf1ddea700 1 -- 172.21.15.8:0/237216653 wait complete. 2023-10-06T04:37:39.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.995+0000 7fbf1ddea700 1 Processor -- start 2023-10-06T04:37:39.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.995+0000 7fbf1ddea700 1 -- start start 2023-10-06T04:37:39.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.996+0000 7fbf1ddea700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf18068ba0 0x7fbf1816af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.996+0000 7fbf1ddea700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf180af800 0x7fbf1816cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.996+0000 7fbf1ddea700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf180cfe00 0x7fbf18159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.996+0000 7fbf1ddea700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf180c5b30 con 0x7fbf18068ba0 2023-10-06T04:37:39.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.996+0000 7fbf1ddea700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1816b4b0 con 0x7fbf180af800 2023-10-06T04:37:39.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.996+0000 7fbf1ddea700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf180c5240 con 0x7fbf180cfe00 2023-10-06T04:37:39.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.996+0000 7fbf1cde8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf18068ba0 0x7fbf1816af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.996+0000 7fbf1cde8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf18068ba0 0x7fbf1816af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54388/0 (socket says 172.21.15.8:54388) 2023-10-06T04:37:39.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.996+0000 7fbf1cde8700 1 -- 172.21.15.8:0/4265891366 learned_addr learned my addr 172.21.15.8:0/4265891366 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:39.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.996+0000 7fbf17fff700 1 --2- 172.21.15.8:0/4265891366 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf180af800 0x7fbf1816cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.996+0000 7fbf1d5e9700 1 --2- 172.21.15.8:0/4265891366 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf180cfe00 0x7fbf18159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.996+0000 7fbf1cde8700 1 -- 172.21.15.8:0/4265891366 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf180cfe00 msgr2=0x7fbf18159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.996+0000 7fbf1cde8700 1 --2- 172.21.15.8:0/4265891366 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf180cfe00 0x7fbf18159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.996+0000 7fbf1cde8700 1 -- 172.21.15.8:0/4265891366 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf180af800 msgr2=0x7fbf1816cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.996+0000 7fbf1cde8700 1 --2- 172.21.15.8:0/4265891366 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf180af800 0x7fbf1816cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.996+0000 7fbf1cde8700 1 -- 172.21.15.8:0/4265891366 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf00009420 con 0x7fbf18068ba0 2023-10-06T04:37:39.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.996+0000 7fbf17fff700 1 --2- 172.21.15.8:0/4265891366 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf180af800 0x7fbf1816cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:39.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.997+0000 7fbf1cde8700 1 --2- 172.21.15.8:0/4265891366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf18068ba0 0x7fbf1816af70 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fbf1000cd60 tx=0x7fbf10001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.997+0000 7fbf14ff9700 1 -- 172.21.15.8:0/4265891366 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf10004bb0 con 0x7fbf18068ba0 2023-10-06T04:37:39.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.997+0000 7fbf14ff9700 1 -- 172.21.15.8:0/4265891366 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf10004d10 con 0x7fbf18068ba0 2023-10-06T04:37:39.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.997+0000 7fbf1ddea700 1 -- 172.21.15.8:0/4265891366 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf1815cf00 con 0x7fbf18068ba0 2023-10-06T04:37:39.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.997+0000 7fbf14ff9700 1 -- 172.21.15.8:0/4265891366 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1000ad60 con 0x7fbf18068ba0 2023-10-06T04:37:39.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.997+0000 7fbf1ddea700 1 -- 172.21.15.8:0/4265891366 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf180c57c0 con 0x7fbf18068ba0 2023-10-06T04:37:39.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.998+0000 7fbf1ddea700 1 -- 172.21.15.8:0/4265891366 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf18088940 con 0x7fbf18068ba0 2023-10-06T04:37:39.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.998+0000 7fbf14ff9700 1 -- 172.21.15.8:0/4265891366 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbf10007300 con 0x7fbf18068ba0 2023-10-06T04:37:39.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.999+0000 7fbf14ff9700 1 --2- 172.21.15.8:0/4265891366 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fbef8066f00 0x7fbef80693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.999+0000 7fbf14ff9700 1 -- 172.21.15.8:0/4265891366 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7fbf100847a0 con 0x7fbf18068ba0 2023-10-06T04:37:39.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:38.999+0000 7fbf17fff700 1 --2- 172.21.15.8:0/4265891366 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fbef8066f00 0x7fbef80693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.000+0000 7fbf17fff700 1 --2- 172.21.15.8:0/4265891366 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fbef8066f00 0x7fbef80693b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbf180716b0 tx=0x7fbf08008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.003+0000 7fbf14ff9700 1 -- 172.21.15.8:0/4265891366 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf100515d0 con 0x7fbf18068ba0 2023-10-06T04:37:39.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.277+0000 7fbf1ddea700 1 -- 172.21.15.8:0/4265891366 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fbf180cf040 con 0x7fbf18068ba0 2023-10-06T04:37:39.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.277+0000 7fbf14ff9700 1 -- 172.21.15.8:0/4265891366 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+616 (secure 0 0 0) 0x7fbf10054bf0 con 0x7fbf18068ba0 2023-10-06T04:37:39.279 INFO:teuthology.orchestra.run.smithi008.stdout: cluster: 2023-10-06T04:37:39.279 INFO:teuthology.orchestra.run.smithi008.stdout: id: c030d94d-df8f-49bb-8df7-07e9e557d96b 2023-10-06T04:37:39.279 INFO:teuthology.orchestra.run.smithi008.stdout: health: HEALTH_ERR 2023-10-06T04:37:39.279 INFO:teuthology.orchestra.run.smithi008.stdout: 2 filesystems are degraded 2023-10-06T04:37:39.279 INFO:teuthology.orchestra.run.smithi008.stdout: 2 filesystems are offline 2023-10-06T04:37:39.279 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:39.279 INFO:teuthology.orchestra.run.smithi008.stdout: services: 2023-10-06T04:37:39.279 INFO:teuthology.orchestra.run.smithi008.stdout: mon: 3 daemons, quorum a,b,c (age 100s) 2023-10-06T04:37:39.279 INFO:teuthology.orchestra.run.smithi008.stdout: mgr: x(active, since 94s), standbys: y 2023-10-06T04:37:39.279 INFO:teuthology.orchestra.run.smithi008.stdout: mds: 0/2 daemons up (2 failed), 4 standby 2023-10-06T04:37:39.280 INFO:teuthology.orchestra.run.smithi008.stdout: osd: 8 osds: 8 up (since 90s), 8 in (since 97s) 2023-10-06T04:37:39.280 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:39.280 INFO:teuthology.orchestra.run.smithi008.stdout: data: 2023-10-06T04:37:39.280 INFO:teuthology.orchestra.run.smithi008.stdout: volumes: 0/2 healthy, 2 failed 2023-10-06T04:37:39.280 INFO:teuthology.orchestra.run.smithi008.stdout: pools: 5 pools, 137 pgs 2023-10-06T04:37:39.280 INFO:teuthology.orchestra.run.smithi008.stdout: objects: 4 objects, 6.6 MiB 2023-10-06T04:37:39.280 INFO:teuthology.orchestra.run.smithi008.stdout: usage: 2.3 GiB used, 718 GiB / 720 GiB avail 2023-10-06T04:37:39.280 INFO:teuthology.orchestra.run.smithi008.stdout: pgs: 137 active+clean 2023-10-06T04:37:39.280 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:39.280 INFO:teuthology.orchestra.run.smithi008.stdout: io: 2023-10-06T04:37:39.280 INFO:teuthology.orchestra.run.smithi008.stdout: client: 0 B/s rd, 1.7 KiB/s wr, 0 op/s rd, 3 op/s wr 2023-10-06T04:37:39.281 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:39.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.279+0000 7fbf1ddea700 1 -- 172.21.15.8:0/4265891366 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fbef8066f00 msgr2=0x7fbef80693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.279+0000 7fbf1ddea700 1 --2- 172.21.15.8:0/4265891366 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fbef8066f00 0x7fbef80693b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbf180716b0 tx=0x7fbf08008040 comp rx=0 tx=0).stop 2023-10-06T04:37:39.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.279+0000 7fbf1ddea700 1 -- 172.21.15.8:0/4265891366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf18068ba0 msgr2=0x7fbf1816af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.279+0000 7fbf1ddea700 1 --2- 172.21.15.8:0/4265891366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf18068ba0 0x7fbf1816af70 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fbf1000cd60 tx=0x7fbf10001ad0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.279+0000 7fbf1ddea700 1 -- 172.21.15.8:0/4265891366 shutdown_connections 2023-10-06T04:37:39.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.279+0000 7fbf1ddea700 1 --2- 172.21.15.8:0/4265891366 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fbef8066f00 0x7fbef80693b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.279+0000 7fbf1ddea700 1 --2- 172.21.15.8:0/4265891366 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf180cfe00 0x7fbf18159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.279+0000 7fbf1ddea700 1 --2- 172.21.15.8:0/4265891366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf18068ba0 0x7fbf1816af70 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.279+0000 7fbf1ddea700 1 --2- 172.21.15.8:0/4265891366 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf180af800 0x7fbf1816cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.279+0000 7fbf1ddea700 1 -- 172.21.15.8:0/4265891366 >> 172.21.15.8:0/4265891366 conn(0x7fbf1806f790 msgr2=0x7fbf18156ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:39.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.279+0000 7fbf1ddea700 1 -- 172.21.15.8:0/4265891366 shutdown_connections 2023-10-06T04:37:39.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.279+0000 7fbf1ddea700 1 -- 172.21.15.8:0/4265891366 wait complete. 2023-10-06T04:37:39.292 DEBUG:teuthology.orchestra.run.smithi008:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 init --force-init --filesystem recovery_fs --alternate-pool recovery_fs_metadata 2023-10-06T04:37:39.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.331+0000 7f3561507740 1 -- start start 2023-10-06T04:37:39.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.331+0000 7f3561507740 1 Processor -- start 2023-10-06T04:37:39.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.331+0000 7f3561507740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b0e2a26400 0x55b0e365e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.331+0000 7f3561507740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0e2a26800 0x55b0e365eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.331+0000 7f3561507740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55b0e2a26c00 0x55b0e365f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.331+0000 7f3561507740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0e28f0dc0 con 0x55b0e2a26800 2023-10-06T04:37:39.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.331+0000 7f3561507740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0e28f1cc0 con 0x55b0e2a26400 2023-10-06T04:37:39.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.331+0000 7f3561507740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b0e28f1b80 con 0x55b0e2a26c00 2023-10-06T04:37:39.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.331+0000 7f3559f73700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0e2a26800 0x55b0e365eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.331+0000 7f3559f73700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0e2a26800 0x55b0e365eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54394/0 (socket says 172.21.15.8:54394) 2023-10-06T04:37:39.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.332+0000 7f3559f73700 1 -- 172.21.15.8:0/3189502836 learned_addr learned my addr 172.21.15.8:0/3189502836 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:39.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.332+0000 7f355a774700 1 --2- 172.21.15.8:0/3189502836 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b0e2a26400 0x55b0e365e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.332+0000 7f355af75700 1 --2- 172.21.15.8:0/3189502836 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55b0e2a26c00 0x55b0e365f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.332+0000 7f3559f73700 1 -- 172.21.15.8:0/3189502836 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55b0e2a26c00 msgr2=0x55b0e365f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:39.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.332+0000 7f3559f73700 1 --2- 172.21.15.8:0/3189502836 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55b0e2a26c00 0x55b0e365f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.332+0000 7f3559f73700 1 -- 172.21.15.8:0/3189502836 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b0e2a26400 msgr2=0x55b0e365e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:39.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.332+0000 7f3559f73700 1 --2- 172.21.15.8:0/3189502836 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b0e2a26400 0x55b0e365e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.332+0000 7f3559f73700 1 -- 172.21.15.8:0/3189502836 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0e28d4340 con 0x55b0e2a26800 2023-10-06T04:37:39.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.332+0000 7f355af75700 1 --2- 172.21.15.8:0/3189502836 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55b0e2a26c00 0x55b0e365f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:39.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.332+0000 7f3559f73700 1 --2- 172.21.15.8:0/3189502836 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0e2a26800 0x55b0e365eb00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x55b0e36946c0 tx=0x55b0e3643260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a00cf704e6296629 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.332+0000 7f3557f6f700 1 -- 172.21.15.8:0/3189502836 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b0e28e9600 con 0x55b0e2a26800 2023-10-06T04:37:39.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.332+0000 7f3557f6f700 1 -- 172.21.15.8:0/3189502836 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b0e2906f00 con 0x55b0e2a26800 2023-10-06T04:37:39.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.332+0000 7f3557f6f700 1 -- 172.21.15.8:0/3189502836 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b0e28e91e0 con 0x55b0e2a26800 2023-10-06T04:37:39.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.332+0000 7f3561507740 1 -- 172.21.15.8:0/3189502836 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b0e28d4ea0 con 0x55b0e2a26800 2023-10-06T04:37:39.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.332+0000 7f3561507740 1 -- 172.21.15.8:0/3189502836 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55b0e28d5860 con 0x55b0e2a26800 2023-10-06T04:37:39.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.332+0000 7f3561507740 4 waiting for MDS map... 2023-10-06T04:37:39.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.332+0000 7f3557f6f700 1 -- 172.21.15.8:0/3189502836 <== mon.0 v2:172.21.15.8:3300/0 4 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x55b0e28f4c40 con 0x55b0e2a26800 2023-10-06T04:37:39.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.332+0000 7f3557f6f700 1 -- 172.21.15.8:0/3189502836 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 23) v1 ==== 3663+0+0 (secure 0 0 0) 0x55b0e36b0600 con 0x55b0e2a26800 2023-10-06T04:37:39.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.332+0000 7f3561507740 4 Got MDS map 23 2023-10-06T04:37:39.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.333+0000 7f3561507740 4 datascan.main: Using metadata pool output 2023-10-06T04:37:39.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.333+0000 7f3561507740 4 datascan.main: connecting to RADOS... 2023-10-06T04:37:39.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.333+0000 7f3561507740 1 Processor -- start 2023-10-06T04:37:39.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.333+0000 7f3561507740 1 -- start start 2023-10-06T04:37:39.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.334+0000 7f3561507740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b0e2a27800 0x55b0e365f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.334+0000 7f3561507740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0e2a27c00 0x55b0e365fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.334+0000 7f3561507740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55b0e3708000 0x55b0e3660100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.334+0000 7f3561507740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0e28f03c0 con 0x55b0e2a27c00 2023-10-06T04:37:39.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.334+0000 7f3561507740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0e28f1cc0 con 0x55b0e2a27800 2023-10-06T04:37:39.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.334+0000 7f3561507740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b0e28f0000 con 0x55b0e3708000 2023-10-06T04:37:39.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.334+0000 7f355a774700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0e2a27c00 0x55b0e365fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.334+0000 7f355a774700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0e2a27c00 0x55b0e365fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54396/0 (socket says 172.21.15.8:54396) 2023-10-06T04:37:39.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.334+0000 7f355a774700 1 -- 172.21.15.8:0/119609080 learned_addr learned my addr 172.21.15.8:0/119609080 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:39.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.334+0000 7f355af75700 1 --2- 172.21.15.8:0/119609080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b0e2a27800 0x55b0e365f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.334+0000 7f3559f73700 1 --2- 172.21.15.8:0/119609080 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55b0e3708000 0x55b0e3660100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.334+0000 7f355a774700 1 -- 172.21.15.8:0/119609080 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55b0e3708000 msgr2=0x55b0e3660100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:39.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.334+0000 7f355a774700 1 --2- 172.21.15.8:0/119609080 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55b0e3708000 0x55b0e3660100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.334+0000 7f355a774700 1 -- 172.21.15.8:0/119609080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b0e2a27800 msgr2=0x55b0e365f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:39.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.334+0000 7f355a774700 1 --2- 172.21.15.8:0/119609080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b0e2a27800 0x55b0e365f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.334+0000 7f355a774700 1 -- 172.21.15.8:0/119609080 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0e28d4340 con 0x55b0e2a27c00 2023-10-06T04:37:39.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.334+0000 7f355a774700 1 --2- 172.21.15.8:0/119609080 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0e2a27c00 0x55b0e365fb80 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x55b0e36955c0 tx=0x55b0e366e2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c6704296ceadc78 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.334+0000 7f3555f6b700 1 -- 172.21.15.8:0/119609080 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b0e28e9080 con 0x55b0e2a27c00 2023-10-06T04:37:39.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.334+0000 7f3555f6b700 1 -- 172.21.15.8:0/119609080 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b0e2906000 con 0x55b0e2a27c00 2023-10-06T04:37:39.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.334+0000 7f3555f6b700 1 -- 172.21.15.8:0/119609080 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b0e28e9600 con 0x55b0e2a27c00 2023-10-06T04:37:39.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.335+0000 7f3561507740 1 -- 172.21.15.8:0/119609080 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0e2a27c00 msgr2=0x55b0e365fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.335+0000 7f3561507740 1 --2- 172.21.15.8:0/119609080 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0e2a27c00 0x55b0e365fb80 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x55b0e36955c0 tx=0x55b0e366e2a0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.335+0000 7f3561507740 1 -- 172.21.15.8:0/119609080 shutdown_connections 2023-10-06T04:37:39.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.335+0000 7f3561507740 1 --2- 172.21.15.8:0/119609080 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55b0e3708000 0x55b0e3660100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.335+0000 7f3561507740 1 --2- 172.21.15.8:0/119609080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b0e2a27800 0x55b0e365f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.335+0000 7f3561507740 1 --2- 172.21.15.8:0/119609080 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0e2a27c00 0x55b0e365fb80 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.335+0000 7f3561507740 1 -- 172.21.15.8:0/119609080 >> 172.21.15.8:0/119609080 conn(0x55b0e2a27000 msgr2=0x55b0e3639800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:39.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.335+0000 7f3561507740 1 -- 172.21.15.8:0/119609080 shutdown_connections 2023-10-06T04:37:39.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.335+0000 7f3561507740 1 -- 172.21.15.8:0/119609080 wait complete. 2023-10-06T04:37:39.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.335+0000 7f3561507740 1 Processor -- start 2023-10-06T04:37:39.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.335+0000 7f3561507740 1 -- start start 2023-10-06T04:37:39.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.336+0000 7f3561507740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55b0e2a27c00 0x55b0e3660c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.336+0000 7f3561507740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0e2a27800 0x55b0e3660680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.336+0000 7f3561507740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b0e370a000 0x55b0e3660100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.336+0000 7f3561507740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0e28f1180 con 0x55b0e2a27800 2023-10-06T04:37:39.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.336+0000 7f3561507740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0e28f1040 con 0x55b0e370a000 2023-10-06T04:37:39.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.336+0000 7f3561507740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b0e28f0f00 con 0x55b0e2a27c00 2023-10-06T04:37:39.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.336+0000 7f355a774700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0e2a27800 0x55b0e3660680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.336+0000 7f355a774700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0e2a27800 0x55b0e3660680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54410/0 (socket says 172.21.15.8:54410) 2023-10-06T04:37:39.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.336+0000 7f355a774700 1 -- 172.21.15.8:0/1450080140 learned_addr learned my addr 172.21.15.8:0/1450080140 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:39.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.336+0000 7f355af75700 1 --2- 172.21.15.8:0/1450080140 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55b0e2a27c00 0x55b0e3660c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.336+0000 7f3559f73700 1 --2- 172.21.15.8:0/1450080140 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b0e370a000 0x55b0e3660100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.336+0000 7f355a774700 1 -- 172.21.15.8:0/1450080140 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55b0e2a27c00 msgr2=0x55b0e3660c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.336+0000 7f355a774700 1 --2- 172.21.15.8:0/1450080140 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55b0e2a27c00 0x55b0e3660c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.336+0000 7f355a774700 1 -- 172.21.15.8:0/1450080140 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b0e370a000 msgr2=0x55b0e3660100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.336+0000 7f355a774700 1 --2- 172.21.15.8:0/1450080140 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b0e370a000 0x55b0e3660100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.336+0000 7f355a774700 1 -- 172.21.15.8:0/1450080140 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0e28d49c0 con 0x55b0e2a27800 2023-10-06T04:37:39.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.337+0000 7f355a774700 1 --2- 172.21.15.8:0/1450080140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0e2a27800 0x55b0e3660680 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x55b0e36ca690 tx=0x55b0e366e240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.337+0000 7f3554768700 1 -- 172.21.15.8:0/1450080140 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b0e28e91e0 con 0x55b0e2a27800 2023-10-06T04:37:39.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.337+0000 7f3554768700 1 -- 172.21.15.8:0/1450080140 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b0e2906300 con 0x55b0e2a27800 2023-10-06T04:37:39.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.337+0000 7f3554768700 1 -- 172.21.15.8:0/1450080140 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b0e28e8dc0 con 0x55b0e2a27800 2023-10-06T04:37:39.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.337+0000 7f3561507740 1 -- 172.21.15.8:0/1450080140 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b0e28d4ea0 con 0x55b0e2a27800 2023-10-06T04:37:39.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.337+0000 7f3561507740 1 -- 172.21.15.8:0/1450080140 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b0e28d5860 con 0x55b0e2a27800 2023-10-06T04:37:39.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.337+0000 7f3561507740 4 datascan.init: forcing metadata pool 'recovery_fs_metadata' 2023-10-06T04:37:39.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.338+0000 7f3554768700 1 -- 172.21.15.8:0/1450080140 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x55b0e3627080 con 0x55b0e2a27800 2023-10-06T04:37:39.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.338+0000 7f3554768700 1 --2- 172.21.15.8:0/1450080140 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x55b0e371e400 0x55b0e3661700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.338+0000 7f3554768700 1 -- 172.21.15.8:0/1450080140 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x55b0e28f4a80 con 0x55b0e2a27800 2023-10-06T04:37:39.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.339+0000 7f3561507740 1 --2- 172.21.15.8:0/1450080140 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x55b0e370a400 0x55b0e365fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.339+0000 7f3561507740 1 -- 172.21.15.8:0/1450080140 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:1 8.14 8:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x55b0e370a800 con 0x55b0e370a400 2023-10-06T04:37:39.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.339+0000 7f355af75700 1 --2- 172.21.15.8:0/1450080140 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x55b0e371e400 0x55b0e3661700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.339+0000 7f3559f73700 1 --2- 172.21.15.8:0/1450080140 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x55b0e370a400 0x55b0e365fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.339+0000 7f355af75700 1 --2- 172.21.15.8:0/1450080140 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x55b0e371e400 0x55b0e3661700 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55b0e362bda0 tx=0x55b0e36bdd40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.339+0000 7f3559f73700 1 --2- 172.21.15.8:0/1450080140 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x55b0e370a400 0x55b0e365fb80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.340+0000 7f3559f73700 1 -- 172.21.15.8:0/1450080140 <== osd.4 v2:172.21.15.184:6800/90868 1 ==== osd_op_reply(1 1.00000000.inode [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 160+0+0 (crc 0 0 0) 0x55b0e3692fc0 con 0x55b0e370a400 2023-10-06T04:37:39.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.340+0000 7f3561507740 1 -- 172.21.15.8:0/1450080140 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:2 8.14 8:287034c4:::1.00000000.inode:head [writefull 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x55b0e370ac00 con 0x55b0e370a400 2023-10-06T04:37:39.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.341+0000 7f3559f73700 1 -- 172.21.15.8:0/1450080140 <== osd.4 v2:172.21.15.184:6800/90868 2 ==== osd_op_reply(2 1.00000000.inode [writefull 0~554] v46'1 uv1 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x55b0e3692fc0 con 0x55b0e370a400 2023-10-06T04:37:39.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.341+0000 7f3561507740 1 --2- 172.21.15.8:0/1450080140 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x55b0e370b000 0x55b0e365f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.341+0000 7f3561507740 1 -- 172.21.15.8:0/1450080140 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:3 8.1f 8:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x55b0e370b400 con 0x55b0e370b000 2023-10-06T04:37:39.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.341+0000 7f355af75700 1 --2- 172.21.15.8:0/1450080140 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x55b0e370b000 0x55b0e365f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.342+0000 7f355af75700 1 --2- 172.21.15.8:0/1450080140 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x55b0e370b000 0x55b0e365f600 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.342+0000 7f355af75700 1 -- 172.21.15.8:0/1450080140 <== osd.0 v2:172.21.15.8:6808/90668 1 ==== osd_op_reply(3 100.00000000.inode [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 162+0+0 (crc 0 0 0) 0x55b0e3693680 con 0x55b0e370b000 2023-10-06T04:37:39.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.342+0000 7f3561507740 1 -- 172.21.15.8:0/1450080140 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:4 8.1f 8:fe07bba1:::100.00000000.inode:head [writefull 0~554 in=554b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x55b0e370b800 con 0x55b0e370b000 2023-10-06T04:37:39.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.343+0000 7f355af75700 1 -- 172.21.15.8:0/1450080140 <== osd.0 v2:172.21.15.8:6808/90668 2 ==== osd_op_reply(4 100.00000000.inode [writefull 0~554] v46'1 uv1 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x55b0e3693680 con 0x55b0e370b000 2023-10-06T04:37:39.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.343+0000 7f3561507740 1 --2- 172.21.15.8:0/1450080140 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x55b0e370bc00 0x55b0e3816000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.343+0000 7f3561507740 1 -- 172.21.15.8:0/1450080140 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:5 8.13 8:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x55b0e371e800 con 0x55b0e370bc00 2023-10-06T04:37:39.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.343+0000 7f355a774700 1 --2- 172.21.15.8:0/1450080140 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x55b0e370bc00 0x55b0e3816000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.344+0000 7f355a774700 1 --2- 172.21.15.8:0/1450080140 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x55b0e370bc00 0x55b0e3816000 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.344+0000 7f355a774700 1 -- 172.21.15.8:0/1450080140 <== osd.3 v2:172.21.15.8:6823/90671 1 ==== osd_op_reply(5 100.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55b0e3693d40 con 0x55b0e370bc00 2023-10-06T04:37:39.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.344+0000 7f3561507740 10 datascan.find_or_create_dirfrag: read_version = 0 2023-10-06T04:37:39.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.344+0000 7f3561507740 1 -- 172.21.15.8:0/1450080140 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:6 8.13 8:cd5a64a3:::100.00000000:head [create,omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x55b0e371ec00 con 0x55b0e370bc00 2023-10-06T04:37:39.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.345+0000 7f355a774700 1 -- 172.21.15.8:0/1450080140 <== osd.3 v2:172.21.15.8:6823/90671 2 ==== osd_op_reply(6 100.00000000 [create,omap-set-header] v46'1 uv1 ondisk = 0) v8 ==== 198+0+0 (crc 0 0 0) 0x55b0e3693d40 con 0x55b0e370bc00 2023-10-06T04:37:39.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.345+0000 7f3561507740 10 datascan.find_or_create_dirfrag: Created dirfrag: 0x0x100 2023-10-06T04:37:39.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.345+0000 7f3561507740 1 -- 172.21.15.8:0/1450080140 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x55b0e370b000 msgr2=0x55b0e365f600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.345+0000 7f3561507740 1 --2- 172.21.15.8:0/1450080140 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x55b0e370b000 0x55b0e365f600 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.345+0000 7f3561507740 1 -- 172.21.15.8:0/1450080140 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x55b0e370bc00 msgr2=0x55b0e3816000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.345+0000 7f3561507740 1 --2- 172.21.15.8:0/1450080140 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x55b0e370bc00 0x55b0e3816000 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.345+0000 7f3561507740 1 -- 172.21.15.8:0/1450080140 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x55b0e370a400 msgr2=0x55b0e365fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.345+0000 7f3561507740 1 --2- 172.21.15.8:0/1450080140 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x55b0e370a400 0x55b0e365fb80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.345+0000 7f355a774700 1 -- 172.21.15.8:0/1450080140 reap_dead start 2023-10-06T04:37:39.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.345+0000 7f3561507740 1 -- 172.21.15.8:0/1450080140 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x55b0e371e400 msgr2=0x55b0e3661700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.345+0000 7f3561507740 1 --2- 172.21.15.8:0/1450080140 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x55b0e371e400 0x55b0e3661700 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55b0e362bda0 tx=0x55b0e36bdd40 comp rx=0 tx=0).stop 2023-10-06T04:37:39.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.345+0000 7f3561507740 1 -- 172.21.15.8:0/1450080140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0e2a27800 msgr2=0x55b0e3660680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.345+0000 7f3561507740 1 --2- 172.21.15.8:0/1450080140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0e2a27800 0x55b0e3660680 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x55b0e36ca690 tx=0x55b0e366e240 comp rx=0 tx=0).stop 2023-10-06T04:37:39.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.345+0000 7f3561507740 1 -- 172.21.15.8:0/1450080140 shutdown_connections 2023-10-06T04:37:39.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.345+0000 7f3561507740 1 --2- 172.21.15.8:0/1450080140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0e2a27800 0x55b0e3660680 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.345+0000 7f3561507740 1 --2- 172.21.15.8:0/1450080140 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x55b0e371e400 0x55b0e3661700 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.345+0000 7f3561507740 1 -- 172.21.15.8:0/1450080140 >> 172.21.15.8:0/1450080140 conn(0x55b0e2a27000 msgr2=0x55b0e3639800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:39.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.345+0000 7f3561507740 1 -- 172.21.15.8:0/1450080140 shutdown_connections 2023-10-06T04:37:39.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.345+0000 7f3561507740 1 -- 172.21.15.8:0/1450080140 wait complete. 2023-10-06T04:37:39.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.345+0000 7f3561507740 1 -- 172.21.15.8:0/3189502836 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0e2a26800 msgr2=0x55b0e365eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.345+0000 7f3561507740 1 --2- 172.21.15.8:0/3189502836 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0e2a26800 0x55b0e365eb00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x55b0e36946c0 tx=0x55b0e3643260 comp rx=0 tx=0).stop 2023-10-06T04:37:39.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.346+0000 7f3561507740 1 -- 172.21.15.8:0/3189502836 shutdown_connections 2023-10-06T04:37:39.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.346+0000 7f3561507740 1 --2- 172.21.15.8:0/3189502836 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55b0e2a26c00 0x55b0e365f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.346+0000 7f3561507740 1 --2- 172.21.15.8:0/3189502836 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b0e2a26400 0x55b0e365e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.346+0000 7f3561507740 1 --2- 172.21.15.8:0/3189502836 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b0e2a26800 0x55b0e365eb00 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.346+0000 7f3561507740 1 -- 172.21.15.8:0/3189502836 >> 172.21.15.8:0/3189502836 conn(0x55b0e2a26000 msgr2=0x55b0e3639000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:39.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.346+0000 7f3561507740 1 -- 172.21.15.8:0/3189502836 shutdown_connections 2023-10-06T04:37:39.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.346+0000 7f3561507740 1 -- 172.21.15.8:0/3189502836 wait complete. 2023-10-06T04:37:39.356 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'init', '--force-init', '--filesystem', 'recovery_fs', '--alternate-pool', 'recovery_fs_metadata'] in time 0:00:00.063234, result: 2023-10-06T04:37:39.356 DEBUG:teuthology.orchestra.run.smithi008:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 recovery_fs:0 reset session 2023-10-06T04:37:39.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.427+0000 7fdf2297f240 1 -- start start 2023-10-06T04:37:39.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.427+0000 7fdf2297f240 1 Processor -- start 2023-10-06T04:37:39.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.428+0000 7fdf2297f240 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a66278a400 0x55a662786580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.428+0000 7fdf2297f240 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a66278a800 0x55a662786b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.428+0000 7fdf2297f240 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a66278ac00 0x55a662787080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.428+0000 7fdf2297f240 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a661a0adc0 con 0x55a66278a800 2023-10-06T04:37:39.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.428+0000 7fdf2297f240 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a661a0bcc0 con 0x55a66278ac00 2023-10-06T04:37:39.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.428+0000 7fdf2297f240 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a661a0bb80 con 0x55a66278a400 2023-10-06T04:37:39.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.428+0000 7fdf1b64c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a66278a800 0x55a662786b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.428+0000 7fdf1b64c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a66278a800 0x55a662786b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54436/0 (socket says 172.21.15.8:54436) 2023-10-06T04:37:39.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.428+0000 7fdf1b64c700 1 -- 172.21.15.8:0/268517835 learned_addr learned my addr 172.21.15.8:0/268517835 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:39.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.428+0000 7fdf1be4d700 1 --2- 172.21.15.8:0/268517835 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a66278a400 0x55a662786580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.428+0000 7fdf1c64e700 1 --2- 172.21.15.8:0/268517835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a66278ac00 0x55a662787080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.428+0000 7fdf1b64c700 1 -- 172.21.15.8:0/268517835 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a66278a400 msgr2=0x55a662786580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:39.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.428+0000 7fdf1b64c700 1 --2- 172.21.15.8:0/268517835 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a66278a400 0x55a662786580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.428+0000 7fdf1b64c700 1 -- 172.21.15.8:0/268517835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a66278ac00 msgr2=0x55a662787080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:39.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.428+0000 7fdf1b64c700 1 --2- 172.21.15.8:0/268517835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a66278ac00 0x55a662787080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.428+0000 7fdf1b64c700 1 -- 172.21.15.8:0/268517835 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a6619ee340 con 0x55a66278a800 2023-10-06T04:37:39.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.428+0000 7fdf1b64c700 1 --2- 172.21.15.8:0/268517835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a66278a800 0x55a662786b00 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x55a662757d10 tx=0x55a66275d980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cccf9d1b716bdf06 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.429+0000 7fdf19648700 1 -- 172.21.15.8:0/268517835 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a661a03080 con 0x55a66278a800 2023-10-06T04:37:39.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.429+0000 7fdf19648700 1 -- 172.21.15.8:0/268517835 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a661a20f00 con 0x55a66278a800 2023-10-06T04:37:39.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.429+0000 7fdf19648700 1 -- 172.21.15.8:0/268517835 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a661a03600 con 0x55a66278a800 2023-10-06T04:37:39.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.429+0000 7fdf2297f240 1 -- 172.21.15.8:0/268517835 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a6619ee000 con 0x55a66278a800 2023-10-06T04:37:39.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.429+0000 7fdf2297f240 1 -- 172.21.15.8:0/268517835 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55a6619eeea0 con 0x55a66278a800 2023-10-06T04:37:39.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.429+0000 7fdf2297f240 4 waiting for MDS map... 2023-10-06T04:37:39.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.429+0000 7fdf19648700 1 -- 172.21.15.8:0/268517835 <== mon.0 v2:172.21.15.8:3300/0 4 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x55a661a0ec40 con 0x55a66278a800 2023-10-06T04:37:39.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.429+0000 7fdf19648700 1 -- 172.21.15.8:0/268517835 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 23) v1 ==== 3663+0+0 (secure 0 0 0) 0x55a662794300 con 0x55a66278a800 2023-10-06T04:37:39.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.429+0000 7fdf2297f240 4 Got MDS map 23 2023-10-06T04:37:39.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.429+0000 7fdf2297f240 10 main: main 2023-10-06T04:37:39.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.429+0000 7fdf2297f240 4 main: connecting to RADOS... 2023-10-06T04:37:39.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.430+0000 7fdf2297f240 1 Processor -- start 2023-10-06T04:37:39.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.430+0000 7fdf2297f240 1 -- start start 2023-10-06T04:37:39.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.430+0000 7fdf2297f240 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a66278b800 0x55a662787600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.430+0000 7fdf2297f240 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a66278bc00 0x55a662787b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.430+0000 7fdf2297f240 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a662828000 0x55a662788100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.430+0000 7fdf2297f240 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a661a0a3c0 con 0x55a66278b800 2023-10-06T04:37:39.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.430+0000 7fdf2297f240 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a661a0bcc0 con 0x55a66278bc00 2023-10-06T04:37:39.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.430+0000 7fdf2297f240 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a661a0adc0 con 0x55a662828000 2023-10-06T04:37:39.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.430+0000 7fdf1c64e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a66278b800 0x55a662787600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.430+0000 7fdf1c64e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a66278b800 0x55a662787600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54442/0 (socket says 172.21.15.8:54442) 2023-10-06T04:37:39.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.430+0000 7fdf1c64e700 1 -- 172.21.15.8:0/1399758322 learned_addr learned my addr 172.21.15.8:0/1399758322 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:39.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.430+0000 7fdf1be4d700 1 --2- 172.21.15.8:0/1399758322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a66278bc00 0x55a662787b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.430+0000 7fdf1b64c700 1 --2- 172.21.15.8:0/1399758322 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a662828000 0x55a662788100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.431+0000 7fdf1c64e700 1 -- 172.21.15.8:0/1399758322 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a662828000 msgr2=0x55a662788100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:39.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.431+0000 7fdf1c64e700 1 --2- 172.21.15.8:0/1399758322 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a662828000 0x55a662788100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.431+0000 7fdf1c64e700 1 -- 172.21.15.8:0/1399758322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a66278bc00 msgr2=0x55a662787b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:39.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.431+0000 7fdf1c64e700 1 --2- 172.21.15.8:0/1399758322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a66278bc00 0x55a662787b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.431+0000 7fdf1c64e700 1 -- 172.21.15.8:0/1399758322 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a6619ef860 con 0x55a66278b800 2023-10-06T04:37:39.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.431+0000 7fdf1c64e700 1 --2- 172.21.15.8:0/1399758322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a66278b800 0x55a662787600 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x55a6627c5110 tx=0x55a6627d4c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91f1a2cad62950ed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.431+0000 7fdf17644700 1 -- 172.21.15.8:0/1399758322 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a661a03080 con 0x55a66278b800 2023-10-06T04:37:39.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.431+0000 7fdf17644700 1 -- 172.21.15.8:0/1399758322 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a661a20000 con 0x55a66278b800 2023-10-06T04:37:39.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.431+0000 7fdf17644700 1 -- 172.21.15.8:0/1399758322 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a661a03600 con 0x55a66278b800 2023-10-06T04:37:39.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.431+0000 7fdf2297f240 1 -- 172.21.15.8:0/1399758322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a66278b800 msgr2=0x55a662787600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.431+0000 7fdf2297f240 1 --2- 172.21.15.8:0/1399758322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a66278b800 0x55a662787600 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x55a6627c5110 tx=0x55a6627d4c00 comp rx=0 tx=0).stop 2023-10-06T04:37:39.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.431+0000 7fdf2297f240 1 -- 172.21.15.8:0/1399758322 shutdown_connections 2023-10-06T04:37:39.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.431+0000 7fdf2297f240 1 --2- 172.21.15.8:0/1399758322 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a662828000 0x55a662788100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.431+0000 7fdf2297f240 1 --2- 172.21.15.8:0/1399758322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a66278b800 0x55a662787600 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.431+0000 7fdf2297f240 1 --2- 172.21.15.8:0/1399758322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a66278bc00 0x55a662787b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.431+0000 7fdf2297f240 1 -- 172.21.15.8:0/1399758322 >> 172.21.15.8:0/1399758322 conn(0x55a66278b000 msgr2=0x55a662751800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:39.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.431+0000 7fdf2297f240 1 -- 172.21.15.8:0/1399758322 shutdown_connections 2023-10-06T04:37:39.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.431+0000 7fdf2297f240 1 -- 172.21.15.8:0/1399758322 wait complete. 2023-10-06T04:37:39.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.432+0000 7fdf2297f240 1 Processor -- start 2023-10-06T04:37:39.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.432+0000 7fdf2297f240 1 -- start start 2023-10-06T04:37:39.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.432+0000 7fdf2297f240 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a66278bc00 0x55a662788c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.432+0000 7fdf2297f240 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a66278b800 0x55a662788680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.432+0000 7fdf2297f240 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a662828000 0x55a662788100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.432+0000 7fdf2297f240 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a661a0a000 con 0x55a66278bc00 2023-10-06T04:37:39.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.432+0000 7fdf2297f240 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a661a0b180 con 0x55a662828000 2023-10-06T04:37:39.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.432+0000 7fdf2297f240 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a661a0b040 con 0x55a66278b800 2023-10-06T04:37:39.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.433+0000 7fdf1c64e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a66278bc00 0x55a662788c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.433+0000 7fdf1c64e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a66278bc00 0x55a662788c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54444/0 (socket says 172.21.15.8:54444) 2023-10-06T04:37:39.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.433+0000 7fdf1c64e700 1 -- 172.21.15.8:0/1290104697 learned_addr learned my addr 172.21.15.8:0/1290104697 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:39.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.433+0000 7fdf1be4d700 1 --2- 172.21.15.8:0/1290104697 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a66278b800 0x55a662788680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.433+0000 7fdf1b64c700 1 --2- 172.21.15.8:0/1290104697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a662828000 0x55a662788100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.433+0000 7fdf1c64e700 1 -- 172.21.15.8:0/1290104697 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a66278b800 msgr2=0x55a662788680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.433+0000 7fdf1c64e700 1 --2- 172.21.15.8:0/1290104697 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a66278b800 0x55a662788680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.433+0000 7fdf1c64e700 1 -- 172.21.15.8:0/1290104697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a662828000 msgr2=0x55a662788100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.433+0000 7fdf1c64e700 1 --2- 172.21.15.8:0/1290104697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a662828000 0x55a662788100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.433+0000 7fdf1c64e700 1 -- 172.21.15.8:0/1290104697 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a6619ee9c0 con 0x55a66278bc00 2023-10-06T04:37:39.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.433+0000 7fdf1b64c700 1 --2- 172.21.15.8:0/1290104697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a662828000 0x55a662788100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:39.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.433+0000 7fdf1c64e700 1 --2- 172.21.15.8:0/1290104697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a66278bc00 0x55a662788c00 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x55a6627c5dd0 tx=0x55a6627d4cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.433+0000 7fdf15e41700 1 -- 172.21.15.8:0/1290104697 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a661a02dc0 con 0x55a66278bc00 2023-10-06T04:37:39.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.434+0000 7fdf15e41700 1 -- 172.21.15.8:0/1290104697 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a661a20000 con 0x55a66278bc00 2023-10-06T04:37:39.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.434+0000 7fdf2297f240 1 -- 172.21.15.8:0/1290104697 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a6619efa00 con 0x55a66278bc00 2023-10-06T04:37:39.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.434+0000 7fdf15e41700 1 -- 172.21.15.8:0/1290104697 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a661a03080 con 0x55a66278bc00 2023-10-06T04:37:39.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.434+0000 7fdf2297f240 1 -- 172.21.15.8:0/1290104697 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a6619ef860 con 0x55a66278bc00 2023-10-06T04:37:39.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.434+0000 7fdf2297f240 4 main: resolving pool 8 2023-10-06T04:37:39.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.435+0000 7fdf15e41700 1 -- 172.21.15.8:0/1290104697 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x55a662741080 con 0x55a66278bc00 2023-10-06T04:37:39.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.435+0000 7fdf15e41700 1 --2- 172.21.15.8:0/1290104697 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x55a662846400 0x55a662789700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.435+0000 7fdf15e41700 1 -- 172.21.15.8:0/1290104697 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x55a661a0ea80 con 0x55a66278bc00 2023-10-06T04:37:39.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.435+0000 7fdf2297f240 4 main: creating IoCtx.. 2023-10-06T04:37:39.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.435+0000 7fdf2297f240 1 --2- 172.21.15.8:0/1290104697 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x55a662828400 0x55a662787b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.435+0000 7fdf2297f240 1 -- 172.21.15.8:0/1290104697 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:1 8.b 8:d0630e4c:::mds0_sessionmap:head [omap-clear,omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a662828800 con 0x55a662828400 2023-10-06T04:37:39.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.435+0000 7fdf1be4d700 1 --2- 172.21.15.8:0/1290104697 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x55a662846400 0x55a662789700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.435+0000 7fdf1b64c700 1 --2- 172.21.15.8:0/1290104697 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x55a662828400 0x55a662787b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.436+0000 7fdf1b64c700 1 --2- 172.21.15.8:0/1290104697 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x55a662828400 0x55a662787b80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.436+0000 7fdf1be4d700 1 --2- 172.21.15.8:0/1290104697 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x55a662846400 0x55a662789700 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x55a662757350 tx=0x55a6627d5e60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.444 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T04:37:39.445 INFO:teuthology.orchestra.run.smithi008.stdout: "0": { 2023-10-06T04:37:39.445 INFO:teuthology.orchestra.run.smithi008.stdout: "data": {}, 2023-10-06T04:37:39.445 INFO:teuthology.orchestra.run.smithi008.stdout: "result": 0 2023-10-06T04:37:39.445 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T04:37:39.445 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T04:37:39.445 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:39.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.437+0000 7fdf1b64c700 1 -- 172.21.15.8:0/1290104697 <== osd.3 v2:172.21.15.8:6823/90671 1 ==== osd_op_reply(1 mds0_sessionmap [omap-clear,omap-set-header] v46'1 uv1 ondisk = 0) v8 ==== 201+0+0 (crc 0 0 0) 0x55a662792fc0 con 0x55a662828400 2023-10-06T04:37:39.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.437+0000 7fdf2297f240 1 -- 172.21.15.8:0/1290104697 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x55a662828400 msgr2=0x55a662787b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.437+0000 7fdf2297f240 1 --2- 172.21.15.8:0/1290104697 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x55a662828400 0x55a662787b80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.437+0000 7fdf2297f240 1 -- 172.21.15.8:0/1290104697 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x55a662846400 msgr2=0x55a662789700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.437+0000 7fdf2297f240 1 --2- 172.21.15.8:0/1290104697 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x55a662846400 0x55a662789700 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x55a662757350 tx=0x55a6627d5e60 comp rx=0 tx=0).stop 2023-10-06T04:37:39.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.437+0000 7fdf2297f240 1 -- 172.21.15.8:0/1290104697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a66278bc00 msgr2=0x55a662788c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.437+0000 7fdf2297f240 1 --2- 172.21.15.8:0/1290104697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a66278bc00 0x55a662788c00 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x55a6627c5dd0 tx=0x55a6627d4cc0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.437+0000 7fdf1be4d700 1 -- 172.21.15.8:0/1290104697 reap_dead start 2023-10-06T04:37:39.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.437+0000 7fdf2297f240 1 -- 172.21.15.8:0/1290104697 shutdown_connections 2023-10-06T04:37:39.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.437+0000 7fdf2297f240 1 -- 172.21.15.8:0/1290104697 >> 172.21.15.8:0/1290104697 conn(0x55a66278b000 msgr2=0x55a662751800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:39.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.437+0000 7fdf2297f240 1 -- 172.21.15.8:0/1290104697 shutdown_connections 2023-10-06T04:37:39.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.437+0000 7fdf2297f240 1 -- 172.21.15.8:0/1290104697 wait complete. 2023-10-06T04:37:39.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.438+0000 7fdf2297f240 1 -- 172.21.15.8:0/268517835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a66278a800 msgr2=0x55a662786b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.438+0000 7fdf2297f240 1 --2- 172.21.15.8:0/268517835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a66278a800 0x55a662786b00 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x55a662757d10 tx=0x55a66275d980 comp rx=0 tx=0).stop 2023-10-06T04:37:39.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.438+0000 7fdf2297f240 1 -- 172.21.15.8:0/268517835 shutdown_connections 2023-10-06T04:37:39.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.438+0000 7fdf2297f240 1 --2- 172.21.15.8:0/268517835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a66278ac00 0x55a662787080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.438+0000 7fdf2297f240 1 --2- 172.21.15.8:0/268517835 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a66278a400 0x55a662786580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.438+0000 7fdf2297f240 1 --2- 172.21.15.8:0/268517835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a66278a800 0x55a662786b00 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.438+0000 7fdf2297f240 1 -- 172.21.15.8:0/268517835 >> 172.21.15.8:0/268517835 conn(0x55a66278a000 msgr2=0x55a662751000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:39.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.438+0000 7fdf2297f240 1 -- 172.21.15.8:0/268517835 shutdown_connections 2023-10-06T04:37:39.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.438+0000 7fdf2297f240 1 -- 172.21.15.8:0/268517835 wait complete. 2023-10-06T04:37:39.449 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'recovery_fs:0', 'reset', 'session'] in time 0:00:00.093262, result: { "0": { "data": {}, "result": 0 } } 2023-10-06T04:37:39.449 DEBUG:teuthology.orchestra.run.smithi008:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 recovery_fs:0 reset snap 2023-10-06T04:37:39.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.524+0000 7f3818a65240 1 -- start start 2023-10-06T04:37:39.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.524+0000 7f3818a65240 1 Processor -- start 2023-10-06T04:37:39.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.525+0000 7f3818a65240 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558238398400 0x558238fda580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.525+0000 7f3818a65240 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558238398800 0x558238fdab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.525+0000 7f3818a65240 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x558238398c00 0x558238fdb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.525+0000 7f3818a65240 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558238262dc0 con 0x558238398800 2023-10-06T04:37:39.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.525+0000 7f3818a65240 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x558238263cc0 con 0x558238398400 2023-10-06T04:37:39.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.525+0000 7f3818a65240 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x5582382623c0 con 0x558238398c00 2023-10-06T04:37:39.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.525+0000 7f3811732700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558238398800 0x558238fdab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.525+0000 7f3811732700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558238398800 0x558238fdab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54466/0 (socket says 172.21.15.8:54466) 2023-10-06T04:37:39.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.525+0000 7f3811732700 1 -- 172.21.15.8:0/2882574851 learned_addr learned my addr 172.21.15.8:0/2882574851 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:39.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.525+0000 7f3811f33700 1 --2- 172.21.15.8:0/2882574851 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558238398400 0x558238fda580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.525+0000 7f3812734700 1 --2- 172.21.15.8:0/2882574851 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x558238398c00 0x558238fdb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.525+0000 7f3811732700 1 -- 172.21.15.8:0/2882574851 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x558238398c00 msgr2=0x558238fdb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:39.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.525+0000 7f3811732700 1 --2- 172.21.15.8:0/2882574851 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x558238398c00 0x558238fdb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.525+0000 7f3811732700 1 -- 172.21.15.8:0/2882574851 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558238398400 msgr2=0x558238fda580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:39.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.525+0000 7f3811732700 1 --2- 172.21.15.8:0/2882574851 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558238398400 0x558238fda580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.525+0000 7f3811732700 1 -- 172.21.15.8:0/2882574851 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558238246340 con 0x558238398800 2023-10-06T04:37:39.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.525+0000 7f3811732700 1 --2- 172.21.15.8:0/2882574851 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558238398800 0x558238fdab00 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x558238fafdd0 tx=0x558238fac9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c79fb6a66f3a5b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.525+0000 7f380f72e700 1 -- 172.21.15.8:0/2882574851 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55823825b600 con 0x558238398800 2023-10-06T04:37:39.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.525+0000 7f380f72e700 1 -- 172.21.15.8:0/2882574851 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558238278480 con 0x558238398800 2023-10-06T04:37:39.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.525+0000 7f380f72e700 1 -- 172.21.15.8:0/2882574851 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55823825b1e0 con 0x558238398800 2023-10-06T04:37:39.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.525+0000 7f3818a65240 1 -- 172.21.15.8:0/2882574851 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558238246000 con 0x558238398800 2023-10-06T04:37:39.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.525+0000 7f3818a65240 1 -- 172.21.15.8:0/2882574851 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x558238246ea0 con 0x558238398800 2023-10-06T04:37:39.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.525+0000 7f3818a65240 4 waiting for MDS map... 2023-10-06T04:37:39.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.525+0000 7f380f72e700 1 -- 172.21.15.8:0/2882574851 <== mon.0 v2:172.21.15.8:3300/0 4 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x558238266c40 con 0x558238398800 2023-10-06T04:37:39.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.526+0000 7f380f72e700 1 -- 172.21.15.8:0/2882574851 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 23) v1 ==== 3663+0+0 (secure 0 0 0) 0x558238ffc600 con 0x558238398800 2023-10-06T04:37:39.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.526+0000 7f3818a65240 4 Got MDS map 23 2023-10-06T04:37:39.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.526+0000 7f3818a65240 10 main: main 2023-10-06T04:37:39.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.526+0000 7f3818a65240 4 main: connecting to RADOS... 2023-10-06T04:37:39.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.526+0000 7f3818a65240 1 Processor -- start 2023-10-06T04:37:39.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.526+0000 7f3818a65240 1 -- start start 2023-10-06T04:37:39.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.527+0000 7f3818a65240 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x558238399800 0x558238fdb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.527+0000 7f3818a65240 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558238399c00 0x558238fdbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.527+0000 7f3818a65240 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558239074000 0x558238fdc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.527+0000 7f3818a65240 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558238262000 con 0x558238399c00 2023-10-06T04:37:39.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.527+0000 7f3818a65240 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582382eb040 con 0x558239074000 2023-10-06T04:37:39.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.527+0000 7f3818a65240 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x558238263cc0 con 0x558238399800 2023-10-06T04:37:39.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.527+0000 7f3811f33700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558238399c00 0x558238fdbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.527+0000 7f3811f33700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558238399c00 0x558238fdbb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54478/0 (socket says 172.21.15.8:54478) 2023-10-06T04:37:39.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.527+0000 7f3811f33700 1 -- 172.21.15.8:0/3285530276 learned_addr learned my addr 172.21.15.8:0/3285530276 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:39.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.527+0000 7f3811732700 1 --2- 172.21.15.8:0/3285530276 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558239074000 0x558238fdc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.527+0000 7f3812734700 1 --2- 172.21.15.8:0/3285530276 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x558238399800 0x558238fdb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.527+0000 7f3811f33700 1 -- 172.21.15.8:0/3285530276 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x558238399800 msgr2=0x558238fdb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:39.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.527+0000 7f3811f33700 1 --2- 172.21.15.8:0/3285530276 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x558238399800 0x558238fdb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.527+0000 7f3811f33700 1 -- 172.21.15.8:0/3285530276 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558239074000 msgr2=0x558238fdc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:39.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.527+0000 7f3811f33700 1 --2- 172.21.15.8:0/3285530276 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558239074000 0x558238fdc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.527+0000 7f3811f33700 1 -- 172.21.15.8:0/3285530276 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558238247860 con 0x558238399c00 2023-10-06T04:37:39.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.527+0000 7f3811f33700 1 --2- 172.21.15.8:0/3285530276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558238399c00 0x558238fdbb80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x558239011320 tx=0x558239020c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=625acd97e575a16c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.527+0000 7f380d72a700 1 -- 172.21.15.8:0/3285530276 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55823825b600 con 0x558238399c00 2023-10-06T04:37:39.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.527+0000 7f380d72a700 1 -- 172.21.15.8:0/3285530276 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558238278c00 con 0x558238399c00 2023-10-06T04:37:39.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.527+0000 7f380d72a700 1 -- 172.21.15.8:0/3285530276 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55823825b1e0 con 0x558238399c00 2023-10-06T04:37:39.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.528+0000 7f3818a65240 1 -- 172.21.15.8:0/3285530276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558238399c00 msgr2=0x558238fdbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.528+0000 7f3818a65240 1 --2- 172.21.15.8:0/3285530276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558238399c00 0x558238fdbb80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x558239011320 tx=0x558239020c00 comp rx=0 tx=0).stop 2023-10-06T04:37:39.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.528+0000 7f3818a65240 1 -- 172.21.15.8:0/3285530276 shutdown_connections 2023-10-06T04:37:39.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.528+0000 7f3818a65240 1 --2- 172.21.15.8:0/3285530276 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558239074000 0x558238fdc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.528+0000 7f3818a65240 1 --2- 172.21.15.8:0/3285530276 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x558238399800 0x558238fdb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.528+0000 7f3818a65240 1 --2- 172.21.15.8:0/3285530276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558238399c00 0x558238fdbb80 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.528+0000 7f3818a65240 1 -- 172.21.15.8:0/3285530276 >> 172.21.15.8:0/3285530276 conn(0x558238399000 msgr2=0x558238313800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:39.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.528+0000 7f3818a65240 1 -- 172.21.15.8:0/3285530276 shutdown_connections 2023-10-06T04:37:39.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.528+0000 7f3818a65240 1 -- 172.21.15.8:0/3285530276 wait complete. 2023-10-06T04:37:39.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.528+0000 7f3818a65240 1 Processor -- start 2023-10-06T04:37:39.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.528+0000 7f3818a65240 1 -- start start 2023-10-06T04:37:39.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.529+0000 7f3818a65240 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x558238399c00 0x558238fdcc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.529+0000 7f3818a65240 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558238399800 0x558238fdc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.529+0000 7f3818a65240 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55823908c000 0x558238fdc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.529+0000 7f3818a65240 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558238263180 con 0x558238399800 2023-10-06T04:37:39.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.529+0000 7f3818a65240 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x558238263040 con 0x55823908c000 2023-10-06T04:37:39.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.529+0000 7f3818a65240 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x558238262f00 con 0x558238399c00 2023-10-06T04:37:39.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.529+0000 7f3811f33700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558238399800 0x558238fdc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.529+0000 7f3811f33700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558238399800 0x558238fdc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54482/0 (socket says 172.21.15.8:54482) 2023-10-06T04:37:39.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.529+0000 7f3811f33700 1 -- 172.21.15.8:0/1002569718 learned_addr learned my addr 172.21.15.8:0/1002569718 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:39.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.529+0000 7f3812734700 1 --2- 172.21.15.8:0/1002569718 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x558238399c00 0x558238fdcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.529+0000 7f3811732700 1 --2- 172.21.15.8:0/1002569718 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55823908c000 0x558238fdc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.530+0000 7f3811f33700 1 -- 172.21.15.8:0/1002569718 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x558238399c00 msgr2=0x558238fdcc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.530+0000 7f3811f33700 1 --2- 172.21.15.8:0/1002569718 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x558238399c00 0x558238fdcc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.530+0000 7f3811f33700 1 -- 172.21.15.8:0/1002569718 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55823908c000 msgr2=0x558238fdc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.530+0000 7f3811f33700 1 --2- 172.21.15.8:0/1002569718 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55823908c000 0x558238fdc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.530+0000 7f3811f33700 1 -- 172.21.15.8:0/1002569718 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558238246340 con 0x558238399800 2023-10-06T04:37:39.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.530+0000 7f3811f33700 1 --2- 172.21.15.8:0/1002569718 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558238399800 0x558238fdc680 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x55823909c000 tx=0x558239020cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.530+0000 7f380bf27700 1 -- 172.21.15.8:0/1002569718 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55823825adc0 con 0x558238399800 2023-10-06T04:37:39.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.530+0000 7f380bf27700 1 -- 172.21.15.8:0/1002569718 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558238278d80 con 0x558238399800 2023-10-06T04:37:39.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.530+0000 7f380bf27700 1 -- 172.21.15.8:0/1002569718 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55823825b600 con 0x558238399800 2023-10-06T04:37:39.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.530+0000 7f3818a65240 1 -- 172.21.15.8:0/1002569718 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558238247a00 con 0x558238399800 2023-10-06T04:37:39.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.530+0000 7f3818a65240 1 -- 172.21.15.8:0/1002569718 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558238247860 con 0x558238399800 2023-10-06T04:37:39.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.530+0000 7f3818a65240 4 main: resolving pool 8 2023-10-06T04:37:39.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.531+0000 7f380bf27700 1 -- 172.21.15.8:0/1002569718 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x558238f99080 con 0x558238399800 2023-10-06T04:37:39.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.531+0000 7f380bf27700 1 --2- 172.21.15.8:0/1002569718 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x55823909a400 0x558238fdd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.532+0000 7f380bf27700 1 -- 172.21.15.8:0/1002569718 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x558238266a80 con 0x558238399800 2023-10-06T04:37:39.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.532+0000 7f3818a65240 4 main: creating IoCtx.. 2023-10-06T04:37:39.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.532+0000 7f3818a65240 1 --2- 172.21.15.8:0/1002569718 >> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] conn(0x55823908c400 0x558238fdbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.532+0000 7f3818a65240 1 -- 172.21.15.8:0/1002569718 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:1 8.d 8:b50e409b:::mds_snaptable:head [writefull 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x55823908c800 con 0x55823908c400 2023-10-06T04:37:39.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.532+0000 7f3812734700 1 --2- 172.21.15.8:0/1002569718 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x55823909a400 0x558238fdd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.532+0000 7f3811732700 1 --2- 172.21.15.8:0/1002569718 >> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] conn(0x55823908c400 0x558238fdbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.532+0000 7f3812734700 1 --2- 172.21.15.8:0/1002569718 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x55823909a400 0x558238fdd700 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x558238fae810 tx=0x558238fee420 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.532+0000 7f3811732700 1 --2- 172.21.15.8:0/1002569718 >> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] conn(0x55823908c400 0x558238fdbb80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.545 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T04:37:39.545 INFO:teuthology.orchestra.run.smithi008.stdout: "result": 0 2023-10-06T04:37:39.545 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T04:37:39.545 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:39.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.534+0000 7f3811732700 1 -- 172.21.15.8:0/1002569718 <== osd.5 v2:172.21.15.184:6824/90894 1 ==== osd_op_reply(1 mds_snaptable [writefull 0~70] v46'1 uv1 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x558238fe8fc0 con 0x55823908c400 2023-10-06T04:37:39.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.534+0000 7f3818a65240 1 -- 172.21.15.8:0/1002569718 >> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] conn(0x55823908c400 msgr2=0x558238fdbb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.534+0000 7f3818a65240 1 --2- 172.21.15.8:0/1002569718 >> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] conn(0x55823908c400 0x558238fdbb80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.534+0000 7f3818a65240 1 -- 172.21.15.8:0/1002569718 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x55823909a400 msgr2=0x558238fdd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.534+0000 7f3818a65240 1 --2- 172.21.15.8:0/1002569718 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x55823909a400 0x558238fdd700 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x558238fae810 tx=0x558238fee420 comp rx=0 tx=0).stop 2023-10-06T04:37:39.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.534+0000 7f3818a65240 1 -- 172.21.15.8:0/1002569718 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558238399800 msgr2=0x558238fdc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.534+0000 7f3818a65240 1 --2- 172.21.15.8:0/1002569718 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558238399800 0x558238fdc680 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x55823909c000 tx=0x558239020cc0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.534+0000 7f3811f33700 1 -- 172.21.15.8:0/1002569718 reap_dead start 2023-10-06T04:37:39.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.534+0000 7f3818a65240 1 -- 172.21.15.8:0/1002569718 shutdown_connections 2023-10-06T04:37:39.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.534+0000 7f3818a65240 1 -- 172.21.15.8:0/1002569718 >> 172.21.15.8:0/1002569718 conn(0x558238399000 msgr2=0x558238313800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:39.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.534+0000 7f3818a65240 1 -- 172.21.15.8:0/1002569718 shutdown_connections 2023-10-06T04:37:39.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.534+0000 7f3818a65240 1 -- 172.21.15.8:0/1002569718 wait complete. 2023-10-06T04:37:39.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.534+0000 7f3818a65240 1 -- 172.21.15.8:0/2882574851 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558238398800 msgr2=0x558238fdab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.534+0000 7f3818a65240 1 --2- 172.21.15.8:0/2882574851 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558238398800 0x558238fdab00 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x558238fafdd0 tx=0x558238fac9c0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.534+0000 7f3818a65240 1 -- 172.21.15.8:0/2882574851 shutdown_connections 2023-10-06T04:37:39.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.534+0000 7f3818a65240 1 --2- 172.21.15.8:0/2882574851 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x558238398c00 0x558238fdb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.534+0000 7f3818a65240 1 --2- 172.21.15.8:0/2882574851 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558238398400 0x558238fda580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.534+0000 7f3818a65240 1 --2- 172.21.15.8:0/2882574851 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558238398800 0x558238fdab00 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.534+0000 7f3818a65240 1 -- 172.21.15.8:0/2882574851 >> 172.21.15.8:0/2882574851 conn(0x558238398000 msgr2=0x558238313000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:39.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.534+0000 7f3818a65240 1 -- 172.21.15.8:0/2882574851 shutdown_connections 2023-10-06T04:37:39.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.534+0000 7f3818a65240 1 -- 172.21.15.8:0/2882574851 wait complete. 2023-10-06T04:37:39.549 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'recovery_fs:0', 'reset', 'snap'] in time 0:00:00.100270, result: { "result": 0 } 2023-10-06T04:37:39.550 DEBUG:teuthology.orchestra.run.smithi008:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 recovery_fs:0 reset inode 2023-10-06T04:37:39.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.622+0000 7f6e1ff31240 1 -- start start 2023-10-06T04:37:39.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.622+0000 7f6e1ff31240 1 Processor -- start 2023-10-06T04:37:39.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.622+0000 7f6e1ff31240 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555d9b96a400 0x555d9b95c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.622+0000 7f6e1ff31240 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d9b96a800 0x555d9b95cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.622+0000 7f6e1ff31240 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d9b96ac00 0x555d9b95d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.622+0000 7f6e1ff31240 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d9abeadc0 con 0x555d9b96a800 2023-10-06T04:37:39.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.622+0000 7f6e1ff31240 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d9abebcc0 con 0x555d9b96ac00 2023-10-06T04:37:39.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.622+0000 7f6e1ff31240 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x555d9abea3c0 con 0x555d9b96a400 2023-10-06T04:37:39.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.622+0000 7f6e18bfe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d9b96a800 0x555d9b95cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.622+0000 7f6e18bfe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d9b96a800 0x555d9b95cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54504/0 (socket says 172.21.15.8:54504) 2023-10-06T04:37:39.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.622+0000 7f6e18bfe700 1 -- 172.21.15.8:0/4101071477 learned_addr learned my addr 172.21.15.8:0/4101071477 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:39.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.623+0000 7f6e19c00700 1 --2- 172.21.15.8:0/4101071477 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d9b96ac00 0x555d9b95d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.623+0000 7f6e193ff700 1 --2- 172.21.15.8:0/4101071477 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555d9b96a400 0x555d9b95c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.623+0000 7f6e18bfe700 1 -- 172.21.15.8:0/4101071477 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555d9b96a400 msgr2=0x555d9b95c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:39.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.623+0000 7f6e18bfe700 1 --2- 172.21.15.8:0/4101071477 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555d9b96a400 0x555d9b95c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.623+0000 7f6e18bfe700 1 -- 172.21.15.8:0/4101071477 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d9b96ac00 msgr2=0x555d9b95d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:39.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.623+0000 7f6e18bfe700 1 --2- 172.21.15.8:0/4101071477 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d9b96ac00 0x555d9b95d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.623+0000 7f6e18bfe700 1 -- 172.21.15.8:0/4101071477 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d9abceb60 con 0x555d9b96a800 2023-10-06T04:37:39.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.623+0000 7f6e18bfe700 1 --2- 172.21.15.8:0/4101071477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d9b96a800 0x555d9b95cb00 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x555d9b937c80 tx=0x555d9b9681e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18aa7c1f5ecc5a8f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.623+0000 7f6e16bfa700 1 -- 172.21.15.8:0/4101071477 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555d9abe3080 con 0x555d9b96a800 2023-10-06T04:37:39.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.623+0000 7f6e16bfa700 1 -- 172.21.15.8:0/4101071477 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555d9ac00600 con 0x555d9b96a800 2023-10-06T04:37:39.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.623+0000 7f6e16bfa700 1 -- 172.21.15.8:0/4101071477 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555d9abe3600 con 0x555d9b96a800 2023-10-06T04:37:39.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.623+0000 7f6e1ff31240 1 -- 172.21.15.8:0/4101071477 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555d9abce000 con 0x555d9b96a800 2023-10-06T04:37:39.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.623+0000 7f6e1ff31240 1 -- 172.21.15.8:0/4101071477 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x555d9abceea0 con 0x555d9b96a800 2023-10-06T04:37:39.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.623+0000 7f6e1ff31240 4 waiting for MDS map... 2023-10-06T04:37:39.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.623+0000 7f6e16bfa700 1 -- 172.21.15.8:0/4101071477 <== mon.0 v2:172.21.15.8:3300/0 4 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x555d9abeec40 con 0x555d9b96a800 2023-10-06T04:37:39.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.623+0000 7f6e16bfa700 1 -- 172.21.15.8:0/4101071477 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 23) v1 ==== 3663+0+0 (secure 0 0 0) 0x555d9b9a0900 con 0x555d9b96a800 2023-10-06T04:37:39.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.623+0000 7f6e1ff31240 4 Got MDS map 23 2023-10-06T04:37:39.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.623+0000 7f6e1ff31240 10 main: main 2023-10-06T04:37:39.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.623+0000 7f6e1ff31240 4 main: connecting to RADOS... 2023-10-06T04:37:39.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.624+0000 7f6e1ff31240 1 Processor -- start 2023-10-06T04:37:39.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.624+0000 7f6e1ff31240 1 -- start start 2023-10-06T04:37:39.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.624+0000 7f6e1ff31240 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d9b96b800 0x555d9b95d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.624+0000 7f6e1ff31240 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d9b96bc00 0x555d9b95db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.625+0000 7f6e1ff31240 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555d9ba02000 0x555d9b95e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.625+0000 7f6e1ff31240 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d9abea000 con 0x555d9b96bc00 2023-10-06T04:37:39.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.625+0000 7f6e1ff31240 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d9abeb180 con 0x555d9b96b800 2023-10-06T04:37:39.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.625+0000 7f6e1ff31240 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x555d9ac73040 con 0x555d9ba02000 2023-10-06T04:37:39.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.625+0000 7f6e193ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d9b96bc00 0x555d9b95db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.625+0000 7f6e193ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d9b96bc00 0x555d9b95db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54506/0 (socket says 172.21.15.8:54506) 2023-10-06T04:37:39.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.625+0000 7f6e193ff700 1 -- 172.21.15.8:0/980605099 learned_addr learned my addr 172.21.15.8:0/980605099 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:39.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.625+0000 7f6e193ff700 1 -- 172.21.15.8:0/980605099 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555d9ba02000 msgr2=0x555d9b95e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:39.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.625+0000 7f6e19c00700 1 --2- 172.21.15.8:0/980605099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d9b96b800 0x555d9b95d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.625+0000 7f6e193ff700 1 --2- 172.21.15.8:0/980605099 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555d9ba02000 0x555d9b95e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.625+0000 7f6e193ff700 1 -- 172.21.15.8:0/980605099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d9b96b800 msgr2=0x555d9b95d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:39.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.625+0000 7f6e193ff700 1 --2- 172.21.15.8:0/980605099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d9b96b800 0x555d9b95d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.625+0000 7f6e193ff700 1 -- 172.21.15.8:0/980605099 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d9abcf860 con 0x555d9b96bc00 2023-10-06T04:37:39.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.625+0000 7f6e193ff700 1 --2- 172.21.15.8:0/980605099 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d9b96bc00 0x555d9b95db80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x555d9b9a71a0 tx=0x555d9b9b2c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7582674eb2910a9e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.625+0000 7f6e14bf6700 1 -- 172.21.15.8:0/980605099 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555d9abe3080 con 0x555d9b96bc00 2023-10-06T04:37:39.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.625+0000 7f6e14bf6700 1 -- 172.21.15.8:0/980605099 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555d9ac00c00 con 0x555d9b96bc00 2023-10-06T04:37:39.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.625+0000 7f6e14bf6700 1 -- 172.21.15.8:0/980605099 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555d9abe3600 con 0x555d9b96bc00 2023-10-06T04:37:39.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.626+0000 7f6e1ff31240 1 -- 172.21.15.8:0/980605099 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d9b96bc00 msgr2=0x555d9b95db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.626+0000 7f6e1ff31240 1 --2- 172.21.15.8:0/980605099 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d9b96bc00 0x555d9b95db80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x555d9b9a71a0 tx=0x555d9b9b2c00 comp rx=0 tx=0).stop 2023-10-06T04:37:39.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.626+0000 7f6e1ff31240 1 -- 172.21.15.8:0/980605099 shutdown_connections 2023-10-06T04:37:39.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.626+0000 7f6e1ff31240 1 --2- 172.21.15.8:0/980605099 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555d9ba02000 0x555d9b95e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.626+0000 7f6e1ff31240 1 --2- 172.21.15.8:0/980605099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d9b96b800 0x555d9b95d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.626+0000 7f6e1ff31240 1 --2- 172.21.15.8:0/980605099 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d9b96bc00 0x555d9b95db80 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.626+0000 7f6e1ff31240 1 -- 172.21.15.8:0/980605099 >> 172.21.15.8:0/980605099 conn(0x555d9b96b000 msgr2=0x555d9ac9b800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:39.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.626+0000 7f6e1ff31240 1 -- 172.21.15.8:0/980605099 shutdown_connections 2023-10-06T04:37:39.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.626+0000 7f6e1ff31240 1 -- 172.21.15.8:0/980605099 wait complete. 2023-10-06T04:37:39.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.626+0000 7f6e1ff31240 1 Processor -- start 2023-10-06T04:37:39.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.626+0000 7f6e1ff31240 1 -- start start 2023-10-06T04:37:39.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.627+0000 7f6e1ff31240 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d9b96bc00 0x555d9b95ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.627+0000 7f6e1ff31240 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d9b96b800 0x555d9b95e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.627+0000 7f6e1ff31240 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555d9ba20000 0x555d9b95e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.627+0000 7f6e1ff31240 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d9ac73180 con 0x555d9b96bc00 2023-10-06T04:37:39.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.627+0000 7f6e1ff31240 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d9abea3c0 con 0x555d9b96b800 2023-10-06T04:37:39.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.627+0000 7f6e1ff31240 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x555d9abeb040 con 0x555d9ba20000 2023-10-06T04:37:39.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.627+0000 7f6e19c00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d9b96bc00 0x555d9b95ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.627+0000 7f6e19c00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d9b96bc00 0x555d9b95ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54514/0 (socket says 172.21.15.8:54514) 2023-10-06T04:37:39.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.627+0000 7f6e19c00700 1 -- 172.21.15.8:0/43770311 learned_addr learned my addr 172.21.15.8:0/43770311 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:39.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.627+0000 7f6e193ff700 1 --2- 172.21.15.8:0/43770311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d9b96b800 0x555d9b95e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.627+0000 7f6e18bfe700 1 --2- 172.21.15.8:0/43770311 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555d9ba20000 0x555d9b95e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.627+0000 7f6e19c00700 1 -- 172.21.15.8:0/43770311 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555d9ba20000 msgr2=0x555d9b95e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.627+0000 7f6e19c00700 1 --2- 172.21.15.8:0/43770311 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555d9ba20000 0x555d9b95e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.627+0000 7f6e19c00700 1 -- 172.21.15.8:0/43770311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d9b96b800 msgr2=0x555d9b95e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.627+0000 7f6e19c00700 1 --2- 172.21.15.8:0/43770311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d9b96b800 0x555d9b95e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.627+0000 7f6e19c00700 1 -- 172.21.15.8:0/43770311 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d9abce9c0 con 0x555d9b96bc00 2023-10-06T04:37:39.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.627+0000 7f6e193ff700 1 --2- 172.21.15.8:0/43770311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d9b96b800 0x555d9b95e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:39.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.627+0000 7f6e18bfe700 1 --2- 172.21.15.8:0/43770311 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555d9ba20000 0x555d9b95e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:39.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.627+0000 7f6e19c00700 1 --2- 172.21.15.8:0/43770311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d9b96bc00 0x555d9b95ec00 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x555d9b9a7e60 tx=0x555d9b9b2d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.627+0000 7f6e133f3700 1 -- 172.21.15.8:0/43770311 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555d9abe3080 con 0x555d9b96bc00 2023-10-06T04:37:39.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.627+0000 7f6e133f3700 1 -- 172.21.15.8:0/43770311 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555d9ac00f00 con 0x555d9b96bc00 2023-10-06T04:37:39.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.627+0000 7f6e133f3700 1 -- 172.21.15.8:0/43770311 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555d9abe3600 con 0x555d9b96bc00 2023-10-06T04:37:39.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.627+0000 7f6e1ff31240 1 -- 172.21.15.8:0/43770311 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555d9abcfa00 con 0x555d9b96bc00 2023-10-06T04:37:39.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.628+0000 7f6e1ff31240 1 -- 172.21.15.8:0/43770311 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555d9abce9c0 con 0x555d9b96bc00 2023-10-06T04:37:39.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.628+0000 7f6e1ff31240 4 main: resolving pool 8 2023-10-06T04:37:39.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.629+0000 7f6e133f3700 1 -- 172.21.15.8:0/43770311 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x555d9b921080 con 0x555d9b96bc00 2023-10-06T04:37:39.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.629+0000 7f6e133f3700 1 --2- 172.21.15.8:0/43770311 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x555d9ba28400 0x555d9b95f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.629+0000 7f6e133f3700 1 -- 172.21.15.8:0/43770311 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x555d9abeea80 con 0x555d9b96bc00 2023-10-06T04:37:39.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.629+0000 7f6e1ff31240 4 main: creating IoCtx.. 2023-10-06T04:37:39.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.629+0000 7f6e1ff31240 1 --2- 172.21.15.8:0/43770311 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x555d9ba20400 0x555d9b95db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.629+0000 7f6e1ff31240 1 -- 172.21.15.8:0/43770311 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:1 8.13 8:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x555d9ba20800 con 0x555d9ba20400 2023-10-06T04:37:39.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.629+0000 7f6e193ff700 1 --2- 172.21.15.8:0/43770311 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x555d9ba28400 0x555d9b95f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.629+0000 7f6e18bfe700 1 --2- 172.21.15.8:0/43770311 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x555d9ba20400 0x555d9b95db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.630+0000 7f6e18bfe700 1 --2- 172.21.15.8:0/43770311 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x555d9ba20400 0x555d9b95db80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.630+0000 7f6e193ff700 1 --2- 172.21.15.8:0/43770311 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x555d9ba28400 0x555d9b95f700 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x555d9b9a71a0 tx=0x555d9b9b2cc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.631+0000 7f6e18bfe700 1 -- 172.21.15.8:0/43770311 <== osd.3 v2:172.21.15.8:6823/90671 1 ==== osd_op_reply(1 mds0_inotable [writefull 0~34] v46'2 uv2 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x555d9b97afc0 con 0x555d9ba20400 2023-10-06T04:37:39.639 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T04:37:39.639 INFO:teuthology.orchestra.run.smithi008.stdout: "0": { 2023-10-06T04:37:39.639 INFO:teuthology.orchestra.run.smithi008.stdout: "data": {}, 2023-10-06T04:37:39.639 INFO:teuthology.orchestra.run.smithi008.stdout: "result": 0 2023-10-06T04:37:39.639 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T04:37:39.639 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T04:37:39.639 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:39.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.631+0000 7f6e1ff31240 1 -- 172.21.15.8:0/43770311 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x555d9ba20400 msgr2=0x555d9b95db80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.631+0000 7f6e1ff31240 1 --2- 172.21.15.8:0/43770311 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x555d9ba20400 0x555d9b95db80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.631+0000 7f6e1ff31240 1 -- 172.21.15.8:0/43770311 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x555d9ba28400 msgr2=0x555d9b95f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.631+0000 7f6e1ff31240 1 --2- 172.21.15.8:0/43770311 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x555d9ba28400 0x555d9b95f700 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x555d9b9a71a0 tx=0x555d9b9b2cc0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.631+0000 7f6e1ff31240 1 -- 172.21.15.8:0/43770311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d9b96bc00 msgr2=0x555d9b95ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.631+0000 7f6e1ff31240 1 --2- 172.21.15.8:0/43770311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d9b96bc00 0x555d9b95ec00 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x555d9b9a7e60 tx=0x555d9b9b2d20 comp rx=0 tx=0).stop 2023-10-06T04:37:39.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.631+0000 7f6e193ff700 1 -- 172.21.15.8:0/43770311 reap_dead start 2023-10-06T04:37:39.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.631+0000 7f6e1ff31240 1 -- 172.21.15.8:0/43770311 shutdown_connections 2023-10-06T04:37:39.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.631+0000 7f6e1ff31240 1 -- 172.21.15.8:0/43770311 >> 172.21.15.8:0/43770311 conn(0x555d9b96b000 msgr2=0x555d9ac9b800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:39.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.631+0000 7f6e1ff31240 1 -- 172.21.15.8:0/43770311 shutdown_connections 2023-10-06T04:37:39.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.631+0000 7f6e1ff31240 1 -- 172.21.15.8:0/43770311 wait complete. 2023-10-06T04:37:39.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.631+0000 7f6e1ff31240 1 -- 172.21.15.8:0/4101071477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d9b96a800 msgr2=0x555d9b95cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.631+0000 7f6e1ff31240 1 --2- 172.21.15.8:0/4101071477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d9b96a800 0x555d9b95cb00 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x555d9b937c80 tx=0x555d9b9681e0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.631+0000 7f6e1ff31240 1 -- 172.21.15.8:0/4101071477 shutdown_connections 2023-10-06T04:37:39.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.631+0000 7f6e1ff31240 1 --2- 172.21.15.8:0/4101071477 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d9b96ac00 0x555d9b95d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.631+0000 7f6e1ff31240 1 --2- 172.21.15.8:0/4101071477 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555d9b96a400 0x555d9b95c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.631+0000 7f6e1ff31240 1 --2- 172.21.15.8:0/4101071477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d9b96a800 0x555d9b95cb00 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.631+0000 7f6e1ff31240 1 -- 172.21.15.8:0/4101071477 >> 172.21.15.8:0/4101071477 conn(0x555d9b96a000 msgr2=0x555d9ac9b000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:39.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.631+0000 7f6e1ff31240 1 -- 172.21.15.8:0/4101071477 shutdown_connections 2023-10-06T04:37:39.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.632+0000 7f6e1ff31240 1 -- 172.21.15.8:0/4101071477 wait complete. 2023-10-06T04:37:39.643 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'recovery_fs:0', 'reset', 'inode'] in time 0:00:00.093540, result: { "0": { "data": {}, "result": 0 } } 2023-10-06T04:37:39.643 DEBUG:teuthology.orchestra.run.smithi008:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents --alternate-pool recovery_fs_metadata --filesystem cephfs cephfs_data 2023-10-06T04:37:39.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.719+0000 7f438137e740 1 -- start start 2023-10-06T04:37:39.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.719+0000 7f438137e740 1 Processor -- start 2023-10-06T04:37:39.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.720+0000 7f438137e740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a30585d000 0x55a306495b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.720+0000 7f438137e740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a30585dc00 0x55a306495080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.720+0000 7f438137e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a30585c800 0x55a306494580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.720+0000 7f438137e740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a305726dc0 con 0x55a30585dc00 2023-10-06T04:37:39.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.720+0000 7f438137e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a305727040 con 0x55a30585c800 2023-10-06T04:37:39.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.720+0000 7f438137e740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a305727180 con 0x55a30585d000 2023-10-06T04:37:39.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.720+0000 7f4379dea700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a30585dc00 0x55a306495080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.720+0000 7f4379dea700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a30585dc00 0x55a306495080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54534/0 (socket says 172.21.15.8:54534) 2023-10-06T04:37:39.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.720+0000 7f4379dea700 1 -- 172.21.15.8:0/3128542879 learned_addr learned my addr 172.21.15.8:0/3128542879 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:39.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.720+0000 7f437a5eb700 1 --2- 172.21.15.8:0/3128542879 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a30585d000 0x55a306495b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.720+0000 7f437adec700 1 --2- 172.21.15.8:0/3128542879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a30585c800 0x55a306494580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.720+0000 7f4379dea700 1 -- 172.21.15.8:0/3128542879 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a30585d000 msgr2=0x55a306495b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:39.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.720+0000 7f4379dea700 1 --2- 172.21.15.8:0/3128542879 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a30585d000 0x55a306495b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.720+0000 7f4379dea700 1 -- 172.21.15.8:0/3128542879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a30585c800 msgr2=0x55a306494580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:39.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.720+0000 7f4379dea700 1 --2- 172.21.15.8:0/3128542879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a30585c800 0x55a306494580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.720+0000 7f4379dea700 1 -- 172.21.15.8:0/3128542879 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a30570aea0 con 0x55a30585dc00 2023-10-06T04:37:39.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.720+0000 7f437adec700 1 --2- 172.21.15.8:0/3128542879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a30585c800 0x55a306494580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:39.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.720+0000 7f4379dea700 1 --2- 172.21.15.8:0/3128542879 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a30585dc00 0x55a306495080 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x55a3064b47e0 tx=0x55a306478a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b7c73d3a14cec8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.721+0000 7f4377de6700 1 -- 172.21.15.8:0/3128542879 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a30571f080 con 0x55a30585dc00 2023-10-06T04:37:39.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.721+0000 7f4377de6700 1 -- 172.21.15.8:0/3128542879 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a30573cf00 con 0x55a30585dc00 2023-10-06T04:37:39.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.721+0000 7f4377de6700 1 -- 172.21.15.8:0/3128542879 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a30571f600 con 0x55a30585dc00 2023-10-06T04:37:39.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.721+0000 7f438137e740 1 -- 172.21.15.8:0/3128542879 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a30570b860 con 0x55a30585dc00 2023-10-06T04:37:39.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.721+0000 7f438137e740 1 -- 172.21.15.8:0/3128542879 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55a30570ba00 con 0x55a30585dc00 2023-10-06T04:37:39.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.721+0000 7f438137e740 4 waiting for MDS map... 2023-10-06T04:37:39.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.721+0000 7f4377de6700 1 -- 172.21.15.8:0/3128542879 <== mon.0 v2:172.21.15.8:3300/0 4 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x55a30572ac40 con 0x55a30585dc00 2023-10-06T04:37:39.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.721+0000 7f4377de6700 1 -- 172.21.15.8:0/3128542879 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 23) v1 ==== 3663+0+0 (secure 0 0 0) 0x55a3064e4600 con 0x55a30585dc00 2023-10-06T04:37:39.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.721+0000 7f438137e740 4 Got MDS map 23 2023-10-06T04:37:39.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.721+0000 7f438137e740 4 datascan.main: Using metadata pool output 2023-10-06T04:37:39.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.721+0000 7f438137e740 4 datascan.main: connecting to RADOS... 2023-10-06T04:37:39.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.721+0000 7f438137e740 1 Processor -- start 2023-10-06T04:37:39.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.722+0000 7f438137e740 1 -- start start 2023-10-06T04:37:39.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.722+0000 7f438137e740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a30585d800 0x55a306496100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.722+0000 7f438137e740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a30585cc00 0x55a306496680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.722+0000 7f438137e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a306548000 0x55a306496c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.722+0000 7f438137e740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a305726000 con 0x55a30585d800 2023-10-06T04:37:39.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.722+0000 7f438137e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a305727b80 con 0x55a306548000 2023-10-06T04:37:39.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.722+0000 7f438137e740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a3057af040 con 0x55a30585cc00 2023-10-06T04:37:39.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.722+0000 7f437adec700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a30585d800 0x55a306496100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.722+0000 7f437adec700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a30585d800 0x55a306496100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54538/0 (socket says 172.21.15.8:54538) 2023-10-06T04:37:39.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.722+0000 7f437adec700 1 -- 172.21.15.8:0/3289340712 learned_addr learned my addr 172.21.15.8:0/3289340712 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:39.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.722+0000 7f437a5eb700 1 --2- 172.21.15.8:0/3289340712 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a30585cc00 0x55a306496680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.722+0000 7f4379dea700 1 --2- 172.21.15.8:0/3289340712 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a306548000 0x55a306496c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.722+0000 7f437adec700 1 -- 172.21.15.8:0/3289340712 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a30585cc00 msgr2=0x55a306496680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:39.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.722+0000 7f437adec700 1 --2- 172.21.15.8:0/3289340712 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a30585cc00 0x55a306496680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.722+0000 7f437adec700 1 -- 172.21.15.8:0/3289340712 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a306548000 msgr2=0x55a306496c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:39.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.722+0000 7f437adec700 1 --2- 172.21.15.8:0/3289340712 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a306548000 0x55a306496c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.723+0000 7f437adec700 1 -- 172.21.15.8:0/3289340712 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a30570bba0 con 0x55a30585d800 2023-10-06T04:37:39.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.723+0000 7f437adec700 1 --2- 172.21.15.8:0/3289340712 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a30585d800 0x55a306496100 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x55a306460ea0 tx=0x55a3064ae480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca8830753c2d410e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.723+0000 7f4375de2700 1 -- 172.21.15.8:0/3289340712 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a30571f080 con 0x55a30585d800 2023-10-06T04:37:39.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.723+0000 7f4375de2700 1 -- 172.21.15.8:0/3289340712 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a30573c900 con 0x55a30585d800 2023-10-06T04:37:39.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.723+0000 7f4375de2700 1 -- 172.21.15.8:0/3289340712 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a30571f600 con 0x55a30585d800 2023-10-06T04:37:39.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.723+0000 7f438137e740 1 -- 172.21.15.8:0/3289340712 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a30585d800 msgr2=0x55a306496100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.723+0000 7f438137e740 1 --2- 172.21.15.8:0/3289340712 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a30585d800 0x55a306496100 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x55a306460ea0 tx=0x55a3064ae480 comp rx=0 tx=0).stop 2023-10-06T04:37:39.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.723+0000 7f438137e740 1 -- 172.21.15.8:0/3289340712 shutdown_connections 2023-10-06T04:37:39.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.723+0000 7f438137e740 1 --2- 172.21.15.8:0/3289340712 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a306548000 0x55a306496c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.723+0000 7f438137e740 1 --2- 172.21.15.8:0/3289340712 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a30585d800 0x55a306496100 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.723+0000 7f438137e740 1 --2- 172.21.15.8:0/3289340712 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a30585cc00 0x55a306496680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.723+0000 7f438137e740 1 -- 172.21.15.8:0/3289340712 >> 172.21.15.8:0/3289340712 conn(0x55a30585c400 msgr2=0x55a306470000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:39.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.723+0000 7f438137e740 1 -- 172.21.15.8:0/3289340712 shutdown_connections 2023-10-06T04:37:39.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.723+0000 7f438137e740 1 -- 172.21.15.8:0/3289340712 wait complete. 2023-10-06T04:37:39.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.724+0000 7f438137e740 1 Processor -- start 2023-10-06T04:37:39.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.724+0000 7f438137e740 1 -- start start 2023-10-06T04:37:39.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.724+0000 7f438137e740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a30585d800 0x55a306496100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.724+0000 7f438137e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a30585cc00 0x55a306496c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.724+0000 7f438137e740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a306550000 0x55a306497180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.724+0000 7f438137e740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3057af180 con 0x55a306550000 2023-10-06T04:37:39.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.724+0000 7f438137e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a305727040 con 0x55a30585cc00 2023-10-06T04:37:39.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.724+0000 7f438137e740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a3057263c0 con 0x55a30585d800 2023-10-06T04:37:39.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.725+0000 7f4379dea700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a306550000 0x55a306497180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.725+0000 7f4379dea700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a306550000 0x55a306497180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54550/0 (socket says 172.21.15.8:54550) 2023-10-06T04:37:39.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.725+0000 7f4379dea700 1 -- 172.21.15.8:0/2123408971 learned_addr learned my addr 172.21.15.8:0/2123408971 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:39.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.725+0000 7f437adec700 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a30585d800 0x55a306496100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.725+0000 7f437a5eb700 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a30585cc00 0x55a306496c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.725+0000 7f4379dea700 1 -- 172.21.15.8:0/2123408971 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a30585d800 msgr2=0x55a306496100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.725+0000 7f4379dea700 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a30585d800 0x55a306496100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.725+0000 7f4379dea700 1 -- 172.21.15.8:0/2123408971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a30585cc00 msgr2=0x55a306496c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.725+0000 7f4379dea700 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a30585cc00 0x55a306496c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.725+0000 7f4379dea700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a30570ab60 con 0x55a306550000 2023-10-06T04:37:39.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.725+0000 7f4379dea700 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a306550000 0x55a306497180 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x55a3064f8660 tx=0x55a306479140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.725+0000 7f43745df700 1 -- 172.21.15.8:0/2123408971 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a30571f1e0 con 0x55a306550000 2023-10-06T04:37:39.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.725+0000 7f43745df700 1 -- 172.21.15.8:0/2123408971 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a3064f4780 con 0x55a306550000 2023-10-06T04:37:39.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.725+0000 7f438137e740 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a30570aea0 con 0x55a306550000 2023-10-06T04:37:39.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.725+0000 7f43745df700 1 -- 172.21.15.8:0/2123408971 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a30571f080 con 0x55a306550000 2023-10-06T04:37:39.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.725+0000 7f438137e740 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a30570b860 con 0x55a306550000 2023-10-06T04:37:39.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.725+0000 7f438137e740 4 datascan.init: forcing metadata pool 'recovery_fs_metadata' 2023-10-06T04:37:39.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.727+0000 7f43745df700 1 -- 172.21.15.8:0/2123408971 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x55a30645d080 con 0x55a306550000 2023-10-06T04:37:39.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.727+0000 7f43745df700 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x55a306554800 0x55a306497700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.727+0000 7f43745df700 1 -- 172.21.15.8:0/2123408971 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x55a30572aa80 con 0x55a306550000 2023-10-06T04:37:39.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.727+0000 7f438137e740 4 datascan.main: data pool 'cephfs_data' has ID 7 2023-10-06T04:37:39.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.727+0000 7f438137e740 4 datascan.main: opening data pool 'cephfs_data' 2023-10-06T04:37:39.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.727+0000 7f438137e740 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] conn(0x55a306550400 0x55a306646000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.727+0000 7f437adec700 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x55a306554800 0x55a306497700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.727+0000 7f438137e740 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:1 7.0 7:00000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306550800 con 0x55a306550400 2023-10-06T04:37:39.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.727+0000 7f437a5eb700 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] conn(0x55a306550400 0x55a306646000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.727+0000 7f437adec700 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x55a306554800 0x55a306497700 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x55a306460ea0 tx=0x55a3064ae3c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.728+0000 7f437a5eb700 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] conn(0x55a306550400 0x55a306646000 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.728+0000 7f437a5eb700 1 -- 172.21.15.8:0/2123408971 <== osd.5 v2:172.21.15.184:6824/90894 1 ==== osd_op_reply(1 [pgnls start_epoch 46 out=49b] v38'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b8fc0 con 0x55a306550400 2023-10-06T04:37:39.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.728+0000 7f43755e1700 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] conn(0x55a306554c00 0x55a306647b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.728+0000 7f43755e1700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] -- osd_op(unknown.0.0:2 7.20 7:04000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306555000 con 0x55a306554c00 2023-10-06T04:37:39.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.728+0000 7f437adec700 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] conn(0x55a306554c00 0x55a306647b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.728+0000 7f437adec700 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] conn(0x55a306554c00 0x55a306647b80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.729+0000 7f437adec700 1 -- 172.21.15.8:0/2123408971 <== osd.2 v2:172.21.15.8:6800/90670 1 ==== osd_op_reply(2 [pgnls start_epoch 46 out=49b] v38'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9200 con 0x55a306554c00 2023-10-06T04:37:39.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.729+0000 7f4375de2700 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x55a306555800 0x55a306648100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.729+0000 7f4375de2700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:3 7.10 7:08000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306555c00 con 0x55a306555800 2023-10-06T04:37:39.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.729+0000 7f437a5eb700 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x55a306555800 0x55a306648100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.729+0000 7f437a5eb700 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x55a306555800 0x55a306648100 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.729+0000 7f437a5eb700 1 -- 172.21.15.8:0/2123408971 <== osd.3 v2:172.21.15.8:6823/90671 1 ==== osd_op_reply(3 [pgnls start_epoch 46 out=49b] v38'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b8fc0 con 0x55a306555800 2023-10-06T04:37:39.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.729+0000 7f43755e1700 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] conn(0x55a306555400 0x55a306648680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.729+0000 7f43755e1700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:4 7.30 7:0c000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306555c00 con 0x55a306555400 2023-10-06T04:37:39.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.730+0000 7f4379dea700 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] conn(0x55a306555400 0x55a306648680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.730+0000 7f4379dea700 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] conn(0x55a306555400 0x55a306648680 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.730+0000 7f4379dea700 1 -- 172.21.15.8:0/2123408971 <== osd.6 v2:172.21.15.184:6816/90899 1 ==== osd_op_reply(4 [pgnls start_epoch 46 out=49b] v38'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9440 con 0x55a306555400 2023-10-06T04:37:39.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.730+0000 7f4375de2700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] -- osd_op(unknown.0.0:5 7.8 7:10000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a30665c000 con 0x55a306554c00 2023-10-06T04:37:39.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.730+0000 7f437adec700 1 -- 172.21.15.8:0/2123408971 <== osd.2 v2:172.21.15.8:6800/90670 2 ==== osd_op_reply(5 [pgnls start_epoch 46 out=49b] v38'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9200 con 0x55a306554c00 2023-10-06T04:37:39.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.730+0000 7f43755e1700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:6 7.28 7:14000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306550800 con 0x55a306555400 2023-10-06T04:37:39.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.731+0000 7f4379dea700 1 -- 172.21.15.8:0/2123408971 <== osd.6 v2:172.21.15.184:6816/90899 2 ==== osd_op_reply(6 [pgnls start_epoch 46 out=49b] v38'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9440 con 0x55a306555400 2023-10-06T04:37:39.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.731+0000 7f4375de2700 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x55a30665c400 0x55a306649180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.731+0000 7f4375de2700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:7 7.18 7:18000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a30665c800 con 0x55a30665c400 2023-10-06T04:37:39.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.731+0000 7f437adec700 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x55a30665c400 0x55a306649180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.731+0000 7f437adec700 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x55a30665c400 0x55a306649180 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.731+0000 7f437adec700 1 -- 172.21.15.8:0/2123408971 <== osd.0 v2:172.21.15.8:6808/90668 1 ==== osd_op_reply(7 [pgnls start_epoch 46 out=49b] v38'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9200 con 0x55a30665c400 2023-10-06T04:37:39.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.731+0000 7f43755e1700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:8 7.38 7:1c000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a30665cc00 con 0x55a30665c400 2023-10-06T04:37:39.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.732+0000 7f437adec700 1 -- 172.21.15.8:0/2123408971 <== osd.0 v2:172.21.15.8:6808/90668 2 ==== osd_op_reply(8 [pgnls start_epoch 46 out=49b] v38'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9200 con 0x55a30665c400 2023-10-06T04:37:39.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.732+0000 7f4375de2700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:9 7.4 7:20000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a30665c000 con 0x55a30665c400 2023-10-06T04:37:39.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.732+0000 7f437adec700 1 -- 172.21.15.8:0/2123408971 <== osd.0 v2:172.21.15.8:6808/90668 3 ==== osd_op_reply(9 [pgnls start_epoch 46 out=49b] v38'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9200 con 0x55a30665c400 2023-10-06T04:37:39.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.732+0000 7f43755e1700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:10 7.24 7:24000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a30665d000 con 0x55a306550400 2023-10-06T04:37:39.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.732+0000 7f437a5eb700 1 -- 172.21.15.8:0/2123408971 <== osd.5 v2:172.21.15.184:6824/90894 2 ==== osd_op_reply(10 [pgnls start_epoch 46 out=49b] v38'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b8fc0 con 0x55a306550400 2023-10-06T04:37:39.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.732+0000 7f4375de2700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:11 7.14 7:28000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a30665c800 con 0x55a306555800 2023-10-06T04:37:39.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.732+0000 7f437a5eb700 1 -- 172.21.15.8:0/2123408971 <== osd.3 v2:172.21.15.8:6823/90671 2 ==== osd_op_reply(11 [pgnls start_epoch 46 out=49b] v38'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b8fc0 con 0x55a306555800 2023-10-06T04:37:39.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.733+0000 7f43755e1700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:12 7.34 7:2c000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a30665d400 con 0x55a306550400 2023-10-06T04:37:39.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.733+0000 7f437a5eb700 1 -- 172.21.15.8:0/2123408971 <== osd.5 v2:172.21.15.184:6824/90894 3 ==== osd_op_reply(12 [pgnls start_epoch 46 out=49b] v38'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b8fc0 con 0x55a306550400 2023-10-06T04:37:39.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.733+0000 7f4375de2700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:13 7.c 7:30000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a30665cc00 con 0x55a306555400 2023-10-06T04:37:39.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.733+0000 7f4379dea700 1 -- 172.21.15.8:0/2123408971 <== osd.6 v2:172.21.15.184:6816/90899 3 ==== osd_op_reply(13 [pgnls start_epoch 46 out=49b] v38'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9440 con 0x55a306555400 2023-10-06T04:37:39.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.733+0000 7f43755e1700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] -- osd_op(unknown.0.0:14 7.2c 7:34000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a30665d800 con 0x55a306554c00 2023-10-06T04:37:39.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.733+0000 7f437adec700 1 -- 172.21.15.8:0/2123408971 <== osd.2 v2:172.21.15.8:6800/90670 3 ==== osd_op_reply(14 [pgnls start_epoch 46 out=49b] v38'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9200 con 0x55a306554c00 2023-10-06T04:37:39.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.733+0000 7f4375de2700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:15 7.1c 7:38000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306555000 con 0x55a306550400 2023-10-06T04:37:39.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.734+0000 7f437a5eb700 1 -- 172.21.15.8:0/2123408971 <== osd.5 v2:172.21.15.184:6824/90894 4 ==== osd_op_reply(15 [pgnls start_epoch 46 out=49b] v38'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b8fc0 con 0x55a306550400 2023-10-06T04:37:39.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.734+0000 7f43755e1700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:16 7.3c 7:3c000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a30665cc00 con 0x55a30665c400 2023-10-06T04:37:39.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.734+0000 7f437adec700 1 -- 172.21.15.8:0/2123408971 <== osd.0 v2:172.21.15.8:6808/90668 4 ==== osd_op_reply(16 [pgnls start_epoch 46 out=49b] v38'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9200 con 0x55a30665c400 2023-10-06T04:37:39.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.734+0000 7f4375de2700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:17 7.2 7:40000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a30665c800 con 0x55a306555800 2023-10-06T04:37:39.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.734+0000 7f437a5eb700 1 -- 172.21.15.8:0/2123408971 <== osd.3 v2:172.21.15.8:6823/90671 3 ==== osd_op_reply(17 [pgnls start_epoch 46 out=49b] v38'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b8fc0 con 0x55a306555800 2023-10-06T04:37:39.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.734+0000 7f43755e1700 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x55a30665d000 0x55a306648c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.734+0000 7f43755e1700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:18 7.22 7:44000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306550800 con 0x55a30665d000 2023-10-06T04:37:39.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.734+0000 7f437a5eb700 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x55a30665d000 0x55a306648c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.735+0000 7f437a5eb700 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x55a30665d000 0x55a306648c00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.735+0000 7f437a5eb700 1 -- 172.21.15.8:0/2123408971 <== osd.4 v2:172.21.15.184:6800/90868 1 ==== osd_op_reply(18 [pgnls start_epoch 46 out=49b] v38'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b8fc0 con 0x55a30665d000 2023-10-06T04:37:39.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.735+0000 7f4375de2700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:19 7.12 7:48000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a30665d400 con 0x55a306555400 2023-10-06T04:37:39.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.735+0000 7f4379dea700 1 -- 172.21.15.8:0/2123408971 <== osd.6 v2:172.21.15.184:6816/90899 4 ==== osd_op_reply(19 [pgnls start_epoch 46 out=49b] v38'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9440 con 0x55a306555400 2023-10-06T04:37:39.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.735+0000 7f43755e1700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:20 7.32 7:4c000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306554400 con 0x55a30665c400 2023-10-06T04:37:39.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.736+0000 7f437adec700 1 -- 172.21.15.8:0/2123408971 <== osd.0 v2:172.21.15.8:6808/90668 5 ==== osd_op_reply(20 [pgnls start_epoch 46 out=49b] v38'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9200 con 0x55a30665c400 2023-10-06T04:37:39.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.736+0000 7f4375de2700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:21 7.a 7:50000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a30665dc00 con 0x55a306555800 2023-10-06T04:37:39.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.736+0000 7f437a5eb700 1 -- 172.21.15.8:0/2123408971 <== osd.3 v2:172.21.15.8:6823/90671 4 ==== osd_op_reply(21 [pgnls start_epoch 46 out=49b] v38'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b8fc0 con 0x55a306555800 2023-10-06T04:37:39.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.736+0000 7f43755e1700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:22 7.2a 7:54000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306555c00 con 0x55a30665c400 2023-10-06T04:37:39.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.736+0000 7f437adec700 1 -- 172.21.15.8:0/2123408971 <== osd.0 v2:172.21.15.8:6808/90668 6 ==== osd_op_reply(22 [pgnls start_epoch 46 out=49b] v38'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9200 con 0x55a30665c400 2023-10-06T04:37:39.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.736+0000 7f4375de2700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:23 7.1a 7:58000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a30665c000 con 0x55a30665d000 2023-10-06T04:37:39.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.736+0000 7f437a5eb700 1 -- 172.21.15.8:0/2123408971 <== osd.4 v2:172.21.15.184:6800/90868 2 ==== osd_op_reply(23 [pgnls start_epoch 46 out=49b] v38'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b8fc0 con 0x55a30665d000 2023-10-06T04:37:39.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.737+0000 7f43755e1700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:24 7.3a 7:5c000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a30665cc00 con 0x55a306555800 2023-10-06T04:37:39.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.737+0000 7f437a5eb700 1 -- 172.21.15.8:0/2123408971 <== osd.3 v2:172.21.15.8:6823/90671 5 ==== osd_op_reply(24 [pgnls start_epoch 46 out=49b] v38'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b8fc0 con 0x55a306555800 2023-10-06T04:37:39.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.737+0000 7f4375de2700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:25 7.6 7:60000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a30665d800 con 0x55a30665c400 2023-10-06T04:37:39.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.737+0000 7f437adec700 1 -- 172.21.15.8:0/2123408971 <== osd.0 v2:172.21.15.8:6808/90668 7 ==== osd_op_reply(25 [pgnls start_epoch 46 out=49b] v38'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9200 con 0x55a30665c400 2023-10-06T04:37:39.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.737+0000 7f43755e1700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] -- osd_op(unknown.0.0:26 7.26 7:64000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a30665c800 con 0x55a306554c00 2023-10-06T04:37:39.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.737+0000 7f437adec700 1 -- 172.21.15.8:0/2123408971 <== osd.2 v2:172.21.15.8:6800/90670 4 ==== osd_op_reply(26 [pgnls start_epoch 46 out=49b] v38'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9200 con 0x55a306554c00 2023-10-06T04:37:39.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.737+0000 7f4375de2700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:27 7.16 7:68000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306550800 con 0x55a30665d000 2023-10-06T04:37:39.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.738+0000 7f437a5eb700 1 -- 172.21.15.8:0/2123408971 <== osd.4 v2:172.21.15.184:6800/90868 3 ==== osd_op_reply(27 [pgnls start_epoch 46 out=49b] v38'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b8fc0 con 0x55a30665d000 2023-10-06T04:37:39.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.738+0000 7f43755e1700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:28 7.36 7:6c000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a30665dc00 con 0x55a30665c400 2023-10-06T04:37:39.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.738+0000 7f437adec700 1 -- 172.21.15.8:0/2123408971 <== osd.0 v2:172.21.15.8:6808/90668 8 ==== osd_op_reply(28 [pgnls start_epoch 46 out=49b] v38'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9200 con 0x55a30665c400 2023-10-06T04:37:39.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.738+0000 7f4375de2700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] -- osd_op(unknown.0.0:29 7.e 7:70000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306554400 con 0x55a306554c00 2023-10-06T04:37:39.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.738+0000 7f437adec700 1 -- 172.21.15.8:0/2123408971 <== osd.2 v2:172.21.15.8:6800/90670 5 ==== osd_op_reply(29 [pgnls start_epoch 46 out=49b] v38'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9200 con 0x55a306554c00 2023-10-06T04:37:39.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.738+0000 7f43755e1700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:30 7.2e 7:74000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306662000 con 0x55a30665d000 2023-10-06T04:37:39.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.739+0000 7f437a5eb700 1 -- 172.21.15.8:0/2123408971 <== osd.4 v2:172.21.15.184:6800/90868 4 ==== osd_op_reply(30 [pgnls start_epoch 46 out=49b] v38'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b8fc0 con 0x55a30665d000 2023-10-06T04:37:39.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.739+0000 7f4375de2700 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] conn(0x55a306555c00 0x55a306649700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.739+0000 7f4375de2700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] -- osd_op(unknown.0.0:31 7.1e 7:78000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306555000 con 0x55a306555c00 2023-10-06T04:37:39.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.739+0000 7f4379dea700 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] conn(0x55a306555c00 0x55a306649700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.739+0000 7f4379dea700 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] conn(0x55a306555c00 0x55a306649700 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.739+0000 7f4379dea700 1 -- 172.21.15.8:0/2123408971 <== osd.1 v2:172.21.15.8:6816/90669 1 ==== osd_op_reply(31 [pgnls start_epoch 46 out=49b] v38'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9440 con 0x55a306555c00 2023-10-06T04:37:39.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.739+0000 7f43755e1700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:32 7.3e 7:7c000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306662400 con 0x55a306550400 2023-10-06T04:37:39.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.740+0000 7f437a5eb700 1 -- 172.21.15.8:0/2123408971 <== osd.5 v2:172.21.15.184:6824/90894 5 ==== osd_op_reply(32 [pgnls start_epoch 46 out=49b] v38'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b8fc0 con 0x55a306550400 2023-10-06T04:37:39.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.740+0000 7f4375de2700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:33 7.1 7:80000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306662000 con 0x55a30665d000 2023-10-06T04:37:39.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.740+0000 7f437a5eb700 1 -- 172.21.15.8:0/2123408971 <== osd.4 v2:172.21.15.184:6800/90868 5 ==== osd_op_reply(33 [pgnls start_epoch 46 out=49b] v38'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b8fc0 con 0x55a30665d000 2023-10-06T04:37:39.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.740+0000 7f43755e1700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:34 7.21 7:84000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306662800 con 0x55a306555800 2023-10-06T04:37:39.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.740+0000 7f437a5eb700 1 -- 172.21.15.8:0/2123408971 <== osd.3 v2:172.21.15.8:6823/90671 6 ==== osd_op_reply(34 [pgnls start_epoch 46 out=49b] v38'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b8fc0 con 0x55a306555800 2023-10-06T04:37:39.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.740+0000 7f4375de2700 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] conn(0x55a306662400 0x55a306680000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.740+0000 7f4375de2700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:35 7.11 7:88000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306663c00 con 0x55a306662400 2023-10-06T04:37:39.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.740+0000 7f437adec700 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] conn(0x55a306662400 0x55a306680000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.741+0000 7f437adec700 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] conn(0x55a306662400 0x55a306680000 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.741+0000 7f437adec700 1 -- 172.21.15.8:0/2123408971 <== osd.7 v2:172.21.15.184:6808/90869 1 ==== osd_op_reply(35 [pgnls start_epoch 46 out=49b] v38'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9200 con 0x55a306662400 2023-10-06T04:37:39.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.741+0000 7f43755e1700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:36 7.31 7:8c000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306662c00 con 0x55a306555800 2023-10-06T04:37:39.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.741+0000 7f437a5eb700 1 -- 172.21.15.8:0/2123408971 <== osd.3 v2:172.21.15.8:6823/90671 7 ==== osd_op_reply(36 [pgnls start_epoch 46 out=49b] v38'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b8fc0 con 0x55a306555800 2023-10-06T04:37:39.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.741+0000 7f4375de2700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:37 7.9 7:90000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306550800 con 0x55a30665c400 2023-10-06T04:37:39.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.742+0000 7f437adec700 1 -- 172.21.15.8:0/2123408971 <== osd.0 v2:172.21.15.8:6808/90668 9 ==== osd_op_reply(37 [pgnls start_epoch 46 out=49b] v38'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9200 con 0x55a30665c400 2023-10-06T04:37:39.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.742+0000 7f43755e1700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:38 7.29 7:94000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306663000 con 0x55a306555400 2023-10-06T04:37:39.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.742+0000 7f4379dea700 1 -- 172.21.15.8:0/2123408971 <== osd.6 v2:172.21.15.184:6816/90899 5 ==== osd_op_reply(38 [pgnls start_epoch 46 out=49b] v38'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9440 con 0x55a306555400 2023-10-06T04:37:39.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.742+0000 7f4375de2700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:39 7.19 7:98000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a30665c000 con 0x55a306555400 2023-10-06T04:37:39.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.742+0000 7f4379dea700 1 -- 172.21.15.8:0/2123408971 <== osd.6 v2:172.21.15.184:6816/90899 6 ==== osd_op_reply(39 [pgnls start_epoch 46 out=49b] v38'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9440 con 0x55a306555400 2023-10-06T04:37:39.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.742+0000 7f43755e1700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:40 7.39 7:9c000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306663400 con 0x55a306662400 2023-10-06T04:37:39.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.743+0000 7f437adec700 1 -- 172.21.15.8:0/2123408971 <== osd.7 v2:172.21.15.184:6808/90869 2 ==== osd_op_reply(40 [pgnls start_epoch 46 out=49b] v38'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9200 con 0x55a306662400 2023-10-06T04:37:39.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.743+0000 7f4375de2700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:41 7.5 7:a0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a30665cc00 con 0x55a306662400 2023-10-06T04:37:39.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.743+0000 7f437adec700 1 -- 172.21.15.8:0/2123408971 <== osd.7 v2:172.21.15.184:6808/90869 3 ==== osd_op_reply(41 [pgnls start_epoch 46 out=49b] v38'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9200 con 0x55a306662400 2023-10-06T04:37:39.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.743+0000 7f43755e1700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:42 7.25 7:a4000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306663800 con 0x55a30665d000 2023-10-06T04:37:39.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.743+0000 7f437a5eb700 1 -- 172.21.15.8:0/2123408971 <== osd.4 v2:172.21.15.184:6800/90868 6 ==== osd_op_reply(42 [pgnls start_epoch 46 out=49b] v38'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b8fc0 con 0x55a30665d000 2023-10-06T04:37:39.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.743+0000 7f4375de2700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:43 7.15 7:a8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306550800 con 0x55a306662400 2023-10-06T04:37:39.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.744+0000 7f437adec700 1 -- 172.21.15.8:0/2123408971 <== osd.7 v2:172.21.15.184:6808/90869 4 ==== osd_op_reply(43 [pgnls start_epoch 46 out=49b] v38'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9200 con 0x55a306662400 2023-10-06T04:37:39.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.744+0000 7f43755e1700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:44 7.35 7:ac000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306686000 con 0x55a30665c400 2023-10-06T04:37:39.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.744+0000 7f437adec700 1 -- 172.21.15.8:0/2123408971 <== osd.0 v2:172.21.15.8:6808/90668 10 ==== osd_op_reply(44 [pgnls start_epoch 46 out=49b] v38'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9200 con 0x55a30665c400 2023-10-06T04:37:39.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.744+0000 7f4375de2700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:45 7.d 7:b0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306663c00 con 0x55a306555400 2023-10-06T04:37:39.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.744+0000 7f4379dea700 1 -- 172.21.15.8:0/2123408971 <== osd.6 v2:172.21.15.184:6816/90899 7 ==== osd_op_reply(45 [pgnls start_epoch 46 out=49b] v38'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9440 con 0x55a306555400 2023-10-06T04:37:39.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.744+0000 7f43755e1700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:46 7.2d 7:b4000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306686400 con 0x55a306555400 2023-10-06T04:37:39.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.744+0000 7f4379dea700 1 -- 172.21.15.8:0/2123408971 <== osd.6 v2:172.21.15.184:6816/90899 8 ==== osd_op_reply(46 [pgnls start_epoch 46 out=49b] v38'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9440 con 0x55a306555400 2023-10-06T04:37:39.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.744+0000 7f4375de2700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] -- osd_op(unknown.0.0:47 7.1d 7:b8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306554400 con 0x55a306555c00 2023-10-06T04:37:39.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.745+0000 7f4379dea700 1 -- 172.21.15.8:0/2123408971 <== osd.1 v2:172.21.15.8:6816/90669 2 ==== osd_op_reply(47 [pgnls start_epoch 46 out=49b] v38'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9440 con 0x55a306555c00 2023-10-06T04:37:39.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.745+0000 7f43755e1700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:48 7.3d 7:bc000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306686800 con 0x55a30665d000 2023-10-06T04:37:39.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.745+0000 7f437a5eb700 1 -- 172.21.15.8:0/2123408971 <== osd.4 v2:172.21.15.184:6800/90868 7 ==== osd_op_reply(48 [pgnls start_epoch 46 out=49b] v38'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b8fc0 con 0x55a30665d000 2023-10-06T04:37:39.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.745+0000 7f4375de2700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:49 7.3 7:c0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a30665d800 con 0x55a306555800 2023-10-06T04:37:39.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.745+0000 7f437a5eb700 1 -- 172.21.15.8:0/2123408971 <== osd.3 v2:172.21.15.8:6823/90671 8 ==== osd_op_reply(49 [pgnls start_epoch 46 out=49b] v38'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b8fc0 con 0x55a306555800 2023-10-06T04:37:39.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.745+0000 7f43755e1700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:50 7.23 7:c4000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306686c00 con 0x55a306555400 2023-10-06T04:37:39.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.746+0000 7f4379dea700 1 -- 172.21.15.8:0/2123408971 <== osd.6 v2:172.21.15.184:6816/90899 9 ==== osd_op_reply(50 [pgnls start_epoch 46 out=49b] v38'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9440 con 0x55a306555400 2023-10-06T04:37:39.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.746+0000 7f4375de2700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:51 7.13 7:c8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a30665c800 con 0x55a30665c400 2023-10-06T04:37:39.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.746+0000 7f437adec700 1 -- 172.21.15.8:0/2123408971 <== osd.0 v2:172.21.15.8:6808/90668 11 ==== osd_op_reply(51 [pgnls start_epoch 46 out=49b] v38'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9200 con 0x55a30665c400 2023-10-06T04:37:39.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.746+0000 7f43755e1700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] -- osd_op(unknown.0.0:52 7.33 7:cc000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306687000 con 0x55a306554c00 2023-10-06T04:37:39.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.746+0000 7f437adec700 1 -- 172.21.15.8:0/2123408971 <== osd.2 v2:172.21.15.8:6800/90670 6 ==== osd_op_reply(52 [pgnls start_epoch 46 out=49b] v38'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9200 con 0x55a306554c00 2023-10-06T04:37:39.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.746+0000 7f4375de2700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] -- osd_op(unknown.0.0:53 7.b 7:d0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a30665dc00 con 0x55a306555c00 2023-10-06T04:37:39.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.746+0000 7f4379dea700 1 -- 172.21.15.8:0/2123408971 <== osd.1 v2:172.21.15.8:6816/90669 3 ==== osd_op_reply(53 [pgnls start_epoch 46 out=49b] v38'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9440 con 0x55a306555c00 2023-10-06T04:37:39.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.746+0000 7f43755e1700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:54 7.2b 7:d4000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306687400 con 0x55a306555800 2023-10-06T04:37:39.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.747+0000 7f437a5eb700 1 -- 172.21.15.8:0/2123408971 <== osd.3 v2:172.21.15.8:6823/90671 9 ==== osd_op_reply(54 [pgnls start_epoch 46 out=49b] v38'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b8fc0 con 0x55a306555800 2023-10-06T04:37:39.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.747+0000 7f4375de2700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:55 7.1b 7:d8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306662000 con 0x55a30665c400 2023-10-06T04:37:39.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.747+0000 7f437adec700 1 -- 172.21.15.8:0/2123408971 <== osd.0 v2:172.21.15.8:6808/90668 12 ==== osd_op_reply(55 [pgnls start_epoch 46 out=49b] v38'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9200 con 0x55a30665c400 2023-10-06T04:37:39.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.747+0000 7f43755e1700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:56 7.3b 7:dc000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306687800 con 0x55a306550400 2023-10-06T04:37:39.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.747+0000 7f437a5eb700 1 -- 172.21.15.8:0/2123408971 <== osd.5 v2:172.21.15.184:6824/90894 6 ==== osd_op_reply(56 [pgnls start_epoch 46 out=49b] v38'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b8fc0 con 0x55a306550400 2023-10-06T04:37:39.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.747+0000 7f4375de2700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:57 7.7 7:e0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306662800 con 0x55a306555400 2023-10-06T04:37:39.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.747+0000 7f4379dea700 1 -- 172.21.15.8:0/2123408971 <== osd.6 v2:172.21.15.184:6816/90899 10 ==== osd_op_reply(57 [pgnls start_epoch 46 out=81b] v38'8 uv8 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55a3064b9440 con 0x55a306555400 2023-10-06T04:37:39.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.748+0000 7f438137e740 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:58 7.7 7:e2e07930:::10000000001.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306550c00 con 0x55a306555400 2023-10-06T04:37:39.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.748+0000 7f4379dea700 1 -- 172.21.15.8:0/2123408971 <== osd.6 v2:172.21.15.184:6816/90899 11 ==== osd_op_reply(58 10000000001.00000000 [stat out=16b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55a3064b9440 con 0x55a306555400 2023-10-06T04:37:39.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.748+0000 7f438137e740 10 datascan.operator(): handling object 1099511627777.0 2023-10-06T04:37:39.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.748+0000 7f438137e740 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:59 7.7 7:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306551000 con 0x55a306555400 2023-10-06T04:37:39.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.749+0000 7f4379dea700 1 -- 172.21.15.8:0/2123408971 <== osd.6 v2:172.21.15.184:6816/90899 12 ==== osd_op_reply(59 10000000001.00000000 [call] v46'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55a3064b9440 con 0x55a306555400 2023-10-06T04:37:39.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.749+0000 7f438137e740 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:60 7.27 7:e4000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306551400 con 0x55a306555400 2023-10-06T04:37:39.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.749+0000 7f4379dea700 1 -- 172.21.15.8:0/2123408971 <== osd.6 v2:172.21.15.184:6816/90899 13 ==== osd_op_reply(60 [pgnls start_epoch 46 out=49b] v38'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9440 con 0x55a306555400 2023-10-06T04:37:39.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.749+0000 7f4375de2700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:61 7.17 7:e8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306662c00 con 0x55a306662400 2023-10-06T04:37:39.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.750+0000 7f437adec700 1 -- 172.21.15.8:0/2123408971 <== osd.7 v2:172.21.15.184:6808/90869 5 ==== osd_op_reply(61 [pgnls start_epoch 46 out=49b] v38'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9200 con 0x55a306662400 2023-10-06T04:37:39.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.750+0000 7f43755e1700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:62 7.37 7:ec000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306687c00 con 0x55a30665c400 2023-10-06T04:37:39.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.750+0000 7f437adec700 1 -- 172.21.15.8:0/2123408971 <== osd.0 v2:172.21.15.8:6808/90668 13 ==== osd_op_reply(62 [pgnls start_epoch 46 out=49b] v38'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9200 con 0x55a30665c400 2023-10-06T04:37:39.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.750+0000 7f4375de2700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:63 7.f 7:f0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306663800 con 0x55a30665c400 2023-10-06T04:37:39.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.750+0000 7f437adec700 1 -- 172.21.15.8:0/2123408971 <== osd.0 v2:172.21.15.8:6808/90668 14 ==== osd_op_reply(63 [pgnls start_epoch 46 out=49b] v38'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9200 con 0x55a30665c400 2023-10-06T04:37:39.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.750+0000 7f43755e1700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:64 7.2f 7:f4000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306686400 con 0x55a30665d000 2023-10-06T04:37:39.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.750+0000 7f437a5eb700 1 -- 172.21.15.8:0/2123408971 <== osd.4 v2:172.21.15.184:6800/90868 8 ==== osd_op_reply(64 [pgnls start_epoch 46 out=81b] v38'9 uv1 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55a3064b8fc0 con 0x55a30665d000 2023-10-06T04:37:39.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.750+0000 7f438137e740 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:65 7.2f 7:f526278d:::10000000001.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306551800 con 0x55a30665d000 2023-10-06T04:37:39.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.751+0000 7f437a5eb700 1 -- 172.21.15.8:0/2123408971 <== osd.4 v2:172.21.15.184:6800/90868 9 ==== osd_op_reply(65 10000000001.00000001 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55a3064b8fc0 con 0x55a30665d000 2023-10-06T04:37:39.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.751+0000 7f438137e740 10 datascan.operator(): handling object 1099511627777.1 2023-10-06T04:37:39.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.751+0000 7f438137e740 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:66 7.7 7:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306551c00 con 0x55a306555400 2023-10-06T04:37:39.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.752+0000 7f4379dea700 1 -- 172.21.15.8:0/2123408971 <== osd.6 v2:172.21.15.184:6816/90899 14 ==== osd_op_reply(66 10000000001.00000000 [call] v46'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55a3064b9440 con 0x55a306555400 2023-10-06T04:37:39.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.752+0000 7f438137e740 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:67 7.1f 7:f8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306662800 con 0x55a306555400 2023-10-06T04:37:39.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.752+0000 7f4379dea700 1 -- 172.21.15.8:0/2123408971 <== osd.6 v2:172.21.15.184:6816/90899 15 ==== osd_op_reply(67 [pgnls start_epoch 46 out=49b] v38'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9440 con 0x55a306555400 2023-10-06T04:37:39.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.752+0000 7f43755e1700 1 -- 172.21.15.8:0/2123408971 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:68 7.3f 7:fc000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a306686c00 con 0x55a306662400 2023-10-06T04:37:39.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.752+0000 7f437adec700 1 -- 172.21.15.8:0/2123408971 <== osd.7 v2:172.21.15.184:6808/90869 6 ==== osd_op_reply(68 [pgnls start_epoch 46 out=49b] v38'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a3064b9200 con 0x55a306662400 2023-10-06T04:37:39.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.753+0000 7f438137e740 1 -- 172.21.15.8:0/2123408971 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x55a30665c400 msgr2=0x55a306649180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.753+0000 7f438137e740 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x55a30665c400 0x55a306649180 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.753+0000 7f438137e740 1 -- 172.21.15.8:0/2123408971 >> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] conn(0x55a306555c00 msgr2=0x55a306649700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.753+0000 7f438137e740 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] conn(0x55a306555c00 0x55a306649700 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.753+0000 7f438137e740 1 -- 172.21.15.8:0/2123408971 >> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] conn(0x55a306554c00 msgr2=0x55a306647b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.753+0000 7f438137e740 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] conn(0x55a306554c00 0x55a306647b80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.753+0000 7f438137e740 1 -- 172.21.15.8:0/2123408971 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x55a306555800 msgr2=0x55a306648100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.753+0000 7f438137e740 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x55a306555800 0x55a306648100 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.753+0000 7f437a5eb700 1 -- 172.21.15.8:0/2123408971 reap_dead start 2023-10-06T04:37:39.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.753+0000 7f438137e740 1 -- 172.21.15.8:0/2123408971 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x55a30665d000 msgr2=0x55a306648c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.753+0000 7f438137e740 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x55a30665d000 0x55a306648c00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.753+0000 7f438137e740 1 -- 172.21.15.8:0/2123408971 >> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] conn(0x55a306550400 msgr2=0x55a306646000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.753+0000 7f437a5eb700 1 -- 172.21.15.8:0/2123408971 reap_dead start 2023-10-06T04:37:39.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.753+0000 7f438137e740 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] conn(0x55a306550400 0x55a306646000 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.753+0000 7f438137e740 1 -- 172.21.15.8:0/2123408971 >> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] conn(0x55a306555400 msgr2=0x55a306648680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.753+0000 7f438137e740 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] conn(0x55a306555400 0x55a306648680 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.753+0000 7f438137e740 1 -- 172.21.15.8:0/2123408971 >> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] conn(0x55a306662400 msgr2=0x55a306680000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.753+0000 7f438137e740 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] conn(0x55a306662400 0x55a306680000 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.753+0000 7f438137e740 1 -- 172.21.15.8:0/2123408971 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x55a306554800 msgr2=0x55a306497700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.753+0000 7f438137e740 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x55a306554800 0x55a306497700 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x55a306460ea0 tx=0x55a3064ae3c0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.753+0000 7f438137e740 1 -- 172.21.15.8:0/2123408971 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a306550000 msgr2=0x55a306497180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.753+0000 7f438137e740 1 --2- 172.21.15.8:0/2123408971 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a306550000 0x55a306497180 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x55a3064f8660 tx=0x55a306479140 comp rx=0 tx=0).stop 2023-10-06T04:37:39.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.753+0000 7f437a5eb700 1 -- 172.21.15.8:0/2123408971 reap_dead start 2023-10-06T04:37:39.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.753+0000 7f438137e740 1 -- 172.21.15.8:0/2123408971 shutdown_connections 2023-10-06T04:37:39.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.753+0000 7f438137e740 1 -- 172.21.15.8:0/2123408971 >> 172.21.15.8:0/2123408971 conn(0x55a30585c400 msgr2=0x55a306470000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:39.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.753+0000 7f438137e740 1 -- 172.21.15.8:0/2123408971 shutdown_connections 2023-10-06T04:37:39.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.753+0000 7f438137e740 1 -- 172.21.15.8:0/2123408971 wait complete. 2023-10-06T04:37:39.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.753+0000 7f438137e740 1 -- 172.21.15.8:0/3128542879 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a30585dc00 msgr2=0x55a306495080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.753+0000 7f438137e740 1 --2- 172.21.15.8:0/3128542879 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a30585dc00 0x55a306495080 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x55a3064b47e0 tx=0x55a306478a20 comp rx=0 tx=0).stop 2023-10-06T04:37:39.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.753+0000 7f438137e740 1 -- 172.21.15.8:0/3128542879 shutdown_connections 2023-10-06T04:37:39.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.753+0000 7f438137e740 1 --2- 172.21.15.8:0/3128542879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a30585c800 0x55a306494580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.753+0000 7f438137e740 1 --2- 172.21.15.8:0/3128542879 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a30585d000 0x55a306495b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.753+0000 7f438137e740 1 --2- 172.21.15.8:0/3128542879 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a30585dc00 0x55a306495080 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.753+0000 7f438137e740 1 -- 172.21.15.8:0/3128542879 >> 172.21.15.8:0/3128542879 conn(0x55a30585c000 msgr2=0x55a30646f800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:39.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.753+0000 7f438137e740 1 -- 172.21.15.8:0/3128542879 shutdown_connections 2023-10-06T04:37:39.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.753+0000 7f438137e740 1 -- 172.21.15.8:0/3128542879 wait complete. 2023-10-06T04:37:39.769 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', '--alternate-pool', 'recovery_fs_metadata', '--filesystem', 'cephfs', 'cephfs_data'] in time 0:00:00.126195, result: 2023-10-06T04:37:39.770 DEBUG:teuthology.orchestra.run.smithi008:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes --alternate-pool recovery_fs_metadata --filesystem cephfs --force-corrupt --force-init cephfs_data 2023-10-06T04:37:39.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.842+0000 7f243d19a740 1 -- start start 2023-10-06T04:37:39.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.842+0000 7f243d19a740 1 Processor -- start 2023-10-06T04:37:39.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.843+0000 7f243d19a740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561bd213000 0x5561bde4a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.843+0000 7f243d19a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561bd213c00 0x5561bde4a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.843+0000 7f243d19a740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5561bd212800 0x5561bde4b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.843+0000 7f243d19a740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561bd0ddcc0 con 0x5561bd213000 2023-10-06T04:37:39.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.843+0000 7f243d19a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561bd0dcdc0 con 0x5561bd213c00 2023-10-06T04:37:39.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.843+0000 7f243d19a740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561bd0dd040 con 0x5561bd212800 2023-10-06T04:37:39.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.843+0000 7f2436407700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561bd213000 0x5561bde4a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.843+0000 7f2436407700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561bd213000 0x5561bde4a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54570/0 (socket says 172.21.15.8:54570) 2023-10-06T04:37:39.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.843+0000 7f2436407700 1 -- 172.21.15.8:0/643797924 learned_addr learned my addr 172.21.15.8:0/643797924 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:39.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.843+0000 7f2435c06700 1 --2- 172.21.15.8:0/643797924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561bd213c00 0x5561bde4a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.843+0000 7f2436c08700 1 --2- 172.21.15.8:0/643797924 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5561bd212800 0x5561bde4b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.843+0000 7f2436407700 1 -- 172.21.15.8:0/643797924 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5561bd212800 msgr2=0x5561bde4b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:39.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.843+0000 7f2436407700 1 --2- 172.21.15.8:0/643797924 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5561bd212800 0x5561bde4b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.843+0000 7f2436407700 1 -- 172.21.15.8:0/643797924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561bd213c00 msgr2=0x5561bde4a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:39.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.843+0000 7f2436407700 1 --2- 172.21.15.8:0/643797924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561bd213c00 0x5561bde4a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.843+0000 7f2436407700 1 -- 172.21.15.8:0/643797924 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561bd0c0ea0 con 0x5561bd213000 2023-10-06T04:37:39.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.843+0000 7f2436c08700 1 --2- 172.21.15.8:0/643797924 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5561bd212800 0x5561bde4b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:39.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.843+0000 7f2436407700 1 --2- 172.21.15.8:0/643797924 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561bd213000 0x5561bde4a580 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x5561bde6e720 tx=0x5561bd214120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f7b353065d6fc87 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.844+0000 7f2433c02700 1 -- 172.21.15.8:0/643797924 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5561bd0d5080 con 0x5561bd213000 2023-10-06T04:37:39.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.844+0000 7f2433c02700 1 -- 172.21.15.8:0/643797924 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5561bd0f2900 con 0x5561bd213000 2023-10-06T04:37:39.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.844+0000 7f2433c02700 1 -- 172.21.15.8:0/643797924 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5561bd0d5600 con 0x5561bd213000 2023-10-06T04:37:39.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.844+0000 7f243d19a740 1 -- 172.21.15.8:0/643797924 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5561bd0c1860 con 0x5561bd213000 2023-10-06T04:37:39.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.844+0000 7f243d19a740 1 -- 172.21.15.8:0/643797924 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5561bd0c1a00 con 0x5561bd213000 2023-10-06T04:37:39.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.844+0000 7f243d19a740 4 waiting for MDS map... 2023-10-06T04:37:39.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.844+0000 7f2433c02700 1 -- 172.21.15.8:0/643797924 <== mon.0 v2:172.21.15.8:3300/0 4 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x5561bd0e0c40 con 0x5561bd213000 2023-10-06T04:37:39.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.844+0000 7f2433c02700 1 -- 172.21.15.8:0/643797924 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 23) v1 ==== 3663+0+0 (secure 0 0 0) 0x5561bde90600 con 0x5561bd213000 2023-10-06T04:37:39.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.844+0000 7f243d19a740 4 Got MDS map 23 2023-10-06T04:37:39.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.844+0000 7f243d19a740 4 datascan.main: Using metadata pool output 2023-10-06T04:37:39.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.844+0000 7f243d19a740 4 datascan.main: connecting to RADOS... 2023-10-06T04:37:39.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.845+0000 7f243d19a740 1 Processor -- start 2023-10-06T04:37:39.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.845+0000 7f243d19a740 1 -- start start 2023-10-06T04:37:39.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.845+0000 7f243d19a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561bd213800 0x5561bde4bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.845+0000 7f243d19a740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561bd212c00 0x5561bde4c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.845+0000 7f243d19a740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5561bdef6000 0x5561bde4c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.845+0000 7f243d19a740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561bd0dd180 con 0x5561bd212c00 2023-10-06T04:37:39.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.845+0000 7f243d19a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561bd0dc000 con 0x5561bd213800 2023-10-06T04:37:39.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.845+0000 7f243d19a740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561bd0dc3c0 con 0x5561bdef6000 2023-10-06T04:37:39.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.845+0000 7f2436407700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561bd212c00 0x5561bde4c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.845+0000 7f2436407700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561bd212c00 0x5561bde4c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54580/0 (socket says 172.21.15.8:54580) 2023-10-06T04:37:39.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.845+0000 7f2436407700 1 -- 172.21.15.8:0/79259750 learned_addr learned my addr 172.21.15.8:0/79259750 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:39.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.845+0000 7f2436c08700 1 --2- 172.21.15.8:0/79259750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561bd213800 0x5561bde4bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.845+0000 7f2435c06700 1 --2- 172.21.15.8:0/79259750 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5561bdef6000 0x5561bde4c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.846+0000 7f2436407700 1 -- 172.21.15.8:0/79259750 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5561bdef6000 msgr2=0x5561bde4c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:39.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.846+0000 7f2436407700 1 --2- 172.21.15.8:0/79259750 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5561bdef6000 0x5561bde4c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.846+0000 7f2436407700 1 -- 172.21.15.8:0/79259750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561bd213800 msgr2=0x5561bde4bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:39.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.846+0000 7f2436407700 1 --2- 172.21.15.8:0/79259750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561bd213800 0x5561bde4bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.846+0000 7f2436407700 1 -- 172.21.15.8:0/79259750 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561bd0c1ba0 con 0x5561bd212c00 2023-10-06T04:37:39.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.846+0000 7f2435c06700 1 --2- 172.21.15.8:0/79259750 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5561bdef6000 0x5561bde4c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:39.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.846+0000 7f2436407700 1 --2- 172.21.15.8:0/79259750 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561bd212c00 0x5561bde4c100 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x5561bde6f650 tx=0x5561bd214060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72aac523883fe4a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.846+0000 7f2431bfe700 1 -- 172.21.15.8:0/79259750 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5561bd0d51e0 con 0x5561bd212c00 2023-10-06T04:37:39.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.846+0000 7f2431bfe700 1 -- 172.21.15.8:0/79259750 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5561bd0f2000 con 0x5561bd212c00 2023-10-06T04:37:39.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.846+0000 7f2431bfe700 1 -- 172.21.15.8:0/79259750 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5561bd0d5080 con 0x5561bd212c00 2023-10-06T04:37:39.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.846+0000 7f243d19a740 1 -- 172.21.15.8:0/79259750 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561bd212c00 msgr2=0x5561bde4c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.846+0000 7f243d19a740 1 --2- 172.21.15.8:0/79259750 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561bd212c00 0x5561bde4c100 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x5561bde6f650 tx=0x5561bd214060 comp rx=0 tx=0).stop 2023-10-06T04:37:39.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.846+0000 7f243d19a740 1 -- 172.21.15.8:0/79259750 shutdown_connections 2023-10-06T04:37:39.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.846+0000 7f243d19a740 1 --2- 172.21.15.8:0/79259750 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5561bdef6000 0x5561bde4c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.846+0000 7f243d19a740 1 --2- 172.21.15.8:0/79259750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561bd213800 0x5561bde4bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.846+0000 7f243d19a740 1 --2- 172.21.15.8:0/79259750 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561bd212c00 0x5561bde4c100 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.846+0000 7f243d19a740 1 -- 172.21.15.8:0/79259750 >> 172.21.15.8:0/79259750 conn(0x5561bd212400 msgr2=0x5561bde25000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:39.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.846+0000 7f243d19a740 1 -- 172.21.15.8:0/79259750 shutdown_connections 2023-10-06T04:37:39.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.846+0000 7f243d19a740 1 -- 172.21.15.8:0/79259750 wait complete. 2023-10-06T04:37:39.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.847+0000 7f243d19a740 1 Processor -- start 2023-10-06T04:37:39.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.847+0000 7f243d19a740 1 -- start start 2023-10-06T04:37:39.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.848+0000 7f243d19a740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5561bd213800 0x5561bde4bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.848+0000 7f243d19a740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561bd212c00 0x5561bde4c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.848+0000 7f243d19a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561bdf14000 0x5561bde4cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.848+0000 7f243d19a740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561bd0ddcc0 con 0x5561bd212c00 2023-10-06T04:37:39.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.848+0000 7f243d19a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561bd0dc3c0 con 0x5561bdf14000 2023-10-06T04:37:39.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.848+0000 7f243d19a740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561bd0dc000 con 0x5561bd213800 2023-10-06T04:37:39.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.848+0000 7f2436407700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561bd212c00 0x5561bde4c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.848+0000 7f2436407700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561bd212c00 0x5561bde4c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54584/0 (socket says 172.21.15.8:54584) 2023-10-06T04:37:39.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.848+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 learned_addr learned my addr 172.21.15.8:0/815602614 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:39.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.848+0000 7f2436c08700 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5561bd213800 0x5561bde4bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.848+0000 7f2435c06700 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561bdf14000 0x5561bde4cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.848+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5561bd213800 msgr2=0x5561bde4bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.848+0000 7f2436407700 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5561bd213800 0x5561bde4bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.848+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561bdf14000 msgr2=0x5561bde4cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:39.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.848+0000 7f2436407700 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561bdf14000 0x5561bde4cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:39.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.848+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561bd0c0ea0 con 0x5561bd212c00 2023-10-06T04:37:39.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.848+0000 7f2436407700 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561bd212c00 0x5561bde4c680 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x5561bde6f8c0 tx=0x5561bdeaecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.848+0000 7f24303fb700 1 -- 172.21.15.8:0/815602614 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5561bd0d5600 con 0x5561bd212c00 2023-10-06T04:37:39.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.848+0000 7f24303fb700 1 -- 172.21.15.8:0/815602614 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5561bdeaa780 con 0x5561bd212c00 2023-10-06T04:37:39.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.848+0000 7f24303fb700 1 -- 172.21.15.8:0/815602614 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5561bd0d4f20 con 0x5561bd212c00 2023-10-06T04:37:39.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.848+0000 7f243d19a740 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5561bd0c1d40 con 0x5561bd212c00 2023-10-06T04:37:39.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.848+0000 7f243d19a740 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5561bd0c1a00 con 0x5561bd212c00 2023-10-06T04:37:39.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.848+0000 7f243d19a740 4 datascan.init: forcing metadata pool 'recovery_fs_metadata' 2023-10-06T04:37:39.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.850+0000 7f24303fb700 1 -- 172.21.15.8:0/815602614 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x5561bde12b00 con 0x5561bd212c00 2023-10-06T04:37:39.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.850+0000 7f24303fb700 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x5561bdf18800 0x5561bde4d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.850+0000 7f24303fb700 1 -- 172.21.15.8:0/815602614 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x5561bd0e0a80 con 0x5561bd212c00 2023-10-06T04:37:39.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.850+0000 7f243d19a740 4 datascan.main: data pool 'cephfs_data' has ID 7 2023-10-06T04:37:39.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.850+0000 7f243d19a740 4 datascan.main: opening data pool 'cephfs_data' 2023-10-06T04:37:39.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.850+0000 7f243d19a740 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x5561bdf14400 0x5561bde4d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.850+0000 7f243d19a740 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:1 8.14 8:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf14800 con 0x5561bdf14400 2023-10-06T04:37:39.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.850+0000 7f2436c08700 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x5561bdf18800 0x5561bde4d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.850+0000 7f2435c06700 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x5561bdf14400 0x5561bde4d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.851+0000 7f2435c06700 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x5561bdf14400 0x5561bde4d180 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.851+0000 7f2436c08700 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x5561bdf18800 0x5561bde4d700 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x5561bde17ce0 tx=0x5561bd214480 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.851+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 <== osd.4 v2:172.21.15.184:6800/90868 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 160+0+16 (crc 0 0 0) 0x5561bde5efc0 con 0x5561bdf14400 2023-10-06T04:37:39.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.851+0000 7f243d19a740 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x5561bdf14c00 0x5561be012000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.851+0000 7f243d19a740 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:2 8.1f 8:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf15000 con 0x5561bdf14c00 2023-10-06T04:37:39.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.851+0000 7f2436c08700 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x5561bdf14c00 0x5561be012000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.851+0000 7f2436c08700 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x5561bdf14c00 0x5561be012000 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.852+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.0 v2:172.21.15.8:6808/90668 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+16 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14c00 2023-10-06T04:37:39.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.852+0000 7f243d19a740 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] conn(0x5561bdf15400 0x5561be012580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.852+0000 7f243d19a740 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:3 7.0 7:00000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf15800 con 0x5561bdf15400 2023-10-06T04:37:39.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.852+0000 7f2436407700 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] conn(0x5561bdf15400 0x5561be012580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.852+0000 7f2436407700 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] conn(0x5561bdf15400 0x5561be012580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.853+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 <== osd.5 v2:172.21.15.184:6824/90894 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 46 out=49b] v38'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f440 con 0x5561bdf15400 2023-10-06T04:37:39.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.853+0000 7f24313fd700 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] conn(0x5561bdf18c00 0x5561be013b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.853+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] -- osd_op(unknown.0.0:4 7.20 7:04000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf19000 con 0x5561bdf18c00 2023-10-06T04:37:39.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.853+0000 7f2435c06700 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] conn(0x5561bdf18c00 0x5561be013b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.853+0000 7f2435c06700 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] conn(0x5561bdf18c00 0x5561be013b80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.853+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 <== osd.2 v2:172.21.15.8:6800/90670 1 ==== osd_op_reply(4 [pgnls-filter start_epoch 46 out=49b] v38'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5efc0 con 0x5561bdf18c00 2023-10-06T04:37:39.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.853+0000 7f2431bfe700 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x5561bdf14800 0x5561be014100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.853+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:5 7.10 7:08000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf19000 con 0x5561bdf14800 2023-10-06T04:37:39.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.854+0000 7f2436c08700 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x5561bdf14800 0x5561be014100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.854+0000 7f2436c08700 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x5561bdf14800 0x5561be014100 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.854+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.3 v2:172.21.15.8:6823/90671 1 ==== osd_op_reply(5 [pgnls-filter start_epoch 46 out=49b] v38'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14800 2023-10-06T04:37:39.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.854+0000 7f24313fd700 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] conn(0x5561bdf19400 0x5561be014680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.854+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:6 7.30 7:0c000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf19c00 con 0x5561bdf19400 2023-10-06T04:37:39.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.854+0000 7f2436407700 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] conn(0x5561bdf19400 0x5561be014680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.855+0000 7f2436407700 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] conn(0x5561bdf19400 0x5561be014680 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.855+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 <== osd.6 v2:172.21.15.184:6816/90899 1 ==== osd_op_reply(6 [pgnls-filter start_epoch 46 out=49b] v38'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f440 con 0x5561bdf19400 2023-10-06T04:37:39.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.855+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] -- osd_op(unknown.0.0:7 7.8 7:10000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf19800 con 0x5561bdf18c00 2023-10-06T04:37:39.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.855+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 <== osd.2 v2:172.21.15.8:6800/90670 2 ==== osd_op_reply(7 [pgnls-filter start_epoch 46 out=49b] v38'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5efc0 con 0x5561bdf18c00 2023-10-06T04:37:39.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.855+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:8 7.28 7:14000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02a000 con 0x5561bdf19400 2023-10-06T04:37:39.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.856+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 <== osd.6 v2:172.21.15.184:6816/90899 2 ==== osd_op_reply(8 [pgnls-filter start_epoch 46 out=49b] v38'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f440 con 0x5561bdf19400 2023-10-06T04:37:39.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.856+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:9 7.18 7:18000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf18400 con 0x5561bdf14c00 2023-10-06T04:37:39.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.856+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.0 v2:172.21.15.8:6808/90668 2 ==== osd_op_reply(9 [pgnls-filter start_epoch 46 out=49b] v38'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14c00 2023-10-06T04:37:39.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.856+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:10 7.38 7:1c000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02a400 con 0x5561bdf14c00 2023-10-06T04:37:39.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.856+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.0 v2:172.21.15.8:6808/90668 3 ==== osd_op_reply(10 [pgnls-filter start_epoch 46 out=49b] v38'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14c00 2023-10-06T04:37:39.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.856+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:11 7.4 7:20000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf19c00 con 0x5561bdf14c00 2023-10-06T04:37:39.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.856+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.0 v2:172.21.15.8:6808/90668 4 ==== osd_op_reply(11 [pgnls-filter start_epoch 46 out=49b] v38'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14c00 2023-10-06T04:37:39.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.856+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:12 7.24 7:24000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02a800 con 0x5561bdf15400 2023-10-06T04:37:39.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.857+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 <== osd.5 v2:172.21.15.184:6824/90894 2 ==== osd_op_reply(12 [pgnls-filter start_epoch 46 out=49b] v38'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f440 con 0x5561bdf15400 2023-10-06T04:37:39.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.857+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:13 7.14 7:28000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf15800 con 0x5561bdf14800 2023-10-06T04:37:39.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.857+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.3 v2:172.21.15.8:6823/90671 2 ==== osd_op_reply(13 [pgnls-filter start_epoch 46 out=49b] v38'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14800 2023-10-06T04:37:39.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.857+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:14 7.34 7:2c000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02ac00 con 0x5561bdf15400 2023-10-06T04:37:39.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.857+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 <== osd.5 v2:172.21.15.184:6824/90894 3 ==== osd_op_reply(14 [pgnls-filter start_epoch 46 out=49b] v38'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f440 con 0x5561bdf15400 2023-10-06T04:37:39.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.857+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:15 7.c 7:30000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02a400 con 0x5561bdf19400 2023-10-06T04:37:39.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.858+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 <== osd.6 v2:172.21.15.184:6816/90899 3 ==== osd_op_reply(15 [pgnls-filter start_epoch 46 out=49b] v38'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f440 con 0x5561bdf19400 2023-10-06T04:37:39.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.858+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] -- osd_op(unknown.0.0:16 7.2c 7:34000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02a000 con 0x5561bdf18c00 2023-10-06T04:37:39.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.858+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 <== osd.2 v2:172.21.15.8:6800/90670 3 ==== osd_op_reply(16 [pgnls-filter start_epoch 46 out=49b] v38'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5efc0 con 0x5561bdf18c00 2023-10-06T04:37:39.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.858+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:17 7.1c 7:38000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf19000 con 0x5561bdf15400 2023-10-06T04:37:39.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.858+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 <== osd.5 v2:172.21.15.184:6824/90894 4 ==== osd_op_reply(17 [pgnls-filter start_epoch 46 out=49b] v38'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f440 con 0x5561bdf15400 2023-10-06T04:37:39.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.858+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:18 7.3c 7:3c000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02b000 con 0x5561bdf14c00 2023-10-06T04:37:39.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.858+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.0 v2:172.21.15.8:6808/90668 5 ==== osd_op_reply(18 [pgnls-filter start_epoch 46 out=49b] v38'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14c00 2023-10-06T04:37:39.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.858+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:19 7.2 7:40000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf18400 con 0x5561bdf14800 2023-10-06T04:37:39.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.859+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.3 v2:172.21.15.8:6823/90671 3 ==== osd_op_reply(19 [pgnls-filter start_epoch 46 out=49b] v38'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14800 2023-10-06T04:37:39.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.859+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:20 7.22 7:44000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02b400 con 0x5561bdf14400 2023-10-06T04:37:39.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.859+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 <== osd.4 v2:172.21.15.184:6800/90868 2 ==== osd_op_reply(20 [pgnls-filter start_epoch 46 out=49b] v38'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5efc0 con 0x5561bdf14400 2023-10-06T04:37:39.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.859+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:21 7.12 7:48000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf15000 con 0x5561bdf19400 2023-10-06T04:37:39.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.859+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 <== osd.6 v2:172.21.15.184:6816/90899 4 ==== osd_op_reply(21 [pgnls-filter start_epoch 46 out=49b] v38'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f440 con 0x5561bdf19400 2023-10-06T04:37:39.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.859+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:22 7.32 7:4c000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02b800 con 0x5561bdf14c00 2023-10-06T04:37:39.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.860+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.0 v2:172.21.15.8:6808/90668 6 ==== osd_op_reply(22 [pgnls-filter start_epoch 46 out=49b] v38'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14c00 2023-10-06T04:37:39.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.860+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:23 7.a 7:50000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf19c00 con 0x5561bdf14800 2023-10-06T04:37:39.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.860+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.3 v2:172.21.15.8:6823/90671 4 ==== osd_op_reply(23 [pgnls-filter start_epoch 46 out=49b] v38'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14800 2023-10-06T04:37:39.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.860+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:24 7.2a 7:54000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02bc00 con 0x5561bdf14c00 2023-10-06T04:37:39.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.860+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.0 v2:172.21.15.8:6808/90668 7 ==== osd_op_reply(24 [pgnls-filter start_epoch 46 out=49b] v38'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14c00 2023-10-06T04:37:39.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.860+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:25 7.1a 7:58000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf18400 con 0x5561bdf14400 2023-10-06T04:37:39.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.861+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 <== osd.4 v2:172.21.15.184:6800/90868 3 ==== osd_op_reply(25 [pgnls-filter start_epoch 46 out=49b] v38'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5efc0 con 0x5561bdf14400 2023-10-06T04:37:39.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.861+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:26 7.3a 7:5c000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02b000 con 0x5561bdf14800 2023-10-06T04:37:39.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.861+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.3 v2:172.21.15.8:6823/90671 5 ==== osd_op_reply(26 [pgnls-filter start_epoch 46 out=49b] v38'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14800 2023-10-06T04:37:39.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.861+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:27 7.6 7:60000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf19000 con 0x5561bdf14c00 2023-10-06T04:37:39.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.861+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.0 v2:172.21.15.8:6808/90668 8 ==== osd_op_reply(27 [pgnls-filter start_epoch 46 out=49b] v38'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14c00 2023-10-06T04:37:39.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.861+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] -- osd_op(unknown.0.0:28 7.26 7:64000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02b800 con 0x5561bdf18c00 2023-10-06T04:37:39.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.861+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 <== osd.2 v2:172.21.15.8:6800/90670 4 ==== osd_op_reply(28 [pgnls-filter start_epoch 46 out=49b] v38'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5efc0 con 0x5561bdf18c00 2023-10-06T04:37:39.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.861+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:29 7.16 7:68000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf15800 con 0x5561bdf14400 2023-10-06T04:37:39.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.862+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 <== osd.4 v2:172.21.15.184:6800/90868 4 ==== osd_op_reply(29 [pgnls-filter start_epoch 46 out=49b] v38'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5efc0 con 0x5561bdf14400 2023-10-06T04:37:39.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.862+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:30 7.36 7:6c000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02a800 con 0x5561bdf14c00 2023-10-06T04:37:39.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.862+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.0 v2:172.21.15.8:6808/90668 9 ==== osd_op_reply(30 [pgnls-filter start_epoch 46 out=49b] v38'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14c00 2023-10-06T04:37:39.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.862+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] -- osd_op(unknown.0.0:31 7.e 7:70000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf15000 con 0x5561bdf18c00 2023-10-06T04:37:39.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.862+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 <== osd.2 v2:172.21.15.8:6800/90670 5 ==== osd_op_reply(31 [pgnls-filter start_epoch 46 out=49b] v38'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5efc0 con 0x5561bdf18c00 2023-10-06T04:37:39.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.862+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:32 7.2e 7:74000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02ac00 con 0x5561bdf14400 2023-10-06T04:37:39.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.862+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 <== osd.4 v2:172.21.15.184:6800/90868 5 ==== osd_op_reply(32 [pgnls-filter start_epoch 46 out=49b] v38'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5efc0 con 0x5561bdf14400 2023-10-06T04:37:39.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.863+0000 7f2431bfe700 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] conn(0x5561be02b800 0x5561be015180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.863+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] -- osd_op(unknown.0.0:33 7.1e 7:78000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02a000 con 0x5561be02b800 2023-10-06T04:37:39.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.863+0000 7f2435c06700 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] conn(0x5561be02b800 0x5561be015180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.863+0000 7f2435c06700 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] conn(0x5561be02b800 0x5561be015180 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.863+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 <== osd.1 v2:172.21.15.8:6816/90669 1 ==== osd_op_reply(33 [pgnls-filter start_epoch 46 out=49b] v38'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5efc0 con 0x5561be02b800 2023-10-06T04:37:39.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.863+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:34 7.3e 7:7c000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02a400 con 0x5561bdf15400 2023-10-06T04:37:39.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.863+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 <== osd.5 v2:172.21.15.184:6824/90894 5 ==== osd_op_reply(34 [pgnls-filter start_epoch 46 out=49b] v38'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f440 con 0x5561bdf15400 2023-10-06T04:37:39.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.863+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:35 7.1 7:80000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02b400 con 0x5561bdf14400 2023-10-06T04:37:39.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.864+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 <== osd.4 v2:172.21.15.184:6800/90868 6 ==== osd_op_reply(35 [pgnls-filter start_epoch 46 out=49b] v38'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5efc0 con 0x5561bdf14400 2023-10-06T04:37:39.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.864+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:36 7.21 7:84000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf19800 con 0x5561bdf14800 2023-10-06T04:37:39.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.864+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.3 v2:172.21.15.8:6823/90671 6 ==== osd_op_reply(36 [pgnls-filter start_epoch 46 out=49b] v38'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14800 2023-10-06T04:37:39.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.864+0000 7f2431bfe700 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] conn(0x5561bdf15800 0x5561be015700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:39.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.864+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:37 7.11 7:88000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf15000 con 0x5561bdf15800 2023-10-06T04:37:39.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.864+0000 7f2436c08700 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] conn(0x5561bdf15800 0x5561be015700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:39.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.865+0000 7f2436c08700 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] conn(0x5561bdf15800 0x5561be015700 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:39.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.865+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.7 v2:172.21.15.184:6808/90869 1 ==== osd_op_reply(37 [pgnls-filter start_epoch 46 out=49b] v38'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf15800 2023-10-06T04:37:39.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.865+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:38 7.31 7:8c000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf19c00 con 0x5561bdf14800 2023-10-06T04:37:39.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.865+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.3 v2:172.21.15.8:6823/90671 7 ==== osd_op_reply(38 [pgnls-filter start_epoch 46 out=49b] v38'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14800 2023-10-06T04:37:39.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.865+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:39 7.9 7:90000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf18400 con 0x5561bdf14c00 2023-10-06T04:37:39.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.866+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.0 v2:172.21.15.8:6808/90668 10 ==== osd_op_reply(39 [pgnls-filter start_epoch 46 out=49b] v38'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14c00 2023-10-06T04:37:39.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.866+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:40 7.29 7:94000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf19000 con 0x5561bdf19400 2023-10-06T04:37:39.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.866+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 <== osd.6 v2:172.21.15.184:6816/90899 5 ==== osd_op_reply(40 [pgnls-filter start_epoch 46 out=49b] v38'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f440 con 0x5561bdf19400 2023-10-06T04:37:39.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.866+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:41 7.19 7:98000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be042000 con 0x5561bdf19400 2023-10-06T04:37:39.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.866+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 <== osd.6 v2:172.21.15.184:6816/90899 6 ==== osd_op_reply(41 [pgnls-filter start_epoch 46 out=49b] v38'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f440 con 0x5561bdf19400 2023-10-06T04:37:39.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.866+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:42 7.39 7:9c000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf19800 con 0x5561bdf15800 2023-10-06T04:37:39.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.867+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.7 v2:172.21.15.184:6808/90869 2 ==== osd_op_reply(42 [pgnls-filter start_epoch 46 out=49b] v38'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf15800 2023-10-06T04:37:39.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.867+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:43 7.5 7:a0000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be042400 con 0x5561bdf15800 2023-10-06T04:37:39.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.867+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.7 v2:172.21.15.184:6808/90869 3 ==== osd_op_reply(43 [pgnls-filter start_epoch 46 out=49b] v38'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf15800 2023-10-06T04:37:39.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.867+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:44 7.25 7:a4000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02bc00 con 0x5561bdf14400 2023-10-06T04:37:39.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.867+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 <== osd.4 v2:172.21.15.184:6800/90868 7 ==== osd_op_reply(44 [pgnls-filter start_epoch 46 out=49b] v38'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5efc0 con 0x5561bdf14400 2023-10-06T04:37:39.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.867+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:45 7.15 7:a8000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be042800 con 0x5561bdf15800 2023-10-06T04:37:39.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.867+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.7 v2:172.21.15.184:6808/90869 4 ==== osd_op_reply(45 [pgnls-filter start_epoch 46 out=49b] v38'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf15800 2023-10-06T04:37:39.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.867+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:46 7.35 7:ac000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02b000 con 0x5561bdf14c00 2023-10-06T04:37:39.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.868+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.0 v2:172.21.15.8:6808/90668 11 ==== osd_op_reply(46 [pgnls-filter start_epoch 46 out=49b] v38'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14c00 2023-10-06T04:37:39.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.868+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:47 7.d 7:b0000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be042c00 con 0x5561bdf19400 2023-10-06T04:37:39.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.868+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 <== osd.6 v2:172.21.15.184:6816/90899 7 ==== osd_op_reply(47 [pgnls-filter start_epoch 46 out=49b] v38'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f440 con 0x5561bdf19400 2023-10-06T04:37:39.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.868+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:48 7.2d 7:b4000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02a800 con 0x5561bdf19400 2023-10-06T04:37:39.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.868+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 <== osd.6 v2:172.21.15.184:6816/90899 8 ==== osd_op_reply(48 [pgnls-filter start_epoch 46 out=49b] v38'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f440 con 0x5561bdf19400 2023-10-06T04:37:39.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.868+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] -- osd_op(unknown.0.0:49 7.1d 7:b8000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be043000 con 0x5561be02b800 2023-10-06T04:37:39.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.869+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 <== osd.1 v2:172.21.15.8:6816/90669 2 ==== osd_op_reply(49 [pgnls-filter start_epoch 46 out=49b] v38'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5efc0 con 0x5561be02b800 2023-10-06T04:37:39.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.869+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:50 7.3d 7:bc000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02ac00 con 0x5561bdf14400 2023-10-06T04:37:39.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.869+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 <== osd.4 v2:172.21.15.184:6800/90868 8 ==== osd_op_reply(50 [pgnls-filter start_epoch 46 out=49b] v38'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5efc0 con 0x5561bdf14400 2023-10-06T04:37:39.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.869+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:51 7.3 7:c0000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be043400 con 0x5561bdf14800 2023-10-06T04:37:39.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.869+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.3 v2:172.21.15.8:6823/90671 8 ==== osd_op_reply(51 [pgnls-filter start_epoch 46 out=49b] v38'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14800 2023-10-06T04:37:39.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.869+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:52 7.23 7:c4000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02a000 con 0x5561bdf19400 2023-10-06T04:37:39.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.869+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 <== osd.6 v2:172.21.15.184:6816/90899 9 ==== osd_op_reply(52 [pgnls-filter start_epoch 46 out=49b] v38'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f440 con 0x5561bdf19400 2023-10-06T04:37:39.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.869+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:53 7.13 7:c8000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be043800 con 0x5561bdf14c00 2023-10-06T04:37:39.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.870+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.0 v2:172.21.15.8:6808/90668 12 ==== osd_op_reply(53 [pgnls-filter start_epoch 46 out=49b] v38'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14c00 2023-10-06T04:37:39.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.870+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] -- osd_op(unknown.0.0:54 7.33 7:cc000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02b400 con 0x5561bdf18c00 2023-10-06T04:37:39.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.870+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 <== osd.2 v2:172.21.15.8:6800/90670 6 ==== osd_op_reply(54 [pgnls-filter start_epoch 46 out=49b] v38'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5efc0 con 0x5561bdf18c00 2023-10-06T04:37:39.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.870+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] -- osd_op(unknown.0.0:55 7.b 7:d0000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be042000 con 0x5561be02b800 2023-10-06T04:37:39.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.870+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 <== osd.1 v2:172.21.15.8:6816/90669 3 ==== osd_op_reply(55 [pgnls-filter start_epoch 46 out=49b] v38'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5efc0 con 0x5561be02b800 2023-10-06T04:37:39.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.870+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:56 7.2b 7:d4000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02bc00 con 0x5561bdf14800 2023-10-06T04:37:39.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.870+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.3 v2:172.21.15.8:6823/90671 9 ==== osd_op_reply(56 [pgnls-filter start_epoch 46 out=49b] v38'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14800 2023-10-06T04:37:39.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.870+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:57 7.1b 7:d8000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be042c00 con 0x5561bdf14c00 2023-10-06T04:37:39.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.871+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.0 v2:172.21.15.8:6808/90668 13 ==== osd_op_reply(57 [pgnls-filter start_epoch 46 out=49b] v38'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14c00 2023-10-06T04:37:39.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.871+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:58 7.3b 7:dc000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf19c00 con 0x5561bdf15400 2023-10-06T04:37:39.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.871+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 <== osd.5 v2:172.21.15.184:6824/90894 6 ==== osd_op_reply(58 [pgnls-filter start_epoch 46 out=49b] v38'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f440 con 0x5561bdf15400 2023-10-06T04:37:39.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.871+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:59 7.7 7:e0000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be043000 con 0x5561bdf19400 2023-10-06T04:37:39.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.872+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 <== osd.6 v2:172.21.15.184:6816/90899 10 ==== osd_op_reply(59 [pgnls-filter start_epoch 46 out=81b] v46'10 uv10 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5561bde5f440 con 0x5561bdf19400 2023-10-06T04:37:39.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.872+0000 7f243d19a740 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:60 7.0 7:00000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf15c00 con 0x5561bdf15400 2023-10-06T04:37:39.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.872+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 <== osd.5 v2:172.21.15.184:6824/90894 7 ==== osd_op_reply(60 [pgnls-filter start_epoch 46 out=49b] v38'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f440 con 0x5561bdf15400 2023-10-06T04:37:39.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.872+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] -- osd_op(unknown.0.0:61 7.20 7:04000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02a400 con 0x5561bdf18c00 2023-10-06T04:37:39.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.872+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 <== osd.2 v2:172.21.15.8:6800/90670 7 ==== osd_op_reply(61 [pgnls-filter start_epoch 46 out=49b] v38'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5efc0 con 0x5561bdf18c00 2023-10-06T04:37:39.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.872+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:62 7.10 7:08000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf18400 con 0x5561bdf14800 2023-10-06T04:37:39.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.872+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.3 v2:172.21.15.8:6823/90671 10 ==== osd_op_reply(62 [pgnls-filter start_epoch 46 out=49b] v38'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14800 2023-10-06T04:37:39.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.872+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:63 7.30 7:0c000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02a800 con 0x5561bdf19400 2023-10-06T04:37:39.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.873+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 <== osd.6 v2:172.21.15.184:6816/90899 11 ==== osd_op_reply(63 [pgnls-filter start_epoch 46 out=49b] v38'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f440 con 0x5561bdf19400 2023-10-06T04:37:39.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.873+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] -- osd_op(unknown.0.0:64 7.8 7:10000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf19800 con 0x5561bdf18c00 2023-10-06T04:37:39.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.873+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 <== osd.2 v2:172.21.15.8:6800/90670 8 ==== osd_op_reply(64 [pgnls-filter start_epoch 46 out=49b] v38'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5efc0 con 0x5561bdf18c00 2023-10-06T04:37:39.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.873+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:65 7.28 7:14000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02a000 con 0x5561bdf19400 2023-10-06T04:37:39.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.873+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 <== osd.6 v2:172.21.15.184:6816/90899 12 ==== osd_op_reply(65 [pgnls-filter start_epoch 46 out=49b] v38'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f440 con 0x5561bdf19400 2023-10-06T04:37:39.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.873+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:66 7.18 7:18000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf15000 con 0x5561bdf14c00 2023-10-06T04:37:39.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.874+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.0 v2:172.21.15.8:6808/90668 14 ==== osd_op_reply(66 [pgnls-filter start_epoch 46 out=49b] v38'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14c00 2023-10-06T04:37:39.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.874+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:67 7.38 7:1c000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02b000 con 0x5561bdf14c00 2023-10-06T04:37:39.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.874+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.0 v2:172.21.15.8:6808/90668 15 ==== osd_op_reply(67 [pgnls-filter start_epoch 46 out=49b] v38'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14c00 2023-10-06T04:37:39.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.874+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:68 7.4 7:20000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be042400 con 0x5561bdf14c00 2023-10-06T04:37:39.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.874+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.0 v2:172.21.15.8:6808/90668 16 ==== osd_op_reply(68 [pgnls-filter start_epoch 46 out=49b] v38'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14c00 2023-10-06T04:37:39.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.874+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:69 7.24 7:24000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf19000 con 0x5561bdf15400 2023-10-06T04:37:39.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.874+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 <== osd.5 v2:172.21.15.184:6824/90894 8 ==== osd_op_reply(69 [pgnls-filter start_epoch 46 out=49b] v38'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f440 con 0x5561bdf15400 2023-10-06T04:37:39.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.874+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:70 7.14 7:28000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be042800 con 0x5561bdf14800 2023-10-06T04:37:39.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.875+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.3 v2:172.21.15.8:6823/90671 11 ==== osd_op_reply(70 [pgnls-filter start_epoch 46 out=49b] v38'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14800 2023-10-06T04:37:39.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.875+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:71 7.34 7:2c000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be043400 con 0x5561bdf15400 2023-10-06T04:37:39.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.875+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 <== osd.5 v2:172.21.15.184:6824/90894 9 ==== osd_op_reply(71 [pgnls-filter start_epoch 46 out=49b] v38'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f440 con 0x5561bdf15400 2023-10-06T04:37:39.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.875+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:72 7.c 7:30000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be043c00 con 0x5561bdf19400 2023-10-06T04:37:39.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.875+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 <== osd.6 v2:172.21.15.184:6816/90899 13 ==== osd_op_reply(72 [pgnls-filter start_epoch 46 out=49b] v38'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f440 con 0x5561bdf19400 2023-10-06T04:37:39.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.875+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] -- osd_op(unknown.0.0:73 7.2c 7:34000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be043800 con 0x5561bdf18c00 2023-10-06T04:37:39.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.875+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 <== osd.2 v2:172.21.15.8:6800/90670 9 ==== osd_op_reply(73 [pgnls-filter start_epoch 46 out=49b] v38'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5efc0 con 0x5561bdf18c00 2023-10-06T04:37:39.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.876+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:74 7.1c 7:38000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be042000 con 0x5561bdf15400 2023-10-06T04:37:39.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.876+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 <== osd.5 v2:172.21.15.184:6824/90894 10 ==== osd_op_reply(74 [pgnls-filter start_epoch 46 out=49b] v38'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f440 con 0x5561bdf15400 2023-10-06T04:37:39.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.876+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:75 7.3c 7:3c000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be042c00 con 0x5561bdf14c00 2023-10-06T04:37:39.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.876+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.0 v2:172.21.15.8:6808/90668 17 ==== osd_op_reply(75 [pgnls-filter start_epoch 46 out=49b] v38'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14c00 2023-10-06T04:37:39.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.876+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:76 7.2 7:40000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf19800 con 0x5561bdf14800 2023-10-06T04:37:39.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.876+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.3 v2:172.21.15.8:6823/90671 12 ==== osd_op_reply(76 [pgnls-filter start_epoch 46 out=49b] v38'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14800 2023-10-06T04:37:39.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.876+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:77 7.22 7:44000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be042400 con 0x5561bdf14400 2023-10-06T04:37:39.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.877+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 <== osd.4 v2:172.21.15.184:6800/90868 9 ==== osd_op_reply(77 [pgnls-filter start_epoch 46 out=49b] v38'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5efc0 con 0x5561bdf14400 2023-10-06T04:37:39.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.877+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:78 7.12 7:48000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf19c00 con 0x5561bdf19400 2023-10-06T04:37:39.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.877+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 <== osd.6 v2:172.21.15.184:6816/90899 14 ==== osd_op_reply(78 [pgnls-filter start_epoch 46 out=49b] v38'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f440 con 0x5561bdf19400 2023-10-06T04:37:39.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.877+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:79 7.32 7:4c000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02bc00 con 0x5561bdf14c00 2023-10-06T04:37:39.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.878+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.0 v2:172.21.15.8:6808/90668 18 ==== osd_op_reply(79 [pgnls-filter start_epoch 46 out=49b] v38'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14c00 2023-10-06T04:37:39.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.878+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:80 7.a 7:50000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf19000 con 0x5561bdf14800 2023-10-06T04:37:39.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.878+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.3 v2:172.21.15.8:6823/90671 13 ==== osd_op_reply(80 [pgnls-filter start_epoch 46 out=49b] v38'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14800 2023-10-06T04:37:39.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.878+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:81 7.2a 7:54000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02b000 con 0x5561bdf14c00 2023-10-06T04:37:39.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.878+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.0 v2:172.21.15.8:6808/90668 19 ==== osd_op_reply(81 [pgnls-filter start_epoch 46 out=49b] v38'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14c00 2023-10-06T04:37:39.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.878+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:82 7.1a 7:58000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02ac00 con 0x5561bdf14400 2023-10-06T04:37:39.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.878+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 <== osd.4 v2:172.21.15.184:6800/90868 10 ==== osd_op_reply(82 [pgnls-filter start_epoch 46 out=49b] v38'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5efc0 con 0x5561bdf14400 2023-10-06T04:37:39.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.878+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:83 7.3a 7:5c000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf15000 con 0x5561bdf14800 2023-10-06T04:37:39.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.879+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.3 v2:172.21.15.8:6823/90671 14 ==== osd_op_reply(83 [pgnls-filter start_epoch 46 out=49b] v38'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14800 2023-10-06T04:37:39.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.879+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:84 7.6 7:60000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02b400 con 0x5561bdf14c00 2023-10-06T04:37:39.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.879+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.0 v2:172.21.15.8:6808/90668 20 ==== osd_op_reply(84 [pgnls-filter start_epoch 46 out=49b] v38'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14c00 2023-10-06T04:37:39.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.879+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] -- osd_op(unknown.0.0:85 7.26 7:64000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf18400 con 0x5561bdf18c00 2023-10-06T04:37:39.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.879+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 <== osd.2 v2:172.21.15.8:6800/90670 10 ==== osd_op_reply(85 [pgnls-filter start_epoch 46 out=49b] v38'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5efc0 con 0x5561bdf18c00 2023-10-06T04:37:39.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.879+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:86 7.16 7:68000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02a400 con 0x5561bdf14400 2023-10-06T04:37:39.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.879+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 <== osd.4 v2:172.21.15.184:6800/90868 11 ==== osd_op_reply(86 [pgnls-filter start_epoch 46 out=49b] v38'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5efc0 con 0x5561bdf14400 2023-10-06T04:37:39.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.879+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:87 7.36 7:6c000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be043800 con 0x5561bdf14c00 2023-10-06T04:37:39.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.880+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.0 v2:172.21.15.8:6808/90668 21 ==== osd_op_reply(87 [pgnls-filter start_epoch 46 out=49b] v38'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14c00 2023-10-06T04:37:39.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.880+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] -- osd_op(unknown.0.0:88 7.e 7:70000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02a800 con 0x5561bdf18c00 2023-10-06T04:37:39.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.880+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 <== osd.2 v2:172.21.15.8:6800/90670 11 ==== osd_op_reply(88 [pgnls-filter start_epoch 46 out=49b] v38'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5efc0 con 0x5561bdf18c00 2023-10-06T04:37:39.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.880+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:89 7.2e 7:74000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be043000 con 0x5561bdf14400 2023-10-06T04:37:39.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.880+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 <== osd.4 v2:172.21.15.184:6800/90868 12 ==== osd_op_reply(89 [pgnls-filter start_epoch 46 out=49b] v38'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5efc0 con 0x5561bdf14400 2023-10-06T04:37:39.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.880+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] -- osd_op(unknown.0.0:90 7.1e 7:78000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02a000 con 0x5561be02b800 2023-10-06T04:37:39.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.881+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 <== osd.1 v2:172.21.15.8:6816/90669 4 ==== osd_op_reply(90 [pgnls-filter start_epoch 46 out=49b] v38'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5efc0 con 0x5561be02b800 2023-10-06T04:37:39.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.881+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:91 7.3e 7:7c000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be043400 con 0x5561bdf15400 2023-10-06T04:37:39.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.881+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 <== osd.5 v2:172.21.15.184:6824/90894 11 ==== osd_op_reply(91 [pgnls-filter start_epoch 46 out=49b] v38'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f440 con 0x5561bdf15400 2023-10-06T04:37:39.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.881+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:92 7.1 7:80000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf15c00 con 0x5561bdf14400 2023-10-06T04:37:39.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.881+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 <== osd.4 v2:172.21.15.184:6800/90868 13 ==== osd_op_reply(92 [pgnls-filter start_epoch 46 out=49b] v38'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5efc0 con 0x5561bdf14400 2023-10-06T04:37:39.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.881+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:93 7.21 7:84000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02ac00 con 0x5561bdf14800 2023-10-06T04:37:39.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.882+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.3 v2:172.21.15.8:6823/90671 15 ==== osd_op_reply(93 [pgnls-filter start_epoch 46 out=49b] v38'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14800 2023-10-06T04:37:39.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.882+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:94 7.11 7:88000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be042400 con 0x5561bdf15800 2023-10-06T04:37:39.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.882+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.7 v2:172.21.15.184:6808/90869 5 ==== osd_op_reply(94 [pgnls-filter start_epoch 46 out=49b] v38'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf15800 2023-10-06T04:37:39.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.882+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:95 7.31 7:8c000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02a400 con 0x5561bdf14800 2023-10-06T04:37:39.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.882+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.3 v2:172.21.15.8:6823/90671 16 ==== osd_op_reply(95 [pgnls-filter start_epoch 46 out=49b] v38'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14800 2023-10-06T04:37:39.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.882+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:96 7.9 7:90000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be043000 con 0x5561bdf14c00 2023-10-06T04:37:39.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.883+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.0 v2:172.21.15.8:6808/90668 22 ==== osd_op_reply(96 [pgnls-filter start_epoch 46 out=49b] v38'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14c00 2023-10-06T04:37:39.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.883+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:97 7.29 7:94000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02a800 con 0x5561bdf19400 2023-10-06T04:37:39.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.883+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 <== osd.6 v2:172.21.15.184:6816/90899 15 ==== osd_op_reply(97 [pgnls-filter start_epoch 46 out=49b] v38'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f440 con 0x5561bdf19400 2023-10-06T04:37:39.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.883+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:98 7.19 7:98000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be042800 con 0x5561bdf19400 2023-10-06T04:37:39.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.883+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 <== osd.6 v2:172.21.15.184:6816/90899 16 ==== osd_op_reply(98 [pgnls-filter start_epoch 46 out=49b] v38'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f440 con 0x5561bdf19400 2023-10-06T04:37:39.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.883+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:99 7.39 7:9c000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02a000 con 0x5561bdf15800 2023-10-06T04:37:39.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.883+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.7 v2:172.21.15.184:6808/90869 6 ==== osd_op_reply(99 [pgnls-filter start_epoch 46 out=49b] v38'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf15800 2023-10-06T04:37:39.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.883+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:100 7.5 7:a0000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be042c00 con 0x5561bdf15800 2023-10-06T04:37:39.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.884+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.7 v2:172.21.15.184:6808/90869 7 ==== osd_op_reply(100 [pgnls-filter start_epoch 46 out=49b] v38'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf15800 2023-10-06T04:37:39.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.884+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:101 7.25 7:a4000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02bc00 con 0x5561bdf14400 2023-10-06T04:37:39.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.884+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 <== osd.4 v2:172.21.15.184:6800/90868 14 ==== osd_op_reply(101 [pgnls-filter start_epoch 46 out=49b] v38'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5efc0 con 0x5561bdf14400 2023-10-06T04:37:39.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.884+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:102 7.15 7:a8000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be043800 con 0x5561bdf15800 2023-10-06T04:37:39.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.885+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.7 v2:172.21.15.184:6808/90869 8 ==== osd_op_reply(102 [pgnls-filter start_epoch 46 out=49b] v38'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf15800 2023-10-06T04:37:39.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.885+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:103 7.35 7:ac000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02b000 con 0x5561bdf14c00 2023-10-06T04:37:39.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.885+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.0 v2:172.21.15.8:6808/90668 23 ==== osd_op_reply(103 [pgnls-filter start_epoch 46 out=49b] v38'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14c00 2023-10-06T04:37:39.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.885+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:104 7.d 7:b0000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be046000 con 0x5561bdf19400 2023-10-06T04:37:39.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.885+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 <== osd.6 v2:172.21.15.184:6816/90899 17 ==== osd_op_reply(104 [pgnls-filter start_epoch 46 out=49b] v38'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f440 con 0x5561bdf19400 2023-10-06T04:37:39.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.885+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:105 7.2d 7:b4000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02b400 con 0x5561bdf19400 2023-10-06T04:37:39.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.885+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 <== osd.6 v2:172.21.15.184:6816/90899 18 ==== osd_op_reply(105 [pgnls-filter start_epoch 46 out=49b] v38'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f440 con 0x5561bdf19400 2023-10-06T04:37:39.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.885+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] -- osd_op(unknown.0.0:106 7.1d 7:b8000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be046400 con 0x5561be02b800 2023-10-06T04:37:39.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.886+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 <== osd.1 v2:172.21.15.8:6816/90669 5 ==== osd_op_reply(106 [pgnls-filter start_epoch 46 out=49b] v38'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5efc0 con 0x5561be02b800 2023-10-06T04:37:39.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.886+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:107 7.3d 7:bc000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf15000 con 0x5561bdf14400 2023-10-06T04:37:39.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.886+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 <== osd.4 v2:172.21.15.184:6800/90868 15 ==== osd_op_reply(107 [pgnls-filter start_epoch 46 out=49b] v38'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5efc0 con 0x5561bdf14400 2023-10-06T04:37:39.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.886+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:108 7.3 7:c0000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be046800 con 0x5561bdf14800 2023-10-06T04:37:39.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.886+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.3 v2:172.21.15.8:6823/90671 17 ==== osd_op_reply(108 [pgnls-filter start_epoch 46 out=49b] v38'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14800 2023-10-06T04:37:39.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.886+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:109 7.23 7:c4000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf18400 con 0x5561bdf19400 2023-10-06T04:37:39.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.886+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 <== osd.6 v2:172.21.15.184:6816/90899 19 ==== osd_op_reply(109 [pgnls-filter start_epoch 46 out=49b] v38'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f440 con 0x5561bdf19400 2023-10-06T04:37:39.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.886+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:110 7.13 7:c8000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be046c00 con 0x5561bdf14c00 2023-10-06T04:37:39.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.887+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.0 v2:172.21.15.8:6808/90668 24 ==== osd_op_reply(110 [pgnls-filter start_epoch 46 out=49b] v38'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14c00 2023-10-06T04:37:39.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.887+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] -- osd_op(unknown.0.0:111 7.33 7:cc000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf19800 con 0x5561bdf18c00 2023-10-06T04:37:39.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.887+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 <== osd.2 v2:172.21.15.8:6800/90670 12 ==== osd_op_reply(111 [pgnls-filter start_epoch 46 out=49b] v38'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5efc0 con 0x5561bdf18c00 2023-10-06T04:37:39.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.887+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] -- osd_op(unknown.0.0:112 7.b 7:d0000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be047000 con 0x5561be02b800 2023-10-06T04:37:39.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.887+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 <== osd.1 v2:172.21.15.8:6816/90669 6 ==== osd_op_reply(112 [pgnls-filter start_epoch 46 out=49b] v38'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5efc0 con 0x5561be02b800 2023-10-06T04:37:39.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.887+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:113 7.2b 7:d4000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561bdf19000 con 0x5561bdf14800 2023-10-06T04:37:39.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.887+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.3 v2:172.21.15.8:6823/90671 18 ==== osd_op_reply(113 [pgnls-filter start_epoch 46 out=49b] v38'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14800 2023-10-06T04:37:39.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.887+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:114 7.1b 7:d8000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be047400 con 0x5561bdf14c00 2023-10-06T04:37:39.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.888+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.0 v2:172.21.15.8:6808/90668 25 ==== osd_op_reply(114 [pgnls-filter start_epoch 46 out=49b] v38'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14c00 2023-10-06T04:37:39.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.888+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:115 7.3b 7:dc000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02ac00 con 0x5561bdf15400 2023-10-06T04:37:39.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.888+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 <== osd.5 v2:172.21.15.184:6824/90894 12 ==== osd_op_reply(115 [pgnls-filter start_epoch 46 out=49b] v38'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f440 con 0x5561bdf15400 2023-10-06T04:37:39.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.888+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:116 7.7 7:e0000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be047800 con 0x5561bdf19400 2023-10-06T04:37:39.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.889+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 <== osd.6 v2:172.21.15.184:6816/90899 20 ==== osd_op_reply(116 [pgnls-filter start_epoch 46 out=81b] v46'10 uv10 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5561bde5f440 con 0x5561bdf19400 2023-10-06T04:37:39.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.889+0000 7f243d19a740 20 datascan.forall_objects: OSD matched oid 10000000001.00000000 2023-10-06T04:37:39.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.889+0000 7f243d19a740 10 datascan.operator(): handling object 10000000001.0 2023-10-06T04:37:39.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.889+0000 7f243d19a740 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:117 7.7 7:e2e07930:::10000000001.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be056000 con 0x5561bdf19400 2023-10-06T04:37:39.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.889+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 <== osd.6 v2:172.21.15.184:6816/90899 21 ==== osd_op_reply(117 10000000001.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (95) out=95b,getxattr (30) out=30b,getxattr] v0'0 uv10 ondisk = 0) v8 ==== 416+0+163 (crc 0 0 0) 0x5561bde5f440 con 0x5561bdf19400 2023-10-06T04:37:39.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.889+0000 7f243d19a740 20 datascan.operator(): loaded layout from xattr: pi: 7 os: 4194304 sc: 1 su: 4194304 2023-10-06T04:37:39.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.889+0000 7f243d19a740 10 datascan.inject_with_backtrace: inode: 0x0x10000000001 2023-10-06T04:37:39.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.889+0000 7f243d19a740 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/sixmegs 2023-10-06T04:37:39.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.889+0000 7f243d19a740 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=sixmegs 2023-10-06T04:37:39.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.889+0000 7f243d19a740 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:118 8.10 8:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be056400 con 0x5561bdf15800 2023-10-06T04:37:39.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.889+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.7 v2:172.21.15.184:6808/90869 9 ==== osd_op_reply(118 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf15800 2023-10-06T04:37:39.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.889+0000 7f243d19a740 4 datascan.get_frag_of: Unexpected error on '10000000000.00000000': (2) No such file or directory 2023-10-06T04:37:39.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.889+0000 7f243d19a740 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/sixmegs, will insert to root 2023-10-06T04:37:39.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.889+0000 7f243d19a740 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:119 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be056800 con 0x5561bdf15800 2023-10-06T04:37:39.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.890+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.7 v2:172.21.15.184:6808/90869 10 ==== osd_op_reply(119 10000000000.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf15800 2023-10-06T04:37:39.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.890+0000 7f243d19a740 10 datascan.find_or_create_dirfrag: read_version = 0 2023-10-06T04:37:39.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.890+0000 7f243d19a740 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:120 8.10 8:0cf6ad0f:::10000000000.00000000:head [create,omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be056c00 con 0x5561bdf15800 2023-10-06T04:37:39.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.891+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.7 v2:172.21.15.184:6808/90869 11 ==== osd_op_reply(120 10000000000.00000000 [create,omap-set-header] v46'1 uv1 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf15800 2023-10-06T04:37:39.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.891+0000 7f243d19a740 10 datascan.find_or_create_dirfrag: Created dirfrag: 0x0x10000000000 2023-10-06T04:37:39.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.891+0000 7f243d19a740 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:121 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be057000 con 0x5561bdf15800 2023-10-06T04:37:39.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.891+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.7 v2:172.21.15.184:6808/90869 12 ==== osd_op_reply(121 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf15800 2023-10-06T04:37:39.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.891+0000 7f243d19a740 20 datascan.read_dentry: oid=10000000000.00000000 dname=sixmegs frag=*, r=0 2023-10-06T04:37:39.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.891+0000 7f243d19a740 20 datascan.read_dentry: sixmegs_head not found in result 2023-10-06T04:37:39.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.891+0000 7f243d19a740 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000001 at 0x0x10000000000/sixmegs with size=6291456 bytes 2023-10-06T04:37:39.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.891+0000 7f243d19a740 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:122 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=496b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be057400 con 0x5561bdf15800 2023-10-06T04:37:39.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.892+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.7 v2:172.21.15.184:6808/90869 13 ==== osd_op_reply(122 10000000000.00000000 [omap-set-vals] v46'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf15800 2023-10-06T04:37:40.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.892+0000 7f243d19a740 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/sixmegs pointing to 0x0x10000000001 2023-10-06T04:37:40.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.892+0000 7f243d19a740 10 datascan.inject_with_backtrace: backptr: 0x0x1/subdir 2023-10-06T04:37:40.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.892+0000 7f243d19a740 20 datascan.get_frag_of: dirino=0x1 target_dname=subdir 2023-10-06T04:37:40.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.892+0000 7f243d19a740 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:123 8.1f 8:ff5b34d6:::1.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be057800 con 0x5561bdf14c00 2023-10-06T04:37:40.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.892+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.0 v2:172.21.15.8:6808/90668 26 ==== osd_op_reply(123 1.00000000 [getxattr] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14c00 2023-10-06T04:37:40.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.892+0000 7f243d19a740 4 datascan.get_frag_of: Unexpected error on '1.00000000': (2) No such file or directory 2023-10-06T04:37:40.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.892+0000 7f243d19a740 20 datascan.inject_with_backtrace: don't know fragment for 0x0x1/subdir, will insert to root 2023-10-06T04:37:40.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.892+0000 7f243d19a740 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:124 8.1f 8:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be057c00 con 0x5561bdf14c00 2023-10-06T04:37:40.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.893+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.0 v2:172.21.15.8:6808/90668 27 ==== osd_op_reply(124 1.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14c00 2023-10-06T04:37:40.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.893+0000 7f243d19a740 10 datascan.find_or_create_dirfrag: read_version = 0 2023-10-06T04:37:40.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.893+0000 7f243d19a740 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:125 8.1f 8:ff5b34d6:::1.00000000:head [create,omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be060000 con 0x5561bdf14c00 2023-10-06T04:37:40.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.894+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.0 v2:172.21.15.8:6808/90668 28 ==== osd_op_reply(125 1.00000000 [create,omap-set-header] v46'2 uv2 ondisk = 0) v8 ==== 196+0+0 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14c00 2023-10-06T04:37:40.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.894+0000 7f243d19a740 10 datascan.find_or_create_dirfrag: Created dirfrag: 0x0x1 2023-10-06T04:37:40.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.894+0000 7f243d19a740 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:126 8.1f 8:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be060400 con 0x5561bdf14c00 2023-10-06T04:37:40.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.894+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.0 v2:172.21.15.8:6808/90668 29 ==== osd_op_reply(126 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv2 ondisk = 0) v8 ==== 154+0+4 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14c00 2023-10-06T04:37:40.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.894+0000 7f243d19a740 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-10-06T04:37:40.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.894+0000 7f243d19a740 20 datascan.read_dentry: subdir_head not found in result 2023-10-06T04:37:40.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.894+0000 7f243d19a740 10 datascan.inject_with_backtrace: Linking ancestor directory of inode 0x0x10000000000 at 0x0x1:subdir 2023-10-06T04:37:40.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.894+0000 7f243d19a740 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:127 8.1f 8:ff5b34d6:::1.00000000:head [omap-set-vals in=495b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be060800 con 0x5561bdf14c00 2023-10-06T04:37:40.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.895+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.0 v2:172.21.15.8:6808/90668 30 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v46'3 uv3 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14c00 2023-10-06T04:37:40.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.895+0000 7f243d19a740 20 datascan.inject_linkage: Injected dentry 0x0x1/subdir pointing to 0x0x10000000000 2023-10-06T04:37:40.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.895+0000 7f243d19a740 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:128 7.27 7:e4000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be060c00 con 0x5561bdf19400 2023-10-06T04:37:40.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.895+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 <== osd.6 v2:172.21.15.184:6816/90899 22 ==== osd_op_reply(128 [pgnls-filter start_epoch 46 out=49b] v38'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f440 con 0x5561bdf19400 2023-10-06T04:37:40.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.895+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:129 7.17 7:e8000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be047c00 con 0x5561bdf15800 2023-10-06T04:37:40.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.896+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.7 v2:172.21.15.184:6808/90869 14 ==== osd_op_reply(129 [pgnls-filter start_epoch 46 out=49b] v38'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf15800 2023-10-06T04:37:40.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.896+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:130 7.37 7:ec000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02a400 con 0x5561bdf14c00 2023-10-06T04:37:40.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.896+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.0 v2:172.21.15.8:6808/90668 31 ==== osd_op_reply(130 [pgnls-filter start_epoch 46 out=49b] v38'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14c00 2023-10-06T04:37:40.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.896+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:131 7.f 7:f0000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be060000 con 0x5561bdf14c00 2023-10-06T04:37:40.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.896+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.0 v2:172.21.15.8:6808/90668 32 ==== osd_op_reply(131 [pgnls-filter start_epoch 46 out=49b] v38'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf14c00 2023-10-06T04:37:40.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.896+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:132 7.2f 7:f4000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02a000 con 0x5561bdf14400 2023-10-06T04:37:40.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.897+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 <== osd.4 v2:172.21.15.184:6800/90868 16 ==== osd_op_reply(132 [pgnls-filter start_epoch 46 out=49b] v38'9 uv1 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5efc0 con 0x5561bdf14400 2023-10-06T04:37:40.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.897+0000 7f24313fd700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:133 7.1f 7:f8000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be060400 con 0x5561bdf19400 2023-10-06T04:37:40.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.897+0000 7f2436407700 1 -- 172.21.15.8:0/815602614 <== osd.6 v2:172.21.15.184:6816/90899 23 ==== osd_op_reply(133 [pgnls-filter start_epoch 46 out=49b] v38'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f440 con 0x5561bdf19400 2023-10-06T04:37:40.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.897+0000 7f2431bfe700 1 -- 172.21.15.8:0/815602614 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:134 7.3f 7:fc000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x5561be02b000 con 0x5561bdf15800 2023-10-06T04:37:40.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f2436c08700 1 -- 172.21.15.8:0/815602614 <== osd.7 v2:172.21.15.184:6808/90869 15 ==== osd_op_reply(134 [pgnls-filter start_epoch 46 out=49b] v38'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561bde5f200 con 0x5561bdf15800 2023-10-06T04:37:40.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f243d19a740 1 -- 172.21.15.8:0/815602614 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x5561bdf14c00 msgr2=0x5561be012000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f243d19a740 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x5561bdf14c00 0x5561be012000 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f243d19a740 1 -- 172.21.15.8:0/815602614 >> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] conn(0x5561be02b800 msgr2=0x5561be015180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f243d19a740 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] conn(0x5561be02b800 0x5561be015180 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f243d19a740 1 -- 172.21.15.8:0/815602614 >> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] conn(0x5561bdf18c00 msgr2=0x5561be013b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f243d19a740 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] conn(0x5561bdf18c00 0x5561be013b80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f243d19a740 1 -- 172.21.15.8:0/815602614 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x5561bdf14800 msgr2=0x5561be014100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f243d19a740 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x5561bdf14800 0x5561be014100 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f243d19a740 1 -- 172.21.15.8:0/815602614 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x5561bdf14400 msgr2=0x5561bde4d180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f243d19a740 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x5561bdf14400 0x5561bde4d180 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 reap_dead start 2023-10-06T04:37:40.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f243d19a740 1 -- 172.21.15.8:0/815602614 >> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] conn(0x5561bdf15400 msgr2=0x5561be012580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f243d19a740 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] conn(0x5561bdf15400 0x5561be012580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f243d19a740 1 -- 172.21.15.8:0/815602614 >> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] conn(0x5561bdf19400 msgr2=0x5561be014680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f243d19a740 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] conn(0x5561bdf19400 0x5561be014680 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f243d19a740 1 -- 172.21.15.8:0/815602614 >> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] conn(0x5561bdf15800 msgr2=0x5561be015700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f243d19a740 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] conn(0x5561bdf15800 0x5561be015700 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 reap_dead start 2023-10-06T04:37:40.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f2435c06700 1 -- 172.21.15.8:0/815602614 reap_dead start 2023-10-06T04:37:40.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f243d19a740 1 -- 172.21.15.8:0/815602614 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x5561bdf18800 msgr2=0x5561bde4d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f243d19a740 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x5561bdf18800 0x5561bde4d700 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x5561bde17ce0 tx=0x5561bd214480 comp rx=0 tx=0).stop 2023-10-06T04:37:40.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f243d19a740 1 -- 172.21.15.8:0/815602614 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561bd212c00 msgr2=0x5561bde4c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f243d19a740 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561bd212c00 0x5561bde4c680 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x5561bde6f8c0 tx=0x5561bdeaecc0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f243d19a740 1 -- 172.21.15.8:0/815602614 shutdown_connections 2023-10-06T04:37:40.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f243d19a740 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561bd212c00 0x5561bde4c680 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f243d19a740 1 --2- 172.21.15.8:0/815602614 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x5561bdf18800 0x5561bde4d700 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f243d19a740 1 -- 172.21.15.8:0/815602614 >> 172.21.15.8:0/815602614 conn(0x5561bd212400 msgr2=0x5561bde25000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:40.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f243d19a740 1 -- 172.21.15.8:0/815602614 shutdown_connections 2023-10-06T04:37:40.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f243d19a740 1 -- 172.21.15.8:0/815602614 wait complete. 2023-10-06T04:37:40.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f243d19a740 1 -- 172.21.15.8:0/643797924 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561bd213000 msgr2=0x5561bde4a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f243d19a740 1 --2- 172.21.15.8:0/643797924 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561bd213000 0x5561bde4a580 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x5561bde6e720 tx=0x5561bd214120 comp rx=0 tx=0).stop 2023-10-06T04:37:40.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f243d19a740 1 -- 172.21.15.8:0/643797924 shutdown_connections 2023-10-06T04:37:40.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f243d19a740 1 --2- 172.21.15.8:0/643797924 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5561bd212800 0x5561bde4b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f243d19a740 1 --2- 172.21.15.8:0/643797924 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561bd213000 0x5561bde4a580 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f243d19a740 1 --2- 172.21.15.8:0/643797924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561bd213c00 0x5561bde4a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f243d19a740 1 -- 172.21.15.8:0/643797924 >> 172.21.15.8:0/643797924 conn(0x5561bd212000 msgr2=0x5561bde26000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:40.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f243d19a740 1 -- 172.21.15.8:0/643797924 shutdown_connections 2023-10-06T04:37:40.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:39.898+0000 7f243d19a740 1 -- 172.21.15.8:0/643797924 wait complete. 2023-10-06T04:37:40.010 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', '--alternate-pool', 'recovery_fs_metadata', '--filesystem', 'cephfs', '--force-corrupt', '--force-init', 'cephfs_data'] in time 0:00:00.240492, result: 2023-10-06T04:37:40.010 DEBUG:teuthology.orchestra.run.smithi008:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links --filesystem recovery_fs 2023-10-06T04:37:40.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.046+0000 7f1ff00bf740 1 -- start start 2023-10-06T04:37:40.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.046+0000 7f1ff00bf740 1 Processor -- start 2023-10-06T04:37:40.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.047+0000 7f1ff00bf740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55907effe400 0x55907fc40580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.047+0000 7f1ff00bf740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55907effe800 0x55907fc40b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.047+0000 7f1ff00bf740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55907effec00 0x55907fc41080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.047+0000 7f1ff00bf740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55907eec8dc0 con 0x55907effe800 2023-10-06T04:37:40.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.047+0000 7f1ff00bf740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55907eec9cc0 con 0x55907effec00 2023-10-06T04:37:40.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.047+0000 7f1ff00bf740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55907eec83c0 con 0x55907effe400 2023-10-06T04:37:40.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.047+0000 7f1fe8b2b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55907effe800 0x55907fc40b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.047+0000 7f1fe8b2b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55907effe800 0x55907fc40b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54614/0 (socket says 172.21.15.8:54614) 2023-10-06T04:37:40.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.047+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/2391139407 learned_addr learned my addr 172.21.15.8:0/2391139407 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:40.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.047+0000 7f1fe932c700 1 --2- 172.21.15.8:0/2391139407 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55907effe400 0x55907fc40580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.047+0000 7f1fe9b2d700 1 --2- 172.21.15.8:0/2391139407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55907effec00 0x55907fc41080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.048+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/2391139407 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55907effe400 msgr2=0x55907fc40580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:40.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.048+0000 7f1fe8b2b700 1 --2- 172.21.15.8:0/2391139407 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55907effe400 0x55907fc40580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.048+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/2391139407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55907effec00 msgr2=0x55907fc41080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:40.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.048+0000 7f1fe8b2b700 1 --2- 172.21.15.8:0/2391139407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55907effec00 0x55907fc41080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.048+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/2391139407 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55907eeac340 con 0x55907effe800 2023-10-06T04:37:40.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.048+0000 7f1fe8b2b700 1 --2- 172.21.15.8:0/2391139407 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55907effe800 0x55907fc40b00 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x55907fc686c0 tx=0x55907fc74180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923fb28b5ec96062 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:40.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.048+0000 7f1fe6b27700 1 -- 172.21.15.8:0/2391139407 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55907eec1600 con 0x55907effe800 2023-10-06T04:37:40.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.048+0000 7f1fe6b27700 1 -- 172.21.15.8:0/2391139407 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55907eede480 con 0x55907effe800 2023-10-06T04:37:40.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.048+0000 7f1fe6b27700 1 -- 172.21.15.8:0/2391139407 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55907eec11e0 con 0x55907effe800 2023-10-06T04:37:40.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.048+0000 7f1ff00bf740 1 -- 172.21.15.8:0/2391139407 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55907eeac000 con 0x55907effe800 2023-10-06T04:37:40.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.048+0000 7f1ff00bf740 1 -- 172.21.15.8:0/2391139407 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55907eeacea0 con 0x55907effe800 2023-10-06T04:37:40.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.048+0000 7f1ff00bf740 4 waiting for MDS map... 2023-10-06T04:37:40.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.048+0000 7f1fe6b27700 1 -- 172.21.15.8:0/2391139407 <== mon.0 v2:172.21.15.8:3300/0 4 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x55907eeccc40 con 0x55907effe800 2023-10-06T04:37:40.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.048+0000 7f1fe6b27700 1 -- 172.21.15.8:0/2391139407 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 23) v1 ==== 3663+0+0 (secure 0 0 0) 0x55907fc6c600 con 0x55907effe800 2023-10-06T04:37:40.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.048+0000 7f1ff00bf740 4 Got MDS map 23 2023-10-06T04:37:40.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.048+0000 7f1ff00bf740 4 datascan.main: Using metadata pool output 2023-10-06T04:37:40.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.048+0000 7f1ff00bf740 4 datascan.main: connecting to RADOS... 2023-10-06T04:37:40.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.049+0000 7f1ff00bf740 1 Processor -- start 2023-10-06T04:37:40.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.049+0000 7f1ff00bf740 1 -- start start 2023-10-06T04:37:40.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.049+0000 7f1ff00bf740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55907efff800 0x55907fc41600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.049+0000 7f1ff00bf740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55907efffc00 0x55907fc41b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.049+0000 7f1ff00bf740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55907fce4000 0x55907fc42100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.049+0000 7f1ff00bf740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55907eec8000 con 0x55907efff800 2023-10-06T04:37:40.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.049+0000 7f1ff00bf740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55907ef51040 con 0x55907efffc00 2023-10-06T04:37:40.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.049+0000 7f1ff00bf740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55907eec9cc0 con 0x55907fce4000 2023-10-06T04:37:40.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.050+0000 7f1fe9b2d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55907efff800 0x55907fc41600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.050+0000 7f1fe9b2d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55907efff800 0x55907fc41600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54618/0 (socket says 172.21.15.8:54618) 2023-10-06T04:37:40.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.050+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/1611124774 learned_addr learned my addr 172.21.15.8:0/1611124774 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:40.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.050+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/1611124774 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55907fce4000 msgr2=0x55907fc42100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:40.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.050+0000 7f1fe9b2d700 1 --2- 172.21.15.8:0/1611124774 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55907fce4000 0x55907fc42100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.050+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/1611124774 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55907efffc00 msgr2=0x55907fc41b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:40.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.050+0000 7f1fe9b2d700 1 --2- 172.21.15.8:0/1611124774 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55907efffc00 0x55907fc41b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.050+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/1611124774 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55907eead860 con 0x55907efff800 2023-10-06T04:37:40.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.050+0000 7f1fe9b2d700 1 --2- 172.21.15.8:0/1611124774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55907efff800 0x55907fc41600 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x55907fc69bc0 tx=0x55907fc1b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c113ac9e61081635 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:40.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.050+0000 7f1fe4b23700 1 -- 172.21.15.8:0/1611124774 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55907eec1080 con 0x55907efff800 2023-10-06T04:37:40.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.050+0000 7f1fe4b23700 1 -- 172.21.15.8:0/1611124774 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55907eedec00 con 0x55907efff800 2023-10-06T04:37:40.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.050+0000 7f1fe4b23700 1 -- 172.21.15.8:0/1611124774 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55907eec1600 con 0x55907efff800 2023-10-06T04:37:40.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.051+0000 7f1ff00bf740 1 -- 172.21.15.8:0/1611124774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55907efff800 msgr2=0x55907fc41600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.051+0000 7f1ff00bf740 1 --2- 172.21.15.8:0/1611124774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55907efff800 0x55907fc41600 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x55907fc69bc0 tx=0x55907fc1b9e0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.051+0000 7f1ff00bf740 1 -- 172.21.15.8:0/1611124774 shutdown_connections 2023-10-06T04:37:40.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.051+0000 7f1ff00bf740 1 --2- 172.21.15.8:0/1611124774 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55907fce4000 0x55907fc42100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.051+0000 7f1ff00bf740 1 --2- 172.21.15.8:0/1611124774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55907efff800 0x55907fc41600 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.051+0000 7f1ff00bf740 1 --2- 172.21.15.8:0/1611124774 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55907efffc00 0x55907fc41b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.051+0000 7f1ff00bf740 1 -- 172.21.15.8:0/1611124774 >> 172.21.15.8:0/1611124774 conn(0x55907efff000 msgr2=0x55907fc11800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:40.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.051+0000 7f1ff00bf740 1 -- 172.21.15.8:0/1611124774 shutdown_connections 2023-10-06T04:37:40.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.051+0000 7f1ff00bf740 1 -- 172.21.15.8:0/1611124774 wait complete. 2023-10-06T04:37:40.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.051+0000 7f1ff00bf740 1 Processor -- start 2023-10-06T04:37:40.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.051+0000 7f1ff00bf740 1 -- start start 2023-10-06T04:37:40.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.052+0000 7f1ff00bf740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55907efffc00 0x55907fc42c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.052+0000 7f1ff00bf740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55907efff800 0x55907fc42680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.052+0000 7f1ff00bf740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55907fcf8000 0x55907fc42100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.052+0000 7f1ff00bf740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55907eec9180 con 0x55907fcf8000 2023-10-06T04:37:40.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.052+0000 7f1ff00bf740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55907eec9040 con 0x55907efff800 2023-10-06T04:37:40.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.052+0000 7f1ff00bf740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55907eec8f00 con 0x55907efffc00 2023-10-06T04:37:40.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.052+0000 7f1fe8b2b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55907fcf8000 0x55907fc42100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.052+0000 7f1fe8b2b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55907fcf8000 0x55907fc42100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54630/0 (socket says 172.21.15.8:54630) 2023-10-06T04:37:40.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.052+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/3051656219 learned_addr learned my addr 172.21.15.8:0/3051656219 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:40.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.052+0000 7f1fe932c700 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55907efff800 0x55907fc42680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.052+0000 7f1fe9b2d700 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55907efffc00 0x55907fc42c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.052+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/3051656219 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55907efffc00 msgr2=0x55907fc42c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.052+0000 7f1fe8b2b700 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55907efffc00 0x55907fc42c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.052+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/3051656219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55907efff800 msgr2=0x55907fc42680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.052+0000 7f1fe8b2b700 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55907efff800 0x55907fc42680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.052+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55907eeac9c0 con 0x55907fcf8000 2023-10-06T04:37:40.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.052+0000 7f1fe8b2b700 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55907fcf8000 0x55907fc42100 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x55907fc98660 tx=0x55907fc74060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:40.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.053+0000 7f1fe3320700 1 -- 172.21.15.8:0/3051656219 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55907eec0f20 con 0x55907fcf8000 2023-10-06T04:37:40.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.053+0000 7f1fe3320700 1 -- 172.21.15.8:0/3051656219 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55907eede300 con 0x55907fcf8000 2023-10-06T04:37:40.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.053+0000 7f1ff00bf740 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55907eeada00 con 0x55907fcf8000 2023-10-06T04:37:40.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.053+0000 7f1fe3320700 1 -- 172.21.15.8:0/3051656219 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55907eec1080 con 0x55907fcf8000 2023-10-06T04:37:40.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.053+0000 7f1ff00bf740 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55907eeacea0 con 0x55907fcf8000 2023-10-06T04:37:40.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.053+0000 7f1ff00bf740 4 datascan.init: resolving metadata pool 8 2023-10-06T04:37:40.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.054+0000 7f1fe3320700 1 -- 172.21.15.8:0/3051656219 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x55907fbff080 con 0x55907fcf8000 2023-10-06T04:37:40.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.054+0000 7f1fe3320700 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x55907fcfe800 0x55907fc43700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.054+0000 7f1fe3320700 1 -- 172.21.15.8:0/3051656219 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x55907eecca80 con 0x55907fcf8000 2023-10-06T04:37:40.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.054+0000 7f1ff00bf740 4 datascan.init: found metadata pool 'recovery_fs_metadata' 2023-10-06T04:37:40.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.054+0000 7f1ff00bf740 4 datascan.main: resolving metadata pool 8 2023-10-06T04:37:40.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.054+0000 7f1ff00bf740 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x55907fcf8400 0x55907fc41b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.054+0000 7f1fe9b2d700 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x55907fcfe800 0x55907fc43700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.054+0000 7f1ff00bf740 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:1 8.0 8:00000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf8800 con 0x55907fcf8400 2023-10-06T04:37:40.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.054+0000 7f1fe932c700 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x55907fcf8400 0x55907fc41b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.055+0000 7f1fe9b2d700 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x55907fcfe800 0x55907fc43700 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55907fc69bc0 tx=0x55907fc1b980 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:40.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.055+0000 7f1fe932c700 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x55907fcf8400 0x55907fc41b80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:40.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.055+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 <== osd.3 v2:172.21.15.8:6823/90671 1 ==== osd_op_reply(1 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc66fc0 con 0x55907fcf8400 2023-10-06T04:37:40.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.055+0000 7f1fe932c700 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] conn(0x55907fcf8800 0x55907fdf6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.055+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:2 8.10 8:08000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcfec00 con 0x55907fcf8800 2023-10-06T04:37:40.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.056+0000 7f1fe9b2d700 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] conn(0x55907fcf8800 0x55907fdf6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.056+0000 7f1fe9b2d700 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] conn(0x55907fcf8800 0x55907fdf6000 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:40.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.056+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 <== osd.7 v2:172.21.15.184:6808/90869 1 ==== osd_op_reply(2 [pgnls start_epoch 46 out=81b] v46'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55907fc67200 con 0x55907fcf8800 2023-10-06T04:37:40.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.056+0000 7f1fe9b2d700 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] conn(0x55907fcfec00 0x55907fdf6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.056+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:3 8.8 8:10000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcff000 con 0x55907fcfec00 2023-10-06T04:37:40.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.056+0000 7f1fe932c700 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] conn(0x55907fcfec00 0x55907fdf6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.057+0000 7f1fe932c700 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] conn(0x55907fcfec00 0x55907fdf6580 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:40.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.057+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 <== osd.5 v2:172.21.15.184:6824/90894 1 ==== osd_op_reply(3 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc66fc0 con 0x55907fcfec00 2023-10-06T04:37:40.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.057+0000 7f1fe932c700 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x55907fcff000 0x55907fdf6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.057+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:4 8.18 8:18000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcff400 con 0x55907fcff000 2023-10-06T04:37:40.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.057+0000 7f1fe8b2b700 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x55907fcff000 0x55907fdf6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.058+0000 7f1fe8b2b700 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x55907fcff000 0x55907fdf6b00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:40.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.058+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/3051656219 <== osd.4 v2:172.21.15.184:6800/90868 1 ==== osd_op_reply(4 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc67440 con 0x55907fcff000 2023-10-06T04:37:40.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.058+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:5 8.4 8:20000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcff400 con 0x55907fcfec00 2023-10-06T04:37:40.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.058+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 <== osd.5 v2:172.21.15.184:6824/90894 2 ==== osd_op_reply(5 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc66fc0 con 0x55907fcfec00 2023-10-06T04:37:40.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.058+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:6 8.14 8:28000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcff400 con 0x55907fcff000 2023-10-06T04:37:40.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.058+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/3051656219 <== osd.4 v2:172.21.15.184:6800/90868 2 ==== osd_op_reply(6 [pgnls start_epoch 46 out=77b] v46'1 uv1 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x55907fc67440 con 0x55907fcff000 2023-10-06T04:37:40.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.058+0000 7f1fe8b2b700 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x55907fcff400 0x55907fdf7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.058+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:7 8.c 8:30000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcfe400 con 0x55907fcff400 2023-10-06T04:37:40.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.059+0000 7f1fe9b2d700 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x55907fcff400 0x55907fdf7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.059+0000 7f1fe9b2d700 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x55907fcff400 0x55907fdf7600 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:40.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.059+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 <== osd.0 v2:172.21.15.8:6808/90668 1 ==== osd_op_reply(7 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc67200 con 0x55907fcff400 2023-10-06T04:37:40.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.059+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:8 8.1c 8:38000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcfe400 con 0x55907fcfec00 2023-10-06T04:37:40.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.059+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 <== osd.5 v2:172.21.15.184:6824/90894 3 ==== osd_op_reply(8 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc66fc0 con 0x55907fcfec00 2023-10-06T04:37:40.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.059+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:9 8.2 8:40000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcfe400 con 0x55907fcff000 2023-10-06T04:37:40.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.060+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/3051656219 <== osd.4 v2:172.21.15.184:6800/90868 3 ==== osd_op_reply(9 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc67440 con 0x55907fcff000 2023-10-06T04:37:40.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.060+0000 7f1fe8b2b700 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] conn(0x55907fcfe400 0x55907fdf7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.060+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:10 8.12 8:48000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcffc00 con 0x55907fcfe400 2023-10-06T04:37:40.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.060+0000 7f1fe932c700 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] conn(0x55907fcfe400 0x55907fdf7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.060+0000 7f1fe932c700 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] conn(0x55907fcfe400 0x55907fdf7b80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:40.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.060+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 <== osd.6 v2:172.21.15.184:6816/90899 1 ==== osd_op_reply(10 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc66fc0 con 0x55907fcfe400 2023-10-06T04:37:40.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.060+0000 7f1fe932c700 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] conn(0x55907fcffc00 0x55907fdf7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.060+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] -- osd_op(unknown.0.0:11 8.a 8:50000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcff800 con 0x55907fcffc00 2023-10-06T04:37:40.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.061+0000 7f1fe8b2b700 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] conn(0x55907fcffc00 0x55907fdf7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.061+0000 7f1fe8b2b700 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] conn(0x55907fcffc00 0x55907fdf7080 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:40.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.061+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/3051656219 <== osd.1 v2:172.21.15.8:6816/90669 1 ==== osd_op_reply(11 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc67440 con 0x55907fcffc00 2023-10-06T04:37:40.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.061+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:12 8.1a 8:58000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcff800 con 0x55907fcff400 2023-10-06T04:37:40.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.061+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 <== osd.0 v2:172.21.15.8:6808/90668 2 ==== osd_op_reply(12 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc67200 con 0x55907fcff400 2023-10-06T04:37:40.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.061+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:13 8.6 8:60000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcff800 con 0x55907fcff400 2023-10-06T04:37:40.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.062+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 <== osd.0 v2:172.21.15.8:6808/90668 3 ==== osd_op_reply(13 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc67200 con 0x55907fcff400 2023-10-06T04:37:40.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.062+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:14 8.16 8:68000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcff800 con 0x55907fcf8400 2023-10-06T04:37:40.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.062+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 <== osd.3 v2:172.21.15.8:6823/90671 2 ==== osd_op_reply(14 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc66fc0 con 0x55907fcf8400 2023-10-06T04:37:40.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.062+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:15 8.e 8:70000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcff800 con 0x55907fcff400 2023-10-06T04:37:40.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.062+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 <== osd.0 v2:172.21.15.8:6808/90668 4 ==== osd_op_reply(15 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc67200 con 0x55907fcff400 2023-10-06T04:37:40.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.062+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:16 8.1e 8:78000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcff800 con 0x55907fcf8400 2023-10-06T04:37:40.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.062+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 <== osd.3 v2:172.21.15.8:6823/90671 3 ==== osd_op_reply(16 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc66fc0 con 0x55907fcf8400 2023-10-06T04:37:40.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.062+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] -- osd_op(unknown.0.0:17 8.1 8:80000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcff800 con 0x55907fcffc00 2023-10-06T04:37:40.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.063+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/3051656219 <== osd.1 v2:172.21.15.8:6816/90669 2 ==== osd_op_reply(17 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc67440 con 0x55907fcffc00 2023-10-06T04:37:40.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.063+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:18 8.11 8:88000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcff800 con 0x55907fcfec00 2023-10-06T04:37:40.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.063+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 <== osd.5 v2:172.21.15.184:6824/90894 4 ==== osd_op_reply(18 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc66fc0 con 0x55907fcfec00 2023-10-06T04:37:40.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.063+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:19 8.9 8:90000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcff800 con 0x55907fcfe400 2023-10-06T04:37:40.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.063+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 <== osd.6 v2:172.21.15.184:6816/90899 2 ==== osd_op_reply(19 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc66fc0 con 0x55907fcfe400 2023-10-06T04:37:40.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.063+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:20 8.19 8:98000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcff800 con 0x55907fcfec00 2023-10-06T04:37:40.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.064+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 <== osd.5 v2:172.21.15.184:6824/90894 5 ==== osd_op_reply(20 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc66fc0 con 0x55907fcfec00 2023-10-06T04:37:40.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.064+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:21 8.5 8:a0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcff800 con 0x55907fcfe400 2023-10-06T04:37:40.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.064+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 <== osd.6 v2:172.21.15.184:6816/90899 3 ==== osd_op_reply(21 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc66fc0 con 0x55907fcfe400 2023-10-06T04:37:40.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.064+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:22 8.15 8:a8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcff800 con 0x55907fcf8800 2023-10-06T04:37:40.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.064+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 <== osd.7 v2:172.21.15.184:6808/90869 2 ==== osd_op_reply(22 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc67200 con 0x55907fcf8800 2023-10-06T04:37:40.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.064+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:23 8.d 8:b0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcff800 con 0x55907fcfec00 2023-10-06T04:37:40.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.065+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 <== osd.5 v2:172.21.15.184:6824/90894 6 ==== osd_op_reply(23 [pgnls start_epoch 46 out=74b] v46'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x55907fc66fc0 con 0x55907fcfec00 2023-10-06T04:37:40.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.065+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:24 8.1d 8:b8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcff800 con 0x55907fcff400 2023-10-06T04:37:40.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.065+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 <== osd.0 v2:172.21.15.8:6808/90668 5 ==== osd_op_reply(24 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc67200 con 0x55907fcff400 2023-10-06T04:37:40.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.065+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] -- osd_op(unknown.0.0:25 8.3 8:c0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcff800 con 0x55907fcffc00 2023-10-06T04:37:40.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.065+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/3051656219 <== osd.1 v2:172.21.15.8:6816/90669 3 ==== osd_op_reply(25 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc67440 con 0x55907fcffc00 2023-10-06T04:37:40.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.065+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:26 8.13 8:c8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcff800 con 0x55907fcf8400 2023-10-06T04:37:40.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.065+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 <== osd.3 v2:172.21.15.8:6823/90671 4 ==== osd_op_reply(26 [pgnls start_epoch 46 out=98b] v46'2 uv2 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x55907fc66fc0 con 0x55907fcf8400 2023-10-06T04:37:40.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.065+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:27 8.b 8:d0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcff800 con 0x55907fcf8400 2023-10-06T04:37:40.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.066+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 <== osd.3 v2:172.21.15.8:6823/90671 5 ==== osd_op_reply(27 [pgnls start_epoch 46 out=76b] v46'1 uv1 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x55907fc66fc0 con 0x55907fcf8400 2023-10-06T04:37:40.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.066+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:28 8.1b 8:d8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcff800 con 0x55907fcff000 2023-10-06T04:37:40.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.066+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/3051656219 <== osd.4 v2:172.21.15.184:6800/90868 4 ==== osd_op_reply(28 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc67440 con 0x55907fcff000 2023-10-06T04:37:40.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.066+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] -- osd_op(unknown.0.0:29 8.7 8:e0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcff800 con 0x55907fcffc00 2023-10-06T04:37:40.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.066+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/3051656219 <== osd.1 v2:172.21.15.8:6816/90669 4 ==== osd_op_reply(29 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc67440 con 0x55907fcffc00 2023-10-06T04:37:40.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.066+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:30 8.17 8:e8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcff800 con 0x55907fcf8800 2023-10-06T04:37:40.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.066+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 <== osd.7 v2:172.21.15.184:6808/90869 3 ==== osd_op_reply(30 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc67200 con 0x55907fcf8800 2023-10-06T04:37:40.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.066+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:31 8.f 8:f0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcff800 con 0x55907fcf8400 2023-10-06T04:37:40.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.067+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 <== osd.3 v2:172.21.15.8:6823/90671 6 ==== osd_op_reply(31 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc66fc0 con 0x55907fcf8400 2023-10-06T04:37:40.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.067+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:32 8.1f 8:f8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcff800 con 0x55907fcff400 2023-10-06T04:37:40.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.067+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 <== osd.0 v2:172.21.15.8:6808/90668 6 ==== osd_op_reply(32 [pgnls start_epoch 46 out=101b] v46'3 uv3 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x55907fc67200 con 0x55907fcff400 2023-10-06T04:37:40.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.067+0000 7f1ff00bf740 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2023-10-06T04:37:40.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.067+0000 7f1ff00bf740 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:33 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf8c00 con 0x55907fcf8800 2023-10-06T04:37:40.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.067+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 <== osd.7 v2:172.21.15.184:6808/90869 4 ==== osd_op_reply(33 10000000000.00000000 [omap-get-vals out=497b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+497 (crc 0 0 0) 0x55907fc67200 con 0x55907fcf8800 2023-10-06T04:37:40.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.067+0000 7f1ff00bf740 20 datascan.scan_links: injected ino detected 2023-10-06T04:37:40.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.067+0000 7f1ff00bf740 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2023-10-06T04:37:40.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.067+0000 7f1ff00bf740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2023-10-06T04:37:40.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.067+0000 7f1ff00bf740 10 datascan.scan_links: step 1: handling object mds_snaptable 2023-10-06T04:37:40.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.067+0000 7f1ff00bf740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2023-10-06T04:37:40.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.067+0000 7f1ff00bf740 10 datascan.scan_links: step 1: handling object mds0_inotable 2023-10-06T04:37:40.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.067+0000 7f1ff00bf740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2023-10-06T04:37:40.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.067+0000 7f1ff00bf740 10 datascan.scan_links: step 1: handling object 100.00000000 2023-10-06T04:37:40.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.067+0000 7f1ff00bf740 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:34 8.13 8:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9000 con 0x55907fcf8400 2023-10-06T04:37:40.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.068+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 <== osd.3 v2:172.21.15.8:6823/90671 7 ==== osd_op_reply(34 100.00000000 [omap-get-vals out=5b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55907fc66fc0 con 0x55907fcf8400 2023-10-06T04:37:40.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.068+0000 7f1ff00bf740 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2023-10-06T04:37:40.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.068+0000 7f1ff00bf740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2023-10-06T04:37:40.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.068+0000 7f1ff00bf740 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2023-10-06T04:37:40.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.068+0000 7f1ff00bf740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2023-10-06T04:37:40.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.068+0000 7f1ff00bf740 10 datascan.scan_links: step 1: handling object 1.00000000 2023-10-06T04:37:40.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.068+0000 7f1ff00bf740 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:35 8.1f 8:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9400 con 0x55907fcff400 2023-10-06T04:37:40.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.068+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 <== osd.0 v2:172.21.15.8:6808/90668 7 ==== osd_op_reply(35 1.00000000 [omap-get-vals out=496b] v0'0 uv3 ondisk = 0) v8 ==== 154+0+496 (crc 0 0 0) 0x55907fc67200 con 0x55907fcff400 2023-10-06T04:37:40.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.068+0000 7f1ff00bf740 20 datascan.scan_links: injected ino detected 2023-10-06T04:37:40.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.068+0000 7f1ff00bf740 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:36 8.0 8:00000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9800 con 0x55907fcf8400 2023-10-06T04:37:40.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.068+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 <== osd.3 v2:172.21.15.8:6823/90671 8 ==== osd_op_reply(36 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc66fc0 con 0x55907fcf8400 2023-10-06T04:37:40.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.068+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:37 8.10 8:08000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9800 con 0x55907fcf8800 2023-10-06T04:37:40.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.069+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 <== osd.7 v2:172.21.15.184:6808/90869 5 ==== osd_op_reply(37 [pgnls start_epoch 46 out=81b] v46'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55907fc67200 con 0x55907fcf8800 2023-10-06T04:37:40.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.069+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:38 8.8 8:10000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9800 con 0x55907fcfec00 2023-10-06T04:37:40.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.069+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 <== osd.5 v2:172.21.15.184:6824/90894 7 ==== osd_op_reply(38 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc66fc0 con 0x55907fcfec00 2023-10-06T04:37:40.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.069+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:39 8.18 8:18000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9800 con 0x55907fcff000 2023-10-06T04:37:40.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.069+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/3051656219 <== osd.4 v2:172.21.15.184:6800/90868 5 ==== osd_op_reply(39 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc67440 con 0x55907fcff000 2023-10-06T04:37:40.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.069+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:40 8.4 8:20000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9800 con 0x55907fcfec00 2023-10-06T04:37:40.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.070+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 <== osd.5 v2:172.21.15.184:6824/90894 8 ==== osd_op_reply(40 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc66fc0 con 0x55907fcfec00 2023-10-06T04:37:40.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.070+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:41 8.14 8:28000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9800 con 0x55907fcff000 2023-10-06T04:37:40.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.070+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/3051656219 <== osd.4 v2:172.21.15.184:6800/90868 6 ==== osd_op_reply(41 [pgnls start_epoch 46 out=77b] v46'1 uv1 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x55907fc67440 con 0x55907fcff000 2023-10-06T04:37:40.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.070+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:42 8.c 8:30000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9800 con 0x55907fcff400 2023-10-06T04:37:40.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.070+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 <== osd.0 v2:172.21.15.8:6808/90668 8 ==== osd_op_reply(42 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc67200 con 0x55907fcff400 2023-10-06T04:37:40.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.070+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:43 8.1c 8:38000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9800 con 0x55907fcfec00 2023-10-06T04:37:40.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.071+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 <== osd.5 v2:172.21.15.184:6824/90894 9 ==== osd_op_reply(43 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc66fc0 con 0x55907fcfec00 2023-10-06T04:37:40.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.071+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:44 8.2 8:40000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9800 con 0x55907fcff000 2023-10-06T04:37:40.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.071+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/3051656219 <== osd.4 v2:172.21.15.184:6800/90868 7 ==== osd_op_reply(44 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc67440 con 0x55907fcff000 2023-10-06T04:37:40.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.071+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:45 8.12 8:48000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9800 con 0x55907fcfe400 2023-10-06T04:37:40.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.071+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 <== osd.6 v2:172.21.15.184:6816/90899 4 ==== osd_op_reply(45 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc66fc0 con 0x55907fcfe400 2023-10-06T04:37:40.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.071+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] -- osd_op(unknown.0.0:46 8.a 8:50000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9800 con 0x55907fcffc00 2023-10-06T04:37:40.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.071+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/3051656219 <== osd.1 v2:172.21.15.8:6816/90669 5 ==== osd_op_reply(46 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc67440 con 0x55907fcffc00 2023-10-06T04:37:40.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.071+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:47 8.1a 8:58000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9800 con 0x55907fcff400 2023-10-06T04:37:40.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.072+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 <== osd.0 v2:172.21.15.8:6808/90668 9 ==== osd_op_reply(47 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc67200 con 0x55907fcff400 2023-10-06T04:37:40.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.072+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:48 8.6 8:60000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9800 con 0x55907fcff400 2023-10-06T04:37:40.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.072+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 <== osd.0 v2:172.21.15.8:6808/90668 10 ==== osd_op_reply(48 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc67200 con 0x55907fcff400 2023-10-06T04:37:40.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.072+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:49 8.16 8:68000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9800 con 0x55907fcf8400 2023-10-06T04:37:40.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.072+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 <== osd.3 v2:172.21.15.8:6823/90671 9 ==== osd_op_reply(49 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc66fc0 con 0x55907fcf8400 2023-10-06T04:37:40.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.072+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:50 8.e 8:70000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9800 con 0x55907fcff400 2023-10-06T04:37:40.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.072+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 <== osd.0 v2:172.21.15.8:6808/90668 11 ==== osd_op_reply(50 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc67200 con 0x55907fcff400 2023-10-06T04:37:40.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.072+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:51 8.1e 8:78000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9800 con 0x55907fcf8400 2023-10-06T04:37:40.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.072+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 <== osd.3 v2:172.21.15.8:6823/90671 10 ==== osd_op_reply(51 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc66fc0 con 0x55907fcf8400 2023-10-06T04:37:40.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.072+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] -- osd_op(unknown.0.0:52 8.1 8:80000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9800 con 0x55907fcffc00 2023-10-06T04:37:40.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.073+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/3051656219 <== osd.1 v2:172.21.15.8:6816/90669 6 ==== osd_op_reply(52 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc67440 con 0x55907fcffc00 2023-10-06T04:37:40.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.073+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:53 8.11 8:88000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9800 con 0x55907fcfec00 2023-10-06T04:37:40.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.073+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 <== osd.5 v2:172.21.15.184:6824/90894 10 ==== osd_op_reply(53 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc66fc0 con 0x55907fcfec00 2023-10-06T04:37:40.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.073+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:54 8.9 8:90000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9800 con 0x55907fcfe400 2023-10-06T04:37:40.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.073+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 <== osd.6 v2:172.21.15.184:6816/90899 5 ==== osd_op_reply(54 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc66fc0 con 0x55907fcfe400 2023-10-06T04:37:40.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.073+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:55 8.19 8:98000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9800 con 0x55907fcfec00 2023-10-06T04:37:40.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.073+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 <== osd.5 v2:172.21.15.184:6824/90894 11 ==== osd_op_reply(55 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc66fc0 con 0x55907fcfec00 2023-10-06T04:37:40.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.074+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- osd_op(unknown.0.0:56 8.5 8:a0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9800 con 0x55907fcfe400 2023-10-06T04:37:40.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.074+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 <== osd.6 v2:172.21.15.184:6816/90899 6 ==== osd_op_reply(56 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc66fc0 con 0x55907fcfe400 2023-10-06T04:37:40.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.074+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:57 8.15 8:a8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9800 con 0x55907fcf8800 2023-10-06T04:37:40.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.074+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 <== osd.7 v2:172.21.15.184:6808/90869 6 ==== osd_op_reply(57 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc67200 con 0x55907fcf8800 2023-10-06T04:37:40.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.074+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:58 8.d 8:b0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9800 con 0x55907fcfec00 2023-10-06T04:37:40.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.074+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 <== osd.5 v2:172.21.15.184:6824/90894 12 ==== osd_op_reply(58 [pgnls start_epoch 46 out=74b] v46'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x55907fc66fc0 con 0x55907fcfec00 2023-10-06T04:37:40.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.074+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:59 8.1d 8:b8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9800 con 0x55907fcff400 2023-10-06T04:37:40.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.075+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 <== osd.0 v2:172.21.15.8:6808/90668 12 ==== osd_op_reply(59 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc67200 con 0x55907fcff400 2023-10-06T04:37:40.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.075+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] -- osd_op(unknown.0.0:60 8.3 8:c0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9800 con 0x55907fcffc00 2023-10-06T04:37:40.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.075+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/3051656219 <== osd.1 v2:172.21.15.8:6816/90669 7 ==== osd_op_reply(60 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc67440 con 0x55907fcffc00 2023-10-06T04:37:40.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.075+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:61 8.13 8:c8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9800 con 0x55907fcf8400 2023-10-06T04:37:40.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.075+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 <== osd.3 v2:172.21.15.8:6823/90671 11 ==== osd_op_reply(61 [pgnls start_epoch 46 out=98b] v46'2 uv2 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x55907fc66fc0 con 0x55907fcf8400 2023-10-06T04:37:40.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.075+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:62 8.b 8:d0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9800 con 0x55907fcf8400 2023-10-06T04:37:40.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.075+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 <== osd.3 v2:172.21.15.8:6823/90671 12 ==== osd_op_reply(62 [pgnls start_epoch 46 out=76b] v46'1 uv1 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x55907fc66fc0 con 0x55907fcf8400 2023-10-06T04:37:40.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.075+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:63 8.1b 8:d8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9800 con 0x55907fcff000 2023-10-06T04:37:40.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.076+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/3051656219 <== osd.4 v2:172.21.15.184:6800/90868 8 ==== osd_op_reply(63 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc67440 con 0x55907fcff000 2023-10-06T04:37:40.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.076+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] -- osd_op(unknown.0.0:64 8.7 8:e0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9800 con 0x55907fcffc00 2023-10-06T04:37:40.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.076+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/3051656219 <== osd.1 v2:172.21.15.8:6816/90669 8 ==== osd_op_reply(64 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc67440 con 0x55907fcffc00 2023-10-06T04:37:40.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.076+0000 7f1fe8b2b700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:65 8.17 8:e8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9800 con 0x55907fcf8800 2023-10-06T04:37:40.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.076+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 <== osd.7 v2:172.21.15.184:6808/90869 7 ==== osd_op_reply(65 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc67200 con 0x55907fcf8800 2023-10-06T04:37:40.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.076+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:66 8.f 8:f0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9800 con 0x55907fcf8400 2023-10-06T04:37:40.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.077+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 <== osd.3 v2:172.21.15.8:6823/90671 13 ==== osd_op_reply(66 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55907fc66fc0 con 0x55907fcf8400 2023-10-06T04:37:40.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.077+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:67 8.1f 8:f8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9800 con 0x55907fcff400 2023-10-06T04:37:40.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.077+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 <== osd.0 v2:172.21.15.8:6808/90668 13 ==== osd_op_reply(67 [pgnls start_epoch 46 out=101b] v46'3 uv3 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x55907fc67200 con 0x55907fcff400 2023-10-06T04:37:40.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.077+0000 7f1ff00bf740 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2023-10-06T04:37:40.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.077+0000 7f1ff00bf740 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:68 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9c00 con 0x55907fcf8800 2023-10-06T04:37:40.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.077+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 <== osd.7 v2:172.21.15.184:6808/90869 8 ==== osd_op_reply(68 10000000000.00000000 [omap-get-vals out=497b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+497 (crc 0 0 0) 0x55907fc67200 con 0x55907fcf8800 2023-10-06T04:37:40.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.077+0000 7f1ff00bf740 20 datascan.scan_links: injected ino detected 2023-10-06T04:37:40.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.077+0000 7f1ff00bf740 20 datascan.scan_links: adding 0x10000000001 for future processing to fix dnfirst 2023-10-06T04:37:40.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.077+0000 7f1ff00bf740 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2023-10-06T04:37:40.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.077+0000 7f1ff00bf740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2023-10-06T04:37:40.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.077+0000 7f1ff00bf740 10 datascan.scan_links: step 2: handling object mds_snaptable 2023-10-06T04:37:40.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.077+0000 7f1ff00bf740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2023-10-06T04:37:40.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.077+0000 7f1ff00bf740 10 datascan.scan_links: step 2: handling object mds0_inotable 2023-10-06T04:37:40.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.077+0000 7f1ff00bf740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2023-10-06T04:37:40.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.077+0000 7f1ff00bf740 10 datascan.scan_links: step 2: handling object 100.00000000 2023-10-06T04:37:40.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.077+0000 7f1ff00bf740 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:69 8.13 8:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf8c00 con 0x55907fcf8400 2023-10-06T04:37:40.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.078+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 <== osd.3 v2:172.21.15.8:6823/90671 14 ==== osd_op_reply(69 100.00000000 [omap-get-vals out=5b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55907fc66fc0 con 0x55907fcf8400 2023-10-06T04:37:40.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.078+0000 7f1ff00bf740 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2023-10-06T04:37:40.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.078+0000 7f1ff00bf740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2023-10-06T04:37:40.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.078+0000 7f1ff00bf740 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2023-10-06T04:37:40.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.078+0000 7f1ff00bf740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2023-10-06T04:37:40.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.078+0000 7f1ff00bf740 10 datascan.scan_links: step 2: handling object 1.00000000 2023-10-06T04:37:40.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.078+0000 7f1ff00bf740 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:70 8.1f 8:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9400 con 0x55907fcff400 2023-10-06T04:37:40.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.078+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 <== osd.0 v2:172.21.15.8:6808/90668 14 ==== osd_op_reply(70 1.00000000 [omap-get-vals out=496b] v0'0 uv3 ondisk = 0) v8 ==== 154+0+496 (crc 0 0 0) 0x55907fc67200 con 0x55907fcff400 2023-10-06T04:37:40.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.078+0000 7f1ff00bf740 20 datascan.scan_links: injected ino detected 2023-10-06T04:37:40.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.078+0000 7f1ff00bf740 20 datascan.scan_links: adding 0x10000000000 for future processing to fix dnfirst 2023-10-06T04:37:40.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.078+0000 7f1ff00bf740 10 datascan.scan_links: processing 0 dup_primaries, 0 remote_links 2023-10-06T04:37:40.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.078+0000 7f1ff00bf740 10 datascan.scan_links: removing dup dentries from 0 objects 2023-10-06T04:37:40.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.078+0000 7f1ff00bf740 10 datascan.scan_links: processing 0 bad_nlink_inos 2023-10-06T04:37:40.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.078+0000 7f1ff00bf740 10 datascan.scan_links: processing 2 injected_inos 2023-10-06T04:37:40.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.078+0000 7f1ff00bf740 10 datascan.scan_links: handling injected_ino 0x10000000000 2023-10-06T04:37:40.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.078+0000 7f1ff00bf740 20 datascan.scan_links: fixing linkage (dnfirst) of 0x1:subdir 2023-10-06T04:37:40.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.078+0000 7f1ff00bf740 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:71 8.1f 8:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcff800 con 0x55907fcff400 2023-10-06T04:37:40.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.078+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 <== osd.0 v2:172.21.15.8:6808/90668 15 ==== osd_op_reply(71 1.00000000 [omap-get-vals-by-keys out=495b] v0'0 uv3 ondisk = 0) v8 ==== 154+0+495 (crc 0 0 0) 0x55907fc67200 con 0x55907fcff400 2023-10-06T04:37:40.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.078+0000 7f1ff00bf740 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-10-06T04:37:40.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.078+0000 7f1ff00bf740 20 datascan.scan_links: first is now 2 2023-10-06T04:37:40.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.078+0000 7f1ff00bf740 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:72 8.1f 8:ff5b34d6:::1.00000000:head [omap-set-vals in=495b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcff800 con 0x55907fcff400 2023-10-06T04:37:40.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.079+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 <== osd.0 v2:172.21.15.8:6808/90668 16 ==== osd_op_reply(72 1.00000000 [omap-set-vals] v46'4 uv4 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x55907fc67200 con 0x55907fcff400 2023-10-06T04:37:40.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.080+0000 7f1ff00bf740 20 datascan.inject_linkage: Injected dentry 0x0x1/subdir pointing to 0x0x10000000000 2023-10-06T04:37:40.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.080+0000 7f1ff00bf740 10 datascan.scan_links: handling injected_ino 0x10000000001 2023-10-06T04:37:40.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.080+0000 7f1ff00bf740 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:sixmegs 2023-10-06T04:37:40.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.080+0000 7f1ff00bf740 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:73 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9800 con 0x55907fcf8800 2023-10-06T04:37:40.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.080+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 <== osd.7 v2:172.21.15.184:6808/90869 9 ==== osd_op_reply(73 10000000000.00000000 [omap-get-vals-by-keys out=496b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+496 (crc 0 0 0) 0x55907fc67200 con 0x55907fcf8800 2023-10-06T04:37:40.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.080+0000 7f1ff00bf740 20 datascan.read_dentry: oid=10000000000.00000000 dname=sixmegs frag=*, r=0 2023-10-06T04:37:40.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.080+0000 7f1ff00bf740 20 datascan.scan_links: first is now 2 2023-10-06T04:37:40.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.080+0000 7f1ff00bf740 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- osd_op(unknown.0.0:74 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=496b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9c00 con 0x55907fcf8800 2023-10-06T04:37:40.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.081+0000 7f1fe9b2d700 1 -- 172.21.15.8:0/3051656219 <== osd.7 v2:172.21.15.184:6808/90869 10 ==== osd_op_reply(74 10000000000.00000000 [omap-set-vals] v46'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55907fc67200 con 0x55907fcf8800 2023-10-06T04:37:40.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.081+0000 7f1ff00bf740 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/sixmegs pointing to 0x0x10000000001 2023-10-06T04:37:40.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.081+0000 7f1ff00bf740 10 datascan.scan_links: updating inotable 2023-10-06T04:37:40.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.081+0000 7f1ff00bf740 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:75 8.13 8:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fcf9400 con 0x55907fcf8400 2023-10-06T04:37:40.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.082+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 <== osd.3 v2:172.21.15.8:6823/90671 15 ==== osd_op_reply(75 mds0_inotable [read 0~34 out=34b] v0'0 uv2 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x55907fc66fc0 con 0x55907fcf8400 2023-10-06T04:37:40.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.082+0000 7f1ff00bf740 10 mds.0.inotable: skip_inos was [0x10000000000~0x10000000000] 2023-10-06T04:37:40.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.082+0000 7f1ff00bf740 10 mds.0.inotable: skip_inos now [0x10000000002~0xfffffffffe] 2023-10-06T04:37:40.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.082+0000 7f1ff00bf740 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:76 8.13 8:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fe18000 con 0x55907fcf8400 2023-10-06T04:37:40.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.083+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 <== osd.3 v2:172.21.15.8:6823/90671 16 ==== osd_op_reply(76 mds0_inotable [writefull 0~34] v46'3 uv3 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x55907fc66fc0 con 0x55907fcf8400 2023-10-06T04:37:40.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.083+0000 7f1ff00bf740 10 datascan.scan_links: updating snaptable 2023-10-06T04:37:40.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.083+0000 7f1ff00bf740 1 -- 172.21.15.8:0/3051656219 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- osd_op(unknown.0.0:77 8.d 8:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x55907fe18400 con 0x55907fcfec00 2023-10-06T04:37:40.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.083+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 <== osd.5 v2:172.21.15.184:6824/90894 13 ==== osd_op_reply(77 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) v8 ==== 157+0+70 (crc 0 0 0) 0x55907fc66fc0 con 0x55907fcfec00 2023-10-06T04:37:40.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.083+0000 7f1ff00bf740 1 -- 172.21.15.8:0/3051656219 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x55907fcff400 msgr2=0x55907fdf7600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.083+0000 7f1ff00bf740 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x55907fcff400 0x55907fdf7600 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.083+0000 7f1ff00bf740 1 -- 172.21.15.8:0/3051656219 >> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] conn(0x55907fcffc00 msgr2=0x55907fdf7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.083+0000 7f1ff00bf740 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] conn(0x55907fcffc00 0x55907fdf7080 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.083+0000 7f1ff00bf740 1 -- 172.21.15.8:0/3051656219 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x55907fcf8400 msgr2=0x55907fc41b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.083+0000 7f1ff00bf740 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x55907fcf8400 0x55907fc41b80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.083+0000 7f1ff00bf740 1 -- 172.21.15.8:0/3051656219 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x55907fcff000 msgr2=0x55907fdf6b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.083+0000 7f1ff00bf740 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x55907fcff000 0x55907fdf6b00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.083+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 reap_dead start 2023-10-06T04:37:40.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.083+0000 7f1ff00bf740 1 -- 172.21.15.8:0/3051656219 >> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] conn(0x55907fcfec00 msgr2=0x55907fdf6580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.083+0000 7f1ff00bf740 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] conn(0x55907fcfec00 0x55907fdf6580 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.083+0000 7f1ff00bf740 1 -- 172.21.15.8:0/3051656219 >> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] conn(0x55907fcfe400 msgr2=0x55907fdf7b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.083+0000 7f1ff00bf740 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] conn(0x55907fcfe400 0x55907fdf7b80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.083+0000 7f1ff00bf740 1 -- 172.21.15.8:0/3051656219 >> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] conn(0x55907fcf8800 msgr2=0x55907fdf6000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.083+0000 7f1ff00bf740 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] conn(0x55907fcf8800 0x55907fdf6000 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.083+0000 7f1ff00bf740 1 -- 172.21.15.8:0/3051656219 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x55907fcfe800 msgr2=0x55907fc43700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.083+0000 7f1ff00bf740 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x55907fcfe800 0x55907fc43700 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55907fc69bc0 tx=0x55907fc1b980 comp rx=0 tx=0).stop 2023-10-06T04:37:40.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.083+0000 7f1fe932c700 1 -- 172.21.15.8:0/3051656219 reap_dead start 2023-10-06T04:37:40.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.083+0000 7f1ff00bf740 1 -- 172.21.15.8:0/3051656219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55907fcf8000 msgr2=0x55907fc42100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.084+0000 7f1ff00bf740 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55907fcf8000 0x55907fc42100 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x55907fc98660 tx=0x55907fc74060 comp rx=0 tx=0).stop 2023-10-06T04:37:40.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.084+0000 7f1ff00bf740 1 -- 172.21.15.8:0/3051656219 shutdown_connections 2023-10-06T04:37:40.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.084+0000 7f1ff00bf740 1 --2- 172.21.15.8:0/3051656219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55907fcf8000 0x55907fc42100 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.084+0000 7f1ff00bf740 1 -- 172.21.15.8:0/3051656219 >> 172.21.15.8:0/3051656219 conn(0x55907efff000 msgr2=0x55907fc11800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:40.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.084+0000 7f1ff00bf740 1 -- 172.21.15.8:0/3051656219 shutdown_connections 2023-10-06T04:37:40.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.084+0000 7f1ff00bf740 1 -- 172.21.15.8:0/3051656219 wait complete. 2023-10-06T04:37:40.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.084+0000 7f1ff00bf740 1 -- 172.21.15.8:0/2391139407 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55907effe800 msgr2=0x55907fc40b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.084+0000 7f1ff00bf740 1 --2- 172.21.15.8:0/2391139407 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55907effe800 0x55907fc40b00 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x55907fc686c0 tx=0x55907fc74180 comp rx=0 tx=0).stop 2023-10-06T04:37:40.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.084+0000 7f1ff00bf740 1 -- 172.21.15.8:0/2391139407 shutdown_connections 2023-10-06T04:37:40.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.084+0000 7f1ff00bf740 1 --2- 172.21.15.8:0/2391139407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55907effec00 0x55907fc41080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.084+0000 7f1ff00bf740 1 --2- 172.21.15.8:0/2391139407 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55907effe400 0x55907fc40580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.084+0000 7f1ff00bf740 1 --2- 172.21.15.8:0/2391139407 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55907effe800 0x55907fc40b00 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.084+0000 7f1ff00bf740 1 -- 172.21.15.8:0/2391139407 >> 172.21.15.8:0/2391139407 conn(0x55907effe000 msgr2=0x55907fc11000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:40.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.084+0000 7f1ff00bf740 1 -- 172.21.15.8:0/2391139407 shutdown_connections 2023-10-06T04:37:40.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.084+0000 7f1ff00bf740 1 -- 172.21.15.8:0/2391139407 wait complete. 2023-10-06T04:37:40.117 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links', '--filesystem', 'recovery_fs'] in time 0:00:00.106148, result: 2023-10-06T04:37:40.117 DEBUG:teuthology.orchestra.run.smithi008:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank recovery_fs:0 event recover_dentries list --alternate-pool recovery_fs_metadata 2023-10-06T04:37:40.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.186+0000 7fe7b0234240 1 -- start start 2023-10-06T04:37:40.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.186+0000 7fe7b0234240 1 Processor -- start 2023-10-06T04:37:40.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.186+0000 7fe7b0234240 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555f25d7a400 0x555f25d64580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.186+0000 7fe7b0234240 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f25d7a800 0x555f25d64b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.186+0000 7fe7b0234240 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f25d7ac00 0x555f25d65080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.186+0000 7fe7b0234240 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f24fecdc0 con 0x555f25d7ac00 2023-10-06T04:37:40.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.186+0000 7fe7b0234240 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f24fedcc0 con 0x555f25d7a800 2023-10-06T04:37:40.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.186+0000 7fe7b0234240 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f24fedb80 con 0x555f25d7a400 2023-10-06T04:37:40.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.186+0000 7fe7a9f03700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f25d7ac00 0x555f25d65080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.186+0000 7fe7a9f03700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f25d7ac00 0x555f25d65080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54640/0 (socket says 172.21.15.8:54640) 2023-10-06T04:37:40.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.186+0000 7fe7a9f03700 1 -- 172.21.15.8:0/1716900621 learned_addr learned my addr 172.21.15.8:0/1716900621 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:40.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.187+0000 7fe7a8f01700 1 --2- 172.21.15.8:0/1716900621 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f25d7a800 0x555f25d64b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.187+0000 7fe7a9702700 1 --2- 172.21.15.8:0/1716900621 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555f25d7a400 0x555f25d64580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.187+0000 7fe7a9f03700 1 -- 172.21.15.8:0/1716900621 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555f25d7a400 msgr2=0x555f25d64580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:40.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.187+0000 7fe7a9f03700 1 --2- 172.21.15.8:0/1716900621 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555f25d7a400 0x555f25d64580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.187+0000 7fe7a9f03700 1 -- 172.21.15.8:0/1716900621 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f25d7a800 msgr2=0x555f25d64b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:40.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.187+0000 7fe7a9f03700 1 --2- 172.21.15.8:0/1716900621 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f25d7a800 0x555f25d64b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.187+0000 7fe7a9f03700 1 -- 172.21.15.8:0/1716900621 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f24fd0340 con 0x555f25d7ac00 2023-10-06T04:37:40.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.187+0000 7fe7a8f01700 1 --2- 172.21.15.8:0/1716900621 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f25d7a800 0x555f25d64b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:40.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.187+0000 7fe7a9f03700 1 --2- 172.21.15.8:0/1716900621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f25d7ac00 0x555f25d65080 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x555f25124120 tx=0x555f25d38a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96aa5173b4ec4d9f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:40.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.187+0000 7fe7a6efd700 1 -- 172.21.15.8:0/1716900621 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555f24fe5600 con 0x555f25d7ac00 2023-10-06T04:37:40.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.187+0000 7fe7a6efd700 1 -- 172.21.15.8:0/1716900621 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555f25002900 con 0x555f25d7ac00 2023-10-06T04:37:40.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.187+0000 7fe7a6efd700 1 -- 172.21.15.8:0/1716900621 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555f24fe51e0 con 0x555f25d7ac00 2023-10-06T04:37:40.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.187+0000 7fe7b0234240 1 -- 172.21.15.8:0/1716900621 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555f24fd0000 con 0x555f25d7ac00 2023-10-06T04:37:40.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.187+0000 7fe7b0234240 1 -- 172.21.15.8:0/1716900621 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x555f24fd0ea0 con 0x555f25d7ac00 2023-10-06T04:37:40.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.187+0000 7fe7b0234240 4 waiting for MDS map... 2023-10-06T04:37:40.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.187+0000 7fe7a6efd700 1 -- 172.21.15.8:0/1716900621 <== mon.0 v2:172.21.15.8:3300/0 4 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x555f24ff0c40 con 0x555f25d7ac00 2023-10-06T04:37:40.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.187+0000 7fe7a6efd700 1 -- 172.21.15.8:0/1716900621 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 23) v1 ==== 3663+0+0 (secure 0 0 0) 0x555f25d9a600 con 0x555f25d7ac00 2023-10-06T04:37:40.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.187+0000 7fe7b0234240 4 Got MDS map 23 2023-10-06T04:37:40.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.187+0000 7fe7b0234240 10 main: JournalTool::main 2023-10-06T04:37:40.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.187+0000 7fe7b0234240 4 main: JournalTool: connecting to RADOS... 2023-10-06T04:37:40.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.188+0000 7fe7b0234240 1 Processor -- start 2023-10-06T04:37:40.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.188+0000 7fe7b0234240 1 -- start start 2023-10-06T04:37:40.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.188+0000 7fe7b0234240 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f25d7b800 0x555f25d65600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.188+0000 7fe7b0234240 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f25d7bc00 0x555f25d65b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.188+0000 7fe7b0234240 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555f25e00000 0x555f25d66100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.188+0000 7fe7b0234240 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f24fec3c0 con 0x555f25d7bc00 2023-10-06T04:37:40.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.188+0000 7fe7b0234240 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f24fedcc0 con 0x555f25d7b800 2023-10-06T04:37:40.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.188+0000 7fe7b0234240 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f24fec000 con 0x555f25e00000 2023-10-06T04:37:40.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.189+0000 7fe7a9702700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f25d7bc00 0x555f25d65b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.189+0000 7fe7a9702700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f25d7bc00 0x555f25d65b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54644/0 (socket says 172.21.15.8:54644) 2023-10-06T04:37:40.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.189+0000 7fe7a8f01700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f25d7b800 0x555f25d65600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.189+0000 7fe7a9702700 1 -- 172.21.15.8:0/3427167205 learned_addr learned my addr 172.21.15.8:0/3427167205 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:40.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.189+0000 7fe7a8f01700 1 --2- 172.21.15.8:0/3427167205 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555f25e00000 0x555f25d66100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.189+0000 7fe7a9702700 1 -- 172.21.15.8:0/3427167205 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555f25e00000 msgr2=0x555f25d66100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:40.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.189+0000 7fe7a9702700 1 --2- 172.21.15.8:0/3427167205 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555f25e00000 0x555f25d66100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.189+0000 7fe7a9702700 1 -- 172.21.15.8:0/3427167205 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f25d7b800 msgr2=0x555f25d65600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:40.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.189+0000 7fe7a9702700 1 --2- 172.21.15.8:0/3427167205 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f25d7b800 0x555f25d65600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.189+0000 7fe7a9702700 1 -- 172.21.15.8:0/3427167205 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f24fd1860 con 0x555f25d7bc00 2023-10-06T04:37:40.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.189+0000 7fe7a8f01700 1 --2- 172.21.15.8:0/3427167205 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f25d7b800 0x555f25d65600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:37:40.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.189+0000 7fe7a9702700 1 --2- 172.21.15.8:0/3427167205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f25d7bc00 0x555f25d65b80 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x555f251256b0 tx=0x555f25db4cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de32e9e1c869b5bd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:40.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.189+0000 7fe7a4ef9700 1 -- 172.21.15.8:0/3427167205 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555f24fe5600 con 0x555f25d7bc00 2023-10-06T04:37:40.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.189+0000 7fe7a4ef9700 1 -- 172.21.15.8:0/3427167205 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555f25002300 con 0x555f25d7bc00 2023-10-06T04:37:40.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.189+0000 7fe7a4ef9700 1 -- 172.21.15.8:0/3427167205 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555f24fe51e0 con 0x555f25d7bc00 2023-10-06T04:37:40.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.190+0000 7fe7b0234240 1 -- 172.21.15.8:0/3427167205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f25d7bc00 msgr2=0x555f25d65b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.190+0000 7fe7b0234240 1 --2- 172.21.15.8:0/3427167205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f25d7bc00 0x555f25d65b80 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x555f251256b0 tx=0x555f25db4cc0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.190+0000 7fe7b0234240 1 -- 172.21.15.8:0/3427167205 shutdown_connections 2023-10-06T04:37:40.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.190+0000 7fe7b0234240 1 --2- 172.21.15.8:0/3427167205 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555f25e00000 0x555f25d66100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.190+0000 7fe7b0234240 1 --2- 172.21.15.8:0/3427167205 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f25d7b800 0x555f25d65600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.190+0000 7fe7b0234240 1 --2- 172.21.15.8:0/3427167205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f25d7bc00 0x555f25d65b80 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.190+0000 7fe7b0234240 1 -- 172.21.15.8:0/3427167205 >> 172.21.15.8:0/3427167205 conn(0x555f25d7b000 msgr2=0x555f2509d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:40.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.190+0000 7fe7b0234240 1 -- 172.21.15.8:0/3427167205 shutdown_connections 2023-10-06T04:37:40.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.190+0000 7fe7b0234240 1 -- 172.21.15.8:0/3427167205 wait complete. 2023-10-06T04:37:40.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.190+0000 7fe7b0234240 1 Processor -- start 2023-10-06T04:37:40.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.190+0000 7fe7b0234240 1 -- start start 2023-10-06T04:37:40.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.191+0000 7fe7b0234240 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f25d7bc00 0x555f25d66c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.191+0000 7fe7b0234240 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555f25d7b800 0x555f25d66680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.191+0000 7fe7b0234240 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f25e18000 0x555f25d66100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.191+0000 7fe7b0234240 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f24fed180 con 0x555f25e18000 2023-10-06T04:37:40.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.191+0000 7fe7b0234240 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f24fed040 con 0x555f25d7bc00 2023-10-06T04:37:40.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.191+0000 7fe7b0234240 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f24fecf00 con 0x555f25d7b800 2023-10-06T04:37:40.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.191+0000 7fe7a8f01700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f25e18000 0x555f25d66100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.191+0000 7fe7a8f01700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f25e18000 0x555f25d66100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54652/0 (socket says 172.21.15.8:54652) 2023-10-06T04:37:40.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.191+0000 7fe7a8f01700 1 -- 172.21.15.8:0/1227935414 learned_addr learned my addr 172.21.15.8:0/1227935414 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:40.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.191+0000 7fe7a9702700 1 --2- 172.21.15.8:0/1227935414 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555f25d7b800 0x555f25d66680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.191+0000 7fe7a8f01700 1 --2- 172.21.15.8:0/1227935414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f25d7bc00 0x555f25d66c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.191+0000 7fe7a8f01700 1 -- 172.21.15.8:0/1227935414 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555f25d7b800 msgr2=0x555f25d66680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.191+0000 7fe7a8f01700 1 --2- 172.21.15.8:0/1227935414 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555f25d7b800 0x555f25d66680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.191+0000 7fe7a8f01700 1 -- 172.21.15.8:0/1227935414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f25d7bc00 msgr2=0x555f25d66c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.191+0000 7fe7a8f01700 1 --2- 172.21.15.8:0/1227935414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f25d7bc00 0x555f25d66c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.191+0000 7fe7a8f01700 1 -- 172.21.15.8:0/1227935414 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f24fd09c0 con 0x555f25e18000 2023-10-06T04:37:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.191+0000 7fe7a8f01700 1 --2- 172.21.15.8:0/1227935414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f25e18000 0x555f25d66100 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x555f25dbe630 tx=0x555f25d700c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.191+0000 7fe7a36f6700 1 -- 172.21.15.8:0/1227935414 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555f24fe5080 con 0x555f25e18000 2023-10-06T04:37:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.192+0000 7fe7a36f6700 1 -- 172.21.15.8:0/1227935414 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555f25002c00 con 0x555f25e18000 2023-10-06T04:37:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.192+0000 7fe7a36f6700 1 -- 172.21.15.8:0/1227935414 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555f24fe5600 con 0x555f25e18000 2023-10-06T04:37:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.192+0000 7fe7b0234240 1 -- 172.21.15.8:0/1227935414 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555f24fd0340 con 0x555f25e18000 2023-10-06T04:37:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.192+0000 7fe7b0234240 1 -- 172.21.15.8:0/1227935414 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555f24fd1a00 con 0x555f25e18000 2023-10-06T04:37:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.192+0000 7fe7b0234240 4 main: JournalTool: resolving pool 8 2023-10-06T04:37:40.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.193+0000 7fe7a36f6700 1 -- 172.21.15.8:0/1227935414 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x555f25d23080 con 0x555f25e18000 2023-10-06T04:37:40.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.193+0000 7fe7a36f6700 1 --2- 172.21.15.8:0/1227935414 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x555f25e24400 0x555f25d67700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.193+0000 7fe7a36f6700 1 -- 172.21.15.8:0/1227935414 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x555f24ff0a80 con 0x555f25e18000 2023-10-06T04:37:40.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.193+0000 7fe7b0234240 4 main: JournalTool: creating IoCtx.. 2023-10-06T04:37:40.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.193+0000 7fe7b0234240 4 main: Executing for rank 0 2023-10-06T04:37:40.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.193+0000 7fe7b0234240 1 main_event: Using alternate pool recovery_fs_metadata 2023-10-06T04:37:40.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.193+0000 7fe7a9702700 1 --2- 172.21.15.8:0/1227935414 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x555f25e24400 0x555f25d67700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.193+0000 7fe7b0234240 1 --2- 172.21.15.8:0/1227935414 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x555f25e18400 0x555f25d65b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.193+0000 7fe7b0234240 1 -- 172.21.15.8:0/1227935414 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:1 8.f 8:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x555f25e18800 con 0x555f25e18400 2023-10-06T04:37:40.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.193+0000 7fe7a8f01700 1 --2- 172.21.15.8:0/1227935414 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x555f25e18400 0x555f25d65b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.194+0000 7fe7a9702700 1 --2- 172.21.15.8:0/1227935414 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x555f25e24400 0x555f25d67700 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x555f251256b0 tx=0x555f25db4d80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:40.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.194+0000 7fe7a8f01700 1 --2- 172.21.15.8:0/1227935414 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x555f25e18400 0x555f25d65b80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:40.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.194+0000 7fe7a8f01700 1 -- 172.21.15.8:0/1227935414 <== osd.3 v2:172.21.15.8:6823/90671 1 ==== osd_op_reply(1 400.00000000 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x555f25d8afc0 con 0x555f25e18400 2023-10-06T04:37:40.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.194+0000 7fe7b0234240 -1 Pointer 400.00000000 is absent 2023-10-06T04:37:40.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.194+0000 7fe7b0234240 4 main_event: consumed 0 inodes 2023-10-06T04:37:40.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.194+0000 7fe7b0234240 1 --2- 172.21.15.8:0/1227935414 >> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] conn(0x555f25e18c00 0x555f25d65600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.194+0000 7fe7b0234240 1 -- 172.21.15.8:0/1227935414 --> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] -- osd_op(unknown.0.0:2 8.3 8:c0ce80d4:::4.00000000:head [omap-rm-keys in=4b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x555f25e19000 con 0x555f25e18c00 2023-10-06T04:37:40.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.194+0000 7fe7a9f03700 1 --2- 172.21.15.8:0/1227935414 >> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] conn(0x555f25e18c00 0x555f25d65600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.194+0000 7fe7a9f03700 1 --2- 172.21.15.8:0/1227935414 >> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] conn(0x555f25e18c00 0x555f25d65600 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:40.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.195+0000 7fe7a9f03700 1 -- 172.21.15.8:0/1227935414 <== osd.1 v2:172.21.15.8:6816/90669 1 ==== osd_op_reply(2 4.00000000 [omap-rm-keys] v46'1 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x555f25d8b680 con 0x555f25e18c00 2023-10-06T04:37:40.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.195+0000 7fe7b0234240 4 0 events 2023-10-06T04:37:40.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.196+0000 7fe7b0234240 1 -- 172.21.15.8:0/1227935414 >> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] conn(0x555f25e18c00 msgr2=0x555f25d65600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.196+0000 7fe7b0234240 1 --2- 172.21.15.8:0/1227935414 >> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] conn(0x555f25e18c00 0x555f25d65600 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.196+0000 7fe7b0234240 1 -- 172.21.15.8:0/1227935414 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x555f25e18400 msgr2=0x555f25d65b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.196+0000 7fe7b0234240 1 --2- 172.21.15.8:0/1227935414 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x555f25e18400 0x555f25d65b80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.196+0000 7fe7b0234240 1 -- 172.21.15.8:0/1227935414 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x555f25e24400 msgr2=0x555f25d67700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.196+0000 7fe7b0234240 1 --2- 172.21.15.8:0/1227935414 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x555f25e24400 0x555f25d67700 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x555f251256b0 tx=0x555f25db4d80 comp rx=0 tx=0).stop 2023-10-06T04:37:40.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.196+0000 7fe7b0234240 1 -- 172.21.15.8:0/1227935414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f25e18000 msgr2=0x555f25d66100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.196+0000 7fe7b0234240 1 --2- 172.21.15.8:0/1227935414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f25e18000 0x555f25d66100 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x555f25dbe630 tx=0x555f25d700c0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.196+0000 7fe7a9702700 1 -- 172.21.15.8:0/1227935414 reap_dead start 2023-10-06T04:37:40.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.196+0000 7fe7a9702700 1 -- 172.21.15.8:0/1227935414 reap_dead start 2023-10-06T04:37:40.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.196+0000 7fe7b0234240 1 -- 172.21.15.8:0/1227935414 shutdown_connections 2023-10-06T04:37:40.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.196+0000 7fe7b0234240 1 -- 172.21.15.8:0/1227935414 >> 172.21.15.8:0/1227935414 conn(0x555f25d7b000 msgr2=0x555f2509d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:40.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.196+0000 7fe7b0234240 1 -- 172.21.15.8:0/1227935414 shutdown_connections 2023-10-06T04:37:40.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.196+0000 7fe7b0234240 1 -- 172.21.15.8:0/1227935414 wait complete. 2023-10-06T04:37:40.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.196+0000 7fe7b0234240 1 -- 172.21.15.8:0/1716900621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f25d7ac00 msgr2=0x555f25d65080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.196+0000 7fe7b0234240 1 --2- 172.21.15.8:0/1716900621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f25d7ac00 0x555f25d65080 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x555f25124120 tx=0x555f25d38a80 comp rx=0 tx=0).stop 2023-10-06T04:37:40.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.196+0000 7fe7b0234240 1 -- 172.21.15.8:0/1716900621 shutdown_connections 2023-10-06T04:37:40.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.196+0000 7fe7b0234240 1 --2- 172.21.15.8:0/1716900621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f25d7ac00 0x555f25d65080 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.196+0000 7fe7b0234240 1 --2- 172.21.15.8:0/1716900621 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555f25d7a400 0x555f25d64580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.196+0000 7fe7b0234240 1 --2- 172.21.15.8:0/1716900621 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f25d7a800 0x555f25d64b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.196+0000 7fe7b0234240 1 -- 172.21.15.8:0/1716900621 >> 172.21.15.8:0/1716900621 conn(0x555f25d7a000 msgr2=0x555f2509d000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:40.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.196+0000 7fe7b0234240 1 -- 172.21.15.8:0/1716900621 shutdown_connections 2023-10-06T04:37:40.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.196+0000 7fe7b0234240 1 -- 172.21.15.8:0/1716900621 wait complete. 2023-10-06T04:37:40.215 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'recovery_fs:0', 'event', 'recover_dentries', 'list', '--alternate-pool', 'recovery_fs_metadata'] in time 0:00:00.097964, result: 2023-10-06T04:37:40.215 DEBUG:teuthology.orchestra.run.smithi008:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank recovery_fs:0 journal reset --force 2023-10-06T04:37:40.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.285+0000 7fa899816240 1 -- start start 2023-10-06T04:37:40.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.285+0000 7fa899816240 1 Processor -- start 2023-10-06T04:37:40.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.285+0000 7fa899816240 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558034c62400 0x558034c50580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.285+0000 7fa899816240 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558034c62800 0x558034c50b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.285+0000 7fa899816240 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x558034c62c00 0x558034c51080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.285+0000 7fa899816240 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558033ededc0 con 0x558034c62800 2023-10-06T04:37:40.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.285+0000 7fa899816240 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x558033edfcc0 con 0x558034c62400 2023-10-06T04:37:40.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.285+0000 7fa899816240 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x558033ede3c0 con 0x558034c62c00 2023-10-06T04:37:40.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.285+0000 7fa8924e3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558034c62800 0x558034c50b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.285+0000 7fa8924e3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558034c62800 0x558034c50b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54674/0 (socket says 172.21.15.8:54674) 2023-10-06T04:37:40.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.285+0000 7fa8924e3700 1 -- 172.21.15.8:0/4252853824 learned_addr learned my addr 172.21.15.8:0/4252853824 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:40.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.285+0000 7fa8934e5700 1 --2- 172.21.15.8:0/4252853824 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x558034c62c00 0x558034c51080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.285+0000 7fa892ce4700 1 --2- 172.21.15.8:0/4252853824 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558034c62400 0x558034c50580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.286+0000 7fa8924e3700 1 -- 172.21.15.8:0/4252853824 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x558034c62c00 msgr2=0x558034c51080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:40.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.286+0000 7fa8924e3700 1 --2- 172.21.15.8:0/4252853824 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x558034c62c00 0x558034c51080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.286+0000 7fa8924e3700 1 -- 172.21.15.8:0/4252853824 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558034c62400 msgr2=0x558034c50580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:40.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.286+0000 7fa8924e3700 1 --2- 172.21.15.8:0/4252853824 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558034c62400 0x558034c50580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.286+0000 7fa8924e3700 1 -- 172.21.15.8:0/4252853824 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558033ec2340 con 0x558034c62800 2023-10-06T04:37:40.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.286+0000 7fa892ce4700 1 --2- 172.21.15.8:0/4252853824 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558034c62400 0x558034c50580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:37:40.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.286+0000 7fa8924e3700 1 --2- 172.21.15.8:0/4252853824 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558034c62800 0x558034c50b00 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x5580340160c0 tx=0x558034c31260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cba5392c6a1d79e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:40.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.286+0000 7fa8904df700 1 -- 172.21.15.8:0/4252853824 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558033ed7600 con 0x558034c62800 2023-10-06T04:37:40.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.286+0000 7fa8904df700 1 -- 172.21.15.8:0/4252853824 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558033ef4600 con 0x558034c62800 2023-10-06T04:37:40.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.286+0000 7fa8904df700 1 -- 172.21.15.8:0/4252853824 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558033ed71e0 con 0x558034c62800 2023-10-06T04:37:40.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.286+0000 7fa899816240 1 -- 172.21.15.8:0/4252853824 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558033ec2000 con 0x558034c62800 2023-10-06T04:37:40.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.286+0000 7fa899816240 1 -- 172.21.15.8:0/4252853824 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x558033ec2ea0 con 0x558034c62800 2023-10-06T04:37:40.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.286+0000 7fa899816240 4 waiting for MDS map... 2023-10-06T04:37:40.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.286+0000 7fa8904df700 1 -- 172.21.15.8:0/4252853824 <== mon.0 v2:172.21.15.8:3300/0 4 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x558033ee2c40 con 0x558034c62800 2023-10-06T04:37:40.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.286+0000 7fa8904df700 1 -- 172.21.15.8:0/4252853824 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 23) v1 ==== 3663+0+0 (secure 0 0 0) 0x558034ca0600 con 0x558034c62800 2023-10-06T04:37:40.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.286+0000 7fa899816240 4 Got MDS map 23 2023-10-06T04:37:40.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.286+0000 7fa899816240 10 main: JournalTool::main 2023-10-06T04:37:40.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.287+0000 7fa899816240 4 main: JournalTool: connecting to RADOS... 2023-10-06T04:37:40.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.287+0000 7fa899816240 1 Processor -- start 2023-10-06T04:37:40.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.287+0000 7fa899816240 1 -- start start 2023-10-06T04:37:40.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.288+0000 7fa899816240 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558034c63c00 0x558034c51600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.288+0000 7fa899816240 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558034cf2000 0x558034c51b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.288+0000 7fa899816240 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x558034cf2400 0x558034c52100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.288+0000 7fa899816240 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558033ede000 con 0x558034cf2000 2023-10-06T04:37:40.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.288+0000 7fa899816240 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x558033edf180 con 0x558034c63c00 2023-10-06T04:37:40.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.288+0000 7fa899816240 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x558033f67040 con 0x558034cf2400 2023-10-06T04:37:40.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.288+0000 7fa892ce4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558034cf2000 0x558034c51b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.288+0000 7fa892ce4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558034cf2000 0x558034c51b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54678/0 (socket says 172.21.15.8:54678) 2023-10-06T04:37:40.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.288+0000 7fa892ce4700 1 -- 172.21.15.8:0/1331956535 learned_addr learned my addr 172.21.15.8:0/1331956535 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:40.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.288+0000 7fa8934e5700 1 --2- 172.21.15.8:0/1331956535 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558034c63c00 0x558034c51600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.288+0000 7fa8924e3700 1 --2- 172.21.15.8:0/1331956535 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x558034cf2400 0x558034c52100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.288+0000 7fa892ce4700 1 -- 172.21.15.8:0/1331956535 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x558034cf2400 msgr2=0x558034c52100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:40.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.288+0000 7fa892ce4700 1 --2- 172.21.15.8:0/1331956535 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x558034cf2400 0x558034c52100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.288+0000 7fa892ce4700 1 -- 172.21.15.8:0/1331956535 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558034c63c00 msgr2=0x558034c51600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:40.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.288+0000 7fa892ce4700 1 --2- 172.21.15.8:0/1331956535 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558034c63c00 0x558034c51600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.288+0000 7fa892ce4700 1 -- 172.21.15.8:0/1331956535 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558033ec3860 con 0x558034cf2000 2023-10-06T04:37:40.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.288+0000 7fa8934e5700 1 --2- 172.21.15.8:0/1331956535 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558034c63c00 0x558034c51600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:40.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.288+0000 7fa892ce4700 1 --2- 172.21.15.8:0/1331956535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558034cf2000 0x558034c51b80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x5580340170b0 tx=0x558034ca6c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e34f4cd14c18f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:40.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.288+0000 7fa88e4db700 1 -- 172.21.15.8:0/1331956535 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558033ed7600 con 0x558034cf2000 2023-10-06T04:37:40.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.288+0000 7fa88e4db700 1 -- 172.21.15.8:0/1331956535 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558033ef4480 con 0x558034cf2000 2023-10-06T04:37:40.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.288+0000 7fa88e4db700 1 -- 172.21.15.8:0/1331956535 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558033ed71e0 con 0x558034cf2000 2023-10-06T04:37:40.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.289+0000 7fa899816240 1 -- 172.21.15.8:0/1331956535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558034cf2000 msgr2=0x558034c51b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.289+0000 7fa899816240 1 --2- 172.21.15.8:0/1331956535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558034cf2000 0x558034c51b80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x5580340170b0 tx=0x558034ca6c00 comp rx=0 tx=0).stop 2023-10-06T04:37:40.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.289+0000 7fa899816240 1 -- 172.21.15.8:0/1331956535 shutdown_connections 2023-10-06T04:37:40.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.289+0000 7fa899816240 1 --2- 172.21.15.8:0/1331956535 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x558034cf2400 0x558034c52100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.289+0000 7fa899816240 1 --2- 172.21.15.8:0/1331956535 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558034c63c00 0x558034c51600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.289+0000 7fa899816240 1 --2- 172.21.15.8:0/1331956535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558034cf2000 0x558034c51b80 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.289+0000 7fa899816240 1 -- 172.21.15.8:0/1331956535 >> 172.21.15.8:0/1331956535 conn(0x558034c63000 msgr2=0x558033f8f800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:40.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.289+0000 7fa899816240 1 -- 172.21.15.8:0/1331956535 shutdown_connections 2023-10-06T04:37:40.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.289+0000 7fa899816240 1 -- 172.21.15.8:0/1331956535 wait complete. 2023-10-06T04:37:40.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.289+0000 7fa899816240 1 Processor -- start 2023-10-06T04:37:40.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.289+0000 7fa899816240 1 -- start start 2023-10-06T04:37:40.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.290+0000 7fa899816240 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558034c63000 0x558034c52c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.290+0000 7fa899816240 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558034d14000 0x558034c52680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.290+0000 7fa899816240 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x558034d14400 0x558034c52100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.290+0000 7fa899816240 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558033f67180 con 0x558034c63000 2023-10-06T04:37:40.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.290+0000 7fa899816240 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x558033edfcc0 con 0x558034d14000 2023-10-06T04:37:40.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.290+0000 7fa899816240 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x558033edf040 con 0x558034d14400 2023-10-06T04:37:40.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.290+0000 7fa8934e5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558034c63000 0x558034c52c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.290+0000 7fa8934e5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558034c63000 0x558034c52c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54682/0 (socket says 172.21.15.8:54682) 2023-10-06T04:37:40.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.290+0000 7fa892ce4700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558034d14000 0x558034c52680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.290+0000 7fa8934e5700 1 -- 172.21.15.8:0/1002437877 learned_addr learned my addr 172.21.15.8:0/1002437877 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:40.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.290+0000 7fa8924e3700 1 --2- 172.21.15.8:0/1002437877 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x558034d14400 0x558034c52100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.290+0000 7fa8934e5700 1 -- 172.21.15.8:0/1002437877 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x558034d14400 msgr2=0x558034c52100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.290+0000 7fa8934e5700 1 --2- 172.21.15.8:0/1002437877 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x558034d14400 0x558034c52100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.290+0000 7fa8934e5700 1 -- 172.21.15.8:0/1002437877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558034d14000 msgr2=0x558034c52680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.290+0000 7fa8934e5700 1 --2- 172.21.15.8:0/1002437877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558034d14000 0x558034c52680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.290+0000 7fa8934e5700 1 -- 172.21.15.8:0/1002437877 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558033ec2340 con 0x558034c63000 2023-10-06T04:37:40.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.290+0000 7fa8934e5700 1 --2- 172.21.15.8:0/1002437877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558034c63000 0x558034c52c00 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x558034d160f0 tx=0x558034c601e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:40.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.290+0000 7fa88ccd8700 1 -- 172.21.15.8:0/1002437877 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558033ed7080 con 0x558034c63000 2023-10-06T04:37:40.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.291+0000 7fa88ccd8700 1 -- 172.21.15.8:0/1002437877 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558033ef4300 con 0x558034c63000 2023-10-06T04:37:40.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.291+0000 7fa899816240 1 -- 172.21.15.8:0/1002437877 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558033ec3a00 con 0x558034c63000 2023-10-06T04:37:40.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.291+0000 7fa88ccd8700 1 -- 172.21.15.8:0/1002437877 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558033ed7600 con 0x558034c63000 2023-10-06T04:37:40.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.291+0000 7fa899816240 1 -- 172.21.15.8:0/1002437877 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558033ec29c0 con 0x558034c63000 2023-10-06T04:37:40.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.291+0000 7fa899816240 4 main: JournalTool: resolving pool 8 2023-10-06T04:37:40.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.292+0000 7fa88ccd8700 1 -- 172.21.15.8:0/1002437877 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x558034c15080 con 0x558034c63000 2023-10-06T04:37:40.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.292+0000 7fa88ccd8700 1 --2- 172.21.15.8:0/1002437877 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x558034d1c400 0x558034c53700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.292+0000 7fa88ccd8700 1 -- 172.21.15.8:0/1002437877 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x558033ee2a80 con 0x558034c63000 2023-10-06T04:37:40.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.292+0000 7fa899816240 4 main: JournalTool: creating IoCtx.. 2023-10-06T04:37:40.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.292+0000 7fa899816240 4 main: Executing for rank 0 2023-10-06T04:37:40.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.292+0000 7fa892ce4700 1 --2- 172.21.15.8:0/1002437877 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x558034d1c400 0x558034c53700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.293+0000 7fa892ce4700 1 --2- 172.21.15.8:0/1002437877 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x558034d1c400 0x558034c53700 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x5580340170b0 tx=0x558034ca6cc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:40.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.293+0000 7fa899816240 1 -- start start 2023-10-06T04:37:40.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.293+0000 7fa899816240 1 Processor -- start 2023-10-06T04:37:40.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.293+0000 7fa899816240 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558034d14c00 0x558034c51600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.294+0000 7fa899816240 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x558034d15000 0x558034e56000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.294+0000 7fa899816240 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558034d15400 0x558034e56580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.294+0000 7fa899816240 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558033edef00 con 0x558034d14c00 2023-10-06T04:37:40.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.294+0000 7fa899816240 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x558033f67040 con 0x558034d15400 2023-10-06T04:37:40.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.294+0000 7fa899816240 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x558033f66c80 con 0x558034d15000 2023-10-06T04:37:40.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.294+0000 7fa8934e5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558034d14c00 0x558034c51600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.294+0000 7fa8934e5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558034d14c00 0x558034c51600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54694/0 (socket says 172.21.15.8:54694) 2023-10-06T04:37:40.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.294+0000 7fa8934e5700 1 -- 172.21.15.8:0/1172891746 learned_addr learned my addr 172.21.15.8:0/1172891746 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:40.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.294+0000 7fa892ce4700 1 --2- 172.21.15.8:0/1172891746 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x558034d15000 0x558034e56000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.294+0000 7fa8924e3700 1 --2- 172.21.15.8:0/1172891746 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558034d15400 0x558034e56580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.294+0000 7fa8934e5700 1 -- 172.21.15.8:0/1172891746 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x558034d15000 msgr2=0x558034e56000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:40.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.294+0000 7fa8934e5700 1 --2- 172.21.15.8:0/1172891746 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x558034d15000 0x558034e56000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.294+0000 7fa8934e5700 1 -- 172.21.15.8:0/1172891746 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558034d15400 msgr2=0x558034e56580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:40.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.294+0000 7fa8934e5700 1 --2- 172.21.15.8:0/1172891746 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558034d15400 0x558034e56580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.294+0000 7fa8934e5700 1 -- 172.21.15.8:0/1172891746 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558033ec3a00 con 0x558034d14c00 2023-10-06T04:37:40.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.294+0000 7fa8934e5700 1 --2- 172.21.15.8:0/1172891746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558034d14c00 0x558034c51600 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x558034d17e30 tx=0x558034ca74a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66d17a7fea3e9ab6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:40.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.294+0000 7fa889cd2700 1 -- 172.21.15.8:0/1172891746 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558033ed71e0 con 0x558034d14c00 2023-10-06T04:37:40.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.294+0000 7fa889cd2700 1 -- 172.21.15.8:0/1172891746 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558033ef4c00 con 0x558034d14c00 2023-10-06T04:37:40.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.294+0000 7fa889cd2700 1 -- 172.21.15.8:0/1172891746 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558033ed6420 con 0x558034d14c00 2023-10-06T04:37:40.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.294+0000 7fa899816240 1 -- 172.21.15.8:0/1172891746 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558033ec2000 con 0x558034d14c00 2023-10-06T04:37:40.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.294+0000 7fa899816240 1 -- 172.21.15.8:0/1172891746 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x558034d50ea0 con 0x558034d14c00 2023-10-06T04:37:40.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.294+0000 7fa899816240 4 waiting for MDS map... 2023-10-06T04:37:40.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.294+0000 7fa889cd2700 1 -- 172.21.15.8:0/1172891746 <== mon.0 v2:172.21.15.8:3300/0 4 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x558033ee28c0 con 0x558034d14c00 2023-10-06T04:37:40.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.295+0000 7fa889cd2700 1 -- 172.21.15.8:0/1172891746 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 23) v1 ==== 3663+0+0 (secure 0 0 0) 0x558034e5e600 con 0x558034d14c00 2023-10-06T04:37:40.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.295+0000 7fa899816240 4 Got MDS map 23 2023-10-06T04:37:40.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.295+0000 7fa899816240 1 --2- 172.21.15.8:0/1172891746 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x558034d15800 0x558034e56b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.295+0000 7fa899816240 1 -- 172.21.15.8:0/1172891746 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:1 8.f 8:f1f69726:::400.00000000:head [writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x558034d15c00 con 0x558034d15800 2023-10-06T04:37:40.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.295+0000 7fa892ce4700 1 --2- 172.21.15.8:0/1172891746 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x558034d15800 0x558034e56b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.295+0000 7fa892ce4700 1 --2- 172.21.15.8:0/1172891746 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x558034d15800 0x558034e56b00 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=8a231e6de6bb6f09 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:40.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.296+0000 7fa892ce4700 1 -- 172.21.15.8:0/1172891746 <== osd.3 v2:172.21.15.8:6823/90671 1 ==== osd_op_reply(1 400.00000000 [writefull 0~22] v46'1 uv1 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x558034c6b200 con 0x558034d15800 2023-10-06T04:37:40.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.296+0000 7fa899816240 1 --2- 172.21.15.8:0/1172891746 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x558034d1d000 0x558034e57080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.296+0000 7fa899816240 1 -- 172.21.15.8:0/1172891746 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:2 8.14 8:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x558034d1d400 con 0x558034d1d000 2023-10-06T04:37:40.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.297+0000 7fa8924e3700 1 --2- 172.21.15.8:0/1172891746 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x558034d1d000 0x558034e57080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.297+0000 7fa8924e3700 1 --2- 172.21.15.8:0/1172891746 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x558034d1d000 0x558034e57080 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=168b0a70aa893071 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:40.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.298+0000 7fa8924e3700 1 -- 172.21.15.8:0/1172891746 <== osd.4 v2:172.21.15.184:6800/90868 1 ==== osd_op_reply(2 200.00000000 [writefull 0~90] v46'2 uv2 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x558034c6b440 con 0x558034d1d000 2023-10-06T04:37:40.309 INFO:teuthology.orchestra.run.smithi008.stdout:writing EResetJournal entry 2023-10-06T04:37:40.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.298+0000 7fa899816240 1 -- 172.21.15.8:0/1172891746 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:3 8.14 8:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x558034d1d800 con 0x558034d1d000 2023-10-06T04:37:40.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.298+0000 7fa899816240 1 -- 172.21.15.8:0/1172891746 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:4 8.1b 8:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x558034d1dc00 con 0x558034d1d000 2023-10-06T04:37:40.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.298+0000 7fa899816240 1 -- 172.21.15.8:0/1172891746 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:5 8.b 8:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x558034d1d400 con 0x558034d15800 2023-10-06T04:37:40.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.298+0000 7fa899816240 1 --2- 172.21.15.8:0/1172891746 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x558034d1d800 0x558034e57600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.298+0000 7fa899816240 1 -- 172.21.15.8:0/1172891746 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:6 8.1f 8:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x558034d1dc00 con 0x558034d1d800 2023-10-06T04:37:40.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.298+0000 7fa899816240 1 -- 172.21.15.8:0/1172891746 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- osd_op(unknown.0.0:7 8.1a 8:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x558034e88000 con 0x558034d1d800 2023-10-06T04:37:40.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.298+0000 7fa899816240 1 -- 172.21.15.8:0/1172891746 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- osd_op(unknown.0.0:8 8.1e 8:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x558034e88400 con 0x558034d15800 2023-10-06T04:37:40.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.298+0000 7fa8934e5700 1 --2- 172.21.15.8:0/1172891746 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x558034d1d800 0x558034e57600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.299+0000 7fa8934e5700 1 --2- 172.21.15.8:0/1172891746 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x558034d1d800 0x558034e57600 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=b6daacd041a76e86 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:40.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.299+0000 7fa8924e3700 1 -- 172.21.15.8:0/1172891746 <== osd.4 v2:172.21.15.184:6800/90868 2 ==== osd_op_reply(4 200.00000002 [delete] v46'1 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x558034c6b440 con 0x558034d1d000 2023-10-06T04:37:40.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.299+0000 7fa892ce4700 1 -- 172.21.15.8:0/1172891746 <== osd.3 v2:172.21.15.8:6823/90671 2 ==== osd_op_reply(8 200.00000006 [delete] v46'1 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x558034c6b200 con 0x558034d15800 2023-10-06T04:37:40.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.300+0000 7fa8924e3700 1 -- 172.21.15.8:0/1172891746 <== osd.4 v2:172.21.15.184:6800/90868 3 ==== osd_op_reply(3 200.00000001 [delete] v46'3 uv2 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x558034c6b440 con 0x558034d1d000 2023-10-06T04:37:40.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.300+0000 7fa8884cf700 1 -- 172.21.15.8:0/1172891746 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- osd_op(unknown.0.0:9 8.14 8:2e2fa760:::200.00000001:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x558034d15c00 con 0x558034d1d000 2023-10-06T04:37:40.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.300+0000 7fa8934e5700 1 -- 172.21.15.8:0/1172891746 <== osd.0 v2:172.21.15.8:6808/90668 1 ==== osd_op_reply(7 200.00000005 [delete] v46'1 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x558034e92000 con 0x558034d1d800 2023-10-06T04:37:40.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.300+0000 7fa892ce4700 1 -- 172.21.15.8:0/1172891746 <== osd.3 v2:172.21.15.8:6823/90671 3 ==== osd_op_reply(5 200.00000003 [delete] v46'2 uv1 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x558034c6b200 con 0x558034d15800 2023-10-06T04:37:40.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.300+0000 7fa8934e5700 1 -- 172.21.15.8:0/1172891746 <== osd.0 v2:172.21.15.8:6808/90668 2 ==== osd_op_reply(6 200.00000004 [delete] v46'5 uv4 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x558034e92000 con 0x558034d1d800 2023-10-06T04:37:40.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.301+0000 7fa8924e3700 1 -- 172.21.15.8:0/1172891746 <== osd.4 v2:172.21.15.184:6800/90868 4 ==== osd_op_reply(9 200.00000001 [write 0~48] v46'4 uv4 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x558034c6b440 con 0x558034d1d000 2023-10-06T04:37:40.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.301+0000 7fa899816240 4 Successfully wrote new journal pointer and header for rank 3:0 2023-10-06T04:37:40.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.301+0000 7fa899816240 1 -- 172.21.15.8:0/1172891746 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x558034d1d800 msgr2=0x558034e57600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.301+0000 7fa899816240 1 --2- 172.21.15.8:0/1172891746 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x558034d1d800 0x558034e57600 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.301+0000 7fa899816240 1 -- 172.21.15.8:0/1172891746 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x558034d15800 msgr2=0x558034e56b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.301+0000 7fa899816240 1 --2- 172.21.15.8:0/1172891746 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x558034d15800 0x558034e56b00 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.301+0000 7fa899816240 1 -- 172.21.15.8:0/1172891746 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x558034d1d000 msgr2=0x558034e57080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.301+0000 7fa899816240 1 --2- 172.21.15.8:0/1172891746 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x558034d1d000 0x558034e57080 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.301+0000 7fa8924e3700 1 -- 172.21.15.8:0/1172891746 reap_dead start 2023-10-06T04:37:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.301+0000 7fa899816240 1 -- 172.21.15.8:0/1172891746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558034d14c00 msgr2=0x558034c51600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.301+0000 7fa899816240 1 --2- 172.21.15.8:0/1172891746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558034d14c00 0x558034c51600 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x558034d17e30 tx=0x558034ca74a0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.301+0000 7fa899816240 1 -- 172.21.15.8:0/1172891746 shutdown_connections 2023-10-06T04:37:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.301+0000 7fa899816240 1 --2- 172.21.15.8:0/1172891746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558034d14c00 0x558034c51600 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.301+0000 7fa899816240 1 -- 172.21.15.8:0/1172891746 >> 172.21.15.8:0/1172891746 conn(0x558034d14800 msgr2=0x558033f90000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.301+0000 7fa899816240 1 -- 172.21.15.8:0/1172891746 shutdown_connections 2023-10-06T04:37:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.301+0000 7fa899816240 1 -- 172.21.15.8:0/1172891746 wait complete. 2023-10-06T04:37:40.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.301+0000 7fa899816240 1 -- 172.21.15.8:0/1002437877 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x558034d1c400 msgr2=0x558034c53700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.301+0000 7fa899816240 1 --2- 172.21.15.8:0/1002437877 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x558034d1c400 0x558034c53700 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x5580340170b0 tx=0x558034ca6cc0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.301+0000 7fa899816240 1 -- 172.21.15.8:0/1002437877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558034c63000 msgr2=0x558034c52c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.301+0000 7fa899816240 1 --2- 172.21.15.8:0/1002437877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558034c63000 0x558034c52c00 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x558034d160f0 tx=0x558034c601e0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.301+0000 7fa899816240 1 -- 172.21.15.8:0/1002437877 shutdown_connections 2023-10-06T04:37:40.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.301+0000 7fa899816240 1 --2- 172.21.15.8:0/1002437877 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x558034d1c400 0x558034c53700 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.301+0000 7fa899816240 1 --2- 172.21.15.8:0/1002437877 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x558034d14400 0x558034c52100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.301+0000 7fa899816240 1 --2- 172.21.15.8:0/1002437877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558034c63000 0x558034c52c00 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.301+0000 7fa899816240 1 --2- 172.21.15.8:0/1002437877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558034d14000 0x558034c52680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.301+0000 7fa899816240 1 -- 172.21.15.8:0/1002437877 >> 172.21.15.8:0/1002437877 conn(0x558034c63c00 msgr2=0x558033f8f800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:40.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.301+0000 7fa899816240 1 -- 172.21.15.8:0/1002437877 shutdown_connections 2023-10-06T04:37:40.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.301+0000 7fa899816240 1 -- 172.21.15.8:0/1002437877 wait complete. 2023-10-06T04:37:40.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.302+0000 7fa899816240 1 -- 172.21.15.8:0/4252853824 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558034c62800 msgr2=0x558034c50b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.302+0000 7fa899816240 1 --2- 172.21.15.8:0/4252853824 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558034c62800 0x558034c50b00 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x5580340160c0 tx=0x558034c31260 comp rx=0 tx=0).stop 2023-10-06T04:37:40.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.302+0000 7fa899816240 1 -- 172.21.15.8:0/4252853824 shutdown_connections 2023-10-06T04:37:40.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.302+0000 7fa899816240 1 --2- 172.21.15.8:0/4252853824 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x558034c62c00 0x558034c51080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.302+0000 7fa899816240 1 --2- 172.21.15.8:0/4252853824 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558034c62400 0x558034c50580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.302+0000 7fa899816240 1 --2- 172.21.15.8:0/4252853824 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558034c62800 0x558034c50b00 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.302+0000 7fa899816240 1 -- 172.21.15.8:0/4252853824 >> 172.21.15.8:0/4252853824 conn(0x558034c62000 msgr2=0x558033f8f000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:40.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.302+0000 7fa899816240 1 -- 172.21.15.8:0/4252853824 shutdown_connections 2023-10-06T04:37:40.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.302+0000 7fa899816240 1 -- 172.21.15.8:0/4252853824 wait complete. 2023-10-06T04:37:40.319 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'recovery_fs:0', 'journal', 'reset', '--force'] in time 0:00:00.103772, result: writing EResetJournal entry 2023-10-06T04:37:40.319 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set recovery_fs joinable true 2023-10-06T04:37:40.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.475+0000 7ff11e195700 1 Processor -- start 2023-10-06T04:37:40.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.475+0000 7ff11e195700 1 -- start start 2023-10-06T04:37:40.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.476+0000 7ff11e195700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff118156e30 0x7ff1180cf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.476+0000 7ff11e195700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff11815b490 0x7ff1180b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.476+0000 7ff11e195700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1180b2620 con 0x7ff1180b1c70 2023-10-06T04:37:40.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.476+0000 7ff11e195700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1180cf370 con 0x7ff11815b490 2023-10-06T04:37:40.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.476+0000 7ff11e195700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1180ce800 con 0x7ff118156e30 2023-10-06T04:37:40.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.476+0000 7ff11d994700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff11815b490 0x7ff1180b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.476+0000 7ff11c992700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ff1180b1c70 0x7ff11815ad80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:51932/0 (socket says 172.21.15.8:51932) 2023-10-06T04:37:40.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.476+0000 7ff11c992700 1 -- 172.21.15.8:0/3452245577 learned_addr learned my addr 172.21.15.8:0/3452245577 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:40.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.476+0000 7ff11d193700 1 --2- 172.21.15.8:0/3452245577 >> v2:172.21.15.184:3300/0 conn(0x7ff118156e30 0x7ff1180cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.477+0000 7ff11d994700 1 -- 172.21.15.8:0/3452245577 >> v2:172.21.15.184:3300/0 conn(0x7ff118156e30 msgr2=0x7ff1180cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:40.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.477+0000 7ff11d994700 1 --2- 172.21.15.8:0/3452245577 >> v2:172.21.15.184:3300/0 conn(0x7ff118156e30 0x7ff1180cf800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.477+0000 7ff11d994700 1 -- 172.21.15.8:0/3452245577 >> v1:172.21.15.8:6789/0 conn(0x7ff1180b1c70 legacy=0x7ff11815ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.477+0000 7ff11d994700 1 -- 172.21.15.8:0/3452245577 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1180cea60 con 0x7ff11815b490 2023-10-06T04:37:40.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.477+0000 7ff117fff700 1 -- 172.21.15.8:0/3452245577 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1471731906 0 0) 0x7ff1180b2620 con 0x7ff1180b1c70 2023-10-06T04:37:40.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.477+0000 7ff11d193700 1 --2- 172.21.15.8:0/3452245577 >> v2:172.21.15.184:3300/0 conn(0x7ff118156e30 0x7ff1180cf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:40.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.477+0000 7ff11d994700 1 --2- 172.21.15.8:0/3452245577 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff11815b490 0x7ff1180b20e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff1180d1390 tx=0x7ff1100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ca8347f5bc30f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:40.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.477+0000 7ff117fff700 1 -- 172.21.15.8:0/3452245577 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11000b6b0 con 0x7ff11815b490 2023-10-06T04:37:40.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.477+0000 7ff117fff700 1 -- 172.21.15.8:0/3452245577 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11000b810 con 0x7ff11815b490 2023-10-06T04:37:40.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.477+0000 7ff117fff700 1 -- 172.21.15.8:0/3452245577 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11000bbb0 con 0x7ff11815b490 2023-10-06T04:37:40.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.477+0000 7ff11e195700 1 -- 172.21.15.8:0/3452245577 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff11815b490 msgr2=0x7ff1180b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.477+0000 7ff11e195700 1 --2- 172.21.15.8:0/3452245577 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff11815b490 0x7ff1180b20e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff1180d1390 tx=0x7ff1100091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.477+0000 7ff11e195700 1 -- 172.21.15.8:0/3452245577 shutdown_connections 2023-10-06T04:37:40.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.477+0000 7ff11e195700 1 --2- 172.21.15.8:0/3452245577 >> v2:172.21.15.184:3300/0 conn(0x7ff118156e30 0x7ff1180cf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.477+0000 7ff11e195700 1 --2- 172.21.15.8:0/3452245577 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff11815b490 0x7ff1180b20e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.477+0000 7ff11e195700 1 -- 172.21.15.8:0/3452245577 >> 172.21.15.8:0/3452245577 conn(0x7ff11806ed00 msgr2=0x7ff11806f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:40.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.478+0000 7ff11e195700 1 -- 172.21.15.8:0/3452245577 shutdown_connections 2023-10-06T04:37:40.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.478+0000 7ff11e195700 1 -- 172.21.15.8:0/3452245577 wait complete. 2023-10-06T04:37:40.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.479+0000 7ff11e195700 1 Processor -- start 2023-10-06T04:37:40.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.479+0000 7ff11e195700 1 -- start start 2023-10-06T04:37:40.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.479+0000 7ff11e195700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1180b1c70 0x7ff118155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.479+0000 7ff11e195700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff118156e30 0x7ff1180ac8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.479+0000 7ff11e195700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff11815b490 0x7ff1180b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.479+0000 7ff11e195700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1180a9e70 con 0x7ff118156e30 2023-10-06T04:37:40.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.479+0000 7ff11e195700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1180aa430 con 0x7ff1180b1c70 2023-10-06T04:37:40.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.479+0000 7ff11e195700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1180a92d0 con 0x7ff11815b490 2023-10-06T04:37:40.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.480+0000 7ff11c992700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff118156e30 0x7ff1180ac8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.480+0000 7ff11c992700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff118156e30 0x7ff1180ac8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54708/0 (socket says 172.21.15.8:54708) 2023-10-06T04:37:40.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.480+0000 7ff11c992700 1 -- 172.21.15.8:0/2038842817 learned_addr learned my addr 172.21.15.8:0/2038842817 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:40.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.480+0000 7ff11c992700 1 -- 172.21.15.8:0/2038842817 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff11815b490 msgr2=0x7ff1180b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.480+0000 7ff11d994700 1 --2- 172.21.15.8:0/2038842817 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff11815b490 0x7ff1180b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.480+0000 7ff11d193700 1 --2- 172.21.15.8:0/2038842817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1180b1c70 0x7ff118155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.480+0000 7ff11c992700 1 --2- 172.21.15.8:0/2038842817 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff11815b490 0x7ff1180b4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.480+0000 7ff11c992700 1 -- 172.21.15.8:0/2038842817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1180b1c70 msgr2=0x7ff118155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.480+0000 7ff11c992700 1 --2- 172.21.15.8:0/2038842817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1180b1c70 0x7ff118155380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.480+0000 7ff11c992700 1 -- 172.21.15.8:0/2038842817 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff110009420 con 0x7ff118156e30 2023-10-06T04:37:40.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.480+0000 7ff11c992700 1 --2- 172.21.15.8:0/2038842817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff118156e30 0x7ff1180ac8f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff10c00c810 tx=0x7ff10c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:40.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.480+0000 7ff1157fa700 1 -- 172.21.15.8:0/2038842817 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10c005b30 con 0x7ff118156e30 2023-10-06T04:37:40.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.480+0000 7ff1157fa700 1 -- 172.21.15.8:0/2038842817 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10c005c90 con 0x7ff118156e30 2023-10-06T04:37:40.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.480+0000 7ff1157fa700 1 -- 172.21.15.8:0/2038842817 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10c007300 con 0x7ff118156e30 2023-10-06T04:37:40.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.480+0000 7ff11e195700 1 -- 172.21.15.8:0/2038842817 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1180a95b0 con 0x7ff118156e30 2023-10-06T04:37:40.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.480+0000 7ff11e195700 1 -- 172.21.15.8:0/2038842817 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1181558c0 con 0x7ff118156e30 2023-10-06T04:37:40.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.481+0000 7ff11e195700 1 -- 172.21.15.8:0/2038842817 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1180aa5c0 con 0x7ff118156e30 2023-10-06T04:37:40.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.482+0000 7ff1157fa700 1 -- 172.21.15.8:0/2038842817 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff10c01b400 con 0x7ff118156e30 2023-10-06T04:37:40.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.482+0000 7ff1157fa700 1 --2- 172.21.15.8:0/2038842817 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff104066f30 0x7ff1040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.482+0000 7ff1157fa700 1 -- 172.21.15.8:0/2038842817 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7ff10c0844f0 con 0x7ff118156e30 2023-10-06T04:37:40.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.482+0000 7ff11d193700 1 --2- 172.21.15.8:0/2038842817 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff104066f30 0x7ff1040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.483+0000 7ff11d193700 1 --2- 172.21.15.8:0/2038842817 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff104066f30 0x7ff1040693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff1080094d0 tx=0x7ff10800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:40.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.487+0000 7ff1157fa700 1 -- 172.21.15.8:0/2038842817 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff10c051320 con 0x7ff118156e30 2023-10-06T04:37:40.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.727+0000 7ff11e195700 1 -- 172.21.15.8:0/2038842817 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "recovery_fs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7ff11804c380 con 0x7ff118156e30 2023-10-06T04:37:40.819 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-06T04:37:40.817+0000 7f5908578700 -1 log_channel(cluster) log [ERR] : Health check update: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T04:37:40.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.817+0000 7ff1157fa700 1 -- 172.21.15.8:0/2038842817 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "recovery_fs", "var": "joinable", "val": "true"}]=0 recovery_fs marked joinable; MDS may join as newly active. v24) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff10c054940 con 0x7ff118156e30 2023-10-06T04:37:40.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.820+0000 7ff11e195700 1 -- 172.21.15.8:0/2038842817 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff104066f30 msgr2=0x7ff1040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.820+0000 7ff11e195700 1 --2- 172.21.15.8:0/2038842817 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff104066f30 0x7ff1040693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff1080094d0 tx=0x7ff10800b040 comp rx=0 tx=0).stop 2023-10-06T04:37:40.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.820+0000 7ff11e195700 1 -- 172.21.15.8:0/2038842817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff118156e30 msgr2=0x7ff1180ac8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.820+0000 7ff11e195700 1 --2- 172.21.15.8:0/2038842817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff118156e30 0x7ff1180ac8f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff10c00c810 tx=0x7ff10c007df0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.820+0000 7ff11e195700 1 -- 172.21.15.8:0/2038842817 shutdown_connections 2023-10-06T04:37:40.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.820+0000 7ff11e195700 1 --2- 172.21.15.8:0/2038842817 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff104066f30 0x7ff1040693e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.820+0000 7ff11e195700 1 --2- 172.21.15.8:0/2038842817 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff11815b490 0x7ff1180b4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.820+0000 7ff11e195700 1 --2- 172.21.15.8:0/2038842817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1180b1c70 0x7ff118155380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.820+0000 7ff11e195700 1 --2- 172.21.15.8:0/2038842817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff118156e30 0x7ff1180ac8f0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.820+0000 7ff11e195700 1 -- 172.21.15.8:0/2038842817 >> 172.21.15.8:0/2038842817 conn(0x7ff11806ed00 msgr2=0x7ff118155de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:40.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.820+0000 7ff11e195700 1 -- 172.21.15.8:0/2038842817 shutdown_connections 2023-10-06T04:37:40.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.820+0000 7ff11e195700 1 -- 172.21.15.8:0/2038842817 wait complete. 2023-10-06T04:37:40.824 INFO:teuthology.orchestra.run.smithi008.stderr:recovery_fs marked joinable; MDS may join as newly active. 2023-10-06T04:37:40.824 INFO:tasks.ceph.mds.a.smithi008.stderr:2023-10-06T04:37:40.822+0000 7f592e8a3700 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2023-10-06T04:37:40.835 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:37:40.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.953+0000 7fe3a922b700 1 Processor -- start 2023-10-06T04:37:40.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.953+0000 7fe3a922b700 1 -- start start 2023-10-06T04:37:40.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.954+0000 7fe3a922b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe3a40af680 0x7fe3a415e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.954+0000 7fe3a922b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3a40d0aa0 0x7fe3a40cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.954+0000 7fe3a922b700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a40cc4c0 con 0x7fe3a40cb360 2023-10-06T04:37:40.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.954+0000 7fe3a922b700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a415d460 con 0x7fe3a40af680 2023-10-06T04:37:40.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.954+0000 7fe3a922b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a415e580 con 0x7fe3a40d0aa0 2023-10-06T04:37:40.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.954+0000 7fe3a259c700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe3a40cb360 0x7fe3a40d0390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:51938/0 (socket says 172.21.15.8:51938) 2023-10-06T04:37:40.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.954+0000 7fe3a259c700 1 -- 172.21.15.8:0/3808927575 learned_addr learned my addr 172.21.15.8:0/3808927575 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:40.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.954+0000 7fe3a2d9d700 1 --2- 172.21.15.8:0/3808927575 >> v2:172.21.15.184:3300/0 conn(0x7fe3a40af680 0x7fe3a415e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.954+0000 7fe3a1d9b700 1 -- 172.21.15.8:0/3808927575 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3674014491 0 0) 0x7fe3a40cc4c0 con 0x7fe3a40cb360 2023-10-06T04:37:40.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.954+0000 7fe3a1d9b700 1 -- 172.21.15.8:0/3808927575 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe38c003570 con 0x7fe3a40cb360 2023-10-06T04:37:40.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.954+0000 7fe3a359e700 1 --2- 172.21.15.8:0/3808927575 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3a40d0aa0 0x7fe3a40cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.954+0000 7fe3a1d9b700 1 -- 172.21.15.8:0/3808927575 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1850548900 0 0) 0x7fe38c003570 con 0x7fe3a40cb360 2023-10-06T04:37:40.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.954+0000 7fe3a1d9b700 1 -- 172.21.15.8:0/3808927575 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3a40d0aa0 msgr2=0x7fe3a40cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:40.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.954+0000 7fe3a1d9b700 1 --2- 172.21.15.8:0/3808927575 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3a40d0aa0 0x7fe3a40cc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.954+0000 7fe3a1d9b700 1 -- 172.21.15.8:0/3808927575 >> v2:172.21.15.184:3300/0 conn(0x7fe3a40af680 msgr2=0x7fe3a415e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:40.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.954+0000 7fe3a1d9b700 1 --2- 172.21.15.8:0/3808927575 >> v2:172.21.15.184:3300/0 conn(0x7fe3a40af680 0x7fe3a415e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.954+0000 7fe3a1d9b700 1 -- 172.21.15.8:0/3808927575 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a40cb8b0 con 0x7fe3a40cb360 2023-10-06T04:37:40.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.954+0000 7fe3a1d9b700 1 -- 172.21.15.8:0/3808927575 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7fe398001470 con 0x7fe3a40cb360 2023-10-06T04:37:40.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.954+0000 7fe3a1d9b700 1 -- 172.21.15.8:0/3808927575 >> v1:172.21.15.8:6789/0 conn(0x7fe3a40cb360 legacy=0x7fe3a40d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.954+0000 7fe3a1d9b700 1 --2- 172.21.15.8:0/3808927575 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe38c003ae0 0x7fe38c003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.955+0000 7fe3a1d9b700 1 --2- 172.21.15.8:0/3808927575 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3a40d0aa0 0x7fe38c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.955+0000 7fe3a1d9b700 1 --2- 172.21.15.8:0/3808927575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe38c004d50 0x7fe38c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.955+0000 7fe3a1d9b700 1 -- 172.21.15.8:0/3808927575 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a415d460 con 0x7fe38c004d50 2023-10-06T04:37:40.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.955+0000 7fe3a1d9b700 1 -- 172.21.15.8:0/3808927575 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a415e580 con 0x7fe38c003ae0 2023-10-06T04:37:40.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.955+0000 7fe3a1d9b700 1 -- 172.21.15.8:0/3808927575 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c00bb40 con 0x7fe3a40d0aa0 2023-10-06T04:37:40.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.955+0000 7fe3a359e700 1 --2- 172.21.15.8:0/3808927575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe38c004d50 0x7fe38c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.955+0000 7fe3a2d9d700 1 --2- 172.21.15.8:0/3808927575 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe38c003ae0 0x7fe38c003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.955+0000 7fe3a259c700 1 --2- 172.21.15.8:0/3808927575 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3a40d0aa0 0x7fe38c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.955+0000 7fe3a359e700 1 -- 172.21.15.8:0/3808927575 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3a40d0aa0 msgr2=0x7fe38c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:40.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.955+0000 7fe3a359e700 1 --2- 172.21.15.8:0/3808927575 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3a40d0aa0 0x7fe38c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.955+0000 7fe3a359e700 1 -- 172.21.15.8:0/3808927575 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe38c003ae0 msgr2=0x7fe38c003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:40.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.955+0000 7fe3a359e700 1 --2- 172.21.15.8:0/3808927575 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe38c003ae0 0x7fe38c003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.955+0000 7fe3a359e700 1 -- 172.21.15.8:0/3808927575 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe38c003570 con 0x7fe38c004d50 2023-10-06T04:37:40.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.955+0000 7fe3a359e700 1 --2- 172.21.15.8:0/3808927575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe38c004d50 0x7fe38c0051c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40d0ea0 tx=0x7fe39c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a11eedf966bb716 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:40.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.955+0000 7fe3a1d9b700 1 -- 172.21.15.8:0/3808927575 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c00ea30 con 0x7fe38c004d50 2023-10-06T04:37:40.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.955+0000 7fe3a1d9b700 1 -- 172.21.15.8:0/3808927575 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39c00f040 con 0x7fe38c004d50 2023-10-06T04:37:40.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.955+0000 7fe3a1d9b700 1 -- 172.21.15.8:0/3808927575 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c00ede0 con 0x7fe38c004d50 2023-10-06T04:37:40.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.956+0000 7fe3a922b700 1 -- 172.21.15.8:0/3808927575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe38c004d50 msgr2=0x7fe38c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.956+0000 7fe3a922b700 1 --2- 172.21.15.8:0/3808927575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe38c004d50 0x7fe38c0051c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40d0ea0 tx=0x7fe39c00b040 comp rx=0 tx=0).stop 2023-10-06T04:37:40.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.956+0000 7fe3a359e700 1 -- 172.21.15.8:0/3808927575 reap_dead start 2023-10-06T04:37:40.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.956+0000 7fe3a922b700 1 -- 172.21.15.8:0/3808927575 shutdown_connections 2023-10-06T04:37:40.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.956+0000 7fe3a922b700 1 -- 172.21.15.8:0/3808927575 >> 172.21.15.8:0/3808927575 conn(0x7fe3a40633d0 msgr2=0x7fe3a40637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:40.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.956+0000 7fe3a922b700 1 -- 172.21.15.8:0/3808927575 shutdown_connections 2023-10-06T04:37:40.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.956+0000 7fe3a922b700 1 -- 172.21.15.8:0/3808927575 wait complete. 2023-10-06T04:37:40.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.957+0000 7fe3a922b700 1 Processor -- start 2023-10-06T04:37:40.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.957+0000 7fe3a922b700 1 -- start start 2023-10-06T04:37:40.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.958+0000 7fe3a922b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3a40afe50 0x7fe3a40b0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.958+0000 7fe3a922b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3a40c9680 0x7fe3a40c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.958+0000 7fe3a922b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3a40c5e20 0x7fe3a40c6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.958+0000 7fe3a922b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a40b3270 con 0x7fe3a40c5e20 2023-10-06T04:37:40.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.958+0000 7fe3a922b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a40b3510 con 0x7fe3a40afe50 2023-10-06T04:37:40.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.958+0000 7fe3a922b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a40b37f0 con 0x7fe3a40c9680 2023-10-06T04:37:40.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.958+0000 7fe3a359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3a40c5e20 0x7fe3a40c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.958+0000 7fe3a359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3a40c5e20 0x7fe3a40c6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54720/0 (socket says 172.21.15.8:54720) 2023-10-06T04:37:40.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.958+0000 7fe3a359e700 1 -- 172.21.15.8:0/2606536296 learned_addr learned my addr 172.21.15.8:0/2606536296 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:40.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.958+0000 7fe3a2d9d700 1 --2- 172.21.15.8:0/2606536296 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3a40afe50 0x7fe3a40b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.958+0000 7fe3a259c700 1 --2- 172.21.15.8:0/2606536296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3a40c9680 0x7fe3a40c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.958+0000 7fe3a359e700 1 -- 172.21.15.8:0/2606536296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3a40c9680 msgr2=0x7fe3a40c9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.958+0000 7fe3a359e700 1 --2- 172.21.15.8:0/2606536296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3a40c9680 0x7fe3a40c9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.958+0000 7fe3a359e700 1 -- 172.21.15.8:0/2606536296 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3a40afe50 msgr2=0x7fe3a40b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:40.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.958+0000 7fe3a359e700 1 --2- 172.21.15.8:0/2606536296 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3a40afe50 0x7fe3a40b0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:40.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.958+0000 7fe3a359e700 1 -- 172.21.15.8:0/2606536296 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a40b3ad0 con 0x7fe3a40c5e20 2023-10-06T04:37:40.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.958+0000 7fe3a359e700 1 --2- 172.21.15.8:0/2606536296 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3a40c5e20 0x7fe3a40c6270 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe39c016000 tx=0x7fe39c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:40.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.959+0000 7fe38affd700 1 -- 172.21.15.8:0/2606536296 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c00eeb0 con 0x7fe3a40c5e20 2023-10-06T04:37:40.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.959+0000 7fe38affd700 1 -- 172.21.15.8:0/2606536296 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39c022070 con 0x7fe3a40c5e20 2023-10-06T04:37:40.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.959+0000 7fe3a922b700 1 -- 172.21.15.8:0/2606536296 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a40c6b70 con 0x7fe3a40c5e20 2023-10-06T04:37:40.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.959+0000 7fe38affd700 1 -- 172.21.15.8:0/2606536296 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c027680 con 0x7fe3a40c5e20 2023-10-06T04:37:40.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.959+0000 7fe3a922b700 1 -- 172.21.15.8:0/2606536296 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a40b3ff0 con 0x7fe3a40c5e20 2023-10-06T04:37:40.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.960+0000 7fe3a922b700 1 -- 172.21.15.8:0/2606536296 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a40b3cc0 con 0x7fe3a40c5e20 2023-10-06T04:37:40.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.960+0000 7fe38affd700 1 -- 172.21.15.8:0/2606536296 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe39c024030 con 0x7fe3a40c5e20 2023-10-06T04:37:40.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.960+0000 7fe38affd700 1 --2- 172.21.15.8:0/2606536296 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe390066f30 0x7fe3900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:40.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.961+0000 7fe38affd700 1 -- 172.21.15.8:0/2606536296 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7fe39c086870 con 0x7fe3a40c5e20 2023-10-06T04:37:40.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.961+0000 7fe3a2d9d700 1 --2- 172.21.15.8:0/2606536296 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe390066f30 0x7fe3900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:40.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.961+0000 7fe3a2d9d700 1 --2- 172.21.15.8:0/2606536296 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe390066f30 0x7fe3900693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe394006f00 tx=0x7fe3940091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:40.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:40.965+0000 7fe38affd700 1 -- 172.21.15.8:0/2606536296 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe39c0536e0 con 0x7fe3a40c5e20 2023-10-06T04:37:41.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:41.201+0000 7fe3a922b700 1 -- 172.21.15.8:0/2606536296 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3a4071550 con 0x7fe3a40c5e20 2023-10-06T04:37:41.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:41.201+0000 7fe38affd700 1 -- 172.21.15.8:0/2606536296 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+5662 (secure 0 0 0) 0x7fe39c056d00 con 0x7fe3a40c5e20 2023-10-06T04:37:41.203 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:41.203 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":25,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/867081044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":867081044},{"type":"v1","addr":"172.21.15.184:6835","nonce":867081044}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5176,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2754847040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2754847040},{"type":"v1","addr":"172.21.15.184:6837","nonce":2754847040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5358,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/1957165234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1957165234},{"type":"v1","addr":"172.21.15.8:6834","nonce":1957165234}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:37:16.932006+0000","modified":"2023-10-06T04:37:26.044254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":39,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:37:29.514098+0000","modified":"2023-10-06T04:37:40.818226+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5361":{"gid":5361,"name":"a","rank":0,"incarnation":25,"state":"up:replay","state_seq":1,"addr":"172.21.15.8:6835/1173304661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1173304661},{"type":"v1","addr":"172.21.15.8:6835","nonce":1173304661}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":8,"enabled":true,"fs_name":"recovery_fs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T04:37:41.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:41.204+0000 7fe3a922b700 1 -- 172.21.15.8:0/2606536296 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe390066f30 msgr2=0x7fe3900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:41.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:41.204+0000 7fe3a922b700 1 --2- 172.21.15.8:0/2606536296 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe390066f30 0x7fe3900693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe394006f00 tx=0x7fe3940091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:41.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:41.204+0000 7fe3a922b700 1 -- 172.21.15.8:0/2606536296 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3a40c5e20 msgr2=0x7fe3a40c6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:41.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:41.204+0000 7fe3a922b700 1 --2- 172.21.15.8:0/2606536296 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3a40c5e20 0x7fe3a40c6270 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe39c016000 tx=0x7fe39c01a000 comp rx=0 tx=0).stop 2023-10-06T04:37:41.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:41.204+0000 7fe3a922b700 1 -- 172.21.15.8:0/2606536296 shutdown_connections 2023-10-06T04:37:41.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:41.204+0000 7fe3a922b700 1 --2- 172.21.15.8:0/2606536296 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe390066f30 0x7fe3900693e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:41.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:41.204+0000 7fe3a922b700 1 --2- 172.21.15.8:0/2606536296 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3a40c5e20 0x7fe3a40c6270 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:41.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:41.204+0000 7fe3a922b700 1 --2- 172.21.15.8:0/2606536296 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3a40afe50 0x7fe3a40b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:41.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:41.204+0000 7fe3a922b700 1 --2- 172.21.15.8:0/2606536296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3a40c9680 0x7fe3a40c9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:41.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:41.204+0000 7fe3a922b700 1 -- 172.21.15.8:0/2606536296 >> 172.21.15.8:0/2606536296 conn(0x7fe3a40633d0 msgr2=0x7fe3a4158050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:41.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:41.204+0000 7fe3a922b700 1 -- 172.21.15.8:0/2606536296 shutdown_connections 2023-10-06T04:37:41.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:41.204+0000 7fe3a922b700 1 -- 172.21.15.8:0/2606536296 wait complete. 2023-10-06T04:37:41.207 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 25 2023-10-06T04:37:41.620 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T04:37:29.514098+0000', 'modified': '2023-10-06T04:37:40.818226+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5361}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5361': {'gid': 5361, 'name': 'a', 'rank': 0, 'incarnation': 25, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.8:6835/1173304661', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6833', 'nonce': 1173304661}, {'type': 'v1', 'addr': '172.21.15.8:6835', 'nonce': 1173304661}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'recovery_fs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T04:37:41.620 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5361:up:replay 2023-10-06T04:37:42.620 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:37:42.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.752+0000 7fd12571f700 1 Processor -- start 2023-10-06T04:37:42.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.752+0000 7fd12571f700 1 -- start start 2023-10-06T04:37:42.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.753+0000 7fd12571f700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd1200af680 0x7fd12015e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:42.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.753+0000 7fd12571f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1200cb360 0x7fd1200d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:42.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.753+0000 7fd12571f700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1200cc4c0 con 0x7fd1200d08d0 2023-10-06T04:37:42.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.753+0000 7fd12571f700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd12015d460 con 0x7fd1200af680 2023-10-06T04:37:42.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.753+0000 7fd12571f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1200d0d50 con 0x7fd1200cb360 2023-10-06T04:37:42.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.753+0000 7fd11effd700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd1200af680 0x7fd12015e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:42.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.753+0000 7fd11f7fe700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fd1200d08d0 0x7fd1200b0000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:51942/0 (socket says 172.21.15.8:51942) 2023-10-06T04:37:42.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.753+0000 7fd11f7fe700 1 -- 172.21.15.8:0/1758947832 learned_addr learned my addr 172.21.15.8:0/1758947832 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:42.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.753+0000 7fd11e7fc700 1 --2- 172.21.15.8:0/1758947832 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1200cb360 0x7fd1200d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:42.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.753+0000 7fd11dffb700 1 -- 172.21.15.8:0/1758947832 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2033338741 0 0) 0x7fd1200cc4c0 con 0x7fd1200d08d0 2023-10-06T04:37:42.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.753+0000 7fd11dffb700 1 -- 172.21.15.8:0/1758947832 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd108003570 con 0x7fd1200d08d0 2023-10-06T04:37:42.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.753+0000 7fd11effd700 1 -- 172.21.15.8:0/1758947832 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1200cb360 msgr2=0x7fd1200d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:42.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.753+0000 7fd11effd700 1 --2- 172.21.15.8:0/1758947832 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1200cb360 0x7fd1200d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:42.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.753+0000 7fd11effd700 1 -- 172.21.15.8:0/1758947832 >> v1:172.21.15.8:6789/0 conn(0x7fd1200d08d0 legacy=0x7fd1200b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:42.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.753+0000 7fd11effd700 1 -- 172.21.15.8:0/1758947832 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd12015e580 con 0x7fd1200af680 2023-10-06T04:37:42.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.753+0000 7fd11effd700 1 --2- 172.21.15.8:0/1758947832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1200af680 0x7fd12015e040 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fd110009910 tx=0x7fd1100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a135f82737ac637 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:42.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.754+0000 7fd11dffb700 1 -- 172.21.15.8:0/1758947832 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11000b640 con 0x7fd1200af680 2023-10-06T04:37:42.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.754+0000 7fd11dffb700 1 -- 172.21.15.8:0/1758947832 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11000b7a0 con 0x7fd1200af680 2023-10-06T04:37:42.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.754+0000 7fd11dffb700 1 -- 172.21.15.8:0/1758947832 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11000bb60 con 0x7fd1200af680 2023-10-06T04:37:42.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.754+0000 7fd12571f700 1 -- 172.21.15.8:0/1758947832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1200af680 msgr2=0x7fd12015e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:42.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.754+0000 7fd12571f700 1 --2- 172.21.15.8:0/1758947832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1200af680 0x7fd12015e040 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fd110009910 tx=0x7fd1100091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:42.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.754+0000 7fd12571f700 1 -- 172.21.15.8:0/1758947832 shutdown_connections 2023-10-06T04:37:42.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.754+0000 7fd12571f700 1 --2- 172.21.15.8:0/1758947832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1200af680 0x7fd12015e040 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:42.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.754+0000 7fd12571f700 1 --2- 172.21.15.8:0/1758947832 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1200cb360 0x7fd1200d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:42.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.754+0000 7fd12571f700 1 -- 172.21.15.8:0/1758947832 >> 172.21.15.8:0/1758947832 conn(0x7fd1200633d0 msgr2=0x7fd1200637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:42.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.754+0000 7fd12571f700 1 -- 172.21.15.8:0/1758947832 shutdown_connections 2023-10-06T04:37:42.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.754+0000 7fd12571f700 1 -- 172.21.15.8:0/1758947832 wait complete. 2023-10-06T04:37:42.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.756+0000 7fd12571f700 1 Processor -- start 2023-10-06T04:37:42.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.756+0000 7fd12571f700 1 -- start start 2023-10-06T04:37:42.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.756+0000 7fd12571f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1200af680 0x7fd120156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:42.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.756+0000 7fd12571f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1200cb360 0x7fd1200b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:42.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.756+0000 7fd12571f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1200d08d0 0x7fd1200ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:42.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.756+0000 7fd12571f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1200c8f20 con 0x7fd1200af680 2023-10-06T04:37:42.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.756+0000 7fd12571f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1200c90b0 con 0x7fd1200d08d0 2023-10-06T04:37:42.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.756+0000 7fd12571f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1200b3b40 con 0x7fd1200cb360 2023-10-06T04:37:42.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.756+0000 7fd11effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1200af680 0x7fd120156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:42.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.756+0000 7fd11effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1200af680 0x7fd120156d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54742/0 (socket says 172.21.15.8:54742) 2023-10-06T04:37:42.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.756+0000 7fd11effd700 1 -- 172.21.15.8:0/1742477974 learned_addr learned my addr 172.21.15.8:0/1742477974 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:42.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.757+0000 7fd11effd700 1 -- 172.21.15.8:0/1742477974 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1200cb360 msgr2=0x7fd1200b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:42.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.757+0000 7fd11effd700 1 --2- 172.21.15.8:0/1742477974 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1200cb360 0x7fd1200b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:42.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.757+0000 7fd11effd700 1 -- 172.21.15.8:0/1742477974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1200d08d0 msgr2=0x7fd1200ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:42.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.757+0000 7fd11effd700 1 --2- 172.21.15.8:0/1742477974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1200d08d0 0x7fd1200ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:42.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.757+0000 7fd11effd700 1 -- 172.21.15.8:0/1742477974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd110009420 con 0x7fd1200af680 2023-10-06T04:37:42.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.757+0000 7fd11effd700 1 --2- 172.21.15.8:0/1742477974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1200af680 0x7fd120156d60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd110009fb0 tx=0x7fd110017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:42.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.757+0000 7fd106ffd700 1 -- 172.21.15.8:0/1742477974 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11001f070 con 0x7fd1200af680 2023-10-06T04:37:42.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.757+0000 7fd106ffd700 1 -- 172.21.15.8:0/1742477974 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11000bb20 con 0x7fd1200af680 2023-10-06T04:37:42.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.757+0000 7fd106ffd700 1 -- 172.21.15.8:0/1742477974 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd110011670 con 0x7fd1200af680 2023-10-06T04:37:42.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.757+0000 7fd12571f700 1 -- 172.21.15.8:0/1742477974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1200b3e20 con 0x7fd1200af680 2023-10-06T04:37:42.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.757+0000 7fd12571f700 1 -- 172.21.15.8:0/1742477974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1200b43e0 con 0x7fd1200af680 2023-10-06T04:37:42.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.758+0000 7fd12571f700 1 -- 172.21.15.8:0/1742477974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd120071550 con 0x7fd1200af680 2023-10-06T04:37:42.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.758+0000 7fd106ffd700 1 -- 172.21.15.8:0/1742477974 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd110011aa0 con 0x7fd1200af680 2023-10-06T04:37:42.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.759+0000 7fd106ffd700 1 --2- 172.21.15.8:0/1742477974 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd10c066f30 0x7fd10c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:42.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.759+0000 7fd106ffd700 1 -- 172.21.15.8:0/1742477974 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7fd110085e90 con 0x7fd1200af680 2023-10-06T04:37:42.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.759+0000 7fd11e7fc700 1 --2- 172.21.15.8:0/1742477974 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd10c066f30 0x7fd10c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:42.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.760+0000 7fd11e7fc700 1 --2- 172.21.15.8:0/1742477974 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd10c066f30 0x7fd10c0693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd1200b46c0 tx=0x7fd114008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:42.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:42.763+0000 7fd106ffd700 1 -- 172.21.15.8:0/1742477974 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd110052c40 con 0x7fd1200af680 2023-10-06T04:37:43.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:43.006+0000 7fd12571f700 1 -- 172.21.15.8:0/1742477974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1200cacd0 con 0x7fd1200af680 2023-10-06T04:37:43.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:43.006+0000 7fd106ffd700 1 -- 172.21.15.8:0/1742477974 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+5662 (secure 0 0 0) 0x7fd110028090 con 0x7fd1200af680 2023-10-06T04:37:43.008 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:43.008 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":27,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/867081044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":867081044},{"type":"v1","addr":"172.21.15.184:6835","nonce":867081044}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5176,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2754847040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2754847040},{"type":"v1","addr":"172.21.15.184:6837","nonce":2754847040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5358,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/1957165234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1957165234},{"type":"v1","addr":"172.21.15.8:6834","nonce":1957165234}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:37:16.932006+0000","modified":"2023-10-06T04:37:26.044254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":39,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:37:29.514098+0000","modified":"2023-10-06T04:37:42.822695+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5361":{"gid":5361,"name":"a","rank":0,"incarnation":25,"state":"up:rejoin","state_seq":6,"addr":"172.21.15.8:6835/1173304661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1173304661},{"type":"v1","addr":"172.21.15.8:6835","nonce":1173304661}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":8,"enabled":true,"fs_name":"recovery_fs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T04:37:43.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:43.008+0000 7fd12571f700 1 -- 172.21.15.8:0/1742477974 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd10c066f30 msgr2=0x7fd10c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:43.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:43.008+0000 7fd12571f700 1 --2- 172.21.15.8:0/1742477974 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd10c066f30 0x7fd10c0693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd1200b46c0 tx=0x7fd114008040 comp rx=0 tx=0).stop 2023-10-06T04:37:43.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:43.008+0000 7fd12571f700 1 -- 172.21.15.8:0/1742477974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1200af680 msgr2=0x7fd120156d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:43.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:43.008+0000 7fd12571f700 1 --2- 172.21.15.8:0/1742477974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1200af680 0x7fd120156d60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd110009fb0 tx=0x7fd110017000 comp rx=0 tx=0).stop 2023-10-06T04:37:43.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:43.008+0000 7fd12571f700 1 -- 172.21.15.8:0/1742477974 shutdown_connections 2023-10-06T04:37:43.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:43.008+0000 7fd12571f700 1 --2- 172.21.15.8:0/1742477974 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd10c066f30 0x7fd10c0693e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:43.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:43.008+0000 7fd12571f700 1 --2- 172.21.15.8:0/1742477974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1200d08d0 0x7fd1200ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:43.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:43.008+0000 7fd12571f700 1 --2- 172.21.15.8:0/1742477974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1200af680 0x7fd120156d60 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:43.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:43.008+0000 7fd12571f700 1 --2- 172.21.15.8:0/1742477974 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1200cb360 0x7fd1200b31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:43.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:43.008+0000 7fd12571f700 1 -- 172.21.15.8:0/1742477974 >> 172.21.15.8:0/1742477974 conn(0x7fd1200633d0 msgr2=0x7fd1200ce7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:43.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:43.008+0000 7fd12571f700 1 -- 172.21.15.8:0/1742477974 shutdown_connections 2023-10-06T04:37:43.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:43.009+0000 7fd12571f700 1 -- 172.21.15.8:0/1742477974 wait complete. 2023-10-06T04:37:43.011 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 27 2023-10-06T04:37:43.424 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T04:37:29.514098+0000', 'modified': '2023-10-06T04:37:42.822695+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5361}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5361': {'gid': 5361, 'name': 'a', 'rank': 0, 'incarnation': 25, 'state': 'up:rejoin', 'state_seq': 6, 'addr': '172.21.15.8:6835/1173304661', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6833', 'nonce': 1173304661}, {'type': 'v1', 'addr': '172.21.15.8:6835', 'nonce': 1173304661}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'recovery_fs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T04:37:43.424 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5361:up:rejoin 2023-10-06T04:37:44.426 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:37:44.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.556+0000 7f5312928700 1 Processor -- start 2023-10-06T04:37:44.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.556+0000 7f5312928700 1 -- start start 2023-10-06T04:37:44.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.557+0000 7f5312928700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f530c0af680 0x7f530c15e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:44.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.557+0000 7f5312928700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f530c0d0aa0 0x7f530c0cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:44.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.557+0000 7f5312928700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f530c0cc4c0 con 0x7f530c0cb360 2023-10-06T04:37:44.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.557+0000 7f5312928700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f530c15d460 con 0x7f530c0af680 2023-10-06T04:37:44.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.557+0000 7f5312928700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f530c15e580 con 0x7f530c0d0aa0 2023-10-06T04:37:44.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.557+0000 7f530bfff700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f530c0af680 0x7f530c15e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:44.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.557+0000 7f530b7fe700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f530c0cb360 0x7f530c0d0390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60154/0 (socket says 172.21.15.8:60154) 2023-10-06T04:37:44.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.557+0000 7f530b7fe700 1 -- 172.21.15.8:0/672906562 learned_addr learned my addr 172.21.15.8:0/672906562 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:44.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.558+0000 7f530bfff700 1 -- 172.21.15.8:0/672906562 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f530c0d0aa0 msgr2=0x7f530c0cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:44.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.558+0000 7f530bfff700 1 --2- 172.21.15.8:0/672906562 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f530c0d0aa0 0x7f530c0cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:44.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.558+0000 7f530bfff700 1 -- 172.21.15.8:0/672906562 >> v1:172.21.15.8:6789/0 conn(0x7f530c0cb360 legacy=0x7f530c0d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:44.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.558+0000 7f530bfff700 1 -- 172.21.15.8:0/672906562 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f530c0cb8b0 con 0x7f530c0af680 2023-10-06T04:37:44.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.558+0000 7f530bfff700 1 --2- 172.21.15.8:0/672906562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f530c0af680 0x7f530c15e040 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0098e0 tx=0x7f52fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e16ec67cd9ae4c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:44.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.558+0000 7f530affd700 1 -- 172.21.15.8:0/672906562 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc009e80 con 0x7f530c0af680 2023-10-06T04:37:44.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.558+0000 7f530affd700 1 -- 172.21.15.8:0/672906562 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52fc00b860 con 0x7f530c0af680 2023-10-06T04:37:44.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.558+0000 7f530affd700 1 -- 172.21.15.8:0/672906562 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc00bbe0 con 0x7f530c0af680 2023-10-06T04:37:44.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.559+0000 7f5312928700 1 -- 172.21.15.8:0/672906562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f530c0af680 msgr2=0x7f530c15e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:44.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.559+0000 7f5312928700 1 --2- 172.21.15.8:0/672906562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f530c0af680 0x7f530c15e040 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0098e0 tx=0x7f52fc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:44.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.559+0000 7f5312928700 1 -- 172.21.15.8:0/672906562 shutdown_connections 2023-10-06T04:37:44.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.559+0000 7f5312928700 1 --2- 172.21.15.8:0/672906562 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f530c0d0aa0 0x7f530c0cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:44.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.559+0000 7f5312928700 1 --2- 172.21.15.8:0/672906562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f530c0af680 0x7f530c15e040 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:44.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.559+0000 7f5312928700 1 -- 172.21.15.8:0/672906562 >> 172.21.15.8:0/672906562 conn(0x7f530c0633d0 msgr2=0x7f530c0637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:44.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.559+0000 7f5312928700 1 -- 172.21.15.8:0/672906562 shutdown_connections 2023-10-06T04:37:44.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.559+0000 7f5312928700 1 -- 172.21.15.8:0/672906562 wait complete. 2023-10-06T04:37:44.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.560+0000 7f5312928700 1 Processor -- start 2023-10-06T04:37:44.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.560+0000 7f5312928700 1 -- start start 2023-10-06T04:37:44.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.561+0000 7f5312928700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f530c0af680 0x7f530c14ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:44.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.561+0000 7f5312928700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f530c0cb360 0x7f530c0c9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:44.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.561+0000 7f5312928700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f530c0d0aa0 0x7f530c169de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:44.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.561+0000 7f5312928700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530c0c4830 con 0x7f530c0d0aa0 2023-10-06T04:37:44.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.561+0000 7f5312928700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530c14efd0 con 0x7f530c0cb360 2023-10-06T04:37:44.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.561+0000 7f5312928700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f530c0c3f00 con 0x7f530c0af680 2023-10-06T04:37:44.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.561+0000 7f5310ec5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f530c0d0aa0 0x7f530c169de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:44.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.561+0000 7f5310ec5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f530c0d0aa0 0x7f530c169de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42386/0 (socket says 172.21.15.8:42386) 2023-10-06T04:37:44.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.561+0000 7f5310ec5700 1 -- 172.21.15.8:0/1854159041 learned_addr learned my addr 172.21.15.8:0/1854159041 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:44.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.561+0000 7f530bfff700 1 --2- 172.21.15.8:0/1854159041 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f530c0af680 0x7f530c14ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:44.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.561+0000 7f530b7fe700 1 --2- 172.21.15.8:0/1854159041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f530c0cb360 0x7f530c0c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:44.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.561+0000 7f5310ec5700 1 -- 172.21.15.8:0/1854159041 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f530c0af680 msgr2=0x7f530c14ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:44.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.561+0000 7f5310ec5700 1 --2- 172.21.15.8:0/1854159041 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f530c0af680 0x7f530c14ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:44.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.561+0000 7f5310ec5700 1 -- 172.21.15.8:0/1854159041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f530c0cb360 msgr2=0x7f530c0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:44.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.561+0000 7f5310ec5700 1 --2- 172.21.15.8:0/1854159041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f530c0cb360 0x7f530c0c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:44.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.561+0000 7f5310ec5700 1 -- 172.21.15.8:0/1854159041 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52fc009420 con 0x7f530c0d0aa0 2023-10-06T04:37:44.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.561+0000 7f530b7fe700 1 --2- 172.21.15.8:0/1854159041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f530c0cb360 0x7f530c0c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:44.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.561+0000 7f530bfff700 1 --2- 172.21.15.8:0/1854159041 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f530c0af680 0x7f530c14ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:44.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.561+0000 7f5310ec5700 1 --2- 172.21.15.8:0/1854159041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f530c0d0aa0 0x7f530c169de0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f530400bb60 tx=0x7f5304009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:44.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.561+0000 7f52f3fff700 1 -- 172.21.15.8:0/1854159041 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530400c940 con 0x7f530c0d0aa0 2023-10-06T04:37:44.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.561+0000 7f52f3fff700 1 -- 172.21.15.8:0/1854159041 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530400caa0 con 0x7f530c0d0aa0 2023-10-06T04:37:44.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.561+0000 7f5312928700 1 -- 172.21.15.8:0/1854159041 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f530c0c41e0 con 0x7f530c0d0aa0 2023-10-06T04:37:44.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.561+0000 7f52f3fff700 1 -- 172.21.15.8:0/1854159041 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530400ce60 con 0x7f530c0d0aa0 2023-10-06T04:37:44.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.562+0000 7f5312928700 1 -- 172.21.15.8:0/1854159041 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f530c0c9560 con 0x7f530c0d0aa0 2023-10-06T04:37:44.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.562+0000 7f5312928700 1 -- 172.21.15.8:0/1854159041 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f530c0c49e0 con 0x7f530c0d0aa0 2023-10-06T04:37:44.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.563+0000 7f52f3fff700 1 -- 172.21.15.8:0/1854159041 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5304014620 con 0x7f530c0d0aa0 2023-10-06T04:37:44.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.563+0000 7f52f3fff700 1 --2- 172.21.15.8:0/1854159041 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f52f8066f30 0x7f52f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:44.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.563+0000 7f52f3fff700 1 -- 172.21.15.8:0/1854159041 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7f5304084a60 con 0x7f530c0d0aa0 2023-10-06T04:37:44.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.564+0000 7f530bfff700 1 --2- 172.21.15.8:0/1854159041 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f52f8066f30 0x7f52f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:44.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.564+0000 7f530bfff700 1 --2- 172.21.15.8:0/1854159041 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f52f8066f30 0x7f52f80693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0091e0 tx=0x7f52fc017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:44.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.568+0000 7f52f3fff700 1 -- 172.21.15.8:0/1854159041 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f530404c5a0 con 0x7f530c0d0aa0 2023-10-06T04:37:44.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.808+0000 7f5312928700 1 -- 172.21.15.8:0/1854159041 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f530c071550 con 0x7f530c0d0aa0 2023-10-06T04:37:44.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.808+0000 7f52f3fff700 1 -- 172.21.15.8:0/1854159041 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+5662 (secure 0 0 0) 0x7f5304051770 con 0x7f530c0d0aa0 2023-10-06T04:37:44.810 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:44.810 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":28,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/867081044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":867081044},{"type":"v1","addr":"172.21.15.184:6835","nonce":867081044}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5176,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2754847040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2754847040},{"type":"v1","addr":"172.21.15.184:6837","nonce":2754847040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5358,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/1957165234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1957165234},{"type":"v1","addr":"172.21.15.8:6834","nonce":1957165234}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:37:16.932006+0000","modified":"2023-10-06T04:37:26.044254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":39,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:37:29.514098+0000","modified":"2023-10-06T04:37:43.827602+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5361":{"gid":5361,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.8:6835/1173304661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1173304661},{"type":"v1","addr":"172.21.15.8:6835","nonce":1173304661}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":8,"enabled":true,"fs_name":"recovery_fs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T04:37:44.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.810+0000 7f5312928700 1 -- 172.21.15.8:0/1854159041 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f52f8066f30 msgr2=0x7f52f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:44.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.810+0000 7f5312928700 1 --2- 172.21.15.8:0/1854159041 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f52f8066f30 0x7f52f80693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0091e0 tx=0x7f52fc017000 comp rx=0 tx=0).stop 2023-10-06T04:37:44.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.810+0000 7f5312928700 1 -- 172.21.15.8:0/1854159041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f530c0d0aa0 msgr2=0x7f530c169de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:44.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.810+0000 7f5312928700 1 --2- 172.21.15.8:0/1854159041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f530c0d0aa0 0x7f530c169de0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f530400bb60 tx=0x7f5304009810 comp rx=0 tx=0).stop 2023-10-06T04:37:44.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.810+0000 7f5312928700 1 -- 172.21.15.8:0/1854159041 shutdown_connections 2023-10-06T04:37:44.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.810+0000 7f5312928700 1 --2- 172.21.15.8:0/1854159041 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f52f8066f30 0x7f52f80693e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:44.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.810+0000 7f5312928700 1 --2- 172.21.15.8:0/1854159041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f530c0d0aa0 0x7f530c169de0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:44.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.810+0000 7f5312928700 1 --2- 172.21.15.8:0/1854159041 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f530c0af680 0x7f530c14ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:44.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.810+0000 7f5312928700 1 --2- 172.21.15.8:0/1854159041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f530c0cb360 0x7f530c0c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:44.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.810+0000 7f5312928700 1 -- 172.21.15.8:0/1854159041 >> 172.21.15.8:0/1854159041 conn(0x7f530c0633d0 msgr2=0x7f530c15cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:44.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.810+0000 7f5312928700 1 -- 172.21.15.8:0/1854159041 shutdown_connections 2023-10-06T04:37:44.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:44.810+0000 7f5312928700 1 -- 172.21.15.8:0/1854159041 wait complete. 2023-10-06T04:37:44.813 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 28 2023-10-06T04:37:45.226 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T04:37:29.514098+0000', 'modified': '2023-10-06T04:37:43.827602+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5361}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5361': {'gid': 5361, 'name': 'a', 'rank': 0, 'incarnation': 25, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.8:6835/1173304661', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6833', 'nonce': 1173304661}, {'type': 'v1', 'addr': '172.21.15.8:6835', 'nonce': 1173304661}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'recovery_fs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T04:37:45.227 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T04:37:45.227 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T04:37:45.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.347+0000 7ff8a887f700 1 Processor -- start 2023-10-06T04:37:45.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.347+0000 7ff8a887f700 1 -- start start 2023-10-06T04:37:45.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.348+0000 7ff8a887f700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff8a4156e30 0x7ff8a40cf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.348+0000 7ff8a887f700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff8a40b1c70 0x7ff8a40b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.348+0000 7ff8a887f700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a40b2620 con 0x7ff8a415ad80 2023-10-06T04:37:45.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.348+0000 7ff8a887f700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8a40cf370 con 0x7ff8a4156e30 2023-10-06T04:37:45.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.348+0000 7ff8a887f700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8a40ce800 con 0x7ff8a40b1c70 2023-10-06T04:37:45.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.348+0000 7ff8a37fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff8a4156e30 0x7ff8a40cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.348+0000 7ff8a3fff700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ff8a415ad80 0x7ff8a415b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60156/0 (socket says 172.21.15.8:60156) 2023-10-06T04:37:45.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.348+0000 7ff8a3fff700 1 -- 172.21.15.8:0/1911801065 learned_addr learned my addr 172.21.15.8:0/1911801065 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:45.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.348+0000 7ff8a2ffd700 1 --2- 172.21.15.8:0/1911801065 >> v2:172.21.15.184:3300/0 conn(0x7ff8a40b1c70 0x7ff8a40b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.348+0000 7ff8a37fe700 1 -- 172.21.15.8:0/1911801065 >> v2:172.21.15.184:3300/0 conn(0x7ff8a40b1c70 msgr2=0x7ff8a40b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:45.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.348+0000 7ff8a37fe700 1 --2- 172.21.15.8:0/1911801065 >> v2:172.21.15.184:3300/0 conn(0x7ff8a40b1c70 0x7ff8a40b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.348+0000 7ff8a37fe700 1 -- 172.21.15.8:0/1911801065 >> v1:172.21.15.8:6789/0 conn(0x7ff8a415ad80 legacy=0x7ff8a415b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:45.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.348+0000 7ff8a37fe700 1 -- 172.21.15.8:0/1911801065 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a40cea60 con 0x7ff8a4156e30 2023-10-06T04:37:45.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.348+0000 7ff8a27fc700 1 -- 172.21.15.8:0/1911801065 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3142212582 0 0) 0x7ff8a40b2620 con 0x7ff8a415ad80 2023-10-06T04:37:45.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.349+0000 7ff8a2ffd700 1 --2- 172.21.15.8:0/1911801065 >> v2:172.21.15.184:3300/0 conn(0x7ff8a40b1c70 0x7ff8a40b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:45.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.349+0000 7ff8a37fe700 1 --2- 172.21.15.8:0/1911801065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8a4156e30 0x7ff8a40cf800 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4067f30 tx=0x7ff8940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b77ce3c7f2b5349 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:45.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.349+0000 7ff8a27fc700 1 -- 172.21.15.8:0/1911801065 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89400b6b0 con 0x7ff8a4156e30 2023-10-06T04:37:45.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.349+0000 7ff8a27fc700 1 -- 172.21.15.8:0/1911801065 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89400b810 con 0x7ff8a4156e30 2023-10-06T04:37:45.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.349+0000 7ff8a27fc700 1 -- 172.21.15.8:0/1911801065 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89400bbb0 con 0x7ff8a4156e30 2023-10-06T04:37:45.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.349+0000 7ff8a887f700 1 -- 172.21.15.8:0/1911801065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8a4156e30 msgr2=0x7ff8a40cf800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:45.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.349+0000 7ff8a887f700 1 --2- 172.21.15.8:0/1911801065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8a4156e30 0x7ff8a40cf800 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4067f30 tx=0x7ff8940091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.349+0000 7ff8a887f700 1 -- 172.21.15.8:0/1911801065 shutdown_connections 2023-10-06T04:37:45.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.349+0000 7ff8a887f700 1 --2- 172.21.15.8:0/1911801065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8a4156e30 0x7ff8a40cf800 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.349+0000 7ff8a887f700 1 --2- 172.21.15.8:0/1911801065 >> v2:172.21.15.184:3300/0 conn(0x7ff8a40b1c70 0x7ff8a40b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.349+0000 7ff8a887f700 1 -- 172.21.15.8:0/1911801065 >> 172.21.15.8:0/1911801065 conn(0x7ff8a406ed00 msgr2=0x7ff8a406f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:45.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.349+0000 7ff8a887f700 1 -- 172.21.15.8:0/1911801065 shutdown_connections 2023-10-06T04:37:45.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.349+0000 7ff8a887f700 1 -- 172.21.15.8:0/1911801065 wait complete. 2023-10-06T04:37:45.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.351+0000 7ff8a887f700 1 Processor -- start 2023-10-06T04:37:45.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.351+0000 7ff8a887f700 1 -- start start 2023-10-06T04:37:45.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.351+0000 7ff8a887f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8a40b1c70 0x7ff8a40c5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.351+0000 7ff8a887f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff8a4156e30 0x7ff8a40c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.351+0000 7ff8a887f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff8a415ad80 0x7ff8a40c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.351+0000 7ff8a887f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a4169f40 con 0x7ff8a40b1c70 2023-10-06T04:37:45.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.351+0000 7ff8a887f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a416a220 con 0x7ff8a4156e30 2023-10-06T04:37:45.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.351+0000 7ff8a887f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a416a500 con 0x7ff8a415ad80 2023-10-06T04:37:45.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.352+0000 7ff8a37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8a40b1c70 0x7ff8a40c5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.352+0000 7ff8a37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8a40b1c70 0x7ff8a40c5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42398/0 (socket says 172.21.15.8:42398) 2023-10-06T04:37:45.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.352+0000 7ff8a37fe700 1 -- 172.21.15.8:0/1911656445 learned_addr learned my addr 172.21.15.8:0/1911656445 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:45.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.352+0000 7ff8a2ffd700 1 --2- 172.21.15.8:0/1911656445 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff8a4156e30 0x7ff8a40c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.352+0000 7ff8a3fff700 1 --2- 172.21.15.8:0/1911656445 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff8a415ad80 0x7ff8a40c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.352+0000 7ff8a37fe700 1 -- 172.21.15.8:0/1911656445 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff8a415ad80 msgr2=0x7ff8a40c6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:45.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.352+0000 7ff8a37fe700 1 --2- 172.21.15.8:0/1911656445 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff8a415ad80 0x7ff8a40c6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.352+0000 7ff8a37fe700 1 -- 172.21.15.8:0/1911656445 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff8a4156e30 msgr2=0x7ff8a40c5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:45.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.352+0000 7ff8a37fe700 1 --2- 172.21.15.8:0/1911656445 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff8a4156e30 0x7ff8a40c5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.352+0000 7ff8a37fe700 1 -- 172.21.15.8:0/1911656445 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff894009420 con 0x7ff8a40b1c70 2023-10-06T04:37:45.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.352+0000 7ff8a2ffd700 1 --2- 172.21.15.8:0/1911656445 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff8a4156e30 0x7ff8a40c5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:45.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.352+0000 7ff8a3fff700 1 --2- 172.21.15.8:0/1911656445 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff8a415ad80 0x7ff8a40c6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:45.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.352+0000 7ff8a37fe700 1 --2- 172.21.15.8:0/1911656445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8a40b1c70 0x7ff8a40c5040 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4067f00 tx=0x7ff894017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:45.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.352+0000 7ff88b7fe700 1 -- 172.21.15.8:0/1911656445 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89400bb90 con 0x7ff8a40b1c70 2023-10-06T04:37:45.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.352+0000 7ff88b7fe700 1 -- 172.21.15.8:0/1911656445 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff894011420 con 0x7ff8a40b1c70 2023-10-06T04:37:45.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.352+0000 7ff8a887f700 1 -- 172.21.15.8:0/1911656445 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a416a7e0 con 0x7ff8a40b1c70 2023-10-06T04:37:45.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.352+0000 7ff88b7fe700 1 -- 172.21.15.8:0/1911656445 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8940117a0 con 0x7ff8a40b1c70 2023-10-06T04:37:45.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.352+0000 7ff8a887f700 1 -- 172.21.15.8:0/1911656445 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a40c62b0 con 0x7ff8a40b1c70 2023-10-06T04:37:45.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.354+0000 7ff88b7fe700 1 -- 172.21.15.8:0/1911656445 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff894011b90 con 0x7ff8a40b1c70 2023-10-06T04:37:45.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.354+0000 7ff88b7fe700 1 --2- 172.21.15.8:0/1911656445 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff890066f30 0x7ff8900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.354+0000 7ff88b7fe700 1 -- 172.21.15.8:0/1911656445 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7ff894086380 con 0x7ff8a40b1c70 2023-10-06T04:37:45.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.354+0000 7ff8a2ffd700 1 --2- 172.21.15.8:0/1911656445 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff890066f30 0x7ff8900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.355+0000 7ff8a2ffd700 1 --2- 172.21.15.8:0/1911656445 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff890066f30 0x7ff8900693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff898006f00 tx=0x7ff898008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:45.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.356+0000 7ff8b2dd9b80 1 Processor -- start 2023-10-06T04:37:45.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.356+0000 7ff8b2dd9b80 1 -- start start 2023-10-06T04:37:45.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.357+0000 7ff8b2dd9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f79ced2950 0x55f79ced2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.357+0000 7ff8b2dd9b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f79cf1cbc0 0x55f79cefb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.357+0000 7ff8b2dd9b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f79cefbe60 0x55f79cece990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.357+0000 7ff8b2dd9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f79ce52c80 con 0x55f79ced2950 2023-10-06T04:37:45.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.357+0000 7ff8b2dd9b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f79ce29a70 con 0x55f79cf1cbc0 2023-10-06T04:37:45.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.357+0000 7ff8b2dd9b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f79ce27270 con 0x55f79cefbe60 2023-10-06T04:37:45.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.357+0000 7ff8a37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f79ced2950 0x55f79ced2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.357+0000 7ff8a37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f79ced2950 0x55f79ced2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42412/0 (socket says 172.21.15.8:42412) 2023-10-06T04:37:45.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.357+0000 7ff8a37fe700 1 -- 172.21.15.8:0/3355276277 learned_addr learned my addr 172.21.15.8:0/3355276277 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:45.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.357+0000 7ff8a2ffd700 1 --2- 172.21.15.8:0/3355276277 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f79cf1cbc0 0x55f79cefb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.357+0000 7ff8a3fff700 1 --2- 172.21.15.8:0/3355276277 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f79cefbe60 0x55f79cece990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.357+0000 7ff8a37fe700 1 -- 172.21.15.8:0/3355276277 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f79cefbe60 msgr2=0x55f79cece990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:45.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.357+0000 7ff8a37fe700 1 --2- 172.21.15.8:0/3355276277 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f79cefbe60 0x55f79cece990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.357+0000 7ff8a37fe700 1 -- 172.21.15.8:0/3355276277 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f79cf1cbc0 msgr2=0x55f79cefb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:45.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.357+0000 7ff8a37fe700 1 --2- 172.21.15.8:0/3355276277 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f79cf1cbc0 0x55f79cefb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.357+0000 7ff8a37fe700 1 -- 172.21.15.8:0/3355276277 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f79ccbd270 con 0x55f79ced2950 2023-10-06T04:37:45.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.357+0000 7ff8a3fff700 1 --2- 172.21.15.8:0/3355276277 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f79cefbe60 0x55f79cece990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:45.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.357+0000 7ff8a37fe700 1 --2- 172.21.15.8:0/3355276277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f79ced2950 0x55f79ced2d20 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff894000e50 tx=0x7ff894084340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24fe3e8fcb822d39 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:45.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.357+0000 7ff888ff9700 1 -- 172.21.15.8:0/3355276277 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8940574f0 con 0x55f79ced2950 2023-10-06T04:37:45.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.357+0000 7ff888ff9700 1 -- 172.21.15.8:0/3355276277 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff894056df0 con 0x55f79ced2950 2023-10-06T04:37:45.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.357+0000 7ff888ff9700 1 -- 172.21.15.8:0/3355276277 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89405a040 con 0x55f79ced2950 2023-10-06T04:37:45.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.358+0000 7ff8b2dd9b80 1 -- 172.21.15.8:0/3355276277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f79ced2950 msgr2=0x55f79ced2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:45.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.358+0000 7ff8b2dd9b80 1 --2- 172.21.15.8:0/3355276277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f79ced2950 0x55f79ced2d20 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff894000e50 tx=0x7ff894084340 comp rx=0 tx=0).stop 2023-10-06T04:37:45.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.358+0000 7ff8b2dd9b80 1 -- 172.21.15.8:0/3355276277 shutdown_connections 2023-10-06T04:37:45.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.358+0000 7ff8b2dd9b80 1 --2- 172.21.15.8:0/3355276277 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f79cefbe60 0x55f79cece990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.358+0000 7ff8b2dd9b80 1 --2- 172.21.15.8:0/3355276277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f79ced2950 0x55f79ced2d20 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.358+0000 7ff8b2dd9b80 1 --2- 172.21.15.8:0/3355276277 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f79cf1cbc0 0x55f79cefb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.358+0000 7ff8b2dd9b80 1 -- 172.21.15.8:0/3355276277 >> 172.21.15.8:0/3355276277 conn(0x55f79ced4270 msgr2=0x55f79ced4640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:45.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.358+0000 7ff8b2dd9b80 1 -- 172.21.15.8:0/3355276277 shutdown_connections 2023-10-06T04:37:45.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.358+0000 7ff8b2dd9b80 1 -- 172.21.15.8:0/3355276277 wait complete. 2023-10-06T04:37:45.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.359+0000 7ff8b2dd9b80 1 -- start start 2023-10-06T04:37:45.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.359+0000 7ff8b2dd9b80 1 Processor -- start 2023-10-06T04:37:45.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.360+0000 7ff8b2dd9b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f79ced2950 0x55f79cf129f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.360+0000 7ff8b2dd9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f79cefbe60 0x55f79cf16b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.360+0000 7ff8b2dd9b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f79cf1cbc0 0x55f79cec91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.360+0000 7ff8b2dd9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f79ce23060 con 0x55f79cefbe60 2023-10-06T04:37:45.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.360+0000 7ff8b2dd9b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f79cdce890 con 0x55f79cf1cbc0 2023-10-06T04:37:45.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.360+0000 7ff8b2dd9b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f79cde9ea0 con 0x55f79ced2950 2023-10-06T04:37:45.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.360+0000 7ff8b2dd9b80 10 client.0 _ll_register_callbacks cb 0x55f79ccbff30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:37:45.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.360+0000 7ff8a2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f79cefbe60 0x55f79cf16b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.360+0000 7ff8a2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f79cefbe60 0x55f79cf16b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42420/0 (socket says 172.21.15.8:42420) 2023-10-06T04:37:45.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.360+0000 7ff8a2ffd700 1 -- 172.21.15.8:0/488647170 learned_addr learned my addr 172.21.15.8:0/488647170 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:45.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.360+0000 7ff8a3fff700 1 --2- 172.21.15.8:0/488647170 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f79cf1cbc0 0x55f79cec91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.360+0000 7ff8a37fe700 1 --2- 172.21.15.8:0/488647170 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f79ced2950 0x55f79cf129f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.360+0000 7ff8a2ffd700 1 -- 172.21.15.8:0/488647170 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f79ced2950 msgr2=0x55f79cf129f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:45.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.360+0000 7ff8a2ffd700 1 --2- 172.21.15.8:0/488647170 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f79ced2950 0x55f79cf129f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.360+0000 7ff8a2ffd700 1 -- 172.21.15.8:0/488647170 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f79cf1cbc0 msgr2=0x55f79cec91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:45.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.360+0000 7ff8a2ffd700 1 --2- 172.21.15.8:0/488647170 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f79cf1cbc0 0x55f79cec91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.360+0000 7ff8a2ffd700 1 -- 172.21.15.8:0/488647170 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a40c62b0 con 0x55f79cefbe60 2023-10-06T04:37:45.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.360+0000 7ff8a2ffd700 1 --2- 172.21.15.8:0/488647170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f79cefbe60 0x55f79cf16b20 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff8a40cd100 tx=0x7ff898016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1302e97ffc582cf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:45.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.360+0000 7ff881ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T04:37:45.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.360+0000 7ff881ffb700 1 -- 172.21.15.8:0/488647170 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff898015620 con 0x55f79cefbe60 2023-10-06T04:37:45.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.360+0000 7ff8b2dd9b80 1 -- 172.21.15.8:0/488647170 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f79cec7690 con 0x55f79cefbe60 2023-10-06T04:37:45.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.360+0000 7ff881ffb700 1 -- 172.21.15.8:0/488647170 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7ff898015780 con 0x55f79cefbe60 2023-10-06T04:37:45.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.361+0000 7ff881ffb700 1 -- 172.21.15.8:0/488647170 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff898015b50 con 0x55f79cefbe60 2023-10-06T04:37:45.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.361+0000 7ff8b2dd9b80 10 client.5664 fetch_fsmap learned FSMap version 28 2023-10-06T04:37:45.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.361+0000 7ff8b2dd9b80 1 -- 172.21.15.8:0/488647170 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x55f79cc5ffe0 con 0x55f79cefbe60 2023-10-06T04:37:45.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.361+0000 7ff881ffb700 1 -- 172.21.15.8:0/488647170 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f79cec7690 con 0x55f79cefbe60 2023-10-06T04:37:45.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.361+0000 7ff881ffb700 1 -- 172.21.15.8:0/488647170 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 28) v1 ==== 3659+0+0 (secure 0 0 0) 0x7ff898015cb0 con 0x55f79cefbe60 2023-10-06T04:37:45.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.361+0000 7ff8b2dd9b80 10 client.5664 fetch_fsmap finished waiting for FSMap version 28 2023-10-06T04:37:45.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.361+0000 7ff8b2dd9b80 10 client.5664 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T04:37:45.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.361+0000 7ff8b2dd9b80 20 client.5664 populate_metadata read hostname 'smithi008' 2023-10-06T04:37:45.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.361+0000 7ff8b2dd9b80 1 --2- 172.21.15.8:0/488647170 >> [v2:172.21.15.8:6833/1173304661,v1:172.21.15.8:6835/1173304661] conn(0x55f79cefa510 0x55f79cefa8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.361+0000 7ff8b2dd9b80 4 client.5664 mds_command: new command op to 5361 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T04:37:45.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.361+0000 7ff8b2dd9b80 1 -- 172.21.15.8:0/488647170 --> [v2:172.21.15.8:6833/1173304661,v1:172.21.15.8:6835/1173304661] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f79cea45c0 con 0x55f79cefa510 2023-10-06T04:37:45.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.361+0000 7ff8a37fe700 1 --2- 172.21.15.8:0/488647170 >> [v2:172.21.15.8:6833/1173304661,v1:172.21.15.8:6835/1173304661] conn(0x55f79cefa510 0x55f79cefa8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.361+0000 7ff881ffb700 10 client.5664 ms_handle_connect on v2:172.21.15.8:6833/1173304661 2023-10-06T04:37:45.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.361+0000 7ff8a37fe700 1 --2- 172.21.15.8:0/488647170 >> [v2:172.21.15.8:6833/1173304661,v1:172.21.15.8:6835/1173304661] conn(0x55f79cefa510 0x55f79cefa8e0 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfd4aba1c75054ca server_cookie=2c5b2dee7add033d in_seq=0 out_seq=0 2023-10-06T04:37:45.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.362+0000 7ff881ffb700 1 -- 172.21.15.8:0/488647170 <== mds.0 v2:172.21.15.8:6833/1173304661 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55f79cea45c0 con 0x55f79cefa510 2023-10-06T04:37:45.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.362+0000 7ff881ffb700 10 client.5664 handle_command_reply: tid=0 2023-10-06T04:37:45.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.362+0000 7ff8b2dd9b80 1 client.5664 shutdown 2023-10-06T04:37:45.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.362+0000 7ff8b2dd9b80 1 -- 172.21.15.8:0/488647170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f79cefbe60 msgr2=0x55f79cf16b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:45.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.362+0000 7ff8b2dd9b80 1 --2- 172.21.15.8:0/488647170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f79cefbe60 0x55f79cf16b20 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff8a40cd100 tx=0x7ff898016000 comp rx=0 tx=0).stop 2023-10-06T04:37:45.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.362+0000 7ff8b2dd9b80 1 -- 172.21.15.8:0/488647170 shutdown_connections 2023-10-06T04:37:45.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.362+0000 7ff8b2dd9b80 1 --2- 172.21.15.8:0/488647170 >> [v2:172.21.15.8:6833/1173304661,v1:172.21.15.8:6835/1173304661] conn(0x55f79cefa510 0x55f79cefa8e0 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.362+0000 7ff8b2dd9b80 1 --2- 172.21.15.8:0/488647170 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f79cf1cbc0 0x55f79cec91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.362+0000 7ff8b2dd9b80 1 --2- 172.21.15.8:0/488647170 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f79ced2950 0x55f79cf129f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.362+0000 7ff8b2dd9b80 1 --2- 172.21.15.8:0/488647170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f79cefbe60 0x55f79cf16b20 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.362+0000 7ff881ffb700 0 client.5664 ms_handle_reset on v2:172.21.15.8:6833/1173304661 2023-10-06T04:37:45.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.362+0000 7ff8b2dd9b80 1 -- 172.21.15.8:0/488647170 >> 172.21.15.8:0/488647170 conn(0x55f79ced4270 msgr2=0x55f79cf184a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:45.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.362+0000 7ff8b2dd9b80 1 -- 172.21.15.8:0/488647170 shutdown_connections 2023-10-06T04:37:45.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.362+0000 7ff8b2dd9b80 1 -- 172.21.15.8:0/488647170 wait complete. 2023-10-06T04:37:45.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.362+0000 7ff8b2dd9b80 20 client.5664 trim_cache size 0 max 16384 2023-10-06T04:37:45.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.379+0000 7ff8b2dd9b80 1 Processor -- start 2023-10-06T04:37:45.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.379+0000 7ff8b2dd9b80 1 -- start start 2023-10-06T04:37:45.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.380+0000 7ff8b2dd9b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f79ced2950 0x55f79cf10ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.380+0000 7ff8b2dd9b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f79cefbe60 0x55f79cf02260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.380+0000 7ff8b2dd9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f79cf1cbc0 0x55f79cf027a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.380+0000 7ff8b2dd9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f79cca5e30 con 0x55f79cf1cbc0 2023-10-06T04:37:45.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.380+0000 7ff8b2dd9b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f79cf28b90 con 0x55f79ced2950 2023-10-06T04:37:45.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.380+0000 7ff8b2dd9b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f79cec91a0 con 0x55f79cefbe60 2023-10-06T04:37:45.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.380+0000 7ff8a3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f79cf1cbc0 0x55f79cf027a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.380+0000 7ff8a3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f79cf1cbc0 0x55f79cf027a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42424/0 (socket says 172.21.15.8:42424) 2023-10-06T04:37:45.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.380+0000 7ff8a3fff700 1 -- 172.21.15.8:0/3756092066 learned_addr learned my addr 172.21.15.8:0/3756092066 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:45.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.380+0000 7ff8a2ffd700 1 --2- 172.21.15.8:0/3756092066 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f79cefbe60 0x55f79cf02260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.380+0000 7ff8a37fe700 1 --2- 172.21.15.8:0/3756092066 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f79ced2950 0x55f79cf10ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.380+0000 7ff8a3fff700 1 -- 172.21.15.8:0/3756092066 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f79cefbe60 msgr2=0x55f79cf02260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:45.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.380+0000 7ff8a3fff700 1 --2- 172.21.15.8:0/3756092066 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f79cefbe60 0x55f79cf02260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.380+0000 7ff8a3fff700 1 -- 172.21.15.8:0/3756092066 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f79ced2950 msgr2=0x55f79cf10ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:45.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.380+0000 7ff8a3fff700 1 --2- 172.21.15.8:0/3756092066 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f79ced2950 0x55f79cf10ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.380+0000 7ff8a3fff700 1 -- 172.21.15.8:0/3756092066 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f79cdf1780 con 0x55f79cf1cbc0 2023-10-06T04:37:45.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.380+0000 7ff8a3fff700 1 --2- 172.21.15.8:0/3756092066 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f79cf1cbc0 0x55f79cf027a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff89c001f60 tx=0x7ff89c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=458f4f10f0e3dbdd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:45.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.380+0000 7ff8897fa700 1 -- 172.21.15.8:0/3756092066 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c004d20 con 0x55f79cf1cbc0 2023-10-06T04:37:45.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.381+0000 7ff8897fa700 1 -- 172.21.15.8:0/3756092066 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89c007a90 con 0x55f79cf1cbc0 2023-10-06T04:37:45.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.381+0000 7ff8897fa700 1 -- 172.21.15.8:0/3756092066 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c015650 con 0x55f79cf1cbc0 2023-10-06T04:37:45.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.381+0000 7ff8b2dd9b80 1 -- 172.21.15.8:0/3756092066 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f79cf1cbc0 msgr2=0x55f79cf027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:45.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.381+0000 7ff8b2dd9b80 1 --2- 172.21.15.8:0/3756092066 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f79cf1cbc0 0x55f79cf027a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff89c001f60 tx=0x7ff89c009040 comp rx=0 tx=0).stop 2023-10-06T04:37:45.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.381+0000 7ff8b2dd9b80 1 -- 172.21.15.8:0/3756092066 shutdown_connections 2023-10-06T04:37:45.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.381+0000 7ff8b2dd9b80 1 --2- 172.21.15.8:0/3756092066 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f79cf1cbc0 0x55f79cf027a0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.381+0000 7ff8b2dd9b80 1 --2- 172.21.15.8:0/3756092066 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f79ced2950 0x55f79cf10ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.381+0000 7ff8b2dd9b80 1 --2- 172.21.15.8:0/3756092066 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f79cefbe60 0x55f79cf02260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.381+0000 7ff8b2dd9b80 1 -- 172.21.15.8:0/3756092066 >> 172.21.15.8:0/3756092066 conn(0x55f79ced4270 msgr2=0x55f79cefa8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:45.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.381+0000 7ff8b2dd9b80 1 -- 172.21.15.8:0/3756092066 shutdown_connections 2023-10-06T04:37:45.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.381+0000 7ff8b2dd9b80 1 -- 172.21.15.8:0/3756092066 wait complete. 2023-10-06T04:37:45.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.382+0000 7ff8b2dd9b80 1 -- start start 2023-10-06T04:37:45.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.382+0000 7ff8b2dd9b80 1 Processor -- start 2023-10-06T04:37:45.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.382+0000 7ff8b2dd9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f79ced2950 0x55f79cef7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.382+0000 7ff8b2dd9b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f79cefbe60 0x55f79cefb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.382+0000 7ff8b2dd9b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f79cf1cbc0 0x55f79cefb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.382+0000 7ff8b2dd9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f79cf80520 con 0x55f79ced2950 2023-10-06T04:37:45.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.382+0000 7ff8b2dd9b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f79cf1da30 con 0x55f79cf1cbc0 2023-10-06T04:37:45.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.382+0000 7ff8b2dd9b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f79cf15060 con 0x55f79cefbe60 2023-10-06T04:37:45.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.383+0000 7ff8b2dd9b80 10 client.0 _ll_register_callbacks cb 0x55f79ccbff30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:37:45.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.383+0000 7ff8a37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f79ced2950 0x55f79cef7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.383+0000 7ff8a37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f79ced2950 0x55f79cef7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42438/0 (socket says 172.21.15.8:42438) 2023-10-06T04:37:45.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.383+0000 7ff8a37fe700 1 -- 172.21.15.8:0/3606259481 learned_addr learned my addr 172.21.15.8:0/3606259481 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:45.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.383+0000 7ff8a3fff700 1 --2- 172.21.15.8:0/3606259481 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f79cf1cbc0 0x55f79cefb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.383+0000 7ff8a2ffd700 1 --2- 172.21.15.8:0/3606259481 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f79cefbe60 0x55f79cefb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.383+0000 7ff8a37fe700 1 -- 172.21.15.8:0/3606259481 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f79cefbe60 msgr2=0x55f79cefb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:45.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.383+0000 7ff8a37fe700 1 --2- 172.21.15.8:0/3606259481 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f79cefbe60 0x55f79cefb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.383+0000 7ff8a37fe700 1 -- 172.21.15.8:0/3606259481 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f79cf1cbc0 msgr2=0x55f79cefb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:45.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.383+0000 7ff8a37fe700 1 --2- 172.21.15.8:0/3606259481 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f79cf1cbc0 0x55f79cefb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.383+0000 7ff8a37fe700 1 -- 172.21.15.8:0/3606259481 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff89c001cc0 con 0x55f79ced2950 2023-10-06T04:37:45.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.383+0000 7ff8a37fe700 1 --2- 172.21.15.8:0/3606259481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f79ced2950 0x55f79cef7bf0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ff8940844c0 tx=0x7ff89401e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c34978670e56c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:45.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.383+0000 7ff881ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T04:37:45.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.383+0000 7ff881ffb700 1 -- 172.21.15.8:0/3606259481 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff894071070 con 0x55f79ced2950 2023-10-06T04:37:45.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.383+0000 7ff881ffb700 1 -- 172.21.15.8:0/3606259481 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7ff894011e40 con 0x55f79ced2950 2023-10-06T04:37:45.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.383+0000 7ff8b2dd9b80 1 -- 172.21.15.8:0/3606259481 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff894056df0 con 0x55f79ced2950 2023-10-06T04:37:45.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.383+0000 7ff881ffb700 1 -- 172.21.15.8:0/3606259481 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff89405a040 con 0x55f79ced2950 2023-10-06T04:37:45.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.383+0000 7ff8b2dd9b80 10 client.5670 fetch_fsmap learned FSMap version 28 2023-10-06T04:37:45.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.383+0000 7ff8b2dd9b80 1 -- 172.21.15.8:0/3606259481 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x55f79cdd8470 con 0x55f79ced2950 2023-10-06T04:37:45.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.383+0000 7ff881ffb700 1 -- 172.21.15.8:0/3606259481 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff894056df0 con 0x55f79ced2950 2023-10-06T04:37:45.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.383+0000 7ff881ffb700 1 -- 172.21.15.8:0/3606259481 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 28) v1 ==== 3659+0+0 (secure 0 0 0) 0x7ff8940562e0 con 0x55f79ced2950 2023-10-06T04:37:45.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.384+0000 7ff8b2dd9b80 10 client.5670 fetch_fsmap finished waiting for FSMap version 28 2023-10-06T04:37:45.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.384+0000 7ff8b2dd9b80 10 client.5670 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T04:37:45.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.384+0000 7ff8b2dd9b80 20 client.5670 populate_metadata read hostname 'smithi008' 2023-10-06T04:37:45.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.384+0000 7ff8b2dd9b80 1 --2- 172.21.15.8:0/3606259481 >> [v2:172.21.15.8:6833/1173304661,v1:172.21.15.8:6835/1173304661] conn(0x55f79cf7f5c0 0x55f79cf7f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.384+0000 7ff8b2dd9b80 4 client.5670 mds_command: new command op to 5361 tid=0[{"prefix": "status"}] 2023-10-06T04:37:45.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.384+0000 7ff8b2dd9b80 1 -- 172.21.15.8:0/3606259481 --> [v2:172.21.15.8:6833/1173304661,v1:172.21.15.8:6835/1173304661] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f79cdc5e00 con 0x55f79cf7f5c0 2023-10-06T04:37:45.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.384+0000 7ff8a2ffd700 1 --2- 172.21.15.8:0/3606259481 >> [v2:172.21.15.8:6833/1173304661,v1:172.21.15.8:6835/1173304661] conn(0x55f79cf7f5c0 0x55f79cf7f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.384+0000 7ff881ffb700 10 client.5670 ms_handle_connect on v2:172.21.15.8:6833/1173304661 2023-10-06T04:37:45.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.384+0000 7ff8a2ffd700 1 --2- 172.21.15.8:0/3606259481 >> [v2:172.21.15.8:6833/1173304661,v1:172.21.15.8:6835/1173304661] conn(0x55f79cf7f5c0 0x55f79cf7f990 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=210f4cb362ac69f3 server_cookie=63df62b5ae1717a7 in_seq=0 out_seq=0 2023-10-06T04:37:45.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.384+0000 7ff881ffb700 1 -- 172.21.15.8:0/3606259481 <== mds.0 v2:172.21.15.8:6833/1173304661 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55f79cdc5e00 con 0x55f79cf7f5c0 2023-10-06T04:37:45.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.384+0000 7ff881ffb700 10 client.5670 handle_command_reply: tid=0 2023-10-06T04:37:45.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.384+0000 7ff8b2dd9b80 1 client.5670 shutdown 2023-10-06T04:37:45.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.384+0000 7ff8b2dd9b80 1 -- 172.21.15.8:0/3606259481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f79ced2950 msgr2=0x55f79cef7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:45.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.384+0000 7ff8b2dd9b80 1 --2- 172.21.15.8:0/3606259481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f79ced2950 0x55f79cef7bf0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ff8940844c0 tx=0x7ff89401e040 comp rx=0 tx=0).stop 2023-10-06T04:37:45.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.384+0000 7ff8b2dd9b80 1 -- 172.21.15.8:0/3606259481 shutdown_connections 2023-10-06T04:37:45.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.384+0000 7ff8b2dd9b80 1 --2- 172.21.15.8:0/3606259481 >> [v2:172.21.15.8:6833/1173304661,v1:172.21.15.8:6835/1173304661] conn(0x55f79cf7f5c0 0x55f79cf7f990 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.384+0000 7ff8b2dd9b80 1 --2- 172.21.15.8:0/3606259481 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f79cf1cbc0 0x55f79cefb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.384+0000 7ff881ffb700 0 client.5670 ms_handle_reset on v2:172.21.15.8:6833/1173304661 2023-10-06T04:37:45.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.384+0000 7ff8b2dd9b80 1 --2- 172.21.15.8:0/3606259481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f79ced2950 0x55f79cef7bf0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.384+0000 7ff8b2dd9b80 1 --2- 172.21.15.8:0/3606259481 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f79cefbe60 0x55f79cefb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.384+0000 7ff8b2dd9b80 1 -- 172.21.15.8:0/3606259481 >> 172.21.15.8:0/3606259481 conn(0x55f79ced4270 msgr2=0x55f79cf16b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:45.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.384+0000 7ff8b2dd9b80 1 -- 172.21.15.8:0/3606259481 shutdown_connections 2023-10-06T04:37:45.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.385+0000 7ff8b2dd9b80 1 -- 172.21.15.8:0/3606259481 wait complete. 2023-10-06T04:37:45.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.385+0000 7ff8b2dd9b80 20 client.5670 trim_cache size 0 max 16384 2023-10-06T04:37:45.393 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T04:37:45.393 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "c030d94d-df8f-49bb-8df7-07e9e557d96b", 2023-10-06T04:37:45.393 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 0, 2023-10-06T04:37:45.393 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 5361, 2023-10-06T04:37:45.394 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-10-06T04:37:45.394 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-10-06T04:37:45.394 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "recovery_fs", 2023-10-06T04:37:45.394 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 4.5647712970000001, 2023-10-06T04:37:45.394 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 28, 2023-10-06T04:37:45.394 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 46, 2023-10-06T04:37:45.394 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 46, 2023-10-06T04:37:45.394 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 18.964225705 2023-10-06T04:37:45.394 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T04:37:45.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.385+0000 7ff8a887f700 1 -- 172.21.15.8:0/1911656445 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff890066f30 msgr2=0x7ff8900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:45.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.385+0000 7ff8a887f700 1 --2- 172.21.15.8:0/1911656445 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff890066f30 0x7ff8900693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff898006f00 tx=0x7ff898008040 comp rx=0 tx=0).stop 2023-10-06T04:37:45.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.385+0000 7ff8a887f700 1 -- 172.21.15.8:0/1911656445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8a40b1c70 msgr2=0x7ff8a40c5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:45.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.385+0000 7ff8a887f700 1 --2- 172.21.15.8:0/1911656445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8a40b1c70 0x7ff8a40c5040 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4067f00 tx=0x7ff894017000 comp rx=0 tx=0).stop 2023-10-06T04:37:45.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.385+0000 7ff8a887f700 1 -- 172.21.15.8:0/1911656445 shutdown_connections 2023-10-06T04:37:45.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.385+0000 7ff8a887f700 1 --2- 172.21.15.8:0/1911656445 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff890066f30 0x7ff8900693e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.385+0000 7ff8a887f700 1 --2- 172.21.15.8:0/1911656445 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff8a415ad80 0x7ff8a40c6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.385+0000 7ff8a887f700 1 --2- 172.21.15.8:0/1911656445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8a40b1c70 0x7ff8a40c5040 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.385+0000 7ff8a887f700 1 --2- 172.21.15.8:0/1911656445 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff8a4156e30 0x7ff8a40c5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.385+0000 7ff8a887f700 1 -- 172.21.15.8:0/1911656445 >> 172.21.15.8:0/1911656445 conn(0x7ff8a406ed00 msgr2=0x7ff8a4153c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:45.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.385+0000 7ff8a887f700 1 -- 172.21.15.8:0/1911656445 shutdown_connections 2023-10-06T04:37:45.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.385+0000 7ff8a887f700 1 -- 172.21.15.8:0/1911656445 wait complete. 2023-10-06T04:37:45.398 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds debug_mds 20 2023-10-06T04:37:45.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.518+0000 7f9ab0f81700 1 Processor -- start 2023-10-06T04:37:45.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.518+0000 7f9ab0f81700 1 -- start start 2023-10-06T04:37:45.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.519+0000 7f9ab0f81700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9aac142cf0 0x7f9aac0b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.519+0000 7f9ab0f81700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9aac1430c0 0x7f9aac0cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.519+0000 7f9ab0f81700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9aac0cfee0 0x7f9aac0b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.519+0000 7f9ab0f81700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aac0cf510 con 0x7f9aac142cf0 2023-10-06T04:37:45.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.519+0000 7f9ab0f81700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aac0ce6a0 con 0x7f9aac0cfee0 2023-10-06T04:37:45.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.519+0000 7f9ab0f81700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac0ce900 con 0x7f9aac1430c0 2023-10-06T04:37:45.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.519+0000 7f9aaa59c700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9aac142cf0 0x7f9aac0b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.520+0000 7f9aaa59c700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9aac142cf0 0x7f9aac0b5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42450/0 (socket says 172.21.15.8:42450) 2023-10-06T04:37:45.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.520+0000 7f9aaa59c700 1 -- 172.21.15.8:0/3470383931 learned_addr learned my addr 172.21.15.8:0/3470383931 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:45.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.520+0000 7f9aa9d9b700 1 --2- 172.21.15.8:0/3470383931 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9aac1430c0 0x7f9aac0cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.520+0000 7f9aaad9d700 1 --2- 172.21.15.8:0/3470383931 >> v2:172.21.15.184:3300/0 conn(0x7f9aac0cfee0 0x7f9aac0b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.520+0000 7f9aaa59c700 1 -- 172.21.15.8:0/3470383931 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9aac1430c0 msgr2=0x7f9aac0cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:45.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.520+0000 7f9aaa59c700 1 --2- 172.21.15.8:0/3470383931 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9aac1430c0 0x7f9aac0cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.520+0000 7f9aaa59c700 1 -- 172.21.15.8:0/3470383931 >> v2:172.21.15.184:3300/0 conn(0x7f9aac0cfee0 msgr2=0x7f9aac0b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:45.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.520+0000 7f9aaa59c700 1 --2- 172.21.15.8:0/3470383931 >> v2:172.21.15.184:3300/0 conn(0x7f9aac0cfee0 0x7f9aac0b3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.520+0000 7f9aaa59c700 1 -- 172.21.15.8:0/3470383931 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aac0cebe0 con 0x7f9aac142cf0 2023-10-06T04:37:45.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.520+0000 7f9aaad9d700 1 --2- 172.21.15.8:0/3470383931 >> v2:172.21.15.184:3300/0 conn(0x7f9aac0cfee0 0x7f9aac0b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:45.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.520+0000 7f9aa9d9b700 1 --2- 172.21.15.8:0/3470383931 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9aac1430c0 0x7f9aac0cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:45.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.520+0000 7f9aaa59c700 1 --2- 172.21.15.8:0/3470383931 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9aac142cf0 0x7f9aac0b5cd0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9aac06fc80 tx=0x7f9aa4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3980d0dd8a1f3bd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:45.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.520+0000 7f9aa959a700 1 -- 172.21.15.8:0/3470383931 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa400b860 con 0x7f9aac142cf0 2023-10-06T04:37:45.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.520+0000 7f9aa959a700 1 -- 172.21.15.8:0/3470383931 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa400b9c0 con 0x7f9aac142cf0 2023-10-06T04:37:45.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.520+0000 7f9aa959a700 1 -- 172.21.15.8:0/3470383931 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa400bd60 con 0x7f9aac142cf0 2023-10-06T04:37:45.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.521+0000 7f9ab0f81700 1 -- 172.21.15.8:0/3470383931 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9aac142cf0 msgr2=0x7f9aac0b5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:45.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.521+0000 7f9ab0f81700 1 --2- 172.21.15.8:0/3470383931 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9aac142cf0 0x7f9aac0b5cd0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9aac06fc80 tx=0x7f9aa4009250 comp rx=0 tx=0).stop 2023-10-06T04:37:45.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.521+0000 7f9ab0f81700 1 -- 172.21.15.8:0/3470383931 shutdown_connections 2023-10-06T04:37:45.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.521+0000 7f9ab0f81700 1 --2- 172.21.15.8:0/3470383931 >> v2:172.21.15.184:3300/0 conn(0x7f9aac0cfee0 0x7f9aac0b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.521+0000 7f9ab0f81700 1 --2- 172.21.15.8:0/3470383931 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9aac142cf0 0x7f9aac0b5cd0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.521+0000 7f9ab0f81700 1 --2- 172.21.15.8:0/3470383931 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9aac1430c0 0x7f9aac0cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.521+0000 7f9ab0f81700 1 -- 172.21.15.8:0/3470383931 >> 172.21.15.8:0/3470383931 conn(0x7f9aac06ed00 msgr2=0x7f9aac06f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:45.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.521+0000 7f9ab0f81700 1 -- 172.21.15.8:0/3470383931 shutdown_connections 2023-10-06T04:37:45.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.521+0000 7f9ab0f81700 1 -- 172.21.15.8:0/3470383931 wait complete. 2023-10-06T04:37:45.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.522+0000 7f9ab0f81700 1 Processor -- start 2023-10-06T04:37:45.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.522+0000 7f9ab0f81700 1 -- start start 2023-10-06T04:37:45.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.523+0000 7f9ab0f81700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9aac0cfee0 0x7f9aac15da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.523+0000 7f9ab0f81700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9aac142cf0 0x7f9aac140740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.523+0000 7f9ab0f81700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9aac1430c0 0x7f9aac140c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.523+0000 7f9ab0f81700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac169650 con 0x7f9aac1430c0 2023-10-06T04:37:45.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.523+0000 7f9ab0f81700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac15c260 con 0x7f9aac0cfee0 2023-10-06T04:37:45.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.523+0000 7f9ab0f81700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac15c540 con 0x7f9aac142cf0 2023-10-06T04:37:45.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.523+0000 7f9aaad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9aac1430c0 0x7f9aac140c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.523+0000 7f9aaad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9aac1430c0 0x7f9aac140c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42452/0 (socket says 172.21.15.8:42452) 2023-10-06T04:37:45.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.523+0000 7f9aaad9d700 1 -- 172.21.15.8:0/122202548 learned_addr learned my addr 172.21.15.8:0/122202548 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:45.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.523+0000 7f9aaa59c700 1 --2- 172.21.15.8:0/122202548 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9aac0cfee0 0x7f9aac15da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.523+0000 7f9aa9d9b700 1 --2- 172.21.15.8:0/122202548 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9aac142cf0 0x7f9aac140740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.523+0000 7f9aaad9d700 1 -- 172.21.15.8:0/122202548 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9aac142cf0 msgr2=0x7f9aac140740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:45.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.523+0000 7f9aaad9d700 1 --2- 172.21.15.8:0/122202548 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9aac142cf0 0x7f9aac140740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.523+0000 7f9aaad9d700 1 -- 172.21.15.8:0/122202548 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9aac0cfee0 msgr2=0x7f9aac15da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:45.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.523+0000 7f9aaad9d700 1 --2- 172.21.15.8:0/122202548 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9aac0cfee0 0x7f9aac15da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.523+0000 7f9aaad9d700 1 -- 172.21.15.8:0/122202548 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa40094f0 con 0x7f9aac1430c0 2023-10-06T04:37:45.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.523+0000 7f9aaa59c700 1 --2- 172.21.15.8:0/122202548 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9aac0cfee0 0x7f9aac15da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:45.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.523+0000 7f9aaad9d700 1 --2- 172.21.15.8:0/122202548 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9aac1430c0 0x7f9aac140c80 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c00cfb0 tx=0x7f9a9c007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:45.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.523+0000 7f9aa27fc700 1 -- 172.21.15.8:0/122202548 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c015440 con 0x7f9aac1430c0 2023-10-06T04:37:45.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.523+0000 7f9aa27fc700 1 -- 172.21.15.8:0/122202548 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9c0155a0 con 0x7f9aac1430c0 2023-10-06T04:37:45.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.523+0000 7f9ab0f81700 1 -- 172.21.15.8:0/122202548 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aac15c820 con 0x7f9aac1430c0 2023-10-06T04:37:45.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.523+0000 7f9aa27fc700 1 -- 172.21.15.8:0/122202548 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c015960 con 0x7f9aac1430c0 2023-10-06T04:37:45.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.523+0000 7f9ab0f81700 1 -- 172.21.15.8:0/122202548 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aac15b4e0 con 0x7f9aac1430c0 2023-10-06T04:37:45.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.525+0000 7f9ab0f81700 1 -- 172.21.15.8:0/122202548 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aac169800 con 0x7f9aac1430c0 2023-10-06T04:37:45.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.525+0000 7f9aa27fc700 1 -- 172.21.15.8:0/122202548 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9a9c003020 con 0x7f9aac1430c0 2023-10-06T04:37:45.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.525+0000 7f9aa27fc700 1 --2- 172.21.15.8:0/122202548 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9a8c066f30 0x7f9a8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.525+0000 7f9aa27fc700 1 -- 172.21.15.8:0/122202548 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7f9a9c0850b0 con 0x7f9aac1430c0 2023-10-06T04:37:45.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.526+0000 7f9aaa59c700 1 --2- 172.21.15.8:0/122202548 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9a8c066f30 0x7f9a8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.526+0000 7f9aaa59c700 1 --2- 172.21.15.8:0/122202548 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9a8c066f30 0x7f9a8c0693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9aac06fc80 tx=0x7f9aa4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:45.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.530+0000 7f9aa27fc700 1 -- 172.21.15.8:0/122202548 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a9c04d5a0 con 0x7f9aac1430c0 2023-10-06T04:37:45.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.721+0000 7f9ab0f81700 1 -- 172.21.15.8:0/122202548 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) v1 -- 0x7f9aac15ca10 con 0x7f9aac1430c0 2023-10-06T04:37:45.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.725+0000 7f9aa27fc700 1 -- 172.21.15.8:0/122202548 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v11)=0 v11) v1 ==== 108+0+0 (secure 0 0 0) 0x7f9a9c0558f0 con 0x7f9aac1430c0 2023-10-06T04:37:45.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.727+0000 7f9ab0f81700 1 -- 172.21.15.8:0/122202548 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9a8c066f30 msgr2=0x7f9a8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:45.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.727+0000 7f9ab0f81700 1 --2- 172.21.15.8:0/122202548 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9a8c066f30 0x7f9a8c0693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9aac06fc80 tx=0x7f9aa4017000 comp rx=0 tx=0).stop 2023-10-06T04:37:45.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.727+0000 7f9ab0f81700 1 -- 172.21.15.8:0/122202548 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9aac1430c0 msgr2=0x7f9aac140c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:45.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.727+0000 7f9ab0f81700 1 --2- 172.21.15.8:0/122202548 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9aac1430c0 0x7f9aac140c80 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c00cfb0 tx=0x7f9a9c007860 comp rx=0 tx=0).stop 2023-10-06T04:37:45.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.727+0000 7f9ab0f81700 1 -- 172.21.15.8:0/122202548 shutdown_connections 2023-10-06T04:37:45.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.727+0000 7f9ab0f81700 1 --2- 172.21.15.8:0/122202548 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9a8c066f30 0x7f9a8c0693e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.727+0000 7f9ab0f81700 1 --2- 172.21.15.8:0/122202548 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9aac1430c0 0x7f9aac140c80 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.727+0000 7f9ab0f81700 1 --2- 172.21.15.8:0/122202548 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9aac0cfee0 0x7f9aac15da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.727+0000 7f9ab0f81700 1 --2- 172.21.15.8:0/122202548 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9aac142cf0 0x7f9aac140740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.727+0000 7f9ab0f81700 1 -- 172.21.15.8:0/122202548 >> 172.21.15.8:0/122202548 conn(0x7f9aac06ed00 msgr2=0x7f9aac0b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:45.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.727+0000 7f9ab0f81700 1 -- 172.21.15.8:0/122202548 shutdown_connections 2023-10-06T04:37:45.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.727+0000 7f9ab0f81700 1 -- 172.21.15.8:0/122202548 wait complete. 2023-10-06T04:37:45.740 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / force,recursive,repair 2023-10-06T04:37:45.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.863+0000 7fc1526d1700 1 Processor -- start 2023-10-06T04:37:45.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.863+0000 7fc1526d1700 1 -- start start 2023-10-06T04:37:45.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.864+0000 7fc1526d1700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc14c0ce600 0x7fc14c15db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.864+0000 7fc1526d1700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc14c069720 0x7fc14c069bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.864+0000 7fc1526d1700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc14c0cf680 con 0x7fc14c0af530 2023-10-06T04:37:45.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.864+0000 7fc1526d1700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc14c06a100 con 0x7fc14c0ce600 2023-10-06T04:37:45.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.864+0000 7fc1526d1700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc14c0cb3f0 con 0x7fc14c069720 2023-10-06T04:37:45.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.864+0000 7fc150ece700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc14c0ce600 0x7fc14c15db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.864+0000 7fc1516cf700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fc14c0af530 0x7fc14c0cfb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60158/0 (socket says 172.21.15.8:60158) 2023-10-06T04:37:45.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.864+0000 7fc1516cf700 1 -- 172.21.15.8:0/4051311407 learned_addr learned my addr 172.21.15.8:0/4051311407 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:45.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.864+0000 7fc151ed0700 1 --2- 172.21.15.8:0/4051311407 >> v2:172.21.15.184:3300/0 conn(0x7fc14c069720 0x7fc14c069bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.864+0000 7fc150ece700 1 -- 172.21.15.8:0/4051311407 >> v2:172.21.15.184:3300/0 conn(0x7fc14c069720 msgr2=0x7fc14c069bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:45.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.864+0000 7fc150ece700 1 --2- 172.21.15.8:0/4051311407 >> v2:172.21.15.184:3300/0 conn(0x7fc14c069720 0x7fc14c069bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.864+0000 7fc150ece700 1 -- 172.21.15.8:0/4051311407 >> v1:172.21.15.8:6789/0 conn(0x7fc14c0af530 legacy=0x7fc14c0cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:45.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.864+0000 7fc143fff700 1 -- 172.21.15.8:0/4051311407 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3502680458 0 0) 0x7fc14c0cf680 con 0x7fc14c0af530 2023-10-06T04:37:45.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.865+0000 7fc150ece700 1 -- 172.21.15.8:0/4051311407 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc14c0cea70 con 0x7fc14c0ce600 2023-10-06T04:37:45.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.865+0000 7fc150ece700 1 --2- 172.21.15.8:0/4051311407 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc14c0ce600 0x7fc14c15db40 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc14c0c72e0 tx=0x7fc13c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70625f96535b6087 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:45.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.865+0000 7fc143fff700 1 -- 172.21.15.8:0/4051311407 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c011630 con 0x7fc14c0ce600 2023-10-06T04:37:45.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.865+0000 7fc143fff700 1 -- 172.21.15.8:0/4051311407 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13c011790 con 0x7fc14c0ce600 2023-10-06T04:37:45.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.865+0000 7fc143fff700 1 -- 172.21.15.8:0/4051311407 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c011b30 con 0x7fc14c0ce600 2023-10-06T04:37:45.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.865+0000 7fc1526d1700 1 -- 172.21.15.8:0/4051311407 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc14c0ce600 msgr2=0x7fc14c15db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:45.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.865+0000 7fc1526d1700 1 --2- 172.21.15.8:0/4051311407 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc14c0ce600 0x7fc14c15db40 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc14c0c72e0 tx=0x7fc13c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.865+0000 7fc1526d1700 1 -- 172.21.15.8:0/4051311407 shutdown_connections 2023-10-06T04:37:45.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.865+0000 7fc1526d1700 1 --2- 172.21.15.8:0/4051311407 >> v2:172.21.15.184:3300/0 conn(0x7fc14c069720 0x7fc14c069bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.865+0000 7fc1526d1700 1 --2- 172.21.15.8:0/4051311407 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc14c0ce600 0x7fc14c15db40 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.865+0000 7fc1526d1700 1 -- 172.21.15.8:0/4051311407 >> 172.21.15.8:0/4051311407 conn(0x7fc14c0d0280 msgr2=0x7fc14c0d0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:45.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.865+0000 7fc1526d1700 1 -- 172.21.15.8:0/4051311407 shutdown_connections 2023-10-06T04:37:45.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.865+0000 7fc1526d1700 1 -- 172.21.15.8:0/4051311407 wait complete. 2023-10-06T04:37:45.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.867+0000 7fc1526d1700 1 Processor -- start 2023-10-06T04:37:45.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.867+0000 7fc1526d1700 1 -- start start 2023-10-06T04:37:45.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.868+0000 7fc1526d1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc14c069720 0x7fc14c15c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.868+0000 7fc1526d1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc14c0af530 0x7fc14c16d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.868+0000 7fc1526d1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc14c0ce600 0x7fc14c14af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.868+0000 7fc1526d1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c15a730 con 0x7fc14c0ce600 2023-10-06T04:37:45.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.868+0000 7fc1526d1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c16df30 con 0x7fc14c069720 2023-10-06T04:37:45.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.868+0000 7fc1526d1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c14b4a0 con 0x7fc14c0af530 2023-10-06T04:37:45.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.868+0000 7fc151ed0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc14c0ce600 0x7fc14c14af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.868+0000 7fc151ed0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc14c0ce600 0x7fc14c14af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42464/0 (socket says 172.21.15.8:42464) 2023-10-06T04:37:45.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.868+0000 7fc151ed0700 1 -- 172.21.15.8:0/2048282392 learned_addr learned my addr 172.21.15.8:0/2048282392 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:45.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.868+0000 7fc1516cf700 1 --2- 172.21.15.8:0/2048282392 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc14c069720 0x7fc14c15c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.868+0000 7fc150ece700 1 --2- 172.21.15.8:0/2048282392 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc14c0af530 0x7fc14c16d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.868+0000 7fc151ed0700 1 -- 172.21.15.8:0/2048282392 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc14c0af530 msgr2=0x7fc14c16d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:45.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.868+0000 7fc151ed0700 1 --2- 172.21.15.8:0/2048282392 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc14c0af530 0x7fc14c16d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.868+0000 7fc151ed0700 1 -- 172.21.15.8:0/2048282392 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc14c069720 msgr2=0x7fc14c15c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:45.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.868+0000 7fc151ed0700 1 --2- 172.21.15.8:0/2048282392 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc14c069720 0x7fc14c15c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.868+0000 7fc151ed0700 1 -- 172.21.15.8:0/2048282392 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc13c009420 con 0x7fc14c0ce600 2023-10-06T04:37:45.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.868+0000 7fc150ece700 1 --2- 172.21.15.8:0/2048282392 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc14c0af530 0x7fc14c16d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:45.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.868+0000 7fc151ed0700 1 --2- 172.21.15.8:0/2048282392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc14c0ce600 0x7fc14c14af60 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc144009df0 tx=0x7fc14400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:45.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.868+0000 7fc1417fa700 1 -- 172.21.15.8:0/2048282392 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14400cb50 con 0x7fc14c0ce600 2023-10-06T04:37:45.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.868+0000 7fc1417fa700 1 -- 172.21.15.8:0/2048282392 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc14400f040 con 0x7fc14c0ce600 2023-10-06T04:37:45.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.868+0000 7fc1526d1700 1 -- 172.21.15.8:0/2048282392 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc14c15c680 con 0x7fc14c0ce600 2023-10-06T04:37:45.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.868+0000 7fc1417fa700 1 -- 172.21.15.8:0/2048282392 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc144014480 con 0x7fc14c0ce600 2023-10-06T04:37:45.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.868+0000 7fc1526d1700 1 -- 172.21.15.8:0/2048282392 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc14c15a0e0 con 0x7fc14c0ce600 2023-10-06T04:37:45.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.870+0000 7fc1417fa700 1 -- 172.21.15.8:0/2048282392 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc144014830 con 0x7fc14c0ce600 2023-10-06T04:37:45.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.870+0000 7fc1417fa700 1 --2- 172.21.15.8:0/2048282392 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc130066f30 0x7fc1300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.870+0000 7fc1417fa700 1 -- 172.21.15.8:0/2048282392 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7fc144085310 con 0x7fc14c0ce600 2023-10-06T04:37:45.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.870+0000 7fc1516cf700 1 --2- 172.21.15.8:0/2048282392 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc130066f30 0x7fc1300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.871+0000 7fc1516cf700 1 --2- 172.21.15.8:0/2048282392 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc130066f30 0x7fc1300693e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc148007fd0 tx=0x7fc148007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:45.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.872+0000 7fc15cc2bb80 1 Processor -- start 2023-10-06T04:37:45.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.872+0000 7fc15cc2bb80 1 -- start start 2023-10-06T04:37:45.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.873+0000 7fc15cc2bb80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563e9e420a40 0x563e9e420e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.873+0000 7fc15cc2bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e9e46acb0 0x563e9e449a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.873+0000 7fc15cc2bb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e9e449f50 0x563e9e41ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.873+0000 7fc15cc2bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e9e3a0d70 con 0x563e9e46acb0 2023-10-06T04:37:45.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.873+0000 7fc15cc2bb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e9e377b60 con 0x563e9e449f50 2023-10-06T04:37:45.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.873+0000 7fc15cc2bb80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x563e9e375360 con 0x563e9e420a40 2023-10-06T04:37:45.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.873+0000 7fc150ece700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e9e46acb0 0x563e9e449a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.873+0000 7fc150ece700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e9e46acb0 0x563e9e449a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42480/0 (socket says 172.21.15.8:42480) 2023-10-06T04:37:45.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.873+0000 7fc150ece700 1 -- 172.21.15.8:0/3516829667 learned_addr learned my addr 172.21.15.8:0/3516829667 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:45.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.873+0000 7fc151ed0700 1 --2- 172.21.15.8:0/3516829667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e9e449f50 0x563e9e41ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.873+0000 7fc1516cf700 1 --2- 172.21.15.8:0/3516829667 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563e9e420a40 0x563e9e420e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.873+0000 7fc150ece700 1 -- 172.21.15.8:0/3516829667 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563e9e420a40 msgr2=0x563e9e420e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:45.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.873+0000 7fc150ece700 1 --2- 172.21.15.8:0/3516829667 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563e9e420a40 0x563e9e420e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.873+0000 7fc150ece700 1 -- 172.21.15.8:0/3516829667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e9e449f50 msgr2=0x563e9e41ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:45.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.873+0000 7fc150ece700 1 --2- 172.21.15.8:0/3516829667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e9e449f50 0x563e9e41ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.873+0000 7fc150ece700 1 -- 172.21.15.8:0/3516829667 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e9e20b360 con 0x563e9e46acb0 2023-10-06T04:37:45.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.873+0000 7fc151ed0700 1 --2- 172.21.15.8:0/3516829667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e9e449f50 0x563e9e41ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:45.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.873+0000 7fc150ece700 1 --2- 172.21.15.8:0/3516829667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e9e46acb0 0x563e9e449a10 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc13c0091e0 tx=0x7fc13c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6474832228c9fd1d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:45.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.873+0000 7fc1367fc700 1 -- 172.21.15.8:0/3516829667 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c020070 con 0x563e9e46acb0 2023-10-06T04:37:45.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.873+0000 7fc1367fc700 1 -- 172.21.15.8:0/3516829667 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13c000d10 con 0x563e9e46acb0 2023-10-06T04:37:45.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.873+0000 7fc1367fc700 1 -- 172.21.15.8:0/3516829667 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c011b30 con 0x563e9e46acb0 2023-10-06T04:37:45.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.874+0000 7fc15cc2bb80 1 -- 172.21.15.8:0/3516829667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e9e46acb0 msgr2=0x563e9e449a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:45.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.874+0000 7fc15cc2bb80 1 --2- 172.21.15.8:0/3516829667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e9e46acb0 0x563e9e449a10 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc13c0091e0 tx=0x7fc13c017000 comp rx=0 tx=0).stop 2023-10-06T04:37:45.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.874+0000 7fc15cc2bb80 1 -- 172.21.15.8:0/3516829667 shutdown_connections 2023-10-06T04:37:45.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.874+0000 7fc15cc2bb80 1 --2- 172.21.15.8:0/3516829667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e9e449f50 0x563e9e41ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.874+0000 7fc15cc2bb80 1 --2- 172.21.15.8:0/3516829667 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563e9e420a40 0x563e9e420e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.874+0000 7fc15cc2bb80 1 --2- 172.21.15.8:0/3516829667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e9e46acb0 0x563e9e449a10 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.874+0000 7fc15cc2bb80 1 -- 172.21.15.8:0/3516829667 >> 172.21.15.8:0/3516829667 conn(0x563e9e422360 msgr2=0x563e9e422730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:45.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.874+0000 7fc15cc2bb80 1 -- 172.21.15.8:0/3516829667 shutdown_connections 2023-10-06T04:37:45.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.874+0000 7fc15cc2bb80 1 -- 172.21.15.8:0/3516829667 wait complete. 2023-10-06T04:37:45.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.875+0000 7fc15cc2bb80 1 -- start start 2023-10-06T04:37:45.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.875+0000 7fc15cc2bb80 1 Processor -- start 2023-10-06T04:37:45.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.876+0000 7fc15cc2bb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e9e420a40 0x563e9e4641c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.876+0000 7fc15cc2bb80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563e9e449f50 0x563e9e4606a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.876+0000 7fc15cc2bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e9e46acb0 0x563e9e477840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.876+0000 7fc15cc2bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e9e371150 con 0x563e9e46acb0 2023-10-06T04:37:45.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.876+0000 7fc15cc2bb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e9e31c980 con 0x563e9e420a40 2023-10-06T04:37:45.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.876+0000 7fc15cc2bb80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x563e9e337f90 con 0x563e9e449f50 2023-10-06T04:37:45.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.876+0000 7fc15cc2bb80 10 client.0 _ll_register_callbacks cb 0x563e9e20e020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:37:45.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.876+0000 7fc151ed0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e9e46acb0 0x563e9e477840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.876+0000 7fc151ed0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e9e46acb0 0x563e9e477840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42484/0 (socket says 172.21.15.8:42484) 2023-10-06T04:37:45.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.876+0000 7fc151ed0700 1 -- 172.21.15.8:0/273537386 learned_addr learned my addr 172.21.15.8:0/273537386 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:45.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.876+0000 7fc1516cf700 1 --2- 172.21.15.8:0/273537386 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e9e420a40 0x563e9e4641c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.876+0000 7fc150ece700 1 --2- 172.21.15.8:0/273537386 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563e9e449f50 0x563e9e4606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.876+0000 7fc151ed0700 1 -- 172.21.15.8:0/273537386 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563e9e449f50 msgr2=0x563e9e4606a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:45.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.876+0000 7fc151ed0700 1 --2- 172.21.15.8:0/273537386 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563e9e449f50 0x563e9e4606a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.876+0000 7fc151ed0700 1 -- 172.21.15.8:0/273537386 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e9e420a40 msgr2=0x563e9e4641c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:45.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.876+0000 7fc151ed0700 1 --2- 172.21.15.8:0/273537386 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e9e420a40 0x563e9e4641c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.876+0000 7fc151ed0700 1 -- 172.21.15.8:0/273537386 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc14c0cea70 con 0x563e9e46acb0 2023-10-06T04:37:45.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.876+0000 7fc151ed0700 1 --2- 172.21.15.8:0/273537386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e9e46acb0 0x563e9e477840 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc144055a80 tx=0x7fc144085040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86272744506b7ace server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:45.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.876+0000 7fc12b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T04:37:45.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.876+0000 7fc12b7fe700 1 -- 172.21.15.8:0/273537386 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14405b0f0 con 0x563e9e46acb0 2023-10-06T04:37:45.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.876+0000 7fc12b7fe700 1 -- 172.21.15.8:0/273537386 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7fc14406c180 con 0x563e9e46acb0 2023-10-06T04:37:45.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.876+0000 7fc15cc2bb80 1 -- 172.21.15.8:0/273537386 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563e9e415780 con 0x563e9e46acb0 2023-10-06T04:37:45.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.876+0000 7fc12b7fe700 1 -- 172.21.15.8:0/273537386 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc144058fd0 con 0x563e9e46acb0 2023-10-06T04:37:45.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.876+0000 7fc15cc2bb80 10 client.5691 fetch_fsmap learned FSMap version 28 2023-10-06T04:37:45.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.876+0000 7fc15cc2bb80 1 -- 172.21.15.8:0/273537386 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x563e9e1ae0d0 con 0x563e9e46acb0 2023-10-06T04:37:45.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.877+0000 7fc12b7fe700 1 -- 172.21.15.8:0/273537386 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563e9e415780 con 0x563e9e46acb0 2023-10-06T04:37:45.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.877+0000 7fc12b7fe700 1 -- 172.21.15.8:0/273537386 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 28) v1 ==== 3659+0+0 (secure 0 0 0) 0x7fc144055270 con 0x563e9e46acb0 2023-10-06T04:37:45.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.877+0000 7fc15cc2bb80 10 client.5691 fetch_fsmap finished waiting for FSMap version 28 2023-10-06T04:37:45.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.877+0000 7fc15cc2bb80 10 client.5691 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2023-10-06T04:37:45.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.877+0000 7fc15cc2bb80 20 client.5691 populate_metadata read hostname 'smithi008' 2023-10-06T04:37:45.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.877+0000 7fc15cc2bb80 1 --2- 172.21.15.8:0/273537386 >> [v2:172.21.15.8:6833/1173304661,v1:172.21.15.8:6835/1173304661] conn(0x563e9e448e50 0x563e9e417290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.877+0000 7fc15cc2bb80 4 client.5691 mds_command: new command op to 5361 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T04:37:45.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.877+0000 7fc15cc2bb80 1 -- 172.21.15.8:0/273537386 --> [v2:172.21.15.8:6833/1173304661,v1:172.21.15.8:6835/1173304661] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563e9e3f26b0 con 0x563e9e448e50 2023-10-06T04:37:45.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.877+0000 7fc1516cf700 1 --2- 172.21.15.8:0/273537386 >> [v2:172.21.15.8:6833/1173304661,v1:172.21.15.8:6835/1173304661] conn(0x563e9e448e50 0x563e9e417290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.877+0000 7fc12b7fe700 10 client.5691 ms_handle_connect on v2:172.21.15.8:6833/1173304661 2023-10-06T04:37:45.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.877+0000 7fc1516cf700 1 --2- 172.21.15.8:0/273537386 >> [v2:172.21.15.8:6833/1173304661,v1:172.21.15.8:6835/1173304661] conn(0x563e9e448e50 0x563e9e417290 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79a4e98e0d30f211 server_cookie=216f209387cb8abb in_seq=0 out_seq=0 2023-10-06T04:37:45.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.878+0000 7fc12b7fe700 1 -- 172.21.15.8:0/273537386 <== mds.0 v2:172.21.15.8:6833/1173304661 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x563e9e3f26b0 con 0x563e9e448e50 2023-10-06T04:37:45.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.878+0000 7fc12b7fe700 10 client.5691 handle_command_reply: tid=0 2023-10-06T04:37:45.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.878+0000 7fc15cc2bb80 1 client.5691 shutdown 2023-10-06T04:37:45.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.878+0000 7fc15cc2bb80 1 -- 172.21.15.8:0/273537386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e9e46acb0 msgr2=0x563e9e477840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:45.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.878+0000 7fc15cc2bb80 1 --2- 172.21.15.8:0/273537386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e9e46acb0 0x563e9e477840 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc144055a80 tx=0x7fc144085040 comp rx=0 tx=0).stop 2023-10-06T04:37:45.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.878+0000 7fc15cc2bb80 1 -- 172.21.15.8:0/273537386 shutdown_connections 2023-10-06T04:37:45.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.878+0000 7fc15cc2bb80 1 --2- 172.21.15.8:0/273537386 >> [v2:172.21.15.8:6833/1173304661,v1:172.21.15.8:6835/1173304661] conn(0x563e9e448e50 0x563e9e417290 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.878+0000 7fc15cc2bb80 1 --2- 172.21.15.8:0/273537386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e9e46acb0 0x563e9e477840 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.878+0000 7fc15cc2bb80 1 --2- 172.21.15.8:0/273537386 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e9e420a40 0x563e9e4641c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.878+0000 7fc15cc2bb80 1 --2- 172.21.15.8:0/273537386 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563e9e449f50 0x563e9e4606a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.878+0000 7fc15cc2bb80 1 -- 172.21.15.8:0/273537386 >> 172.21.15.8:0/273537386 conn(0x563e9e422360 msgr2=0x563e9e41d190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:45.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.878+0000 7fc12b7fe700 0 client.5691 ms_handle_reset on v2:172.21.15.8:6833/1173304661 2023-10-06T04:37:45.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.878+0000 7fc15cc2bb80 1 -- 172.21.15.8:0/273537386 shutdown_connections 2023-10-06T04:37:45.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.878+0000 7fc15cc2bb80 1 -- 172.21.15.8:0/273537386 wait complete. 2023-10-06T04:37:45.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.878+0000 7fc15cc2bb80 20 client.5691 trim_cache size 0 max 16384 2023-10-06T04:37:45.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.894+0000 7fc15cc2bb80 1 Processor -- start 2023-10-06T04:37:45.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.895+0000 7fc15cc2bb80 1 -- start start 2023-10-06T04:37:45.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.895+0000 7fc15cc2bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e9e420a40 0x563e9e417460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.895+0000 7fc15cc2bb80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563e9e449f50 0x563e9e45d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.895+0000 7fc15cc2bb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e9e46acb0 0x563e9e45da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.895+0000 7fc15cc2bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e9e421e90 con 0x563e9e420a40 2023-10-06T04:37:45.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.895+0000 7fc15cc2bb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e9e1f3f20 con 0x563e9e46acb0 2023-10-06T04:37:45.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.895+0000 7fc15cc2bb80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x563e9e448400 con 0x563e9e449f50 2023-10-06T04:37:45.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.895+0000 7fc1516cf700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e9e420a40 0x563e9e417460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.895+0000 7fc1516cf700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e9e420a40 0x563e9e417460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42490/0 (socket says 172.21.15.8:42490) 2023-10-06T04:37:45.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.895+0000 7fc1516cf700 1 -- 172.21.15.8:0/1938942720 learned_addr learned my addr 172.21.15.8:0/1938942720 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:45.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.896+0000 7fc150ece700 1 --2- 172.21.15.8:0/1938942720 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563e9e449f50 0x563e9e45d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.896+0000 7fc151ed0700 1 --2- 172.21.15.8:0/1938942720 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e9e46acb0 0x563e9e45da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.896+0000 7fc1516cf700 1 -- 172.21.15.8:0/1938942720 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563e9e449f50 msgr2=0x563e9e45d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:45.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.896+0000 7fc1516cf700 1 --2- 172.21.15.8:0/1938942720 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563e9e449f50 0x563e9e45d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.896+0000 7fc1516cf700 1 -- 172.21.15.8:0/1938942720 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e9e46acb0 msgr2=0x563e9e45da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:45.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.896+0000 7fc1516cf700 1 --2- 172.21.15.8:0/1938942720 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e9e46acb0 0x563e9e45da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.896+0000 7fc1516cf700 1 -- 172.21.15.8:0/1938942720 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e9e33f870 con 0x563e9e420a40 2023-10-06T04:37:45.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.896+0000 7fc1516cf700 1 --2- 172.21.15.8:0/1938942720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e9e420a40 0x563e9e417460 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc148006a60 tx=0x7fc148014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49acc95336f8fd29 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:45.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.896+0000 7fc136ffd700 1 -- 172.21.15.8:0/1938942720 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1480247c0 con 0x563e9e420a40 2023-10-06T04:37:45.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.896+0000 7fc136ffd700 1 -- 172.21.15.8:0/1938942720 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc148024920 con 0x563e9e420a40 2023-10-06T04:37:45.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.896+0000 7fc136ffd700 1 -- 172.21.15.8:0/1938942720 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc148024cc0 con 0x563e9e420a40 2023-10-06T04:37:45.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.896+0000 7fc15cc2bb80 1 -- 172.21.15.8:0/1938942720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e9e420a40 msgr2=0x563e9e417460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:45.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.896+0000 7fc15cc2bb80 1 --2- 172.21.15.8:0/1938942720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e9e420a40 0x563e9e417460 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc148006a60 tx=0x7fc148014000 comp rx=0 tx=0).stop 2023-10-06T04:37:45.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.896+0000 7fc15cc2bb80 1 -- 172.21.15.8:0/1938942720 shutdown_connections 2023-10-06T04:37:45.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.896+0000 7fc15cc2bb80 1 --2- 172.21.15.8:0/1938942720 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e9e46acb0 0x563e9e45da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.896+0000 7fc15cc2bb80 1 --2- 172.21.15.8:0/1938942720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e9e420a40 0x563e9e417460 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.896+0000 7fc15cc2bb80 1 --2- 172.21.15.8:0/1938942720 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563e9e449f50 0x563e9e45d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.896+0000 7fc15cc2bb80 1 -- 172.21.15.8:0/1938942720 >> 172.21.15.8:0/1938942720 conn(0x563e9e422360 msgr2=0x563e9e4509c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:45.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.897+0000 7fc15cc2bb80 1 -- 172.21.15.8:0/1938942720 shutdown_connections 2023-10-06T04:37:45.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.897+0000 7fc15cc2bb80 1 -- 172.21.15.8:0/1938942720 wait complete. 2023-10-06T04:37:45.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.897+0000 7fc15cc2bb80 1 -- start start 2023-10-06T04:37:45.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.897+0000 7fc15cc2bb80 1 Processor -- start 2023-10-06T04:37:45.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.898+0000 7fc15cc2bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e9e420a40 0x563e9e4c7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.898+0000 7fc15cc2bb80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563e9e449f50 0x563e9e44c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.898+0000 7fc15cc2bb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e9e46acb0 0x563e9e460f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.898+0000 7fc15cc2bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e9e464320 con 0x563e9e420a40 2023-10-06T04:37:45.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.898+0000 7fc15cc2bb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e9e464c60 con 0x563e9e46acb0 2023-10-06T04:37:45.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.898+0000 7fc15cc2bb80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x563e9e44d380 con 0x563e9e449f50 2023-10-06T04:37:45.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.898+0000 7fc15cc2bb80 10 client.0 _ll_register_callbacks cb 0x563e9e476e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:37:45.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.898+0000 7fc1516cf700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e9e420a40 0x563e9e4c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.898+0000 7fc1516cf700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e9e420a40 0x563e9e4c7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42506/0 (socket says 172.21.15.8:42506) 2023-10-06T04:37:45.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.898+0000 7fc1516cf700 1 -- 172.21.15.8:0/2950807559 learned_addr learned my addr 172.21.15.8:0/2950807559 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:45.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.898+0000 7fc150ece700 1 --2- 172.21.15.8:0/2950807559 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563e9e449f50 0x563e9e44c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.898+0000 7fc151ed0700 1 --2- 172.21.15.8:0/2950807559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e9e46acb0 0x563e9e460f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.898+0000 7fc1516cf700 1 -- 172.21.15.8:0/2950807559 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563e9e449f50 msgr2=0x563e9e44c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:45.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.898+0000 7fc1516cf700 1 --2- 172.21.15.8:0/2950807559 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563e9e449f50 0x563e9e44c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.898+0000 7fc1516cf700 1 -- 172.21.15.8:0/2950807559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e9e46acb0 msgr2=0x563e9e460f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:45.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.898+0000 7fc1516cf700 1 --2- 172.21.15.8:0/2950807559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e9e46acb0 0x563e9e460f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.898+0000 7fc1516cf700 1 -- 172.21.15.8:0/2950807559 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc148001980 con 0x563e9e420a40 2023-10-06T04:37:45.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.898+0000 7fc151ed0700 1 --2- 172.21.15.8:0/2950807559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e9e46acb0 0x563e9e460f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:45.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.899+0000 7fc1516cf700 1 --2- 172.21.15.8:0/2950807559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e9e420a40 0x563e9e4c7580 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc14802c000 tx=0x7fc14802d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c68f6a7348f0fa67 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:45.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.899+0000 7fc12b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T04:37:45.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.899+0000 7fc12b7fe700 1 -- 172.21.15.8:0/2950807559 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc148024740 con 0x563e9e420a40 2023-10-06T04:37:45.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.899+0000 7fc15cc2bb80 1 -- 172.21.15.8:0/2950807559 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563e9e41e270 con 0x563e9e420a40 2023-10-06T04:37:45.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.899+0000 7fc12b7fe700 1 -- 172.21.15.8:0/2950807559 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7fc14801c040 con 0x563e9e420a40 2023-10-06T04:37:45.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.899+0000 7fc12b7fe700 1 -- 172.21.15.8:0/2950807559 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc148014a80 con 0x563e9e420a40 2023-10-06T04:37:45.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.899+0000 7fc15cc2bb80 10 client.5697 fetch_fsmap learned FSMap version 28 2023-10-06T04:37:45.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.899+0000 7fc15cc2bb80 1 -- 172.21.15.8:0/2950807559 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x563e9e326560 con 0x563e9e420a40 2023-10-06T04:37:45.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.899+0000 7fc12b7fe700 1 -- 172.21.15.8:0/2950807559 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc148045030 con 0x563e9e420a40 2023-10-06T04:37:45.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.899+0000 7fc12b7fe700 1 -- 172.21.15.8:0/2950807559 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 28) v1 ==== 3659+0+0 (secure 0 0 0) 0x7fc148014be0 con 0x563e9e420a40 2023-10-06T04:37:45.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.899+0000 7fc15cc2bb80 10 client.5697 fetch_fsmap finished waiting for FSMap version 28 2023-10-06T04:37:45.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.899+0000 7fc15cc2bb80 10 client.5697 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2023-10-06T04:37:45.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.899+0000 7fc15cc2bb80 20 client.5697 populate_metadata read hostname 'smithi008' 2023-10-06T04:37:45.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.899+0000 7fc15cc2bb80 1 --2- 172.21.15.8:0/2950807559 >> [v2:172.21.15.8:6833/1173304661,v1:172.21.15.8:6835/1173304661] conn(0x563e9e421590 0x563e9e461470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:45.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.899+0000 7fc15cc2bb80 4 client.5697 mds_command: new command op to 5361 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive", "repair"]}] 2023-10-06T04:37:45.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.899+0000 7fc15cc2bb80 1 -- 172.21.15.8:0/2950807559 --> [v2:172.21.15.8:6833/1173304661,v1:172.21.15.8:6835/1173304661] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive", "repair"]}) v1 -- 0x7fc13c000d10 con 0x563e9e421590 2023-10-06T04:37:45.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.899+0000 7fc150ece700 1 --2- 172.21.15.8:0/2950807559 >> [v2:172.21.15.8:6833/1173304661,v1:172.21.15.8:6835/1173304661] conn(0x563e9e421590 0x563e9e461470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:45.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.900+0000 7fc12b7fe700 10 client.5697 ms_handle_connect on v2:172.21.15.8:6833/1173304661 2023-10-06T04:37:45.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.900+0000 7fc150ece700 1 --2- 172.21.15.8:0/2950807559 >> [v2:172.21.15.8:6833/1173304661,v1:172.21.15.8:6835/1173304661] conn(0x563e9e421590 0x563e9e461470 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b174a86d7deb7b5e server_cookie=d48136500c280d97 in_seq=0 out_seq=0 2023-10-06T04:37:45.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.900+0000 7fc12b7fe700 1 -- 172.21.15.8:0/2950807559 <== mds.0 v2:172.21.15.8:6833/1173304661 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x7fc13c000d10 con 0x563e9e421590 2023-10-06T04:37:45.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.900+0000 7fc12b7fe700 10 client.5697 handle_command_reply: tid=0 2023-10-06T04:37:45.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.900+0000 7fc15cc2bb80 1 client.5697 shutdown 2023-10-06T04:37:45.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.900+0000 7fc15cc2bb80 1 -- 172.21.15.8:0/2950807559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e9e420a40 msgr2=0x563e9e4c7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:45.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.900+0000 7fc15cc2bb80 1 --2- 172.21.15.8:0/2950807559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e9e420a40 0x563e9e4c7580 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc14802c000 tx=0x7fc14802d000 comp rx=0 tx=0).stop 2023-10-06T04:37:45.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.900+0000 7fc15cc2bb80 1 -- 172.21.15.8:0/2950807559 shutdown_connections 2023-10-06T04:37:45.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.900+0000 7fc15cc2bb80 1 --2- 172.21.15.8:0/2950807559 >> [v2:172.21.15.8:6833/1173304661,v1:172.21.15.8:6835/1173304661] conn(0x563e9e421590 0x563e9e461470 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.900+0000 7fc15cc2bb80 1 --2- 172.21.15.8:0/2950807559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e9e46acb0 0x563e9e460f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.900+0000 7fc15cc2bb80 1 --2- 172.21.15.8:0/2950807559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e9e420a40 0x563e9e4c7580 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.900+0000 7fc12b7fe700 0 client.5697 ms_handle_reset on v2:172.21.15.8:6833/1173304661 2023-10-06T04:37:45.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.900+0000 7fc15cc2bb80 1 --2- 172.21.15.8:0/2950807559 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563e9e449f50 0x563e9e44c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.901+0000 7fc15cc2bb80 1 -- 172.21.15.8:0/2950807559 >> 172.21.15.8:0/2950807559 conn(0x563e9e422360 msgr2=0x563e9e463350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:45.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.901+0000 7fc15cc2bb80 1 -- 172.21.15.8:0/2950807559 shutdown_connections 2023-10-06T04:37:45.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.901+0000 7fc15cc2bb80 1 -- 172.21.15.8:0/2950807559 wait complete. 2023-10-06T04:37:45.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.901+0000 7fc15cc2bb80 20 client.5697 trim_cache size 0 max 16384 2023-10-06T04:37:45.910 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T04:37:45.910 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2023-10-06T04:37:45.910 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "c5ab840c-c9bb-4bf8-a684-128a9510bda7", 2023-10-06T04:37:45.910 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2023-10-06T04:37:45.910 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T04:37:45.910 INFO:tasks.ceph.mds.a.smithi008.stderr:2023-10-06T04:37:45.901+0000 7f592e8a3700 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000000 2023-10-06T04:37:45.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.901+0000 7fc1526d1700 1 -- 172.21.15.8:0/2048282392 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc130066f30 msgr2=0x7fc1300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:45.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.901+0000 7fc1526d1700 1 --2- 172.21.15.8:0/2048282392 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc130066f30 0x7fc1300693e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc148007fd0 tx=0x7fc148007d30 comp rx=0 tx=0).stop 2023-10-06T04:37:45.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.901+0000 7fc1526d1700 1 -- 172.21.15.8:0/2048282392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc14c0ce600 msgr2=0x7fc14c14af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:45.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.901+0000 7fc1526d1700 1 --2- 172.21.15.8:0/2048282392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc14c0ce600 0x7fc14c14af60 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc144009df0 tx=0x7fc14400b040 comp rx=0 tx=0).stop 2023-10-06T04:37:45.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.901+0000 7fc1526d1700 1 -- 172.21.15.8:0/2048282392 shutdown_connections 2023-10-06T04:37:45.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.901+0000 7fc1526d1700 1 --2- 172.21.15.8:0/2048282392 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc130066f30 0x7fc1300693e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.901+0000 7fc1526d1700 1 --2- 172.21.15.8:0/2048282392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc14c0ce600 0x7fc14c14af60 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.901+0000 7fc1526d1700 1 --2- 172.21.15.8:0/2048282392 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc14c069720 0x7fc14c15c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.901+0000 7fc1526d1700 1 --2- 172.21.15.8:0/2048282392 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc14c0af530 0x7fc14c16d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:45.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.901+0000 7fc1526d1700 1 -- 172.21.15.8:0/2048282392 >> 172.21.15.8:0/2048282392 conn(0x7fc14c0d0280 msgr2=0x7fc14c0ccb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:45.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.902+0000 7fc1526d1700 1 -- 172.21.15.8:0/2048282392 shutdown_connections 2023-10-06T04:37:45.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:45.902+0000 7fc1526d1700 1 -- 172.21.15.8:0/2048282392 wait complete. 2023-10-06T04:37:45.913 INFO:tasks.ceph.mds.a.smithi008.stderr:2023-10-06T04:37:45.902+0000 7f592e8a3700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /subdir/ auth v1 pv4 ap=3 DIRTYPARENT f(v0 1=1+0) n() (inest lock dirty) (ifile lock->sync w=1 flushing) (iversion lock) | dirtyscattered=2 lock=1 dirfrag=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x563a0179ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000000:[<0x1/subdir v1>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 1=1+0)","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 1=1+0)","memory_value.rstat":"n()","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-61} 2023-10-06T04:37:45.913 INFO:tasks.ceph.mds.a.smithi008.stderr:2023-10-06T04:37:45.902+0000 7f592e8a3700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/sixmegs auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x563a01801080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(7)0x10000000001:[<0x10000000000/sixmegs v10>,<0x1/subdir v12>]//[]","memoryvalue":"(7)0x10000000001:[<0x10000000000/sixmegs v1>,<0x1/subdir v1>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-06T04:37:45.913 INFO:tasks.ceph.mds.a.smithi008.stderr:2023-10-06T04:37:45.906+0000 7f592e8a3700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1 [...2,head] / auth v4 ap=5 snaprealm=0x563a009fb000 DIRTYPARENT f(v1 1=0+1) n(v0 1=0+1)/n() (idft sync r=1) (inest sync r=1) (ifile sync->mix r=1) (iversion lock) | dirtyscattered=0 lock=3 dirfrag=1 openingsnapparents=0 dirtyparent=1 dirty=1 waiter=1 authpin=1 scrubqueue=0 0x563a0179a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x1:[]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 1=0+1)","ondisk_value.rstat":"n(v0 2=0+2)","memory_value.dirstat":"f(v1 1=0+1)","memory_value.rstat":"n(v0 1=0+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-61} 2023-10-06T04:37:45.916 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:37:46.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.034+0000 7f71730dd700 1 Processor -- start 2023-10-06T04:37:46.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.034+0000 7f71730dd700 1 -- start start 2023-10-06T04:37:46.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.035+0000 7f71730dd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f716c0caf40 0x7f716c0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:46.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.035+0000 7f71730dd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f716c142850 0x7f716c142c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:46.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.035+0000 7f71730dd700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f716c06ad70 con 0x7f716c0cb310 2023-10-06T04:37:46.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.035+0000 7f71730dd700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f716c067ce0 con 0x7f716c0caf40 2023-10-06T04:37:46.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.035+0000 7f71730dd700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f716c06a760 con 0x7f716c142850 2023-10-06T04:37:46.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.035+0000 7f7170e79700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f716c0caf40 0x7f716c0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:46.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.035+0000 7f717167a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f716c142850 0x7f716c142c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:46.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.035+0000 7f716bfff700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f716c0cb310 0x7f716c0675d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.8:57854/0 (socket says 172.21.15.8:57854) 2023-10-06T04:37:46.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.035+0000 7f716bfff700 1 -- 172.21.15.8:0/1803477086 learned_addr learned my addr 172.21.15.8:0/1803477086 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:46.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.035+0000 7f716b7fe700 1 -- 172.21.15.8:0/1803477086 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 678453762 0 0) 0x7f716c06ad70 con 0x7f716c0cb310 2023-10-06T04:37:46.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.035+0000 7f716b7fe700 1 -- 172.21.15.8:0/1803477086 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7158003570 con 0x7f716c0cb310 2023-10-06T04:37:46.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.035+0000 7f717167a700 1 -- 172.21.15.8:0/1803477086 >> v2:172.21.15.184:3300/0 conn(0x7f716c0caf40 msgr2=0x7f716c0c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:46.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.035+0000 7f717167a700 1 --2- 172.21.15.8:0/1803477086 >> v2:172.21.15.184:3300/0 conn(0x7f716c0caf40 0x7f716c0c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:46.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.035+0000 7f717167a700 1 -- 172.21.15.8:0/1803477086 >> v1:172.21.15.184:6789/0 conn(0x7f716c0cb310 legacy=0x7f716c0675d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:46.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.035+0000 7f717167a700 1 -- 172.21.15.8:0/1803477086 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716c067f40 con 0x7f716c142850 2023-10-06T04:37:46.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.036+0000 7f717167a700 1 --2- 172.21.15.8:0/1803477086 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f716c142850 0x7f716c142c90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7164009e90 tx=0x7f7164009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b449ce4be1e94c17 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:46.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.036+0000 7f716b7fe700 1 -- 172.21.15.8:0/1803477086 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716400e070 con 0x7f716c142850 2023-10-06T04:37:46.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.036+0000 7f716b7fe700 1 -- 172.21.15.8:0/1803477086 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716400bb40 con 0x7f716c142850 2023-10-06T04:37:46.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.036+0000 7f716b7fe700 1 -- 172.21.15.8:0/1803477086 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7164012430 con 0x7f716c142850 2023-10-06T04:37:46.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.036+0000 7f71730dd700 1 -- 172.21.15.8:0/1803477086 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f716c142850 msgr2=0x7f716c142c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:46.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.036+0000 7f71730dd700 1 --2- 172.21.15.8:0/1803477086 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f716c142850 0x7f716c142c90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7164009e90 tx=0x7f7164009780 comp rx=0 tx=0).stop 2023-10-06T04:37:46.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.036+0000 7f71730dd700 1 -- 172.21.15.8:0/1803477086 shutdown_connections 2023-10-06T04:37:46.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.036+0000 7f71730dd700 1 --2- 172.21.15.8:0/1803477086 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f716c142850 0x7f716c142c90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:46.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.036+0000 7f71730dd700 1 --2- 172.21.15.8:0/1803477086 >> v2:172.21.15.184:3300/0 conn(0x7f716c0caf40 0x7f716c0c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:46.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.036+0000 7f71730dd700 1 -- 172.21.15.8:0/1803477086 >> 172.21.15.8:0/1803477086 conn(0x7f716c0cd120 msgr2=0x7f716c0cd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:46.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.036+0000 7f71730dd700 1 -- 172.21.15.8:0/1803477086 shutdown_connections 2023-10-06T04:37:46.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.037+0000 7f71730dd700 1 -- 172.21.15.8:0/1803477086 wait complete. 2023-10-06T04:37:46.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.038+0000 7f71730dd700 1 Processor -- start 2023-10-06T04:37:46.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.038+0000 7f71730dd700 1 -- start start 2023-10-06T04:37:46.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.038+0000 7f71730dd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f716c0caf40 0x7f716c15c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:46.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.038+0000 7f71730dd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f716c0cb310 0x7f716c15cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:46.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.038+0000 7f71730dd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f716c142850 0x7f716c16cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:46.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.038+0000 7f71730dd700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716c15a490 con 0x7f716c0cb310 2023-10-06T04:37:46.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.038+0000 7f71730dd700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716c159e80 con 0x7f716c0caf40 2023-10-06T04:37:46.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.038+0000 7f71730dd700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f716c0c6ae0 con 0x7f716c142850 2023-10-06T04:37:46.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.039+0000 7f716bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f716c0cb310 0x7f716c15cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:46.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.039+0000 7f716bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f716c0cb310 0x7f716c15cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42508/0 (socket says 172.21.15.8:42508) 2023-10-06T04:37:46.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.039+0000 7f716bfff700 1 -- 172.21.15.8:0/701649708 learned_addr learned my addr 172.21.15.8:0/701649708 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:46.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.039+0000 7f7170e79700 1 --2- 172.21.15.8:0/701649708 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f716c0caf40 0x7f716c15c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:46.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.039+0000 7f717167a700 1 --2- 172.21.15.8:0/701649708 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f716c142850 0x7f716c16cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:46.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.039+0000 7f716bfff700 1 -- 172.21.15.8:0/701649708 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f716c142850 msgr2=0x7f716c16cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:46.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.039+0000 7f716bfff700 1 --2- 172.21.15.8:0/701649708 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f716c142850 0x7f716c16cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:46.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.039+0000 7f716bfff700 1 -- 172.21.15.8:0/701649708 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f716c0caf40 msgr2=0x7f716c15c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:46.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.039+0000 7f716bfff700 1 --2- 172.21.15.8:0/701649708 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f716c0caf40 0x7f716c15c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:46.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.039+0000 7f716bfff700 1 -- 172.21.15.8:0/701649708 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7164009a20 con 0x7f716c0cb310 2023-10-06T04:37:46.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.039+0000 7f716bfff700 1 --2- 172.21.15.8:0/701649708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f716c0cb310 0x7f716c15cd70 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f71540011e0 tx=0x7f7154007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:46.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.039+0000 7f7168ff9700 1 -- 172.21.15.8:0/701649708 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7154005b30 con 0x7f716c0cb310 2023-10-06T04:37:46.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.039+0000 7f7168ff9700 1 -- 172.21.15.8:0/701649708 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7154005c90 con 0x7f716c0cb310 2023-10-06T04:37:46.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.039+0000 7f71730dd700 1 -- 172.21.15.8:0/701649708 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f716c0c6dc0 con 0x7f716c0cb310 2023-10-06T04:37:46.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.039+0000 7f7168ff9700 1 -- 172.21.15.8:0/701649708 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7154007320 con 0x7f716c0cb310 2023-10-06T04:37:46.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.039+0000 7f71730dd700 1 -- 172.21.15.8:0/701649708 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f716c16d240 con 0x7f716c0cb310 2023-10-06T04:37:46.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.040+0000 7f71730dd700 1 -- 172.21.15.8:0/701649708 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f716c071550 con 0x7f716c0cb310 2023-10-06T04:37:46.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.041+0000 7f7168ff9700 1 -- 172.21.15.8:0/701649708 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7154007690 con 0x7f716c0cb310 2023-10-06T04:37:46.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.041+0000 7f7168ff9700 1 --2- 172.21.15.8:0/701649708 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f714c066f30 0x7f714c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:46.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.041+0000 7f7168ff9700 1 -- 172.21.15.8:0/701649708 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7f7154083e80 con 0x7f716c0cb310 2023-10-06T04:37:46.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.041+0000 7f7170e79700 1 --2- 172.21.15.8:0/701649708 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f714c066f30 0x7f714c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:46.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.042+0000 7f7170e79700 1 --2- 172.21.15.8:0/701649708 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f714c066f30 0x7f714c0693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f716c159780 tx=0x7f715c0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:46.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.045+0000 7f7168ff9700 1 -- 172.21.15.8:0/701649708 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7154050c30 con 0x7f716c0cb310 2023-10-06T04:37:46.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.283+0000 7f71730dd700 1 -- 172.21.15.8:0/701649708 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f716c06aa00 con 0x7f716c0cb310 2023-10-06T04:37:46.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.284+0000 7f7168ff9700 1 -- 172.21.15.8:0/701649708 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+5662 (secure 0 0 0) 0x7f7154017020 con 0x7f716c0cb310 2023-10-06T04:37:46.285 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:46.286 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":28,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/867081044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":867081044},{"type":"v1","addr":"172.21.15.184:6835","nonce":867081044}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5176,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2754847040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2754847040},{"type":"v1","addr":"172.21.15.184:6837","nonce":2754847040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5358,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/1957165234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1957165234},{"type":"v1","addr":"172.21.15.8:6834","nonce":1957165234}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:37:16.932006+0000","modified":"2023-10-06T04:37:26.044254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":39,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:37:29.514098+0000","modified":"2023-10-06T04:37:43.827602+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5361":{"gid":5361,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.8:6835/1173304661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1173304661},{"type":"v1","addr":"172.21.15.8:6835","nonce":1173304661}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":8,"enabled":true,"fs_name":"recovery_fs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T04:37:46.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.286+0000 7f71730dd700 1 -- 172.21.15.8:0/701649708 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f714c066f30 msgr2=0x7f714c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:46.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.286+0000 7f71730dd700 1 --2- 172.21.15.8:0/701649708 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f714c066f30 0x7f714c0693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f716c159780 tx=0x7f715c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:46.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.286+0000 7f71730dd700 1 -- 172.21.15.8:0/701649708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f716c0cb310 msgr2=0x7f716c15cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:46.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.286+0000 7f71730dd700 1 --2- 172.21.15.8:0/701649708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f716c0cb310 0x7f716c15cd70 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f71540011e0 tx=0x7f7154007df0 comp rx=0 tx=0).stop 2023-10-06T04:37:46.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.286+0000 7f71730dd700 1 -- 172.21.15.8:0/701649708 shutdown_connections 2023-10-06T04:37:46.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.286+0000 7f71730dd700 1 --2- 172.21.15.8:0/701649708 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f714c066f30 0x7f714c0693e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:46.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.286+0000 7f71730dd700 1 --2- 172.21.15.8:0/701649708 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f716c142850 0x7f716c16cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:46.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.286+0000 7f71730dd700 1 --2- 172.21.15.8:0/701649708 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f716c0caf40 0x7f716c15c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:46.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.286+0000 7f71730dd700 1 --2- 172.21.15.8:0/701649708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f716c0cb310 0x7f716c15cd70 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:46.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.286+0000 7f71730dd700 1 -- 172.21.15.8:0/701649708 >> 172.21.15.8:0/701649708 conn(0x7f716c0cd120 msgr2=0x7f716c0c3730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:46.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.286+0000 7f71730dd700 1 -- 172.21.15.8:0/701649708 shutdown_connections 2023-10-06T04:37:46.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.286+0000 7f71730dd700 1 -- 172.21.15.8:0/701649708 wait complete. 2023-10-06T04:37:46.289 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 28 2023-10-06T04:37:46.300 INFO:tasks.cephfs.test_recovery_pool:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 2, "epoch": 28, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 2, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-10-06T04:37:16.932006+0000", "damaged": [], "data_pools": [ 7 ], "enabled": true, "epoch": 19, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [ 0 ], "flags": 19, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": false }, "fs_name": "cephfs", "in": [ 0 ], "info": {}, "last_failure": 0, "last_failure_osd_epoch": 39, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 6, "modified": "2023-10-06T04:37:26.044254+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": {} } }, { "id": 3, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-10-06T04:37:29.514098+0000", "damaged": [], "data_pools": [ 7 ], "enabled": true, "epoch": 28, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true }, "fs_name": "recovery_fs", "in": [ 0 ], "info": { "gid_5361": { "addr": "172.21.15.8:6835/1173304661", "addrs": { "addrvec": [ { "addr": "172.21.15.8:6833", "nonce": 1173304661, "type": "v2" }, { "addr": "172.21.15.8:6835", "nonce": 1173304661, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138320759226367, "flags": 0, "gid": 5361, "incarnation": 25, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:active", "state_seq": 7 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 8, "modified": "2023-10-06T04:37:43.827602+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5361 } } } ], "standbys": [ { "addr": "172.21.15.184:6835/867081044", "addrs": { "addrvec": [ { "addr": "172.21.15.184:6834", "nonce": 867081044, "type": "v2" }, { "addr": "172.21.15.184:6835", "nonce": 867081044, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 20, "export_targets": [], "features": 4540138320759226367, "flags": 0, "gid": 4931, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.184:6837/2754847040", "addrs": { "addrvec": [ { "addr": "172.21.15.184:6836", "nonce": 2754847040, "type": "v2" }, { "addr": "172.21.15.184:6837", "nonce": 2754847040, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 20, "export_targets": [], "features": 4540138320759226367, "flags": 0, "gid": 5176, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.8:6834/1957165234", "addrs": { "addrvec": [ { "addr": "172.21.15.8:6832", "nonce": 1957165234, "type": "v2" }, { "addr": "172.21.15.8:6834", "nonce": 1957165234, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 20, "export_targets": [], "features": 4540138320759226367, "flags": 0, "gid": 5358, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-10-06T04:37:46.301 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:37:46.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.418+0000 7f6d718dd700 1 Processor -- start 2023-10-06T04:37:46.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.418+0000 7f6d718dd700 1 -- start start 2023-10-06T04:37:46.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.419+0000 7f6d718dd700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6d6c15a7b0 0x7f6d6c153b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:46.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.419+0000 7f6d718dd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6d6c15d8e0 0x7f6d6c0696c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:46.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.419+0000 7f6d718dd700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d6c15d170 con 0x7f6d6c153740 2023-10-06T04:37:46.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.419+0000 7f6d718dd700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d6c0ca990 con 0x7f6d6c15a7b0 2023-10-06T04:37:46.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.419+0000 7f6d718dd700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d6c0cac70 con 0x7f6d6c15d8e0 2023-10-06T04:37:46.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.419+0000 7f6d6bfff700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6d6c15a7b0 0x7f6d6c153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:46.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.419+0000 7f6d6bfff700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6d6c15a7b0 0x7f6d6c153b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42520/0 (socket says 172.21.15.8:42520) 2023-10-06T04:37:46.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.419+0000 7f6d6bfff700 1 -- 172.21.15.8:0/1224454289 learned_addr learned my addr 172.21.15.8:0/1224454289 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:46.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.419+0000 7f6d710dc700 1 --2- 172.21.15.8:0/1224454289 >> v2:172.21.15.184:3300/0 conn(0x7f6d6c15d8e0 0x7f6d6c0696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:46.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.419+0000 7f6d6bfff700 1 -- 172.21.15.8:0/1224454289 >> v2:172.21.15.184:3300/0 conn(0x7f6d6c15d8e0 msgr2=0x7f6d6c0696c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:46.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.419+0000 7f6d6bfff700 1 --2- 172.21.15.8:0/1224454289 >> v2:172.21.15.184:3300/0 conn(0x7f6d6c15d8e0 0x7f6d6c0696c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:46.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.419+0000 7f6d6bfff700 1 -- 172.21.15.8:0/1224454289 >> v1:172.21.15.184:6789/0 conn(0x7f6d6c153740 legacy=0x7f6d6c0cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:46.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.419+0000 7f6d6bfff700 1 -- 172.21.15.8:0/1224454289 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6c0caf50 con 0x7f6d6c15a7b0 2023-10-06T04:37:46.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.419+0000 7f6d6bfff700 1 --2- 172.21.15.8:0/1224454289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d6c15a7b0 0x7f6d6c153b10 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c0cc630 tx=0x7f6d60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be15fa04316df46 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:46.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.420+0000 7f6d6b7fe700 1 -- 172.21.15.8:0/1224454289 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6000b860 con 0x7f6d6c15a7b0 2023-10-06T04:37:46.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.420+0000 7f6d6b7fe700 1 -- 172.21.15.8:0/1224454289 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6000b9c0 con 0x7f6d6c15a7b0 2023-10-06T04:37:46.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.420+0000 7f6d6b7fe700 1 -- 172.21.15.8:0/1224454289 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6000bd60 con 0x7f6d6c15a7b0 2023-10-06T04:37:46.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.420+0000 7f6d718dd700 1 -- 172.21.15.8:0/1224454289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d6c15a7b0 msgr2=0x7f6d6c153b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:46.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.420+0000 7f6d718dd700 1 --2- 172.21.15.8:0/1224454289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d6c15a7b0 0x7f6d6c153b10 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c0cc630 tx=0x7f6d60009250 comp rx=0 tx=0).stop 2023-10-06T04:37:46.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.420+0000 7f6d718dd700 1 -- 172.21.15.8:0/1224454289 shutdown_connections 2023-10-06T04:37:46.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.420+0000 7f6d718dd700 1 --2- 172.21.15.8:0/1224454289 >> v2:172.21.15.184:3300/0 conn(0x7f6d6c15d8e0 0x7f6d6c0696c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:46.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.420+0000 7f6d718dd700 1 --2- 172.21.15.8:0/1224454289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d6c15a7b0 0x7f6d6c153b10 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:46.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.420+0000 7f6d718dd700 1 -- 172.21.15.8:0/1224454289 >> 172.21.15.8:0/1224454289 conn(0x7f6d6c0d02b0 msgr2=0x7f6d6c0d06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:46.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.420+0000 7f6d718dd700 1 -- 172.21.15.8:0/1224454289 shutdown_connections 2023-10-06T04:37:46.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.420+0000 7f6d718dd700 1 -- 172.21.15.8:0/1224454289 wait complete. 2023-10-06T04:37:46.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.421+0000 7f6d718dd700 1 Processor -- start 2023-10-06T04:37:46.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.422+0000 7f6d718dd700 1 -- start start 2023-10-06T04:37:46.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.422+0000 7f6d718dd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d6c153740 0x7f6d6c16a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:46.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.422+0000 7f6d718dd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d6c15a7b0 0x7f6d6c0c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:46.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.422+0000 7f6d718dd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d6c15d8e0 0x7f6d6c0c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:46.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.422+0000 7f6d718dd700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c0c8530 con 0x7f6d6c153740 2023-10-06T04:37:46.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.422+0000 7f6d718dd700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c16a850 con 0x7f6d6c15a7b0 2023-10-06T04:37:46.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.422+0000 7f6d718dd700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c0c7920 con 0x7f6d6c15d8e0 2023-10-06T04:37:46.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.422+0000 7f6d708db700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d6c153740 0x7f6d6c16a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:46.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.422+0000 7f6d708db700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d6c153740 0x7f6d6c16a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42522/0 (socket says 172.21.15.8:42522) 2023-10-06T04:37:46.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.422+0000 7f6d708db700 1 -- 172.21.15.8:0/1567805106 learned_addr learned my addr 172.21.15.8:0/1567805106 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:46.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.423+0000 7f6d710dc700 1 --2- 172.21.15.8:0/1567805106 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d6c15d8e0 0x7f6d6c0c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:46.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.423+0000 7f6d6bfff700 1 --2- 172.21.15.8:0/1567805106 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d6c15a7b0 0x7f6d6c0c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:46.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.423+0000 7f6d708db700 1 -- 172.21.15.8:0/1567805106 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d6c15d8e0 msgr2=0x7f6d6c0c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:46.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.423+0000 7f6d708db700 1 --2- 172.21.15.8:0/1567805106 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d6c15d8e0 0x7f6d6c0c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:46.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.423+0000 7f6d708db700 1 -- 172.21.15.8:0/1567805106 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d6c15a7b0 msgr2=0x7f6d6c0c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:46.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.423+0000 7f6d708db700 1 --2- 172.21.15.8:0/1567805106 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d6c15a7b0 0x7f6d6c0c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:46.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.423+0000 7f6d708db700 1 -- 172.21.15.8:0/1567805106 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d600094f0 con 0x7f6d6c153740 2023-10-06T04:37:46.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.423+0000 7f6d708db700 1 --2- 172.21.15.8:0/1567805106 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d6c153740 0x7f6d6c16a310 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c00c590 tx=0x7f6d5c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:46.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.423+0000 7f6d68ff9700 1 -- 172.21.15.8:0/1567805106 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c011590 con 0x7f6d6c153740 2023-10-06T04:37:46.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.423+0000 7f6d718dd700 1 -- 172.21.15.8:0/1567805106 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d6c0c7c00 con 0x7f6d6c153740 2023-10-06T04:37:46.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.423+0000 7f6d718dd700 1 -- 172.21.15.8:0/1567805106 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d6c0c81c0 con 0x7f6d6c153740 2023-10-06T04:37:46.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.423+0000 7f6d68ff9700 1 -- 172.21.15.8:0/1567805106 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5c011710 con 0x7f6d6c153740 2023-10-06T04:37:46.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.423+0000 7f6d68ff9700 1 -- 172.21.15.8:0/1567805106 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c011ad0 con 0x7f6d6c153740 2023-10-06T04:37:46.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.424+0000 7f6d718dd700 1 -- 172.21.15.8:0/1567805106 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d4c0052b0 con 0x7f6d6c153740 2023-10-06T04:37:46.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.425+0000 7f6d68ff9700 1 -- 172.21.15.8:0/1567805106 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6d5c01b3b0 con 0x7f6d6c153740 2023-10-06T04:37:46.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.425+0000 7f6d68ff9700 1 --2- 172.21.15.8:0/1567805106 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6d58066f30 0x7f6d580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:46.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.425+0000 7f6d68ff9700 1 -- 172.21.15.8:0/1567805106 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7f6d5c083ea0 con 0x7f6d6c153740 2023-10-06T04:37:46.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.425+0000 7f6d6bfff700 1 --2- 172.21.15.8:0/1567805106 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6d58066f30 0x7f6d580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:46.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.426+0000 7f6d6bfff700 1 --2- 172.21.15.8:0/1567805106 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6d58066f30 0x7f6d580693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c0cc630 tx=0x7f6d60017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:46.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.429+0000 7f6d68ff9700 1 -- 172.21.15.8:0/1567805106 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d5c050c50 con 0x7f6d6c153740 2023-10-06T04:37:46.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.670+0000 7f6d718dd700 1 -- 172.21.15.8:0/1567805106 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6d4c005830 con 0x7f6d6c153740 2023-10-06T04:37:46.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.670+0000 7f6d68ff9700 1 -- 172.21.15.8:0/1567805106 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) v1 ==== 53+0+156 (secure 0 0 0) 0x7f6d5c017070 con 0x7f6d6c153740 2023-10-06T04:37:46.672 INFO:teuthology.orchestra.run.smithi008.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T04:37:46.672 INFO:teuthology.orchestra.run.smithi008.stdout:name: recovery_fs, metadata pool: recovery_fs_metadata, data pools: [cephfs_data ] 2023-10-06T04:37:46.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.673+0000 7f6d718dd700 1 -- 172.21.15.8:0/1567805106 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6d58066f30 msgr2=0x7f6d580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:46.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.673+0000 7f6d718dd700 1 --2- 172.21.15.8:0/1567805106 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6d58066f30 0x7f6d580693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c0cc630 tx=0x7f6d60017000 comp rx=0 tx=0).stop 2023-10-06T04:37:46.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.673+0000 7f6d718dd700 1 -- 172.21.15.8:0/1567805106 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d6c153740 msgr2=0x7f6d6c16a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:46.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.673+0000 7f6d718dd700 1 --2- 172.21.15.8:0/1567805106 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d6c153740 0x7f6d6c16a310 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c00c590 tx=0x7f6d5c00c8a0 comp rx=0 tx=0).stop 2023-10-06T04:37:46.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.673+0000 7f6d718dd700 1 -- 172.21.15.8:0/1567805106 shutdown_connections 2023-10-06T04:37:46.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.673+0000 7f6d718dd700 1 --2- 172.21.15.8:0/1567805106 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6d58066f30 0x7f6d580693e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:46.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.673+0000 7f6d718dd700 1 --2- 172.21.15.8:0/1567805106 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d6c15d8e0 0x7f6d6c0c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:46.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.673+0000 7f6d718dd700 1 --2- 172.21.15.8:0/1567805106 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d6c153740 0x7f6d6c16a310 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:46.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.673+0000 7f6d718dd700 1 --2- 172.21.15.8:0/1567805106 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d6c15a7b0 0x7f6d6c0c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:46.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.673+0000 7f6d718dd700 1 -- 172.21.15.8:0/1567805106 >> 172.21.15.8:0/1567805106 conn(0x7f6d6c0d02b0 msgr2=0x7f6d6c0cccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:46.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.673+0000 7f6d718dd700 1 -- 172.21.15.8:0/1567805106 shutdown_connections 2023-10-06T04:37:46.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:46.673+0000 7f6d718dd700 1 -- 172.21.15.8:0/1567805106 wait complete. 2023-10-06T04:37:46.686 INFO:tasks.cephfs.mount:Mounting Ceph FS recovery_fs; just confirmed its presence on cluster 2023-10-06T04:37:46.686 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:37:46.686 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi008.front.sepia.ceph.com 2023-10-06T04:37:46.686 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T04:37:46.686 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T04:37:46.686 INFO:tasks.cephfs.mount:self.cephfs_name = recovery_fs 2023-10-06T04:37:46.687 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T04:37:46.687 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:37:46.687 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:37:46.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:37:46.687 DEBUG:teuthology.orchestra.run.smithi008:> ip addr 2023-10-06T04:37:46.703 INFO:teuthology.orchestra.run.smithi008.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:37:46.703 INFO:teuthology.orchestra.run.smithi008.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:37:46.703 INFO:teuthology.orchestra.run.smithi008.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:37:46.703 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:37:46.703 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 ::1/128 scope host 2023-10-06T04:37:46.703 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:37:46.703 INFO:teuthology.orchestra.run.smithi008.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:37:46.703 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2e brd ff:ff:ff:ff:ff:ff 2023-10-06T04:37:46.703 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f0 2023-10-06T04:37:46.704 INFO:teuthology.orchestra.run.smithi008.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:37:46.704 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2f brd ff:ff:ff:ff:ff:ff 2023-10-06T04:37:46.704 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f1 2023-10-06T04:37:46.704 INFO:teuthology.orchestra.run.smithi008.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:37:46.704 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:fe brd ff:ff:ff:ff:ff:ff 2023-10-06T04:37:46.704 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f0 2023-10-06T04:37:46.704 INFO:teuthology.orchestra.run.smithi008.stdout: inet 172.21.15.8/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T04:37:46.704 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft 42413sec preferred_lft 42413sec 2023-10-06T04:37:46.704 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::ae1f:6bff:fef8:25fe/64 scope link 2023-10-06T04:37:46.704 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:37:46.704 INFO:teuthology.orchestra.run.smithi008.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:37:46.705 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:ff brd ff:ff:ff:ff:ff:ff 2023-10-06T04:37:46.705 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f1 2023-10-06T04:37:46.705 INFO:teuthology.orchestra.run.smithi008.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:37:46.705 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 2e:0e:f6:ba:f1:d2 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:37:46.705 INFO:teuthology.orchestra.run.smithi008.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T04:37:46.705 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:37:46.705 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::2096:16ff:fef6:bb26/64 scope link 2023-10-06T04:37:46.705 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:37:46.705 INFO:teuthology.orchestra.run.smithi008.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:37:46.705 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 3e:b3:ce:23:96:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T04:37:46.705 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::3cb3:ceff:fe23:965e/64 scope link 2023-10-06T04:37:46.706 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:37:46.706 INFO:teuthology.orchestra.run.smithi008.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:37:46.706 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 2e:0e:f6:ba:f1:d2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T04:37:46.706 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::2c0e:f6ff:feba:f1d2/64 scope link 2023-10-06T04:37:46.706 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:37:46.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:37:46.706 DEBUG:teuthology.orchestra.run.smithi008:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:37:46.767 INFO:teuthology.orchestra.run.smithi008.stdout:1 2023-10-06T04:37:46.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:37:46.768 DEBUG:teuthology.orchestra.run.smithi008:> route 2023-10-06T04:37:46.824 INFO:teuthology.orchestra.run.smithi008.stdout:Kernel IP routing table 2023-10-06T04:37:46.824 INFO:teuthology.orchestra.run.smithi008.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:37:46.825 INFO:teuthology.orchestra.run.smithi008.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T04:37:46.825 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T04:37:46.825 INFO:teuthology.orchestra.run.smithi008.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:37:46.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:37:46.825 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-10-06T04:37:46.825 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-10-06T04:37:46.825 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T04:37:46.826 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T04:37:46.826 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T04:37:46.826 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-10-06T04:37:46.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:37:46.927 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2023-10-06T04:37:46.942 INFO:teuthology.orchestra.run.smithi008.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T04:37:46.942 INFO:teuthology.orchestra.run.smithi008.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T04:37:46.942 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:37:46.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:37:46.943 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set brx.0 up 2023-10-06T04:37:47.007 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:37:47.007 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T04:37:47.055 INFO:tasks.ceph.mds.a.smithi008.stderr:2023-10-06T04:37:47.054+0000 7f59320aa700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T04:37:47.062 INFO:teuthology.orchestra.run.smithi008.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:37:47.063 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:37:47.063 DEBUG:teuthology.orchestra.run.smithi008:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T04:37:47.117 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.recovery_fs=/ 2023-10-06T04:37:47.118 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:37:47.118 DEBUG:teuthology.orchestra.run.smithi008:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.recovery_fs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:37:47.199 INFO:teuthology.orchestra.run.smithi008.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:37:47.199 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T04:37:47.218 INFO:teuthology.orchestra.run.smithi008.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:37:47.219 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T04:37:47.219 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: resolved to: "172.21.15.8:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-10-06T04:37:47.219 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: trying mount with new device syntax: 0@c030d94d-df8f-49bb-8df7-07e9e557d96b.recovery_fs=/ 2023-10-06T04:37:47.219 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.8:3300/172.21.15.184:3300/172.21.15.184:3301" will pass to kernel 2023-10-06T04:37:47.219 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T04:37:47.219 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T04:37:47.219 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:37:47.242 INFO:teuthology.orchestra.run.smithi008.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T04:37:47.242 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T04:37:47.242 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: resolved to: "172.21.15.8:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-10-06T04:37:47.242 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: trying mount with new device syntax: 0@c030d94d-df8f-49bb-8df7-07e9e557d96b.recovery_fs=/ 2023-10-06T04:37:47.242 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.8:3300/172.21.15.184:3300/172.21.15.184:3301" will pass to kernel 2023-10-06T04:37:47.242 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T04:37:47.242 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T04:37:47.242 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:37:47.243 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: resolved to: "172.21.15.8:6789,172.21.15.184:6789,172.21.15.184:6790" 2023-10-06T04:37:47.243 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.8:6789,172.21.15.184:6789,172.21.15.184:6790:/ 2023-10-06T04:37:47.243 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=recovery_fs,fsid=c030d94d-df8f-49bb-8df7-07e9e557d96b" will pass to kernel 2023-10-06T04:37:47.244 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T04:37:47.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:37:47.244 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T04:37:47.310 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:37:47.310 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls subdir) 2023-10-06T04:37:47.383 INFO:teuthology.orchestra.run.smithi008.stdout:sixmegs 2023-10-06T04:37:47.383 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:37:47.383 DEBUG:teuthology.orchestra.run.smithi008:> import os 2023-10-06T04:37:47.383 DEBUG:teuthology.orchestra.run.smithi008:> import stat 2023-10-06T04:37:47.384 DEBUG:teuthology.orchestra.run.smithi008:> import json 2023-10-06T04:37:47.384 DEBUG:teuthology.orchestra.run.smithi008:> import sys 2023-10-06T04:37:47.384 DEBUG:teuthology.orchestra.run.smithi008:> 2023-10-06T04:37:47.384 DEBUG:teuthology.orchestra.run.smithi008:> try: 2023-10-06T04:37:47.384 DEBUG:teuthology.orchestra.run.smithi008:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2023-10-06T04:37:47.384 DEBUG:teuthology.orchestra.run.smithi008:> except OSError as e: 2023-10-06T04:37:47.384 DEBUG:teuthology.orchestra.run.smithi008:> sys.exit(e.errno) 2023-10-06T04:37:47.384 DEBUG:teuthology.orchestra.run.smithi008:> 2023-10-06T04:37:47.384 DEBUG:teuthology.orchestra.run.smithi008:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2023-10-06T04:37:47.384 DEBUG:teuthology.orchestra.run.smithi008:> print(json.dumps( 2023-10-06T04:37:47.384 DEBUG:teuthology.orchestra.run.smithi008:> dict([(a, getattr(s, a)) for a in attrs]), 2023-10-06T04:37:47.384 DEBUG:teuthology.orchestra.run.smithi008:> indent=2)) 2023-10-06T04:37:47.384 DEBUG:teuthology.orchestra.run.smithi008:> ' 2023-10-06T04:37:47.508 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T04:37:47.509 INFO:teuthology.orchestra.run.smithi008.stdout: "st_mode": 33088, 2023-10-06T04:37:47.509 INFO:teuthology.orchestra.run.smithi008.stdout: "st_ino": 1099511627777, 2023-10-06T04:37:47.509 INFO:teuthology.orchestra.run.smithi008.stdout: "st_dev": 46, 2023-10-06T04:37:47.509 INFO:teuthology.orchestra.run.smithi008.stdout: "st_nlink": 1, 2023-10-06T04:37:47.509 INFO:teuthology.orchestra.run.smithi008.stdout: "st_uid": 0, 2023-10-06T04:37:47.509 INFO:teuthology.orchestra.run.smithi008.stdout: "st_gid": 0, 2023-10-06T04:37:47.509 INFO:teuthology.orchestra.run.smithi008.stdout: "st_size": 6291456, 2023-10-06T04:37:47.509 INFO:teuthology.orchestra.run.smithi008.stdout: "st_atime": 1696567045.0, 2023-10-06T04:37:47.509 INFO:teuthology.orchestra.run.smithi008.stdout: "st_mtime": 1696567045.0, 2023-10-06T04:37:47.509 INFO:teuthology.orchestra.run.smithi008.stdout: "st_ctime": 1696567045.0 2023-10-06T04:37:47.510 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T04:37:47.677 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T04:37:47.678 DEBUG:teuthology.orchestra.run.smithi008:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T04:37:47.757 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T04:37:47.798 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T04:37:47.798 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T04:37:47.798 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:37:47.798 DEBUG:teuthology.orchestra.run.smithi008:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T04:37:47.845 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi008.front.sepia.ceph.com 2023-10-06T04:37:47.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:37:47.845 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T04:37:47.860 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:37:48.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.017+0000 7f7315896700 1 Processor -- start 2023-10-06T04:37:48.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.017+0000 7f7315896700 1 -- start start 2023-10-06T04:37:48.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.018+0000 7f7315896700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f731006be70 0x7f73100cc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:48.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.018+0000 7f7315896700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7310140f40 0x7f73100cc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:48.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.018+0000 7f7315896700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73100ccf00 con 0x7f731006baa0 2023-10-06T04:37:48.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.018+0000 7f7315896700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73100b2610 con 0x7f7310140f40 2023-10-06T04:37:48.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.018+0000 7f7315896700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73100cd1e0 con 0x7f731006be70 2023-10-06T04:37:48.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.018+0000 7f7315095700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7310140f40 0x7f73100cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:48.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.018+0000 7f7315095700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7310140f40 0x7f73100cc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42524/0 (socket says 172.21.15.8:42524) 2023-10-06T04:37:48.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.018+0000 7f7315095700 1 -- 172.21.15.8:0/1263689323 learned_addr learned my addr 172.21.15.8:0/1263689323 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:48.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.018+0000 7f730ffff700 1 --2- 172.21.15.8:0/1263689323 >> v2:172.21.15.184:3300/0 conn(0x7f731006be70 0x7f73100cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:48.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.019+0000 7f7315095700 1 -- 172.21.15.8:0/1263689323 >> v2:172.21.15.184:3300/0 conn(0x7f731006be70 msgr2=0x7f73100cc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:48.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.019+0000 7f7315095700 1 --2- 172.21.15.8:0/1263689323 >> v2:172.21.15.184:3300/0 conn(0x7f731006be70 0x7f73100cc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:48.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.019+0000 7f7315095700 1 -- 172.21.15.8:0/1263689323 >> v1:172.21.15.184:6789/0 conn(0x7f731006baa0 legacy=0x7f7310140830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:48.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.019+0000 7f7315095700 1 -- 172.21.15.8:0/1263689323 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73100cd4c0 con 0x7f7310140f40 2023-10-06T04:37:48.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.019+0000 7f7315095700 1 --2- 172.21.15.8:0/1263689323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7310140f40 0x7f73100cc650 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f731006e1a0 tx=0x7f7308009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ef4d7723d2aaa2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:48.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.019+0000 7f730f7fe700 1 -- 172.21.15.8:0/1263689323 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730800e070 con 0x7f7310140f40 2023-10-06T04:37:48.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.019+0000 7f730f7fe700 1 -- 172.21.15.8:0/1263689323 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730800ba20 con 0x7f7310140f40 2023-10-06T04:37:48.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.019+0000 7f730f7fe700 1 -- 172.21.15.8:0/1263689323 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73080092e0 con 0x7f7310140f40 2023-10-06T04:37:48.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.019+0000 7f7315896700 1 -- 172.21.15.8:0/1263689323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7310140f40 msgr2=0x7f73100cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:48.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.019+0000 7f7315896700 1 --2- 172.21.15.8:0/1263689323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7310140f40 0x7f73100cc650 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f731006e1a0 tx=0x7f7308009840 comp rx=0 tx=0).stop 2023-10-06T04:37:48.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.020+0000 7f7315896700 1 -- 172.21.15.8:0/1263689323 shutdown_connections 2023-10-06T04:37:48.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.020+0000 7f7315896700 1 --2- 172.21.15.8:0/1263689323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7310140f40 0x7f73100cc650 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:48.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.020+0000 7f7315896700 1 --2- 172.21.15.8:0/1263689323 >> v2:172.21.15.184:3300/0 conn(0x7f731006be70 0x7f73100cc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:48.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.020+0000 7f7315896700 1 -- 172.21.15.8:0/1263689323 >> 172.21.15.8:0/1263689323 conn(0x7f73100ce2f0 msgr2=0x7f73100ce6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:48.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.020+0000 7f7315896700 1 -- 172.21.15.8:0/1263689323 shutdown_connections 2023-10-06T04:37:48.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.020+0000 7f7315896700 1 -- 172.21.15.8:0/1263689323 wait complete. 2023-10-06T04:37:48.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.021+0000 7f7315896700 1 Processor -- start 2023-10-06T04:37:48.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.021+0000 7f7315896700 1 -- start start 2023-10-06T04:37:48.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.021+0000 7f7315896700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f731006baa0 0x7f73100c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:48.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.021+0000 7f7315896700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f731006be70 0x7f731015c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:48.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.022+0000 7f7315896700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7310140f40 0x7f73100a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:48.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.022+0000 7f7315896700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73100c9780 con 0x7f731006baa0 2023-10-06T04:37:48.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.022+0000 7f7315896700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73100c8b70 con 0x7f7310140f40 2023-10-06T04:37:48.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.022+0000 7f7315896700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73100c8e50 con 0x7f731006be70 2023-10-06T04:37:48.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.022+0000 7f7314894700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f731006baa0 0x7f73100c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:48.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.022+0000 7f7314894700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f731006baa0 0x7f73100c9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42538/0 (socket says 172.21.15.8:42538) 2023-10-06T04:37:48.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.022+0000 7f7314894700 1 -- 172.21.15.8:0/1654853387 learned_addr learned my addr 172.21.15.8:0/1654853387 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:48.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.022+0000 7f7315095700 1 --2- 172.21.15.8:0/1654853387 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7310140f40 0x7f73100a5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:48.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.022+0000 7f730ffff700 1 --2- 172.21.15.8:0/1654853387 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f731006be70 0x7f731015c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:48.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.022+0000 7f7314894700 1 -- 172.21.15.8:0/1654853387 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f731006be70 msgr2=0x7f731015c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:48.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.022+0000 7f7314894700 1 --2- 172.21.15.8:0/1654853387 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f731006be70 0x7f731015c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:48.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.022+0000 7f7314894700 1 -- 172.21.15.8:0/1654853387 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7310140f40 msgr2=0x7f73100a5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:48.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.022+0000 7f7314894700 1 --2- 172.21.15.8:0/1654853387 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7310140f40 0x7f73100a5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:48.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.022+0000 7f7314894700 1 -- 172.21.15.8:0/1654853387 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7308009ae0 con 0x7f731006baa0 2023-10-06T04:37:48.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.022+0000 7f7314894700 1 --2- 172.21.15.8:0/1654853387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f731006baa0 0x7f73100c9c10 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f730000c590 tx=0x7f730000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:48.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.022+0000 7f730cff9700 1 -- 172.21.15.8:0/1654853387 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7300011590 con 0x7f731006baa0 2023-10-06T04:37:48.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.022+0000 7f730cff9700 1 -- 172.21.15.8:0/1654853387 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73000116f0 con 0x7f731006baa0 2023-10-06T04:37:48.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.022+0000 7f7315896700 1 -- 172.21.15.8:0/1654853387 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73100c9130 con 0x7f731006baa0 2023-10-06T04:37:48.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.022+0000 7f730cff9700 1 -- 172.21.15.8:0/1654853387 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7300011ab0 con 0x7f731006baa0 2023-10-06T04:37:48.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.022+0000 7f7315896700 1 -- 172.21.15.8:0/1654853387 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73100c8740 con 0x7f731006baa0 2023-10-06T04:37:48.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.023+0000 7f7315896700 1 -- 172.21.15.8:0/1654853387 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f731004c380 con 0x7f731006baa0 2023-10-06T04:37:48.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.024+0000 7f730cff9700 1 -- 172.21.15.8:0/1654853387 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f730001b3b0 con 0x7f731006baa0 2023-10-06T04:37:48.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.024+0000 7f730cff9700 1 --2- 172.21.15.8:0/1654853387 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f72fc066f30 0x7f72fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:48.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.024+0000 7f730cff9700 1 -- 172.21.15.8:0/1654853387 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7f7300084020 con 0x7f731006baa0 2023-10-06T04:37:48.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.024+0000 7f730ffff700 1 --2- 172.21.15.8:0/1654853387 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f72fc066f30 0x7f72fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:48.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.025+0000 7f730ffff700 1 --2- 172.21.15.8:0/1654853387 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f72fc066f30 0x7f72fc0693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f73100affc0 tx=0x7f7304008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:48.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.028+0000 7f730cff9700 1 -- 172.21.15.8:0/1654853387 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7300050d30 con 0x7f731006baa0 2023-10-06T04:37:48.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.268+0000 7f7315896700 1 -- 172.21.15.8:0/1654853387 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73100c9a60 con 0x7f731006baa0 2023-10-06T04:37:48.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.268+0000 7f730cff9700 1 -- 172.21.15.8:0/1654853387 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+5662 (secure 0 0 0) 0x7f7300017070 con 0x7f731006baa0 2023-10-06T04:37:48.270 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:48.270 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":28,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/867081044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":867081044},{"type":"v1","addr":"172.21.15.184:6835","nonce":867081044}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5176,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2754847040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2754847040},{"type":"v1","addr":"172.21.15.184:6837","nonce":2754847040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5358,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/1957165234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1957165234},{"type":"v1","addr":"172.21.15.8:6834","nonce":1957165234}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:37:16.932006+0000","modified":"2023-10-06T04:37:26.044254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":39,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:37:29.514098+0000","modified":"2023-10-06T04:37:43.827602+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5361":{"gid":5361,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.8:6835/1173304661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1173304661},{"type":"v1","addr":"172.21.15.8:6835","nonce":1173304661}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":8,"enabled":true,"fs_name":"recovery_fs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T04:37:48.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.270+0000 7f7315896700 1 -- 172.21.15.8:0/1654853387 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f72fc066f30 msgr2=0x7f72fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:48.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.270+0000 7f7315896700 1 --2- 172.21.15.8:0/1654853387 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f72fc066f30 0x7f72fc0693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f73100affc0 tx=0x7f7304008040 comp rx=0 tx=0).stop 2023-10-06T04:37:48.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.270+0000 7f7315896700 1 -- 172.21.15.8:0/1654853387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f731006baa0 msgr2=0x7f73100c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:48.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.270+0000 7f7315896700 1 --2- 172.21.15.8:0/1654853387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f731006baa0 0x7f73100c9c10 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f730000c590 tx=0x7f730000c950 comp rx=0 tx=0).stop 2023-10-06T04:37:48.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.270+0000 7f7315896700 1 -- 172.21.15.8:0/1654853387 shutdown_connections 2023-10-06T04:37:48.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.270+0000 7f7315896700 1 --2- 172.21.15.8:0/1654853387 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f72fc066f30 0x7f72fc0693e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:48.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.270+0000 7f7315896700 1 --2- 172.21.15.8:0/1654853387 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7310140f40 0x7f73100a5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:48.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.270+0000 7f7315896700 1 --2- 172.21.15.8:0/1654853387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f731006baa0 0x7f73100c9c10 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:48.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.270+0000 7f7315896700 1 --2- 172.21.15.8:0/1654853387 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f731006be70 0x7f731015c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:48.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.270+0000 7f7315896700 1 -- 172.21.15.8:0/1654853387 >> 172.21.15.8:0/1654853387 conn(0x7f73100ce2f0 msgr2=0x7f731013f590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:48.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.270+0000 7f7315896700 1 -- 172.21.15.8:0/1654853387 shutdown_connections 2023-10-06T04:37:48.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.271+0000 7f7315896700 1 -- 172.21.15.8:0/1654853387 wait complete. 2023-10-06T04:37:48.274 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 28 2023-10-06T04:37:48.284 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:37:48.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.402+0000 7fba6e190700 1 Processor -- start 2023-10-06T04:37:48.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.402+0000 7fba6e190700 1 -- start start 2023-10-06T04:37:48.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.402+0000 7fba6e190700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fba680af680 0x7fba6815e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:48.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.402+0000 7fba6e190700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fba680cb360 0x7fba680d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:48.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.402+0000 7fba6e190700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba680cc4c0 con 0x7fba680d08d0 2023-10-06T04:37:48.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.402+0000 7fba6e190700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba6815d460 con 0x7fba680cb360 2023-10-06T04:37:48.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.402+0000 7fba6e190700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba680d0d50 con 0x7fba680af680 2023-10-06T04:37:48.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.403+0000 7fba66ffd700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fba680cb360 0x7fba680d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:48.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.403+0000 7fba67fff700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fba680d08d0 0x7fba680b0000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60168/0 (socket says 172.21.15.8:60168) 2023-10-06T04:37:48.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.403+0000 7fba67fff700 1 -- 172.21.15.8:0/3711191192 learned_addr learned my addr 172.21.15.8:0/3711191192 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:48.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.403+0000 7fba677fe700 1 --2- 172.21.15.8:0/3711191192 >> v2:172.21.15.184:3300/0 conn(0x7fba680af680 0x7fba6815e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:48.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.403+0000 7fba66ffd700 1 -- 172.21.15.8:0/3711191192 >> v2:172.21.15.184:3300/0 conn(0x7fba680af680 msgr2=0x7fba6815e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:48.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.403+0000 7fba66ffd700 1 --2- 172.21.15.8:0/3711191192 >> v2:172.21.15.184:3300/0 conn(0x7fba680af680 0x7fba6815e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:48.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.403+0000 7fba66ffd700 1 -- 172.21.15.8:0/3711191192 >> v1:172.21.15.8:6789/0 conn(0x7fba680d08d0 legacy=0x7fba680b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:48.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.403+0000 7fba66ffd700 1 -- 172.21.15.8:0/3711191192 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba6815e580 con 0x7fba680cb360 2023-10-06T04:37:48.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.403+0000 7fba66ffd700 1 --2- 172.21.15.8:0/3711191192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba680cb360 0x7fba680d0390 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fba680d1020 tx=0x7fba5c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8532ead98f1b509 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:48.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.403+0000 7fba667fc700 1 -- 172.21.15.8:0/3711191192 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c009e80 con 0x7fba680cb360 2023-10-06T04:37:48.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.403+0000 7fba667fc700 1 -- 172.21.15.8:0/3711191192 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5c00b820 con 0x7fba680cb360 2023-10-06T04:37:48.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.403+0000 7fba667fc700 1 -- 172.21.15.8:0/3711191192 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c00bba0 con 0x7fba680cb360 2023-10-06T04:37:48.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.404+0000 7fba6e190700 1 -- 172.21.15.8:0/3711191192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba680cb360 msgr2=0x7fba680d0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:48.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.404+0000 7fba6e190700 1 --2- 172.21.15.8:0/3711191192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba680cb360 0x7fba680d0390 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fba680d1020 tx=0x7fba5c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:48.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.404+0000 7fba6e190700 1 -- 172.21.15.8:0/3711191192 shutdown_connections 2023-10-06T04:37:48.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.404+0000 7fba6e190700 1 --2- 172.21.15.8:0/3711191192 >> v2:172.21.15.184:3300/0 conn(0x7fba680af680 0x7fba6815e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:48.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.404+0000 7fba6e190700 1 --2- 172.21.15.8:0/3711191192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba680cb360 0x7fba680d0390 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:48.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.404+0000 7fba6e190700 1 -- 172.21.15.8:0/3711191192 >> 172.21.15.8:0/3711191192 conn(0x7fba680633d0 msgr2=0x7fba680637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:48.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.404+0000 7fba6e190700 1 -- 172.21.15.8:0/3711191192 shutdown_connections 2023-10-06T04:37:48.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.404+0000 7fba6e190700 1 -- 172.21.15.8:0/3711191192 wait complete. 2023-10-06T04:37:48.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.405+0000 7fba6e190700 1 Processor -- start 2023-10-06T04:37:48.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.405+0000 7fba6e190700 1 -- start start 2023-10-06T04:37:48.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.406+0000 7fba6e190700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba680af680 0x7fba680a7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:48.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.406+0000 7fba6e190700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba680cb360 0x7fba680ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:48.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.406+0000 7fba6e190700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba680d08d0 0x7fba680ced00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:48.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.406+0000 7fba6e190700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba680c6f00 con 0x7fba680d08d0 2023-10-06T04:37:48.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.406+0000 7fba6e190700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba680c62f0 con 0x7fba680cb360 2023-10-06T04:37:48.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.406+0000 7fba6e190700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba680c65d0 con 0x7fba680af680 2023-10-06T04:37:48.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.406+0000 7fba67fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba680d08d0 0x7fba680ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:48.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.406+0000 7fba67fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba680d08d0 0x7fba680ced00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42566/0 (socket says 172.21.15.8:42566) 2023-10-06T04:37:48.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.406+0000 7fba67fff700 1 -- 172.21.15.8:0/2821121015 learned_addr learned my addr 172.21.15.8:0/2821121015 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:48.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.406+0000 7fba66ffd700 1 --2- 172.21.15.8:0/2821121015 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba680cb360 0x7fba680ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:48.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.406+0000 7fba677fe700 1 --2- 172.21.15.8:0/2821121015 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba680af680 0x7fba680a7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:48.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.406+0000 7fba67fff700 1 -- 172.21.15.8:0/2821121015 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba680af680 msgr2=0x7fba680a7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:48.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.406+0000 7fba67fff700 1 --2- 172.21.15.8:0/2821121015 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba680af680 0x7fba680a7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:48.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.406+0000 7fba67fff700 1 -- 172.21.15.8:0/2821121015 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba680cb360 msgr2=0x7fba680ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:48.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.406+0000 7fba67fff700 1 --2- 172.21.15.8:0/2821121015 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba680cb360 0x7fba680ce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:48.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.406+0000 7fba67fff700 1 -- 172.21.15.8:0/2821121015 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5c009420 con 0x7fba680d08d0 2023-10-06T04:37:48.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.407+0000 7fba67fff700 1 --2- 172.21.15.8:0/2821121015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba680d08d0 0x7fba680ced00 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fba6000cbc0 tx=0x7fba600019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:48.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.407+0000 7fba4f7fe700 1 -- 172.21.15.8:0/2821121015 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6000a7e0 con 0x7fba680d08d0 2023-10-06T04:37:48.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.407+0000 7fba4f7fe700 1 -- 172.21.15.8:0/2821121015 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6000a940 con 0x7fba680d08d0 2023-10-06T04:37:48.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.407+0000 7fba6e190700 1 -- 172.21.15.8:0/2821121015 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba680c68b0 con 0x7fba680d08d0 2023-10-06T04:37:48.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.407+0000 7fba4f7fe700 1 -- 172.21.15.8:0/2821121015 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6000acc0 con 0x7fba680d08d0 2023-10-06T04:37:48.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.407+0000 7fba6e190700 1 -- 172.21.15.8:0/2821121015 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba680a8450 con 0x7fba680d08d0 2023-10-06T04:37:48.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.408+0000 7fba6e190700 1 -- 172.21.15.8:0/2821121015 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba68070ee0 con 0x7fba680d08d0 2023-10-06T04:37:48.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.408+0000 7fba4f7fe700 1 -- 172.21.15.8:0/2821121015 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba60007300 con 0x7fba680d08d0 2023-10-06T04:37:48.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.408+0000 7fba4f7fe700 1 --2- 172.21.15.8:0/2821121015 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fba54066f30 0x7fba540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:48.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.409+0000 7fba4f7fe700 1 -- 172.21.15.8:0/2821121015 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7fba60084ca0 con 0x7fba680d08d0 2023-10-06T04:37:48.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.409+0000 7fba677fe700 1 --2- 172.21.15.8:0/2821121015 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fba54066f30 0x7fba540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:48.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.409+0000 7fba677fe700 1 --2- 172.21.15.8:0/2821121015 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fba54066f30 0x7fba540693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fba58006fd0 tx=0x7fba58008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:48.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.413+0000 7fba4f7fe700 1 -- 172.21.15.8:0/2821121015 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba60051a40 con 0x7fba680d08d0 2023-10-06T04:37:48.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.608+0000 7fba6e190700 1 -- 172.21.15.8:0/2821121015 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba68071550 con 0x7fba680d08d0 2023-10-06T04:37:48.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.609+0000 7fba4f7fe700 1 -- 172.21.15.8:0/2821121015 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+18779 (secure 0 0 0) 0x7fba60055060 con 0x7fba680d08d0 2023-10-06T04:37:48.610 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:48.610 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":46,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:37:30.782691+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:36:10.148177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:36:10.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:37:15.099258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T04:37:15.902657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}}},{"pool":8,"pool_name":"recovery_fs_metadata","create_time":"2023-10-06T04:37:28.524294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}}}],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.555871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.490505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.504578+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.517217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:05.991135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.537329+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.543232+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.443715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6835/3478733664":"2023-10-07T04:37:26.044067+0000","172.21.15.8:6833/3478733664":"2023-10-07T04:37:26.044067+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:37:48.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.610+0000 7fba6e190700 1 -- 172.21.15.8:0/2821121015 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fba54066f30 msgr2=0x7fba540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:48.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.611+0000 7fba6e190700 1 --2- 172.21.15.8:0/2821121015 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fba54066f30 0x7fba540693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fba58006fd0 tx=0x7fba58008040 comp rx=0 tx=0).stop 2023-10-06T04:37:48.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.611+0000 7fba6e190700 1 -- 172.21.15.8:0/2821121015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba680d08d0 msgr2=0x7fba680ced00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:48.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.611+0000 7fba6e190700 1 --2- 172.21.15.8:0/2821121015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba680d08d0 0x7fba680ced00 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fba6000cbc0 tx=0x7fba600019c0 comp rx=0 tx=0).stop 2023-10-06T04:37:48.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.611+0000 7fba6e190700 1 -- 172.21.15.8:0/2821121015 shutdown_connections 2023-10-06T04:37:48.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.611+0000 7fba6e190700 1 --2- 172.21.15.8:0/2821121015 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fba54066f30 0x7fba540693e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:48.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.611+0000 7fba6e190700 1 --2- 172.21.15.8:0/2821121015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba680d08d0 0x7fba680ced00 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:48.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.611+0000 7fba6e190700 1 --2- 172.21.15.8:0/2821121015 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba680af680 0x7fba680a7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:48.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.611+0000 7fba6e190700 1 --2- 172.21.15.8:0/2821121015 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba680cb360 0x7fba680ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:48.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.611+0000 7fba6e190700 1 -- 172.21.15.8:0/2821121015 >> 172.21.15.8:0/2821121015 conn(0x7fba680633d0 msgr2=0x7fba6815c940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:48.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.611+0000 7fba6e190700 1 -- 172.21.15.8:0/2821121015 shutdown_connections 2023-10-06T04:37:48.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.611+0000 7fba6e190700 1 -- 172.21.15.8:0/2821121015 wait complete. 2023-10-06T04:37:48.624 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:36:10.148177+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:36:10.684157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:37:15.099258+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:37:15.902657+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'recovery_fs'}}}, {'pool': 8, 'pool_name': 'recovery_fs_metadata', 'create_time': '2023-10-06T04:37:28.524294+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'recovery_fs'}}}] 2023-10-06T04:37:48.625 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:37:48.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.746+0000 7f65c0ad8700 1 Processor -- start 2023-10-06T04:37:48.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.746+0000 7f65c0ad8700 1 -- start start 2023-10-06T04:37:48.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.747+0000 7f65c0ad8700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f65bc15b490 0x7f65bc0b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:48.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.747+0000 7f65c0ad8700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65bc0b2620 con 0x7f65bc156e30 2023-10-06T04:37:48.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.747+0000 7f65c0ad8700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65bc0cf370 con 0x7f65bc0b1c70 2023-10-06T04:37:48.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.747+0000 7f65c0ad8700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65bc0ce800 con 0x7f65bc15b490 2023-10-06T04:37:48.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.747+0000 7f65bb7fe700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f65bc156e30 0x7f65bc0cf800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60180/0 (socket says 172.21.15.8:60180) 2023-10-06T04:37:48.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.747+0000 7f65bb7fe700 1 -- 172.21.15.8:0/310308573 learned_addr learned my addr 172.21.15.8:0/310308573 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:48.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.747+0000 7f65bbfff700 1 --2- 172.21.15.8:0/310308573 >> v2:172.21.15.8:3300/0 conn(0x7f65bc15b490 0x7f65bc0b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:48.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.747+0000 7f65ba7fc700 1 -- 172.21.15.8:0/310308573 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 792696825 0 0) 0x7f65bc0b2620 con 0x7f65bc156e30 2023-10-06T04:37:48.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.747+0000 7f65ba7fc700 1 -- 172.21.15.8:0/310308573 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65a8003570 con 0x7f65bc156e30 2023-10-06T04:37:48.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.747+0000 7f65bbfff700 1 -- 172.21.15.8:0/310308573 >> v1:172.21.15.184:6789/0 conn(0x7f65bc0b1c70 legacy=0x7f65bc15ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:48.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.747+0000 7f65bbfff700 1 -- 172.21.15.8:0/310308573 >> v1:172.21.15.8:6789/0 conn(0x7f65bc156e30 legacy=0x7f65bc0cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:48.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.747+0000 7f65bbfff700 1 -- 172.21.15.8:0/310308573 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65bc0cea60 con 0x7f65bc15b490 2023-10-06T04:37:48.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.747+0000 7f65bbfff700 1 --2- 172.21.15.8:0/310308573 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65bc15b490 0x7f65bc0b20e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f65b40098e0 tx=0x7f65b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b380b5c3c03a9bf9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:48.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.747+0000 7f65ba7fc700 1 -- 172.21.15.8:0/310308573 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b400b640 con 0x7f65bc15b490 2023-10-06T04:37:48.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.747+0000 7f65ba7fc700 1 -- 172.21.15.8:0/310308573 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b400b7a0 con 0x7f65bc15b490 2023-10-06T04:37:48.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.747+0000 7f65ba7fc700 1 -- 172.21.15.8:0/310308573 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b400bb40 con 0x7f65bc15b490 2023-10-06T04:37:48.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.748+0000 7f65c0ad8700 1 -- 172.21.15.8:0/310308573 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65bc15b490 msgr2=0x7f65bc0b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:48.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.748+0000 7f65c0ad8700 1 --2- 172.21.15.8:0/310308573 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65bc15b490 0x7f65bc0b20e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f65b40098e0 tx=0x7f65b40091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:48.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.748+0000 7f65c0ad8700 1 -- 172.21.15.8:0/310308573 shutdown_connections 2023-10-06T04:37:48.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.748+0000 7f65c0ad8700 1 --2- 172.21.15.8:0/310308573 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65bc15b490 0x7f65bc0b20e0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:48.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.748+0000 7f65c0ad8700 1 -- 172.21.15.8:0/310308573 >> 172.21.15.8:0/310308573 conn(0x7f65bc06ed00 msgr2=0x7f65bc06f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:48.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.748+0000 7f65c0ad8700 1 -- 172.21.15.8:0/310308573 shutdown_connections 2023-10-06T04:37:48.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.748+0000 7f65c0ad8700 1 -- 172.21.15.8:0/310308573 wait complete. 2023-10-06T04:37:48.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.749+0000 7f65c0ad8700 1 Processor -- start 2023-10-06T04:37:48.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.749+0000 7f65c0ad8700 1 -- start start 2023-10-06T04:37:48.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.750+0000 7f65c0ad8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65bc0b1c70 0x7f65bc0b4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:48.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.750+0000 7f65c0ad8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65bc156e30 0x7f65bc13db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:48.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.750+0000 7f65c0ad8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65bc15b490 0x7f65bc0b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:48.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.750+0000 7f65c0ad8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc16d190 con 0x7f65bc15b490 2023-10-06T04:37:48.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.750+0000 7f65c0ad8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc16d470 con 0x7f65bc156e30 2023-10-06T04:37:48.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.750+0000 7f65c0ad8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc16d750 con 0x7f65bc0b1c70 2023-10-06T04:37:48.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.750+0000 7f65bbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65bc15b490 0x7f65bc0b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:48.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.750+0000 7f65bbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65bc15b490 0x7f65bc0b3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42584/0 (socket says 172.21.15.8:42584) 2023-10-06T04:37:48.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.750+0000 7f65bbfff700 1 -- 172.21.15.8:0/1081299640 learned_addr learned my addr 172.21.15.8:0/1081299640 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:48.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.750+0000 7f65baffd700 1 --2- 172.21.15.8:0/1081299640 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65bc156e30 0x7f65bc13db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:48.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.750+0000 7f65bb7fe700 1 --2- 172.21.15.8:0/1081299640 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65bc0b1c70 0x7f65bc0b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:48.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.750+0000 7f65bbfff700 1 -- 172.21.15.8:0/1081299640 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65bc0b1c70 msgr2=0x7f65bc0b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:48.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.750+0000 7f65bbfff700 1 --2- 172.21.15.8:0/1081299640 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65bc0b1c70 0x7f65bc0b4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:48.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.750+0000 7f65bbfff700 1 -- 172.21.15.8:0/1081299640 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65bc156e30 msgr2=0x7f65bc13db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:48.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.750+0000 7f65bbfff700 1 --2- 172.21.15.8:0/1081299640 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65bc156e30 0x7f65bc13db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:48.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.750+0000 7f65bbfff700 1 -- 172.21.15.8:0/1081299640 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b4009420 con 0x7f65bc15b490 2023-10-06T04:37:48.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.750+0000 7f65baffd700 1 --2- 172.21.15.8:0/1081299640 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65bc156e30 0x7f65bc13db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:48.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.751+0000 7f65bbfff700 1 --2- 172.21.15.8:0/1081299640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65bc15b490 0x7f65bc0b3ac0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f65b40030c0 tx=0x7f65b4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:48.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.751+0000 7f65b37fe700 1 -- 172.21.15.8:0/1081299640 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b4011df0 con 0x7f65bc15b490 2023-10-06T04:37:48.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.751+0000 7f65b37fe700 1 -- 172.21.15.8:0/1081299640 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b4020070 con 0x7f65bc15b490 2023-10-06T04:37:48.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.751+0000 7f65c0ad8700 1 -- 172.21.15.8:0/1081299640 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65bc16da30 con 0x7f65bc15b490 2023-10-06T04:37:48.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.751+0000 7f65b37fe700 1 -- 172.21.15.8:0/1081299640 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b401b6a0 con 0x7f65bc15b490 2023-10-06T04:37:48.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.751+0000 7f65c0ad8700 1 -- 172.21.15.8:0/1081299640 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65bc14e3a0 con 0x7f65bc15b490 2023-10-06T04:37:48.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.752+0000 7f65c0ad8700 1 -- 172.21.15.8:0/1081299640 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65bc16ded0 con 0x7f65bc15b490 2023-10-06T04:37:48.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.752+0000 7f65b37fe700 1 -- 172.21.15.8:0/1081299640 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f65b4022030 con 0x7f65bc15b490 2023-10-06T04:37:48.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.752+0000 7f65b37fe700 1 --2- 172.21.15.8:0/1081299640 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f659c066f30 0x7f659c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:48.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.752+0000 7f65b37fe700 1 -- 172.21.15.8:0/1081299640 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7f65b4086950 con 0x7f65bc15b490 2023-10-06T04:37:48.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.753+0000 7f65bb7fe700 1 --2- 172.21.15.8:0/1081299640 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f659c066f30 0x7f659c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:48.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.753+0000 7f65bb7fe700 1 --2- 172.21.15.8:0/1081299640 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f659c066f30 0x7f659c0693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f65bc155340 tx=0x7f65ac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:48.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.757+0000 7f65b37fe700 1 -- 172.21.15.8:0/1081299640 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f65b4053700 con 0x7f65bc15b490 2023-10-06T04:37:48.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.954+0000 7f65c0ad8700 1 -- 172.21.15.8:0/1081299640 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f65bc16ded0 con 0x7f65bc15b490 2023-10-06T04:37:48.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.954+0000 7f65b37fe700 1 -- 172.21.15.8:0/1081299640 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v46) v1 ==== 92+0+10 (secure 0 0 0) 0x7f65b4056d20 con 0x7f65bc15b490 2023-10-06T04:37:48.956 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 8 2023-10-06T04:37:48.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.956+0000 7f65c0ad8700 1 -- 172.21.15.8:0/1081299640 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f659c066f30 msgr2=0x7f659c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:48.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.956+0000 7f65c0ad8700 1 --2- 172.21.15.8:0/1081299640 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f659c066f30 0x7f659c0693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f65bc155340 tx=0x7f65ac009040 comp rx=0 tx=0).stop 2023-10-06T04:37:48.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.956+0000 7f65c0ad8700 1 -- 172.21.15.8:0/1081299640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65bc15b490 msgr2=0x7f65bc0b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:48.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.956+0000 7f65c0ad8700 1 --2- 172.21.15.8:0/1081299640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65bc15b490 0x7f65bc0b3ac0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f65b40030c0 tx=0x7f65b4016000 comp rx=0 tx=0).stop 2023-10-06T04:37:48.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.957+0000 7f65c0ad8700 1 -- 172.21.15.8:0/1081299640 shutdown_connections 2023-10-06T04:37:48.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.957+0000 7f65c0ad8700 1 --2- 172.21.15.8:0/1081299640 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f659c066f30 0x7f659c0693e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:48.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.957+0000 7f65c0ad8700 1 --2- 172.21.15.8:0/1081299640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65bc15b490 0x7f65bc0b3ac0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:48.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.957+0000 7f65c0ad8700 1 --2- 172.21.15.8:0/1081299640 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65bc0b1c70 0x7f65bc0b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:48.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.957+0000 7f65c0ad8700 1 --2- 172.21.15.8:0/1081299640 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65bc156e30 0x7f65bc13db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:48.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.957+0000 7f65c0ad8700 1 -- 172.21.15.8:0/1081299640 >> 172.21.15.8:0/1081299640 conn(0x7f65bc06ed00 msgr2=0x7f65bc15aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:48.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.957+0000 7f65c0ad8700 1 -- 172.21.15.8:0/1081299640 shutdown_connections 2023-10-06T04:37:48.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:48.957+0000 7f65c0ad8700 1 -- 172.21.15.8:0/1081299640 wait complete. 2023-10-06T04:37:48.970 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:37:49.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.090+0000 7f2eb4005700 1 Processor -- start 2023-10-06T04:37:49.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.090+0000 7f2eb4005700 1 -- start start 2023-10-06T04:37:49.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.091+0000 7f2eb4005700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2eac1430c0 0x7f2eac0cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:49.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.091+0000 7f2eb4005700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eac0cf510 con 0x7f2eac0cfee0 2023-10-06T04:37:49.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.091+0000 7f2eb4005700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eac0ce6a0 con 0x7f2eac142cf0 2023-10-06T04:37:49.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.091+0000 7f2eb4005700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eac0ce900 con 0x7f2eac1430c0 2023-10-06T04:37:49.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.091+0000 7f2eb25a2700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f2eac0cfee0 0x7f2eac0b3790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60196/0 (socket says 172.21.15.8:60196) 2023-10-06T04:37:49.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.091+0000 7f2eb25a2700 1 -- 172.21.15.8:0/552313440 learned_addr learned my addr 172.21.15.8:0/552313440 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:49.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.091+0000 7f2eb15a0700 1 --2- 172.21.15.8:0/552313440 >> v2:172.21.15.184:3300/0 conn(0x7f2eac1430c0 0x7f2eac0cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:49.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.092+0000 7f2eb0d9f700 1 -- 172.21.15.8:0/552313440 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1928881483 0 0) 0x7f2eac0cf510 con 0x7f2eac0cfee0 2023-10-06T04:37:49.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.092+0000 7f2eb0d9f700 1 -- 172.21.15.8:0/552313440 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e94003570 con 0x7f2eac0cfee0 2023-10-06T04:37:49.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.092+0000 7f2eb0d9f700 1 -- 172.21.15.8:0/552313440 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3574789885 0 0) 0x7f2eac0ce6a0 con 0x7f2eac142cf0 2023-10-06T04:37:49.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.092+0000 7f2eb0d9f700 1 -- 172.21.15.8:0/552313440 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2eac0cf510 con 0x7f2eac142cf0 2023-10-06T04:37:49.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.092+0000 7f2eb0d9f700 1 -- 172.21.15.8:0/552313440 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2819821800 0 0) 0x7f2e94003570 con 0x7f2eac0cfee0 2023-10-06T04:37:49.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.092+0000 7f2eb15a0700 1 -- 172.21.15.8:0/552313440 >> v1:172.21.15.184:6789/0 conn(0x7f2eac142cf0 legacy=0x7f2eac0b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:49.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.092+0000 7f2eb15a0700 1 -- 172.21.15.8:0/552313440 >> v1:172.21.15.8:6789/0 conn(0x7f2eac0cfee0 legacy=0x7f2eac0b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:49.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.092+0000 7f2eb15a0700 1 -- 172.21.15.8:0/552313440 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eac0cebe0 con 0x7f2eac1430c0 2023-10-06T04:37:49.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.092+0000 7f2eb15a0700 1 --2- 172.21.15.8:0/552313440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2eac1430c0 0x7f2eac0cf9a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2ea00098e0 tx=0x7f2ea00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a44caf0b3bbfefe6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:49.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.092+0000 7f2eb0d9f700 1 -- 172.21.15.8:0/552313440 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4001470 con 0x7f2eac1430c0 2023-10-06T04:37:49.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.092+0000 7f2eb0d9f700 1 -- 172.21.15.8:0/552313440 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea0011420 con 0x7f2eac1430c0 2023-10-06T04:37:49.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.092+0000 7f2eb0d9f700 1 -- 172.21.15.8:0/552313440 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea00117c0 con 0x7f2eac1430c0 2023-10-06T04:37:49.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.093+0000 7f2eb4005700 1 -- 172.21.15.8:0/552313440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2eac1430c0 msgr2=0x7f2eac0cf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:49.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.093+0000 7f2eb4005700 1 --2- 172.21.15.8:0/552313440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2eac1430c0 0x7f2eac0cf9a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2ea00098e0 tx=0x7f2ea00091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:49.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.093+0000 7f2eb4005700 1 -- 172.21.15.8:0/552313440 shutdown_connections 2023-10-06T04:37:49.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.093+0000 7f2eb4005700 1 --2- 172.21.15.8:0/552313440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2eac1430c0 0x7f2eac0cf9a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:49.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.093+0000 7f2eb4005700 1 -- 172.21.15.8:0/552313440 >> 172.21.15.8:0/552313440 conn(0x7f2eac06ed00 msgr2=0x7f2eac06f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:49.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.093+0000 7f2eb4005700 1 -- 172.21.15.8:0/552313440 shutdown_connections 2023-10-06T04:37:49.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.093+0000 7f2eb4005700 1 -- 172.21.15.8:0/552313440 wait complete. 2023-10-06T04:37:49.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.094+0000 7f2eb4005700 1 Processor -- start 2023-10-06T04:37:49.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.094+0000 7f2eb4005700 1 -- start start 2023-10-06T04:37:49.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.095+0000 7f2eb4005700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2eac0cfee0 0x7f2eac0c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:49.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.095+0000 7f2eb4005700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2eac142cf0 0x7f2eac169ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:49.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.095+0000 7f2eb4005700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2eac1430c0 0x7f2eac16a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:49.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.095+0000 7f2eb4005700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac159fb0 con 0x7f2eac0cfee0 2023-10-06T04:37:49.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.095+0000 7f2eb4005700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac159cb0 con 0x7f2eac1430c0 2023-10-06T04:37:49.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.095+0000 7f2eb4005700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac16a600 con 0x7f2eac142cf0 2023-10-06T04:37:49.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.095+0000 7f2eb1da1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2eac0cfee0 0x7f2eac0c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:49.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.095+0000 7f2eb1da1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2eac0cfee0 0x7f2eac0c72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42594/0 (socket says 172.21.15.8:42594) 2023-10-06T04:37:49.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.095+0000 7f2eb1da1700 1 -- 172.21.15.8:0/2208132526 learned_addr learned my addr 172.21.15.8:0/2208132526 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:49.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.095+0000 7f2eb25a2700 1 --2- 172.21.15.8:0/2208132526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2eac1430c0 0x7f2eac16a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:49.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.095+0000 7f2eb15a0700 1 --2- 172.21.15.8:0/2208132526 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2eac142cf0 0x7f2eac169ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:49.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.095+0000 7f2eb1da1700 1 -- 172.21.15.8:0/2208132526 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2eac142cf0 msgr2=0x7f2eac169ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:49.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.095+0000 7f2eb1da1700 1 --2- 172.21.15.8:0/2208132526 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2eac142cf0 0x7f2eac169ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:49.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.095+0000 7f2eb1da1700 1 -- 172.21.15.8:0/2208132526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2eac1430c0 msgr2=0x7f2eac16a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:49.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.095+0000 7f2eb1da1700 1 --2- 172.21.15.8:0/2208132526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2eac1430c0 0x7f2eac16a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:49.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.095+0000 7f2eb1da1700 1 -- 172.21.15.8:0/2208132526 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea0009420 con 0x7f2eac0cfee0 2023-10-06T04:37:49.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.095+0000 7f2eb1da1700 1 --2- 172.21.15.8:0/2208132526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2eac0cfee0 0x7f2eac0c72a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c00cb10 tx=0x7f2e9c002820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:49.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.095+0000 7f2ea9ffb700 1 -- 172.21.15.8:0/2208132526 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c00a760 con 0x7f2eac0cfee0 2023-10-06T04:37:49.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.096+0000 7f2ea9ffb700 1 -- 172.21.15.8:0/2208132526 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9c00a8c0 con 0x7f2eac0cfee0 2023-10-06T04:37:49.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.096+0000 7f2eb4005700 1 -- 172.21.15.8:0/2208132526 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eac16a8e0 con 0x7f2eac0cfee0 2023-10-06T04:37:49.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.096+0000 7f2ea9ffb700 1 -- 172.21.15.8:0/2208132526 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c00ac60 con 0x7f2eac0cfee0 2023-10-06T04:37:49.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.096+0000 7f2eb4005700 1 -- 172.21.15.8:0/2208132526 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eac16abc0 con 0x7f2eac0cfee0 2023-10-06T04:37:49.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.097+0000 7f2eb4005700 1 -- 172.21.15.8:0/2208132526 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eac071550 con 0x7f2eac0cfee0 2023-10-06T04:37:49.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.097+0000 7f2ea9ffb700 1 -- 172.21.15.8:0/2208132526 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2e9c012630 con 0x7f2eac0cfee0 2023-10-06T04:37:49.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.097+0000 7f2ea9ffb700 1 --2- 172.21.15.8:0/2208132526 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2e98066f30 0x7f2e980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:49.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.098+0000 7f2ea9ffb700 1 -- 172.21.15.8:0/2208132526 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7f2e9c084dc0 con 0x7f2eac0cfee0 2023-10-06T04:37:49.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.098+0000 7f2eb15a0700 1 --2- 172.21.15.8:0/2208132526 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2e98066f30 0x7f2e980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:49.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.098+0000 7f2eb15a0700 1 --2- 172.21.15.8:0/2208132526 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2e98066f30 0x7f2e980693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2ea00093f0 tx=0x7f2ea0016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:49.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.102+0000 7f2ea9ffb700 1 -- 172.21.15.8:0/2208132526 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e9c051b70 con 0x7f2eac0cfee0 2023-10-06T04:37:49.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.294+0000 7f2eb4005700 1 -- 172.21.15.8:0/2208132526 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2eac0ceec0 con 0x7f2eac0cfee0 2023-10-06T04:37:49.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.295+0000 7f2ea9ffb700 1 -- 172.21.15.8:0/2208132526 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2e9c055190 con 0x7f2eac0cfee0 2023-10-06T04:37:49.296 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-06T04:37:49.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.297+0000 7f2eb4005700 1 -- 172.21.15.8:0/2208132526 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2e98066f30 msgr2=0x7f2e980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:49.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.297+0000 7f2eb4005700 1 --2- 172.21.15.8:0/2208132526 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2e98066f30 0x7f2e980693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2ea00093f0 tx=0x7f2ea0016000 comp rx=0 tx=0).stop 2023-10-06T04:37:49.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.297+0000 7f2eb4005700 1 -- 172.21.15.8:0/2208132526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2eac0cfee0 msgr2=0x7f2eac0c72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:49.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.297+0000 7f2eb4005700 1 --2- 172.21.15.8:0/2208132526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2eac0cfee0 0x7f2eac0c72a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c00cb10 tx=0x7f2e9c002820 comp rx=0 tx=0).stop 2023-10-06T04:37:49.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.297+0000 7f2eb4005700 1 -- 172.21.15.8:0/2208132526 shutdown_connections 2023-10-06T04:37:49.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.297+0000 7f2eb4005700 1 --2- 172.21.15.8:0/2208132526 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f2e98066f30 0x7f2e980693e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:49.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.297+0000 7f2eb4005700 1 --2- 172.21.15.8:0/2208132526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2eac1430c0 0x7f2eac16a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:49.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.297+0000 7f2eb4005700 1 --2- 172.21.15.8:0/2208132526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2eac0cfee0 0x7f2eac0c72a0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:49.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.297+0000 7f2eb4005700 1 --2- 172.21.15.8:0/2208132526 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2eac142cf0 0x7f2eac169ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:49.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.297+0000 7f2eb4005700 1 -- 172.21.15.8:0/2208132526 >> 172.21.15.8:0/2208132526 conn(0x7f2eac06ed00 msgr2=0x7f2eac0b0730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:49.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.297+0000 7f2eb4005700 1 -- 172.21.15.8:0/2208132526 shutdown_connections 2023-10-06T04:37:49.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.297+0000 7f2eb4005700 1 -- 172.21.15.8:0/2208132526 wait complete. 2023-10-06T04:37:49.310 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:37:49.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.430+0000 7f43b0467700 1 Processor -- start 2023-10-06T04:37:49.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.430+0000 7f43b0467700 1 -- start start 2023-10-06T04:37:49.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.431+0000 7f43b0467700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43a81532d0 0x7f43a80698d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:49.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.431+0000 7f43b0467700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f43a8069e10 0x7f43a8159530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:49.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.431+0000 7f43b0467700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43a80ca770 con 0x7f43a81536a0 2023-10-06T04:37:49.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.431+0000 7f43b0467700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43a806a930 con 0x7f43a8069e10 2023-10-06T04:37:49.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.431+0000 7f43b0467700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a80cce40 con 0x7f43a81532d0 2023-10-06T04:37:49.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.431+0000 7f43aea04700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f43a81536a0 0x7f43a80cc730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60210/0 (socket says 172.21.15.8:60210) 2023-10-06T04:37:49.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.431+0000 7f43aea04700 1 -- 172.21.15.8:0/1232612053 learned_addr learned my addr 172.21.15.8:0/1232612053 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:49.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.431+0000 7f43ada02700 1 --2- 172.21.15.8:0/1232612053 >> v2:172.21.15.184:3300/0 conn(0x7f43a8069e10 0x7f43a8159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:49.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.431+0000 7f43ae203700 1 --2- 172.21.15.8:0/1232612053 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43a81532d0 0x7f43a80698d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:49.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.431+0000 7f43ad201700 1 -- 172.21.15.8:0/1232612053 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2904254593 0 0) 0x7f43a80ca770 con 0x7f43a81536a0 2023-10-06T04:37:49.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.432+0000 7f43ad201700 1 -- 172.21.15.8:0/1232612053 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4394003570 con 0x7f43a81536a0 2023-10-06T04:37:49.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.432+0000 7f43ada02700 1 -- 172.21.15.8:0/1232612053 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43a81532d0 msgr2=0x7f43a80698d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:49.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.432+0000 7f43ada02700 1 --2- 172.21.15.8:0/1232612053 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43a81532d0 0x7f43a80698d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:49.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.432+0000 7f43ada02700 1 -- 172.21.15.8:0/1232612053 >> v1:172.21.15.8:6789/0 conn(0x7f43a81536a0 legacy=0x7f43a80cc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:49.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.432+0000 7f43ada02700 1 -- 172.21.15.8:0/1232612053 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a806d6d0 con 0x7f43a8069e10 2023-10-06T04:37:49.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.432+0000 7f43ae203700 1 --2- 172.21.15.8:0/1232612053 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43a81532d0 0x7f43a80698d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:37:49.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.432+0000 7f43ada02700 1 --2- 172.21.15.8:0/1232612053 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43a8069e10 0x7f43a8159530 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4398009910 tx=0x7f43980091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=794010e4552b942b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:49.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.432+0000 7f43ad201700 1 -- 172.21.15.8:0/1232612053 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4398011630 con 0x7f43a8069e10 2023-10-06T04:37:49.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.432+0000 7f43ad201700 1 -- 172.21.15.8:0/1232612053 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4398011790 con 0x7f43a8069e10 2023-10-06T04:37:49.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.432+0000 7f43ad201700 1 -- 172.21.15.8:0/1232612053 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4398011b30 con 0x7f43a8069e10 2023-10-06T04:37:49.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.433+0000 7f43b0467700 1 -- 172.21.15.8:0/1232612053 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43a8069e10 msgr2=0x7f43a8159530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:49.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.433+0000 7f43b0467700 1 --2- 172.21.15.8:0/1232612053 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43a8069e10 0x7f43a8159530 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4398009910 tx=0x7f43980091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:49.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.433+0000 7f43b0467700 1 -- 172.21.15.8:0/1232612053 shutdown_connections 2023-10-06T04:37:49.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.433+0000 7f43b0467700 1 --2- 172.21.15.8:0/1232612053 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43a81532d0 0x7f43a80698d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:49.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.433+0000 7f43b0467700 1 --2- 172.21.15.8:0/1232612053 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43a8069e10 0x7f43a8159530 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:49.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.433+0000 7f43b0467700 1 -- 172.21.15.8:0/1232612053 >> 172.21.15.8:0/1232612053 conn(0x7f43a80680a0 msgr2=0x7f43a80cc020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:49.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.433+0000 7f43b0467700 1 -- 172.21.15.8:0/1232612053 shutdown_connections 2023-10-06T04:37:49.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.433+0000 7f43b0467700 1 -- 172.21.15.8:0/1232612053 wait complete. 2023-10-06T04:37:49.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.434+0000 7f43b0467700 1 Processor -- start 2023-10-06T04:37:49.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.434+0000 7f43b0467700 1 -- start start 2023-10-06T04:37:49.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.435+0000 7f43b0467700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43a8069e10 0x7f43a8099710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:49.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.435+0000 7f43b0467700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43a81532d0 0x7f43a8150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:49.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.435+0000 7f43b0467700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43a81536a0 0x7f43a80ac510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:49.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.435+0000 7f43b0467700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a80ad8e0 con 0x7f43a81536a0 2023-10-06T04:37:49.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.435+0000 7f43b0467700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a8151160 con 0x7f43a81532d0 2023-10-06T04:37:49.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.435+0000 7f43b0467700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a80aca50 con 0x7f43a8069e10 2023-10-06T04:37:49.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.435+0000 7f43aea04700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43a81536a0 0x7f43a80ac510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:49.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.435+0000 7f43aea04700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43a81536a0 0x7f43a80ac510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42608/0 (socket says 172.21.15.8:42608) 2023-10-06T04:37:49.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.435+0000 7f43aea04700 1 -- 172.21.15.8:0/3539264534 learned_addr learned my addr 172.21.15.8:0/3539264534 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:49.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.435+0000 7f43ada02700 1 --2- 172.21.15.8:0/3539264534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43a81532d0 0x7f43a8150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:49.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.435+0000 7f43ae203700 1 --2- 172.21.15.8:0/3539264534 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43a8069e10 0x7f43a8099710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:49.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.435+0000 7f43aea04700 1 -- 172.21.15.8:0/3539264534 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43a8069e10 msgr2=0x7f43a8099710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:49.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.435+0000 7f43aea04700 1 --2- 172.21.15.8:0/3539264534 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43a8069e10 0x7f43a8099710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:49.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.435+0000 7f43aea04700 1 -- 172.21.15.8:0/3539264534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43a81532d0 msgr2=0x7f43a8150c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:49.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.435+0000 7f43aea04700 1 --2- 172.21.15.8:0/3539264534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43a81532d0 0x7f43a8150c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:49.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.435+0000 7f43aea04700 1 -- 172.21.15.8:0/3539264534 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a4009420 con 0x7f43a81536a0 2023-10-06T04:37:49.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.436+0000 7f43aea04700 1 --2- 172.21.15.8:0/3539264534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43a81536a0 0x7f43a80ac510 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f43a0001460 tx=0x7f43a0001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:49.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.436+0000 7f439e7fc700 1 -- 172.21.15.8:0/3539264534 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a000a890 con 0x7f43a81536a0 2023-10-06T04:37:49.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.436+0000 7f43b0467700 1 -- 172.21.15.8:0/3539264534 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4398009420 con 0x7f43a81536a0 2023-10-06T04:37:49.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.436+0000 7f439e7fc700 1 -- 172.21.15.8:0/3539264534 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a000a9f0 con 0x7f43a81536a0 2023-10-06T04:37:49.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.436+0000 7f439e7fc700 1 -- 172.21.15.8:0/3539264534 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a000ad70 con 0x7f43a81536a0 2023-10-06T04:37:49.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.436+0000 7f43b0467700 1 -- 172.21.15.8:0/3539264534 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a80acfb0 con 0x7f43a81536a0 2023-10-06T04:37:49.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.437+0000 7f43b0467700 1 -- 172.21.15.8:0/3539264534 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43a80ada50 con 0x7f43a81536a0 2023-10-06T04:37:49.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.437+0000 7f439e7fc700 1 -- 172.21.15.8:0/3539264534 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f43a0007300 con 0x7f43a81536a0 2023-10-06T04:37:49.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.438+0000 7f439e7fc700 1 --2- 172.21.15.8:0/3539264534 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f438c066f30 0x7f438c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:49.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.438+0000 7f439e7fc700 1 -- 172.21.15.8:0/3539264534 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7f43a0084e60 con 0x7f43a81536a0 2023-10-06T04:37:49.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.438+0000 7f43ae203700 1 --2- 172.21.15.8:0/3539264534 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f438c066f30 0x7f438c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:49.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.439+0000 7f43ae203700 1 --2- 172.21.15.8:0/3539264534 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f438c066f30 0x7f438c0693e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f43a4009f40 tx=0x7f43a40091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:49.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.442+0000 7f439e7fc700 1 -- 172.21.15.8:0/3539264534 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43a0051c10 con 0x7f43a81536a0 2023-10-06T04:37:49.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.639+0000 7f43b0467700 1 -- 172.21.15.8:0/3539264534 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f43a8071550 con 0x7f43a81536a0 2023-10-06T04:37:49.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.640+0000 7f439e7fc700 1 -- 172.21.15.8:0/3539264534 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) v1 ==== 104+0+11 (secure 0 0 0) 0x7f43a0055230 con 0x7f43a81536a0 2023-10-06T04:37:49.641 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-06T04:37:49.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.642+0000 7f43b0467700 1 -- 172.21.15.8:0/3539264534 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f438c066f30 msgr2=0x7f438c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:49.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.642+0000 7f43b0467700 1 --2- 172.21.15.8:0/3539264534 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f438c066f30 0x7f438c0693e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f43a4009f40 tx=0x7f43a40091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:49.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.642+0000 7f43b0467700 1 -- 172.21.15.8:0/3539264534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43a81536a0 msgr2=0x7f43a80ac510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:49.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.642+0000 7f43b0467700 1 --2- 172.21.15.8:0/3539264534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43a81536a0 0x7f43a80ac510 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f43a0001460 tx=0x7f43a0001ae0 comp rx=0 tx=0).stop 2023-10-06T04:37:49.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.642+0000 7f43b0467700 1 -- 172.21.15.8:0/3539264534 shutdown_connections 2023-10-06T04:37:49.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.642+0000 7f43b0467700 1 --2- 172.21.15.8:0/3539264534 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f438c066f30 0x7f438c0693e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:49.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.642+0000 7f43b0467700 1 --2- 172.21.15.8:0/3539264534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43a81536a0 0x7f43a80ac510 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:49.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.642+0000 7f43b0467700 1 --2- 172.21.15.8:0/3539264534 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43a8069e10 0x7f43a8099710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:49.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.642+0000 7f43b0467700 1 --2- 172.21.15.8:0/3539264534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43a81532d0 0x7f43a8150c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:49.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.642+0000 7f43b0467700 1 -- 172.21.15.8:0/3539264534 >> 172.21.15.8:0/3539264534 conn(0x7f43a80680a0 msgr2=0x7f43a806e470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:49.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.642+0000 7f43b0467700 1 -- 172.21.15.8:0/3539264534 shutdown_connections 2023-10-06T04:37:49.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.642+0000 7f43b0467700 1 -- 172.21.15.8:0/3539264534 wait complete. 2023-10-06T04:37:49.655 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:37:49.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.774+0000 7f19cbaa3700 1 Processor -- start 2023-10-06T04:37:49.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.775+0000 7f19cbaa3700 1 -- start start 2023-10-06T04:37:49.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.775+0000 7f19cbaa3700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f19c40ccea0 0x7f19c415e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:49.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.775+0000 7f19cbaa3700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c40c3ec0 con 0x7f19c40c6a50 2023-10-06T04:37:49.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.775+0000 7f19cbaa3700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c40cb080 con 0x7f19c40b00c0 2023-10-06T04:37:49.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.775+0000 7f19cbaa3700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c415e680 con 0x7f19c40ccea0 2023-10-06T04:37:49.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.776+0000 7f19ca040700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f19c40c6a50 0x7f19c41592a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60220/0 (socket says 172.21.15.8:60220) 2023-10-06T04:37:49.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.776+0000 7f19ca040700 1 -- 172.21.15.8:0/977623232 learned_addr learned my addr 172.21.15.8:0/977623232 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:49.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.776+0000 7f19c983f700 1 --2- 172.21.15.8:0/977623232 >> v2:172.21.15.184:3300/0 conn(0x7f19c40ccea0 0x7f19c415e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:49.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.776+0000 7f19c883d700 1 -- 172.21.15.8:0/977623232 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205069924 0 0) 0x7f19c40c3ec0 con 0x7f19c40c6a50 2023-10-06T04:37:49.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.776+0000 7f19c883d700 1 -- 172.21.15.8:0/977623232 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19ac003570 con 0x7f19c40c6a50 2023-10-06T04:37:49.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.776+0000 7f19c883d700 1 -- 172.21.15.8:0/977623232 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 890726534 0 0) 0x7f19c40cb080 con 0x7f19c40b00c0 2023-10-06T04:37:49.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.776+0000 7f19c883d700 1 -- 172.21.15.8:0/977623232 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19c40c3ec0 con 0x7f19c40b00c0 2023-10-06T04:37:49.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.776+0000 7f19c983f700 1 -- 172.21.15.8:0/977623232 >> v1:172.21.15.184:6789/0 conn(0x7f19c40b00c0 legacy=0x7f19c40c6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:49.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.776+0000 7f19c983f700 1 -- 172.21.15.8:0/977623232 >> v1:172.21.15.8:6789/0 conn(0x7f19c40c6a50 legacy=0x7f19c41592a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:49.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.776+0000 7f19c983f700 1 -- 172.21.15.8:0/977623232 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c40b0660 con 0x7f19c40ccea0 2023-10-06T04:37:49.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.776+0000 7f19c983f700 1 --2- 172.21.15.8:0/977623232 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19c40ccea0 0x7f19c415e140 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f19b40098e0 tx=0x7f19b40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3830331ae84aa41 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:49.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.776+0000 7f19c883d700 1 -- 172.21.15.8:0/977623232 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b4011630 con 0x7f19c40ccea0 2023-10-06T04:37:49.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.776+0000 7f19c883d700 1 -- 172.21.15.8:0/977623232 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b4011790 con 0x7f19c40ccea0 2023-10-06T04:37:49.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.776+0000 7f19c883d700 1 -- 172.21.15.8:0/977623232 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b4011b10 con 0x7f19c40ccea0 2023-10-06T04:37:49.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.777+0000 7f19cbaa3700 1 -- 172.21.15.8:0/977623232 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19c40ccea0 msgr2=0x7f19c415e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:49.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.777+0000 7f19cbaa3700 1 --2- 172.21.15.8:0/977623232 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19c40ccea0 0x7f19c415e140 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f19b40098e0 tx=0x7f19b40091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:49.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.777+0000 7f19cbaa3700 1 -- 172.21.15.8:0/977623232 shutdown_connections 2023-10-06T04:37:49.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.777+0000 7f19cbaa3700 1 --2- 172.21.15.8:0/977623232 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19c40ccea0 0x7f19c415e140 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:49.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.777+0000 7f19cbaa3700 1 -- 172.21.15.8:0/977623232 >> 172.21.15.8:0/977623232 conn(0x7f19c406f780 msgr2=0x7f19c40698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:49.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.777+0000 7f19cbaa3700 1 -- 172.21.15.8:0/977623232 shutdown_connections 2023-10-06T04:37:49.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.777+0000 7f19cbaa3700 1 -- 172.21.15.8:0/977623232 wait complete. 2023-10-06T04:37:49.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.778+0000 7f19cbaa3700 1 Processor -- start 2023-10-06T04:37:49.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.778+0000 7f19cbaa3700 1 -- start start 2023-10-06T04:37:49.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.779+0000 7f19cbaa3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19c40b00c0 0x7f19c40b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:49.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.779+0000 7f19cbaa3700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19c40c6a50 0x7f19c4149890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:49.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.779+0000 7f19cbaa3700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19c40ccea0 0x7f19c40c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:49.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.779+0000 7f19cbaa3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c4149600 con 0x7f19c40b00c0 2023-10-06T04:37:49.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.779+0000 7f19cbaa3700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c40c8ae0 con 0x7f19c40ccea0 2023-10-06T04:37:49.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.779+0000 7f19cbaa3700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c40c8dc0 con 0x7f19c40c6a50 2023-10-06T04:37:49.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.779+0000 7f19c983f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19c40b00c0 0x7f19c40b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:49.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.779+0000 7f19c983f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19c40b00c0 0x7f19c40b5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42614/0 (socket says 172.21.15.8:42614) 2023-10-06T04:37:49.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.779+0000 7f19c983f700 1 -- 172.21.15.8:0/4153005221 learned_addr learned my addr 172.21.15.8:0/4153005221 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:49.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.779+0000 7f19ca040700 1 --2- 172.21.15.8:0/4153005221 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19c40ccea0 0x7f19c40c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:49.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.779+0000 7f19c903e700 1 --2- 172.21.15.8:0/4153005221 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19c40c6a50 0x7f19c4149890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:49.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.779+0000 7f19c983f700 1 -- 172.21.15.8:0/4153005221 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19c40c6a50 msgr2=0x7f19c4149890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:49.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.779+0000 7f19c983f700 1 --2- 172.21.15.8:0/4153005221 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19c40c6a50 0x7f19c4149890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:49.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.779+0000 7f19c983f700 1 -- 172.21.15.8:0/4153005221 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19c40ccea0 msgr2=0x7f19c40c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:49.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.779+0000 7f19c983f700 1 --2- 172.21.15.8:0/4153005221 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19c40ccea0 0x7f19c40c9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:49.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.779+0000 7f19c983f700 1 -- 172.21.15.8:0/4153005221 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b4009420 con 0x7f19c40b00c0 2023-10-06T04:37:49.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.780+0000 7f19c983f700 1 --2- 172.21.15.8:0/4153005221 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19c40b00c0 0x7f19c40b5520 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f19b4009ed0 tx=0x7f19b4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:49.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.780+0000 7f19c1ffb700 1 -- 172.21.15.8:0/4153005221 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b4011b10 con 0x7f19c40b00c0 2023-10-06T04:37:49.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.780+0000 7f19c1ffb700 1 -- 172.21.15.8:0/4153005221 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b4000c90 con 0x7f19c40b00c0 2023-10-06T04:37:49.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.780+0000 7f19c1ffb700 1 -- 172.21.15.8:0/4153005221 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b401a680 con 0x7f19c40b00c0 2023-10-06T04:37:49.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.780+0000 7f19cbaa3700 1 -- 172.21.15.8:0/4153005221 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c40c90a0 con 0x7f19c40b00c0 2023-10-06T04:37:49.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.780+0000 7f19cbaa3700 1 -- 172.21.15.8:0/4153005221 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c40c9660 con 0x7f19c40b00c0 2023-10-06T04:37:49.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.781+0000 7f19cbaa3700 1 -- 172.21.15.8:0/4153005221 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c4071550 con 0x7f19c40b00c0 2023-10-06T04:37:49.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.781+0000 7f19c1ffb700 1 -- 172.21.15.8:0/4153005221 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f19b401aa30 con 0x7f19c40b00c0 2023-10-06T04:37:49.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.782+0000 7f19c1ffb700 1 --2- 172.21.15.8:0/4153005221 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f19b0066f30 0x7f19b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:49.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.782+0000 7f19c1ffb700 1 -- 172.21.15.8:0/4153005221 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7f19b4086550 con 0x7f19c40b00c0 2023-10-06T04:37:49.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.782+0000 7f19c903e700 1 --2- 172.21.15.8:0/4153005221 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f19b0066f30 0x7f19b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:49.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.782+0000 7f19c903e700 1 --2- 172.21.15.8:0/4153005221 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f19b0066f30 0x7f19b00693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f19c40d00a0 tx=0x7f19b8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:49.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.786+0000 7f19c1ffb700 1 -- 172.21.15.8:0/4153005221 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f19b4053300 con 0x7f19c40b00c0 2023-10-06T04:37:49.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.978+0000 7f19cbaa3700 1 -- 172.21.15.8:0/4153005221 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f19c40afa00 con 0x7f19c40b00c0 2023-10-06T04:37:49.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.978+0000 7f19c1ffb700 1 -- 172.21.15.8:0/4153005221 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v46) v1 ==== 100+0+11 (secure 0 0 0) 0x7f19b4056920 con 0x7f19c40b00c0 2023-10-06T04:37:49.980 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-06T04:37:49.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.980+0000 7f19cbaa3700 1 -- 172.21.15.8:0/4153005221 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f19b0066f30 msgr2=0x7f19b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:49.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.980+0000 7f19cbaa3700 1 --2- 172.21.15.8:0/4153005221 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f19b0066f30 0x7f19b00693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f19c40d00a0 tx=0x7f19b8009040 comp rx=0 tx=0).stop 2023-10-06T04:37:49.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.980+0000 7f19cbaa3700 1 -- 172.21.15.8:0/4153005221 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19c40b00c0 msgr2=0x7f19c40b5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:49.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.980+0000 7f19cbaa3700 1 --2- 172.21.15.8:0/4153005221 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19c40b00c0 0x7f19c40b5520 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f19b4009ed0 tx=0x7f19b4017000 comp rx=0 tx=0).stop 2023-10-06T04:37:49.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.980+0000 7f19cbaa3700 1 -- 172.21.15.8:0/4153005221 shutdown_connections 2023-10-06T04:37:49.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.980+0000 7f19cbaa3700 1 --2- 172.21.15.8:0/4153005221 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f19b0066f30 0x7f19b00693e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:49.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.980+0000 7f19cbaa3700 1 --2- 172.21.15.8:0/4153005221 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19c40ccea0 0x7f19c40c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:49.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.980+0000 7f19cbaa3700 1 --2- 172.21.15.8:0/4153005221 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19c40b00c0 0x7f19c40b5520 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:49.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.980+0000 7f19cbaa3700 1 --2- 172.21.15.8:0/4153005221 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19c40c6a50 0x7f19c4149890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:49.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.981+0000 7f19cbaa3700 1 -- 172.21.15.8:0/4153005221 >> 172.21.15.8:0/4153005221 conn(0x7f19c406f780 msgr2=0x7f19c40ce340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:49.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.981+0000 7f19cbaa3700 1 -- 172.21.15.8:0/4153005221 shutdown_connections 2023-10-06T04:37:49.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:49.981+0000 7f19cbaa3700 1 -- 172.21.15.8:0/4153005221 wait complete. 2023-10-06T04:37:49.994 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get recovery_fs_metadata pg_num 2023-10-06T04:37:50.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.114+0000 7f93eb780700 1 Processor -- start 2023-10-06T04:37:50.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.114+0000 7f93eb780700 1 -- start start 2023-10-06T04:37:50.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.115+0000 7f93eb780700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f93e4142cf0 0x7f93e40b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:50.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.115+0000 7f93eb780700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f93e40b3790 0x7f93e40b3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:50.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.115+0000 7f93eb780700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e40cf510 con 0x7f93e41430c0 2023-10-06T04:37:50.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.115+0000 7f93eb780700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e40ce6a0 con 0x7f93e40b3790 2023-10-06T04:37:50.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.115+0000 7f93eb780700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e40b40d0 con 0x7f93e4142cf0 2023-10-06T04:37:50.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.115+0000 7f93e9d1d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f93e40b3790 0x7f93e40b3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:50.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.115+0000 7f93e8d1b700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f93e41430c0 0x7f93e40cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60228/0 (socket says 172.21.15.8:60228) 2023-10-06T04:37:50.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.115+0000 7f93e8d1b700 1 -- 172.21.15.8:0/198432678 learned_addr learned my addr 172.21.15.8:0/198432678 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:50.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.115+0000 7f93e9d1d700 1 -- 172.21.15.8:0/198432678 >> v2:172.21.15.184:3300/0 conn(0x7f93e4142cf0 msgr2=0x7f93e40b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:50.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.115+0000 7f93e951c700 1 --2- 172.21.15.8:0/198432678 >> v2:172.21.15.184:3300/0 conn(0x7f93e4142cf0 0x7f93e40b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:50.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.115+0000 7f93e9d1d700 1 --2- 172.21.15.8:0/198432678 >> v2:172.21.15.184:3300/0 conn(0x7f93e4142cf0 0x7f93e40b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:50.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.115+0000 7f93e9d1d700 1 -- 172.21.15.8:0/198432678 >> v1:172.21.15.8:6789/0 conn(0x7f93e41430c0 legacy=0x7f93e40cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:50.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.115+0000 7f93e3fff700 1 -- 172.21.15.8:0/198432678 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1795233836 0 0) 0x7f93e40cf510 con 0x7f93e41430c0 2023-10-06T04:37:50.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.115+0000 7f93e9d1d700 1 -- 172.21.15.8:0/198432678 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e40ce900 con 0x7f93e40b3790 2023-10-06T04:37:50.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.115+0000 7f93e951c700 1 --2- 172.21.15.8:0/198432678 >> v2:172.21.15.184:3300/0 conn(0x7f93e4142cf0 0x7f93e40b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:50.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.116+0000 7f93e9d1d700 1 --2- 172.21.15.8:0/198432678 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93e40b3790 0x7f93e40b3b90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f93e4089240 tx=0x7f93dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a5f9db62d58675f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:50.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.116+0000 7f93e3fff700 1 -- 172.21.15.8:0/198432678 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93dc00b6b0 con 0x7f93e40b3790 2023-10-06T04:37:50.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.116+0000 7f93e3fff700 1 -- 172.21.15.8:0/198432678 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93dc00b810 con 0x7f93e40b3790 2023-10-06T04:37:50.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.116+0000 7f93e3fff700 1 -- 172.21.15.8:0/198432678 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93dc00bbb0 con 0x7f93e40b3790 2023-10-06T04:37:50.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.116+0000 7f93eb780700 1 -- 172.21.15.8:0/198432678 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93e40b3790 msgr2=0x7f93e40b3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:50.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.116+0000 7f93eb780700 1 --2- 172.21.15.8:0/198432678 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93e40b3790 0x7f93e40b3b90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f93e4089240 tx=0x7f93dc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:50.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.116+0000 7f93eb780700 1 -- 172.21.15.8:0/198432678 shutdown_connections 2023-10-06T04:37:50.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.116+0000 7f93eb780700 1 --2- 172.21.15.8:0/198432678 >> v2:172.21.15.184:3300/0 conn(0x7f93e4142cf0 0x7f93e40b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:50.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.116+0000 7f93eb780700 1 --2- 172.21.15.8:0/198432678 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93e40b3790 0x7f93e40b3b90 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:50.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.116+0000 7f93eb780700 1 -- 172.21.15.8:0/198432678 >> 172.21.15.8:0/198432678 conn(0x7f93e406ed00 msgr2=0x7f93e406f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:50.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.116+0000 7f93eb780700 1 -- 172.21.15.8:0/198432678 shutdown_connections 2023-10-06T04:37:50.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.116+0000 7f93eb780700 1 -- 172.21.15.8:0/198432678 wait complete. 2023-10-06T04:37:50.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.117+0000 7f93eb780700 1 Processor -- start 2023-10-06T04:37:50.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.117+0000 7f93eb780700 1 -- start start 2023-10-06T04:37:50.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.118+0000 7f93eb780700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93e40b3790 0x7f93e4158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:50.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.118+0000 7f93eb780700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93e4142cf0 0x7f93e415ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:50.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.118+0000 7f93eb780700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93e41430c0 0x7f93e40ade50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:50.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.118+0000 7f93eb780700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e415a930 con 0x7f93e4142cf0 2023-10-06T04:37:50.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.118+0000 7f93eb780700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e4140be0 con 0x7f93e41430c0 2023-10-06T04:37:50.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.118+0000 7f93eb780700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e41402b0 con 0x7f93e40b3790 2023-10-06T04:37:50.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.118+0000 7f93e8d1b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93e4142cf0 0x7f93e415ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:50.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.118+0000 7f93e8d1b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93e4142cf0 0x7f93e415ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42644/0 (socket says 172.21.15.8:42644) 2023-10-06T04:37:50.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.118+0000 7f93e8d1b700 1 -- 172.21.15.8:0/3803932480 learned_addr learned my addr 172.21.15.8:0/3803932480 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:50.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.119+0000 7f93e9d1d700 1 --2- 172.21.15.8:0/3803932480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93e41430c0 0x7f93e40ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:50.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.119+0000 7f93e951c700 1 --2- 172.21.15.8:0/3803932480 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93e40b3790 0x7f93e4158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:50.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.119+0000 7f93e8d1b700 1 -- 172.21.15.8:0/3803932480 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93e40b3790 msgr2=0x7f93e4158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:50.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.119+0000 7f93e8d1b700 1 --2- 172.21.15.8:0/3803932480 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93e40b3790 0x7f93e4158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:50.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.119+0000 7f93e8d1b700 1 -- 172.21.15.8:0/3803932480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93e41430c0 msgr2=0x7f93e40ade50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:50.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.119+0000 7f93e8d1b700 1 --2- 172.21.15.8:0/3803932480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93e41430c0 0x7f93e40ade50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:50.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.119+0000 7f93e8d1b700 1 -- 172.21.15.8:0/3803932480 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93dc009420 con 0x7f93e4142cf0 2023-10-06T04:37:50.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.119+0000 7f93e9d1d700 1 --2- 172.21.15.8:0/3803932480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93e41430c0 0x7f93e40ade50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:50.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.119+0000 7f93e951c700 1 --2- 172.21.15.8:0/3803932480 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93e40b3790 0x7f93e4158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:50.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.119+0000 7f93e8d1b700 1 --2- 172.21.15.8:0/3803932480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93e4142cf0 0x7f93e415ae30 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f93d800c560 tx=0x7f93d8000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:50.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.119+0000 7f93e17fa700 1 -- 172.21.15.8:0/3803932480 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d8005b30 con 0x7f93e4142cf0 2023-10-06T04:37:50.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.119+0000 7f93e17fa700 1 -- 172.21.15.8:0/3803932480 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d8005c90 con 0x7f93e4142cf0 2023-10-06T04:37:50.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.119+0000 7f93eb780700 1 -- 172.21.15.8:0/3803932480 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e4140590 con 0x7f93e4142cf0 2023-10-06T04:37:50.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.119+0000 7f93e17fa700 1 -- 172.21.15.8:0/3803932480 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d8007320 con 0x7f93e4142cf0 2023-10-06T04:37:50.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.119+0000 7f93eb780700 1 -- 172.21.15.8:0/3803932480 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e41593d0 con 0x7f93e4142cf0 2023-10-06T04:37:50.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.120+0000 7f93eb780700 1 -- 172.21.15.8:0/3803932480 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e4071550 con 0x7f93e4142cf0 2023-10-06T04:37:50.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.121+0000 7f93e17fa700 1 -- 172.21.15.8:0/3803932480 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f93d801b3b0 con 0x7f93e4142cf0 2023-10-06T04:37:50.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.121+0000 7f93e17fa700 1 --2- 172.21.15.8:0/3803932480 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f93d0066f30 0x7f93d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:50.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.121+0000 7f93e17fa700 1 -- 172.21.15.8:0/3803932480 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7f93d8083fa0 con 0x7f93e4142cf0 2023-10-06T04:37:50.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.121+0000 7f93e951c700 1 --2- 172.21.15.8:0/3803932480 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f93d0066f30 0x7f93d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:50.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.122+0000 7f93e951c700 1 --2- 172.21.15.8:0/3803932480 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f93d0066f30 0x7f93d00693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f93e415d0d0 tx=0x7f93d4007690 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:50.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.125+0000 7f93e17fa700 1 -- 172.21.15.8:0/3803932480 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f93d8050d50 con 0x7f93e4142cf0 2023-10-06T04:37:50.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.317+0000 7f93eb780700 1 -- 172.21.15.8:0/3803932480 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "recovery_fs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f93e40cebe0 con 0x7f93e4142cf0 2023-10-06T04:37:50.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.317+0000 7f93e17fa700 1 -- 172.21.15.8:0/3803932480 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "recovery_fs_metadata", "var": "pg_num"}]=0 v46) v1 ==== 109+0+11 (secure 0 0 0) 0x7f93d8017020 con 0x7f93e4142cf0 2023-10-06T04:37:50.319 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-06T04:37:50.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.319+0000 7f93eb780700 1 -- 172.21.15.8:0/3803932480 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f93d0066f30 msgr2=0x7f93d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:50.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.319+0000 7f93eb780700 1 --2- 172.21.15.8:0/3803932480 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f93d0066f30 0x7f93d00693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f93e415d0d0 tx=0x7f93d4007690 comp rx=0 tx=0).stop 2023-10-06T04:37:50.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.319+0000 7f93eb780700 1 -- 172.21.15.8:0/3803932480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93e4142cf0 msgr2=0x7f93e415ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:50.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.319+0000 7f93eb780700 1 --2- 172.21.15.8:0/3803932480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93e4142cf0 0x7f93e415ae30 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f93d800c560 tx=0x7f93d8000fe0 comp rx=0 tx=0).stop 2023-10-06T04:37:50.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.319+0000 7f93eb780700 1 -- 172.21.15.8:0/3803932480 shutdown_connections 2023-10-06T04:37:50.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.319+0000 7f93eb780700 1 --2- 172.21.15.8:0/3803932480 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f93d0066f30 0x7f93d00693e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:50.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.319+0000 7f93eb780700 1 --2- 172.21.15.8:0/3803932480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93e41430c0 0x7f93e40ade50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:50.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.319+0000 7f93eb780700 1 --2- 172.21.15.8:0/3803932480 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93e40b3790 0x7f93e4158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:50.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.319+0000 7f93eb780700 1 --2- 172.21.15.8:0/3803932480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93e4142cf0 0x7f93e415ae30 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:50.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.319+0000 7f93eb780700 1 -- 172.21.15.8:0/3803932480 >> 172.21.15.8:0/3803932480 conn(0x7f93e406ed00 msgr2=0x7f93e40cf9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:50.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.319+0000 7f93eb780700 1 -- 172.21.15.8:0/3803932480 shutdown_connections 2023-10-06T04:37:50.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.319+0000 7f93eb780700 1 -- 172.21.15.8:0/3803932480 wait complete. 2023-10-06T04:37:50.332 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:37:50.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.450+0000 7fb59fb8c700 1 Processor -- start 2023-10-06T04:37:50.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.450+0000 7fb59fb8c700 1 -- start start 2023-10-06T04:37:50.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.451+0000 7fb59fb8c700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb598142cc0 0x7fb5980686e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:50.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.451+0000 7fb59fb8c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb598143090 0x7fb598068c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:50.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.451+0000 7fb59fb8c700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb598069f70 con 0x7fb5980cbe20 2023-10-06T04:37:50.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.451+0000 7fb59fb8c700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb598069160 con 0x7fb598142cc0 2023-10-06T04:37:50.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.451+0000 7fb59fb8c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb598069360 con 0x7fb598143090 2023-10-06T04:37:50.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.451+0000 7fb59d928700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb598142cc0 0x7fb5980686e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:50.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.451+0000 7fb59d928700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb598142cc0 0x7fb5980686e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42646/0 (socket says 172.21.15.8:42646) 2023-10-06T04:37:50.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.451+0000 7fb59d928700 1 -- 172.21.15.8:0/509264057 learned_addr learned my addr 172.21.15.8:0/509264057 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:50.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.452+0000 7fb59d127700 1 --2- 172.21.15.8:0/509264057 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb598143090 0x7fb598068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:50.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.452+0000 7fb59d928700 1 -- 172.21.15.8:0/509264057 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb598143090 msgr2=0x7fb598068c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:50.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.452+0000 7fb59d928700 1 --2- 172.21.15.8:0/509264057 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb598143090 0x7fb598068c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:50.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.452+0000 7fb59d928700 1 -- 172.21.15.8:0/509264057 >> v1:172.21.15.184:6789/0 conn(0x7fb5980cbe20 legacy=0x7fb5980cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:50.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.452+0000 7fb59d928700 1 -- 172.21.15.8:0/509264057 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb598069640 con 0x7fb598142cc0 2023-10-06T04:37:50.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.452+0000 7fb59d928700 1 --2- 172.21.15.8:0/509264057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb598142cc0 0x7fb5980686e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fb588009f70 tx=0x7fb588009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acbb0deca634ca3b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:50.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.452+0000 7fb59c926700 1 -- 172.21.15.8:0/509264057 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58800e070 con 0x7fb598142cc0 2023-10-06T04:37:50.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.452+0000 7fb59c926700 1 -- 172.21.15.8:0/509264057 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58800ba20 con 0x7fb598142cc0 2023-10-06T04:37:50.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.452+0000 7fb59c926700 1 -- 172.21.15.8:0/509264057 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5880092e0 con 0x7fb598142cc0 2023-10-06T04:37:50.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.453+0000 7fb59fb8c700 1 -- 172.21.15.8:0/509264057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb598142cc0 msgr2=0x7fb5980686e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:50.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.453+0000 7fb59fb8c700 1 --2- 172.21.15.8:0/509264057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb598142cc0 0x7fb5980686e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fb588009f70 tx=0x7fb588009840 comp rx=0 tx=0).stop 2023-10-06T04:37:50.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.453+0000 7fb59fb8c700 1 -- 172.21.15.8:0/509264057 shutdown_connections 2023-10-06T04:37:50.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.453+0000 7fb59fb8c700 1 --2- 172.21.15.8:0/509264057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb598142cc0 0x7fb5980686e0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:50.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.453+0000 7fb59fb8c700 1 --2- 172.21.15.8:0/509264057 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb598143090 0x7fb598068c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:50.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.453+0000 7fb59fb8c700 1 -- 172.21.15.8:0/509264057 >> 172.21.15.8:0/509264057 conn(0x7fb5980ce250 msgr2=0x7fb5980ce650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:50.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.453+0000 7fb59fb8c700 1 -- 172.21.15.8:0/509264057 shutdown_connections 2023-10-06T04:37:50.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.453+0000 7fb59fb8c700 1 -- 172.21.15.8:0/509264057 wait complete. 2023-10-06T04:37:50.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.454+0000 7fb59fb8c700 1 Processor -- start 2023-10-06T04:37:50.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.454+0000 7fb59fb8c700 1 -- start start 2023-10-06T04:37:50.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.455+0000 7fb59fb8c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5980cbe20 0x7fb59815e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:50.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.455+0000 7fb59fb8c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb598142cc0 0x7fb5980b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:50.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.455+0000 7fb59fb8c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb598143090 0x7fb598141d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:50.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.455+0000 7fb59fb8c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59815e990 con 0x7fb598143090 2023-10-06T04:37:50.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.455+0000 7fb59fb8c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5980b3240 con 0x7fb598142cc0 2023-10-06T04:37:50.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.455+0000 7fb59fb8c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5980b3480 con 0x7fb5980cbe20 2023-10-06T04:37:50.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.455+0000 7fb59e129700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb598143090 0x7fb598141d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:50.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.455+0000 7fb59e129700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb598143090 0x7fb598141d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42652/0 (socket says 172.21.15.8:42652) 2023-10-06T04:37:50.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.455+0000 7fb59e129700 1 -- 172.21.15.8:0/68360466 learned_addr learned my addr 172.21.15.8:0/68360466 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:50.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.455+0000 7fb59d127700 1 --2- 172.21.15.8:0/68360466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb598142cc0 0x7fb5980b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:50.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.455+0000 7fb59d928700 1 --2- 172.21.15.8:0/68360466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5980cbe20 0x7fb59815e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:50.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.455+0000 7fb59e129700 1 -- 172.21.15.8:0/68360466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5980cbe20 msgr2=0x7fb59815e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:50.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.455+0000 7fb59e129700 1 --2- 172.21.15.8:0/68360466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5980cbe20 0x7fb59815e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:50.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.455+0000 7fb59e129700 1 -- 172.21.15.8:0/68360466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb598142cc0 msgr2=0x7fb5980b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:50.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.455+0000 7fb59e129700 1 --2- 172.21.15.8:0/68360466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb598142cc0 0x7fb5980b2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:50.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.455+0000 7fb59e129700 1 -- 172.21.15.8:0/68360466 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb588009ae0 con 0x7fb598143090 2023-10-06T04:37:50.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.455+0000 7fb59d127700 1 --2- 172.21.15.8:0/68360466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb598142cc0 0x7fb5980b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:50.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.455+0000 7fb59e129700 1 --2- 172.21.15.8:0/68360466 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb598143090 0x7fb598141d40 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fb59000c560 tx=0x7fb590007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:50.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.455+0000 7fb595ffb700 1 -- 172.21.15.8:0/68360466 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb590011590 con 0x7fb598143090 2023-10-06T04:37:50.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.455+0000 7fb595ffb700 1 -- 172.21.15.8:0/68360466 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5900116f0 con 0x7fb598143090 2023-10-06T04:37:50.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.455+0000 7fb59fb8c700 1 -- 172.21.15.8:0/68360466 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5980b3760 con 0x7fb598143090 2023-10-06T04:37:50.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.455+0000 7fb595ffb700 1 -- 172.21.15.8:0/68360466 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb590011ab0 con 0x7fb598143090 2023-10-06T04:37:50.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.456+0000 7fb59fb8c700 1 -- 172.21.15.8:0/68360466 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5980b3da0 con 0x7fb598143090 2023-10-06T04:37:50.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.457+0000 7fb59fb8c700 1 -- 172.21.15.8:0/68360466 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb598071550 con 0x7fb598143090 2023-10-06T04:37:50.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.457+0000 7fb595ffb700 1 -- 172.21.15.8:0/68360466 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb59001b3b0 con 0x7fb598143090 2023-10-06T04:37:50.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.457+0000 7fb595ffb700 1 --2- 172.21.15.8:0/68360466 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb584066f30 0x7fb5840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:50.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.457+0000 7fb595ffb700 1 -- 172.21.15.8:0/68360466 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7fb590083fc0 con 0x7fb598143090 2023-10-06T04:37:50.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.458+0000 7fb59d928700 1 --2- 172.21.15.8:0/68360466 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb584066f30 0x7fb5840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:50.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.458+0000 7fb59d928700 1 --2- 172.21.15.8:0/68360466 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb584066f30 0x7fb5840693e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb588009880 tx=0x7fb588018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:50.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.462+0000 7fb595ffb700 1 -- 172.21.15.8:0/68360466 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb590050cd0 con 0x7fb598143090 2023-10-06T04:37:50.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.705+0000 7fb59fb8c700 1 -- 172.21.15.8:0/68360466 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb598069920 con 0x7fb598143090 2023-10-06T04:37:50.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.705+0000 7fb595ffb700 1 -- 172.21.15.8:0/68360466 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+5662 (secure 0 0 0) 0x7fb590017070 con 0x7fb598143090 2023-10-06T04:37:50.707 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:50.707 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":28,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/867081044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":867081044},{"type":"v1","addr":"172.21.15.184:6835","nonce":867081044}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5176,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2754847040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2754847040},{"type":"v1","addr":"172.21.15.184:6837","nonce":2754847040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5358,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/1957165234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1957165234},{"type":"v1","addr":"172.21.15.8:6834","nonce":1957165234}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:37:16.932006+0000","modified":"2023-10-06T04:37:26.044254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":39,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:37:29.514098+0000","modified":"2023-10-06T04:37:43.827602+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5361":{"gid":5361,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.8:6835/1173304661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1173304661},{"type":"v1","addr":"172.21.15.8:6835","nonce":1173304661}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":8,"enabled":true,"fs_name":"recovery_fs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T04:37:50.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.708+0000 7fb59fb8c700 1 -- 172.21.15.8:0/68360466 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb584066f30 msgr2=0x7fb5840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:50.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.708+0000 7fb59fb8c700 1 --2- 172.21.15.8:0/68360466 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb584066f30 0x7fb5840693e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb588009880 tx=0x7fb588018000 comp rx=0 tx=0).stop 2023-10-06T04:37:50.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.708+0000 7fb59fb8c700 1 -- 172.21.15.8:0/68360466 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb598143090 msgr2=0x7fb598141d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:50.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.708+0000 7fb59fb8c700 1 --2- 172.21.15.8:0/68360466 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb598143090 0x7fb598141d40 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fb59000c560 tx=0x7fb590007ef0 comp rx=0 tx=0).stop 2023-10-06T04:37:50.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.708+0000 7fb59fb8c700 1 -- 172.21.15.8:0/68360466 shutdown_connections 2023-10-06T04:37:50.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.708+0000 7fb59fb8c700 1 --2- 172.21.15.8:0/68360466 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb584066f30 0x7fb5840693e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:50.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.708+0000 7fb59fb8c700 1 --2- 172.21.15.8:0/68360466 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb598143090 0x7fb598141d40 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:50.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.708+0000 7fb59fb8c700 1 --2- 172.21.15.8:0/68360466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5980cbe20 0x7fb59815e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:50.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.708+0000 7fb59fb8c700 1 --2- 172.21.15.8:0/68360466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb598142cc0 0x7fb5980b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:50.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.708+0000 7fb59fb8c700 1 -- 172.21.15.8:0/68360466 >> 172.21.15.8:0/68360466 conn(0x7fb5980ce250 msgr2=0x7fb5980c2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:50.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.708+0000 7fb59fb8c700 1 -- 172.21.15.8:0/68360466 shutdown_connections 2023-10-06T04:37:50.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.708+0000 7fb59fb8c700 1 -- 172.21.15.8:0/68360466 wait complete. 2023-10-06T04:37:50.711 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 28 2023-10-06T04:37:50.721 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:37:50.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.839+0000 7fd49239d700 1 Processor -- start 2023-10-06T04:37:50.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.839+0000 7fd49239d700 1 -- start start 2023-10-06T04:37:50.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.840+0000 7fd49239d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd48c0af680 0x7fd48c15e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:50.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.840+0000 7fd49239d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd48c0cb360 0x7fd48c0d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:50.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.840+0000 7fd49239d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0cc4c0 con 0x7fd48c0d08d0 2023-10-06T04:37:50.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.840+0000 7fd49239d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c15d460 con 0x7fd48c0af680 2023-10-06T04:37:50.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.840+0000 7fd49239d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0d0d50 con 0x7fd48c0cb360 2023-10-06T04:37:50.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.840+0000 7fd48b7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd48c0cb360 0x7fd48c0d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:50.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.840+0000 7fd48bfff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd48c0af680 0x7fd48c15e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:50.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.840+0000 7fd48b7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd48c0cb360 0x7fd48c0d0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.8:49658/0 (socket says 172.21.15.8:49658) 2023-10-06T04:37:50.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.840+0000 7fd48bfff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd48c0af680 0x7fd48c15e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.8:44746/0 (socket says 172.21.15.8:44746) 2023-10-06T04:37:50.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.840+0000 7fd48b7fe700 1 -- 172.21.15.8:0/4099056892 learned_addr learned my addr 172.21.15.8:0/4099056892 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:50.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.840+0000 7fd49093a700 1 --1- 172.21.15.8:0/4099056892 >> v1:172.21.15.184:6789/0 conn(0x7fd48c0d08d0 0x7fd48c0b0000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.8:57906/0 (socket says 172.21.15.8:57906) 2023-10-06T04:37:50.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.841+0000 7fd48b7fe700 1 -- 172.21.15.8:0/4099056892 >> v2:172.21.15.184:3300/0 conn(0x7fd48c0af680 msgr2=0x7fd48c15e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:50.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.841+0000 7fd48b7fe700 1 --2- 172.21.15.8:0/4099056892 >> v2:172.21.15.184:3300/0 conn(0x7fd48c0af680 0x7fd48c15e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:50.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.841+0000 7fd48b7fe700 1 -- 172.21.15.8:0/4099056892 >> v1:172.21.15.184:6789/0 conn(0x7fd48c0d08d0 legacy=0x7fd48c0b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:50.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.841+0000 7fd48b7fe700 1 -- 172.21.15.8:0/4099056892 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48c15e580 con 0x7fd48c0cb360 2023-10-06T04:37:50.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.841+0000 7fd48bfff700 1 --2- 172.21.15.8:0/4099056892 >> v2:172.21.15.184:3300/0 conn(0x7fd48c0af680 0x7fd48c15e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:37:50.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.841+0000 7fd48b7fe700 1 --2- 172.21.15.8:0/4099056892 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd48c0cb360 0x7fd48c0d0390 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd4740099b0 tx=0x7fd474009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d4e2fa55afccc3c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:50.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.841+0000 7fd48affd700 1 -- 172.21.15.8:0/4099056892 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd474009ea0 con 0x7fd48c0cb360 2023-10-06T04:37:50.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.841+0000 7fd48affd700 1 -- 172.21.15.8:0/4099056892 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47400b860 con 0x7fd48c0cb360 2023-10-06T04:37:50.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.841+0000 7fd48affd700 1 -- 172.21.15.8:0/4099056892 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47400bc00 con 0x7fd48c0cb360 2023-10-06T04:37:50.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.841+0000 7fd49239d700 1 -- 172.21.15.8:0/4099056892 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd48c0cb360 msgr2=0x7fd48c0d0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:50.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.841+0000 7fd49239d700 1 --2- 172.21.15.8:0/4099056892 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd48c0cb360 0x7fd48c0d0390 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd4740099b0 tx=0x7fd474009250 comp rx=0 tx=0).stop 2023-10-06T04:37:50.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.842+0000 7fd49239d700 1 -- 172.21.15.8:0/4099056892 shutdown_connections 2023-10-06T04:37:50.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.842+0000 7fd49239d700 1 --2- 172.21.15.8:0/4099056892 >> v2:172.21.15.184:3300/0 conn(0x7fd48c0af680 0x7fd48c15e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:50.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.842+0000 7fd49239d700 1 --2- 172.21.15.8:0/4099056892 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd48c0cb360 0x7fd48c0d0390 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:50.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.842+0000 7fd49239d700 1 -- 172.21.15.8:0/4099056892 >> 172.21.15.8:0/4099056892 conn(0x7fd48c0633d0 msgr2=0x7fd48c0637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:50.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.842+0000 7fd49239d700 1 -- 172.21.15.8:0/4099056892 shutdown_connections 2023-10-06T04:37:50.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.842+0000 7fd49239d700 1 -- 172.21.15.8:0/4099056892 wait complete. 2023-10-06T04:37:50.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.843+0000 7fd49239d700 1 Processor -- start 2023-10-06T04:37:50.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.843+0000 7fd49239d700 1 -- start start 2023-10-06T04:37:50.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.844+0000 7fd49239d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd48c0af680 0x7fd48c15b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:50.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.844+0000 7fd49239d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd48c0cb360 0x7fd48c0c95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:50.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.844+0000 7fd49239d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd48c0d08d0 0x7fd48c0b46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:50.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.844+0000 7fd49239d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c15be90 con 0x7fd48c0cb360 2023-10-06T04:37:50.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.844+0000 7fd49239d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c169f90 con 0x7fd48c0d08d0 2023-10-06T04:37:50.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.844+0000 7fd49239d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0c9b10 con 0x7fd48c0af680 2023-10-06T04:37:50.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.844+0000 7fd48b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd48c0cb360 0x7fd48c0c95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:50.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.844+0000 7fd48b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd48c0cb360 0x7fd48c0c95d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42664/0 (socket says 172.21.15.8:42664) 2023-10-06T04:37:50.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.844+0000 7fd48b7fe700 1 -- 172.21.15.8:0/2909075697 learned_addr learned my addr 172.21.15.8:0/2909075697 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:50.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.844+0000 7fd48bfff700 1 --2- 172.21.15.8:0/2909075697 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd48c0af680 0x7fd48c15b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:50.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.844+0000 7fd49093a700 1 --2- 172.21.15.8:0/2909075697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd48c0d08d0 0x7fd48c0b46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:50.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.844+0000 7fd48b7fe700 1 -- 172.21.15.8:0/2909075697 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd48c0af680 msgr2=0x7fd48c15b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:50.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.844+0000 7fd48b7fe700 1 --2- 172.21.15.8:0/2909075697 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd48c0af680 0x7fd48c15b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:50.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.844+0000 7fd48b7fe700 1 -- 172.21.15.8:0/2909075697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd48c0d08d0 msgr2=0x7fd48c0b46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:50.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.844+0000 7fd48b7fe700 1 --2- 172.21.15.8:0/2909075697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd48c0d08d0 0x7fd48c0b46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:50.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.844+0000 7fd48b7fe700 1 -- 172.21.15.8:0/2909075697 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd47c009420 con 0x7fd48c0cb360 2023-10-06T04:37:50.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.844+0000 7fd49093a700 1 --2- 172.21.15.8:0/2909075697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd48c0d08d0 0x7fd48c0b46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:50.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.844+0000 7fd48b7fe700 1 --2- 172.21.15.8:0/2909075697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd48c0cb360 0x7fd48c0c95d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fd474006fd0 tx=0x7fd474017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:50.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.845+0000 7fd483fff700 1 -- 172.21.15.8:0/2909075697 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47400bbe0 con 0x7fd48c0cb360 2023-10-06T04:37:50.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.845+0000 7fd483fff700 1 -- 172.21.15.8:0/2909075697 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd474011420 con 0x7fd48c0cb360 2023-10-06T04:37:50.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.845+0000 7fd49239d700 1 -- 172.21.15.8:0/2909075697 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4740094f0 con 0x7fd48c0cb360 2023-10-06T04:37:50.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.845+0000 7fd483fff700 1 -- 172.21.15.8:0/2909075697 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4740117e0 con 0x7fd48c0cb360 2023-10-06T04:37:50.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.845+0000 7fd49239d700 1 -- 172.21.15.8:0/2909075697 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd48c0c77d0 con 0x7fd48c0cb360 2023-10-06T04:37:50.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.846+0000 7fd49239d700 1 -- 172.21.15.8:0/2909075697 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd48c071550 con 0x7fd48c0cb360 2023-10-06T04:37:50.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.846+0000 7fd483fff700 1 -- 172.21.15.8:0/2909075697 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd474011bd0 con 0x7fd48c0cb360 2023-10-06T04:37:50.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.847+0000 7fd483fff700 1 --2- 172.21.15.8:0/2909075697 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd46c066f30 0x7fd46c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:50.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.847+0000 7fd483fff700 1 -- 172.21.15.8:0/2909075697 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7fd474086330 con 0x7fd48c0cb360 2023-10-06T04:37:50.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.847+0000 7fd48bfff700 1 --2- 172.21.15.8:0/2909075697 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd46c066f30 0x7fd46c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:50.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.848+0000 7fd48bfff700 1 --2- 172.21.15.8:0/2909075697 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd46c066f30 0x7fd46c0693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd47c009f40 tx=0x7fd47c0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:50.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:50.853+0000 7fd483fff700 1 -- 172.21.15.8:0/2909075697 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4740530e0 con 0x7fd48c0cb360 2023-10-06T04:37:51.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.044+0000 7fd49239d700 1 -- 172.21.15.8:0/2909075697 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd48c16a100 con 0x7fd48c0cb360 2023-10-06T04:37:51.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.045+0000 7fd483fff700 1 -- 172.21.15.8:0/2909075697 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+18779 (secure 0 0 0) 0x7fd474056700 con 0x7fd48c0cb360 2023-10-06T04:37:51.047 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:51.047 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":46,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:37:30.782691+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:36:10.148177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:36:10.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:37:15.099258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T04:37:15.902657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}}},{"pool":8,"pool_name":"recovery_fs_metadata","create_time":"2023-10-06T04:37:28.524294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}}}],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.555871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.490505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.504578+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.517217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:05.991135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.537329+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.543232+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.443715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6835/3478733664":"2023-10-07T04:37:26.044067+0000","172.21.15.8:6833/3478733664":"2023-10-07T04:37:26.044067+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:37:51.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.047+0000 7fd49239d700 1 -- 172.21.15.8:0/2909075697 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd46c066f30 msgr2=0x7fd46c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:51.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.047+0000 7fd49239d700 1 --2- 172.21.15.8:0/2909075697 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd46c066f30 0x7fd46c0693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd47c009f40 tx=0x7fd47c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:51.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.047+0000 7fd49239d700 1 -- 172.21.15.8:0/2909075697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd48c0cb360 msgr2=0x7fd48c0c95d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:51.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.047+0000 7fd49239d700 1 --2- 172.21.15.8:0/2909075697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd48c0cb360 0x7fd48c0c95d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fd474006fd0 tx=0x7fd474017000 comp rx=0 tx=0).stop 2023-10-06T04:37:51.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.047+0000 7fd49239d700 1 -- 172.21.15.8:0/2909075697 shutdown_connections 2023-10-06T04:37:51.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.047+0000 7fd49239d700 1 --2- 172.21.15.8:0/2909075697 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd46c066f30 0x7fd46c0693e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:51.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.047+0000 7fd49239d700 1 --2- 172.21.15.8:0/2909075697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd48c0d08d0 0x7fd48c0b46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:51.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.047+0000 7fd49239d700 1 --2- 172.21.15.8:0/2909075697 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd48c0af680 0x7fd48c15b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:51.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.047+0000 7fd49239d700 1 --2- 172.21.15.8:0/2909075697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd48c0cb360 0x7fd48c0c95d0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:51.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.047+0000 7fd49239d700 1 -- 172.21.15.8:0/2909075697 >> 172.21.15.8:0/2909075697 conn(0x7fd48c0633d0 msgr2=0x7fd48c0afa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:51.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.047+0000 7fd49239d700 1 -- 172.21.15.8:0/2909075697 shutdown_connections 2023-10-06T04:37:51.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.047+0000 7fd49239d700 1 -- 172.21.15.8:0/2909075697 wait complete. 2023-10-06T04:37:51.061 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T04:37:51.061 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:37:51.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.179+0000 7fadab2b1700 1 Processor -- start 2023-10-06T04:37:51.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.179+0000 7fadab2b1700 1 -- start start 2023-10-06T04:37:51.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.180+0000 7fadab2b1700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fada40cb360 0x7fada40d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:51.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.180+0000 7fadab2b1700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fada40d08d0 0x7fada40cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:51.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.180+0000 7fadab2b1700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fada40cc4c0 con 0x7fada40af680 2023-10-06T04:37:51.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.180+0000 7fadab2b1700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fada415d460 con 0x7fada40d08d0 2023-10-06T04:37:51.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.180+0000 7fadab2b1700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fada40d0d20 con 0x7fada40cb360 2023-10-06T04:37:51.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.180+0000 7fada984e700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fada40d08d0 0x7fada40cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:51.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.180+0000 7fada984e700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fada40d08d0 0x7fada40cc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42676/0 (socket says 172.21.15.8:42676) 2023-10-06T04:37:51.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.180+0000 7fada984e700 1 -- 172.21.15.8:0/2215841131 learned_addr learned my addr 172.21.15.8:0/2215841131 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:51.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.180+0000 7fada884c700 1 --2- 172.21.15.8:0/2215841131 >> v2:172.21.15.184:3300/0 conn(0x7fada40cb360 0x7fada40d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:51.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.180+0000 7fada984e700 1 -- 172.21.15.8:0/2215841131 >> v2:172.21.15.184:3300/0 conn(0x7fada40cb360 msgr2=0x7fada40d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:51.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.180+0000 7fada984e700 1 --2- 172.21.15.8:0/2215841131 >> v2:172.21.15.184:3300/0 conn(0x7fada40cb360 0x7fada40d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:51.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.180+0000 7fada984e700 1 -- 172.21.15.8:0/2215841131 >> v1:172.21.15.184:6789/0 conn(0x7fada40af680 legacy=0x7fada415e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:51.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.180+0000 7fada984e700 1 -- 172.21.15.8:0/2215841131 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada40cb8b0 con 0x7fada40d08d0 2023-10-06T04:37:51.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.180+0000 7fada884c700 1 --2- 172.21.15.8:0/2215841131 >> v2:172.21.15.184:3300/0 conn(0x7fada40cb360 0x7fada40d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:51.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.180+0000 7fada984e700 1 --2- 172.21.15.8:0/2215841131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fada40d08d0 0x7fada40cc950 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fada40b2f70 tx=0x7fad9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84785627dee17157 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:51.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.180+0000 7fad9bfff700 1 -- 172.21.15.8:0/2215841131 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9c00b820 con 0x7fada40d08d0 2023-10-06T04:37:51.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.180+0000 7fad9bfff700 1 -- 172.21.15.8:0/2215841131 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9c00b980 con 0x7fada40d08d0 2023-10-06T04:37:51.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.180+0000 7fad9bfff700 1 -- 172.21.15.8:0/2215841131 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9c00bd20 con 0x7fada40d08d0 2023-10-06T04:37:51.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.181+0000 7fadab2b1700 1 -- 172.21.15.8:0/2215841131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fada40d08d0 msgr2=0x7fada40cc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:51.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.181+0000 7fadab2b1700 1 --2- 172.21.15.8:0/2215841131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fada40d08d0 0x7fada40cc950 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fada40b2f70 tx=0x7fad9c009250 comp rx=0 tx=0).stop 2023-10-06T04:37:51.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.181+0000 7fadab2b1700 1 -- 172.21.15.8:0/2215841131 shutdown_connections 2023-10-06T04:37:51.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.181+0000 7fadab2b1700 1 --2- 172.21.15.8:0/2215841131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fada40d08d0 0x7fada40cc950 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:51.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.181+0000 7fadab2b1700 1 --2- 172.21.15.8:0/2215841131 >> v2:172.21.15.184:3300/0 conn(0x7fada40cb360 0x7fada40d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:51.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.181+0000 7fadab2b1700 1 -- 172.21.15.8:0/2215841131 >> 172.21.15.8:0/2215841131 conn(0x7fada40633d0 msgr2=0x7fada40637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:51.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.181+0000 7fadab2b1700 1 -- 172.21.15.8:0/2215841131 shutdown_connections 2023-10-06T04:37:51.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.181+0000 7fadab2b1700 1 -- 172.21.15.8:0/2215841131 wait complete. 2023-10-06T04:37:51.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.182+0000 7fadab2b1700 1 Processor -- start 2023-10-06T04:37:51.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.182+0000 7fadab2b1700 1 -- start start 2023-10-06T04:37:51.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.183+0000 7fadab2b1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fada40af680 0x7fada40c7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:51.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.183+0000 7fadab2b1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fada40cb360 0x7fada40c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:51.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.183+0000 7fadab2b1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fada40d08d0 0x7fada4156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:51.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.183+0000 7fadab2b1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada415b040 con 0x7fada40d08d0 2023-10-06T04:37:51.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.183+0000 7fadab2b1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada40b57c0 con 0x7fada40cb360 2023-10-06T04:37:51.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.183+0000 7fadab2b1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fada40b44c0 con 0x7fada40af680 2023-10-06T04:37:51.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.183+0000 7fada984e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fada40d08d0 0x7fada4156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:51.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.183+0000 7fada984e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fada40d08d0 0x7fada4156730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42678/0 (socket says 172.21.15.8:42678) 2023-10-06T04:37:51.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.183+0000 7fada984e700 1 -- 172.21.15.8:0/3077396852 learned_addr learned my addr 172.21.15.8:0/3077396852 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:51.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.183+0000 7fada884c700 1 --2- 172.21.15.8:0/3077396852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fada40cb360 0x7fada40c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:51.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.183+0000 7fada904d700 1 --2- 172.21.15.8:0/3077396852 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fada40af680 0x7fada40c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:51.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.184+0000 7fada984e700 1 -- 172.21.15.8:0/3077396852 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fada40af680 msgr2=0x7fada40c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:51.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.184+0000 7fada984e700 1 --2- 172.21.15.8:0/3077396852 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fada40af680 0x7fada40c7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:51.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.184+0000 7fada984e700 1 -- 172.21.15.8:0/3077396852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fada40cb360 msgr2=0x7fada40c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:51.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.184+0000 7fada984e700 1 --2- 172.21.15.8:0/3077396852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fada40cb360 0x7fada40c92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:51.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.184+0000 7fada984e700 1 -- 172.21.15.8:0/3077396852 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9c0094f0 con 0x7fada40d08d0 2023-10-06T04:37:51.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.184+0000 7fada984e700 1 --2- 172.21.15.8:0/3077396852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fada40d08d0 0x7fada4156730 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fad9c009290 tx=0x7fad9c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:51.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.184+0000 7fad997fa700 1 -- 172.21.15.8:0/3077396852 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9c01b450 con 0x7fada40d08d0 2023-10-06T04:37:51.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.184+0000 7fad997fa700 1 -- 172.21.15.8:0/3077396852 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9c020070 con 0x7fada40d08d0 2023-10-06T04:37:51.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.184+0000 7fadab2b1700 1 -- 172.21.15.8:0/3077396852 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fada40b47a0 con 0x7fada40d08d0 2023-10-06T04:37:51.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.184+0000 7fad997fa700 1 -- 172.21.15.8:0/3077396852 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9c01b820 con 0x7fada40d08d0 2023-10-06T04:37:51.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.184+0000 7fadab2b1700 1 -- 172.21.15.8:0/3077396852 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fada415acd0 con 0x7fada40d08d0 2023-10-06T04:37:51.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.185+0000 7fadab2b1700 1 -- 172.21.15.8:0/3077396852 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fada4071550 con 0x7fada40d08d0 2023-10-06T04:37:51.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.185+0000 7fad997fa700 1 -- 172.21.15.8:0/3077396852 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fad9c022030 con 0x7fada40d08d0 2023-10-06T04:37:51.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.186+0000 7fad997fa700 1 --2- 172.21.15.8:0/3077396852 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fad88066f30 0x7fad880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:51.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.186+0000 7fad997fa700 1 -- 172.21.15.8:0/3077396852 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7fad9c086ab0 con 0x7fada40d08d0 2023-10-06T04:37:51.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.186+0000 7fada904d700 1 --2- 172.21.15.8:0/3077396852 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fad88066f30 0x7fad880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:51.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.187+0000 7fada904d700 1 --2- 172.21.15.8:0/3077396852 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fad88066f30 0x7fad880693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fada0007560 tx=0x7fada0009760 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:51.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.190+0000 7fad997fa700 1 -- 172.21.15.8:0/3077396852 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad9c053860 con 0x7fada40d08d0 2023-10-06T04:37:51.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.425+0000 7fadab2b1700 1 -- 172.21.15.8:0/3077396852 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fada4071550 con 0x7fada40d08d0 2023-10-06T04:37:51.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.426+0000 7fad997fa700 1 -- 172.21.15.8:0/3077396852 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+5662 (secure 0 0 0) 0x7fad9c056e80 con 0x7fada40d08d0 2023-10-06T04:37:51.427 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:51.427 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":28,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/867081044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":867081044},{"type":"v1","addr":"172.21.15.184:6835","nonce":867081044}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5176,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2754847040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2754847040},{"type":"v1","addr":"172.21.15.184:6837","nonce":2754847040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5358,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/1957165234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1957165234},{"type":"v1","addr":"172.21.15.8:6834","nonce":1957165234}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:37:16.932006+0000","modified":"2023-10-06T04:37:26.044254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":39,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:37:29.514098+0000","modified":"2023-10-06T04:37:43.827602+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5361":{"gid":5361,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.8:6835/1173304661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1173304661},{"type":"v1","addr":"172.21.15.8:6835","nonce":1173304661}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":8,"enabled":true,"fs_name":"recovery_fs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T04:37:51.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.428+0000 7fadab2b1700 1 -- 172.21.15.8:0/3077396852 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fad88066f30 msgr2=0x7fad880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:51.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.428+0000 7fadab2b1700 1 --2- 172.21.15.8:0/3077396852 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fad88066f30 0x7fad880693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fada0007560 tx=0x7fada0009760 comp rx=0 tx=0).stop 2023-10-06T04:37:51.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.428+0000 7fadab2b1700 1 -- 172.21.15.8:0/3077396852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fada40d08d0 msgr2=0x7fada4156730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:51.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.428+0000 7fadab2b1700 1 --2- 172.21.15.8:0/3077396852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fada40d08d0 0x7fada4156730 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fad9c009290 tx=0x7fad9c016000 comp rx=0 tx=0).stop 2023-10-06T04:37:51.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.428+0000 7fadab2b1700 1 -- 172.21.15.8:0/3077396852 shutdown_connections 2023-10-06T04:37:51.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.428+0000 7fadab2b1700 1 --2- 172.21.15.8:0/3077396852 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fad88066f30 0x7fad880693e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:51.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.428+0000 7fadab2b1700 1 --2- 172.21.15.8:0/3077396852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fada40d08d0 0x7fada4156730 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:51.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.428+0000 7fadab2b1700 1 --2- 172.21.15.8:0/3077396852 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fada40af680 0x7fada40c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:51.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.428+0000 7fadab2b1700 1 --2- 172.21.15.8:0/3077396852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fada40cb360 0x7fada40c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:51.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.428+0000 7fadab2b1700 1 -- 172.21.15.8:0/3077396852 >> 172.21.15.8:0/3077396852 conn(0x7fada40633d0 msgr2=0x7fada40cf5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:51.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.428+0000 7fadab2b1700 1 -- 172.21.15.8:0/3077396852 shutdown_connections 2023-10-06T04:37:51.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.428+0000 7fadab2b1700 1 -- 172.21.15.8:0/3077396852 wait complete. 2023-10-06T04:37:51.431 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 28 2023-10-06T04:37:51.441 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:37:51.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.559+0000 7f06efcb4700 1 Processor -- start 2023-10-06T04:37:51.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.559+0000 7f06efcb4700 1 -- start start 2023-10-06T04:37:51.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.560+0000 7f06efcb4700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f06e80cb360 0x7f06e80d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:51.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.560+0000 7f06efcb4700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06e80d08d0 0x7f06e80cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:51.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.560+0000 7f06efcb4700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06e80cc4c0 con 0x7f06e80af680 2023-10-06T04:37:51.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.560+0000 7f06efcb4700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e815d460 con 0x7f06e80cb360 2023-10-06T04:37:51.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.560+0000 7f06efcb4700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e80d0d20 con 0x7f06e80d08d0 2023-10-06T04:37:51.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.561+0000 7f06ed24f700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f06e80cb360 0x7f06e80d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:51.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.561+0000 7f06eda50700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f06e80af680 0x7f06e815e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.8:57916/0 (socket says 172.21.15.8:57916) 2023-10-06T04:37:51.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.561+0000 7f06ee251700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06e80d08d0 0x7f06e80cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:51.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.561+0000 7f06eda50700 1 -- 172.21.15.8:0/2666966998 learned_addr learned my addr 172.21.15.8:0/2666966998 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:51.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.561+0000 7f06eca4e700 1 -- 172.21.15.8:0/2666966998 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1210434918 0 0) 0x7f06e80cc4c0 con 0x7f06e80af680 2023-10-06T04:37:51.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.561+0000 7f06ee251700 1 -- 172.21.15.8:0/2666966998 >> v2:172.21.15.184:3300/0 conn(0x7f06e80cb360 msgr2=0x7f06e80d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:51.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.561+0000 7f06ee251700 1 --2- 172.21.15.8:0/2666966998 >> v2:172.21.15.184:3300/0 conn(0x7f06e80cb360 0x7f06e80d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:51.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.561+0000 7f06ee251700 1 -- 172.21.15.8:0/2666966998 >> v1:172.21.15.184:6789/0 conn(0x7f06e80af680 legacy=0x7f06e815e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:51.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.561+0000 7f06ee251700 1 -- 172.21.15.8:0/2666966998 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e80cb8b0 con 0x7f06e80d08d0 2023-10-06T04:37:51.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.561+0000 7f06ed24f700 1 --2- 172.21.15.8:0/2666966998 >> v2:172.21.15.184:3300/0 conn(0x7f06e80cb360 0x7f06e80d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:37:51.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.561+0000 7f06ee251700 1 --2- 172.21.15.8:0/2666966998 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06e80d08d0 0x7f06e80cc950 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f06e00098e0 tx=0x7f06e00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=627ba15ebb51ae14 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:51.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.561+0000 7f06eca4e700 1 -- 172.21.15.8:0/2666966998 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e000b640 con 0x7f06e80d08d0 2023-10-06T04:37:51.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.561+0000 7f06eca4e700 1 -- 172.21.15.8:0/2666966998 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e000b7a0 con 0x7f06e80d08d0 2023-10-06T04:37:51.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.561+0000 7f06eca4e700 1 -- 172.21.15.8:0/2666966998 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e000bb40 con 0x7f06e80d08d0 2023-10-06T04:37:51.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.562+0000 7f06efcb4700 1 -- 172.21.15.8:0/2666966998 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06e80d08d0 msgr2=0x7f06e80cc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:51.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.562+0000 7f06efcb4700 1 --2- 172.21.15.8:0/2666966998 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06e80d08d0 0x7f06e80cc950 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f06e00098e0 tx=0x7f06e00091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:51.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.562+0000 7f06efcb4700 1 -- 172.21.15.8:0/2666966998 shutdown_connections 2023-10-06T04:37:51.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.562+0000 7f06efcb4700 1 --2- 172.21.15.8:0/2666966998 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06e80d08d0 0x7f06e80cc950 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:51.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.562+0000 7f06efcb4700 1 --2- 172.21.15.8:0/2666966998 >> v2:172.21.15.184:3300/0 conn(0x7f06e80cb360 0x7f06e80d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:51.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.562+0000 7f06efcb4700 1 -- 172.21.15.8:0/2666966998 >> 172.21.15.8:0/2666966998 conn(0x7f06e80633d0 msgr2=0x7f06e80637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:51.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.562+0000 7f06efcb4700 1 -- 172.21.15.8:0/2666966998 shutdown_connections 2023-10-06T04:37:51.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.562+0000 7f06efcb4700 1 -- 172.21.15.8:0/2666966998 wait complete. 2023-10-06T04:37:51.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.563+0000 7f06efcb4700 1 Processor -- start 2023-10-06T04:37:51.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.563+0000 7f06efcb4700 1 -- start start 2023-10-06T04:37:51.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.564+0000 7f06efcb4700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06e80af680 0x7f06e80c6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:51.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.564+0000 7f06efcb4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06e80cb360 0x7f06e80c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:51.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.564+0000 7f06efcb4700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06e80d08d0 0x7f06e815e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:51.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.564+0000 7f06efcb4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e816a470 con 0x7f06e80cb360 2023-10-06T04:37:51.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.564+0000 7f06efcb4700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e80b48d0 con 0x7f06e80d08d0 2023-10-06T04:37:51.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.564+0000 7f06efcb4700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e80b3c10 con 0x7f06e80af680 2023-10-06T04:37:51.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.564+0000 7f06ed24f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06e80cb360 0x7f06e80c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:51.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.564+0000 7f06ed24f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06e80cb360 0x7f06e80c8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42686/0 (socket says 172.21.15.8:42686) 2023-10-06T04:37:51.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.564+0000 7f06ed24f700 1 -- 172.21.15.8:0/2726467665 learned_addr learned my addr 172.21.15.8:0/2726467665 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:51.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.564+0000 7f06eda50700 1 --2- 172.21.15.8:0/2726467665 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06e80af680 0x7f06e80c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:51.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.564+0000 7f06ee251700 1 --2- 172.21.15.8:0/2726467665 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06e80d08d0 0x7f06e815e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:51.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.564+0000 7f06ed24f700 1 -- 172.21.15.8:0/2726467665 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06e80af680 msgr2=0x7f06e80c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:51.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.564+0000 7f06ed24f700 1 --2- 172.21.15.8:0/2726467665 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06e80af680 0x7f06e80c6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:51.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.564+0000 7f06ed24f700 1 -- 172.21.15.8:0/2726467665 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06e80d08d0 msgr2=0x7f06e815e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:51.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.564+0000 7f06ed24f700 1 --2- 172.21.15.8:0/2726467665 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06e80d08d0 0x7f06e815e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:51.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.564+0000 7f06ed24f700 1 -- 172.21.15.8:0/2726467665 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06dc009420 con 0x7f06e80cb360 2023-10-06T04:37:51.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.564+0000 7f06ee251700 1 --2- 172.21.15.8:0/2726467665 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06e80d08d0 0x7f06e815e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:51.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.564+0000 7f06ed24f700 1 --2- 172.21.15.8:0/2726467665 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06e80cb360 0x7f06e80c8210 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00ec80 tx=0x7f06dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:51.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.564+0000 7f06e5ffb700 1 -- 172.21.15.8:0/2726467665 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc00c9d0 con 0x7f06e80cb360 2023-10-06T04:37:51.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.564+0000 7f06e5ffb700 1 -- 172.21.15.8:0/2726467665 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06dc00cb30 con 0x7f06e80cb360 2023-10-06T04:37:51.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.564+0000 7f06efcb4700 1 -- 172.21.15.8:0/2726467665 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e0009420 con 0x7f06e80cb360 2023-10-06T04:37:51.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.564+0000 7f06e5ffb700 1 -- 172.21.15.8:0/2726467665 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc00ceb0 con 0x7f06e80cb360 2023-10-06T04:37:51.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.565+0000 7f06efcb4700 1 -- 172.21.15.8:0/2726467665 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e80b4280 con 0x7f06e80cb360 2023-10-06T04:37:51.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.566+0000 7f06efcb4700 1 -- 172.21.15.8:0/2726467665 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e80b4a40 con 0x7f06e80cb360 2023-10-06T04:37:51.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.566+0000 7f06e5ffb700 1 -- 172.21.15.8:0/2726467665 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f06dc013680 con 0x7f06e80cb360 2023-10-06T04:37:51.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.566+0000 7f06e5ffb700 1 --2- 172.21.15.8:0/2726467665 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f06d4066f30 0x7f06d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:51.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.566+0000 7f06e5ffb700 1 -- 172.21.15.8:0/2726467665 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7f06dc084df0 con 0x7f06e80cb360 2023-10-06T04:37:51.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.567+0000 7f06eda50700 1 --2- 172.21.15.8:0/2726467665 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f06d4066f30 0x7f06d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:51.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.567+0000 7f06eda50700 1 --2- 172.21.15.8:0/2726467665 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f06d4066f30 0x7f06d40693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f06d8002220 tx=0x7f06d8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:51.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.570+0000 7f06e5ffb700 1 -- 172.21.15.8:0/2726467665 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f06dc051ba0 con 0x7f06e80cb360 2023-10-06T04:37:51.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.809+0000 7f06efcb4700 1 -- 172.21.15.8:0/2726467665 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06e8071550 con 0x7f06e80cb360 2023-10-06T04:37:51.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.809+0000 7f06e5ffb700 1 -- 172.21.15.8:0/2726467665 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+5662 (secure 0 0 0) 0x7f06dc0551c0 con 0x7f06e80cb360 2023-10-06T04:37:51.811 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:51.811 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":28,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/867081044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":867081044},{"type":"v1","addr":"172.21.15.184:6835","nonce":867081044}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5176,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2754847040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2754847040},{"type":"v1","addr":"172.21.15.184:6837","nonce":2754847040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5358,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/1957165234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1957165234},{"type":"v1","addr":"172.21.15.8:6834","nonce":1957165234}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:37:16.932006+0000","modified":"2023-10-06T04:37:26.044254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":39,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:37:29.514098+0000","modified":"2023-10-06T04:37:43.827602+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5361":{"gid":5361,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.8:6835/1173304661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1173304661},{"type":"v1","addr":"172.21.15.8:6835","nonce":1173304661}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":8,"enabled":true,"fs_name":"recovery_fs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T04:37:51.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.811+0000 7f06efcb4700 1 -- 172.21.15.8:0/2726467665 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f06d4066f30 msgr2=0x7f06d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:51.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.811+0000 7f06efcb4700 1 --2- 172.21.15.8:0/2726467665 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f06d4066f30 0x7f06d40693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f06d8002220 tx=0x7f06d8009040 comp rx=0 tx=0).stop 2023-10-06T04:37:51.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.811+0000 7f06efcb4700 1 -- 172.21.15.8:0/2726467665 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06e80cb360 msgr2=0x7f06e80c8210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:51.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.811+0000 7f06efcb4700 1 --2- 172.21.15.8:0/2726467665 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06e80cb360 0x7f06e80c8210 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00ec80 tx=0x7f06dc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:51.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.811+0000 7f06efcb4700 1 -- 172.21.15.8:0/2726467665 shutdown_connections 2023-10-06T04:37:51.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.811+0000 7f06efcb4700 1 --2- 172.21.15.8:0/2726467665 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f06d4066f30 0x7f06d40693e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:51.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.811+0000 7f06efcb4700 1 --2- 172.21.15.8:0/2726467665 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06e80d08d0 0x7f06e815e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:51.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.811+0000 7f06efcb4700 1 --2- 172.21.15.8:0/2726467665 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06e80af680 0x7f06e80c6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:51.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.811+0000 7f06efcb4700 1 --2- 172.21.15.8:0/2726467665 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06e80cb360 0x7f06e80c8210 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:51.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.811+0000 7f06efcb4700 1 -- 172.21.15.8:0/2726467665 >> 172.21.15.8:0/2726467665 conn(0x7f06e80633d0 msgr2=0x7f06e80b0970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:51.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.812+0000 7f06efcb4700 1 -- 172.21.15.8:0/2726467665 shutdown_connections 2023-10-06T04:37:51.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.812+0000 7f06efcb4700 1 -- 172.21.15.8:0/2726467665 wait complete. 2023-10-06T04:37:51.815 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 28 2023-10-06T04:37:51.825 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:37:51.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.943+0000 7f5f9aafe700 1 Processor -- start 2023-10-06T04:37:51.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.943+0000 7f5f9aafe700 1 -- start start 2023-10-06T04:37:51.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.944+0000 7f5f9aafe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5f940cb360 0x7f5f940d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:51.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.944+0000 7f5f9aafe700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f940cc4c0 con 0x7f5f940af680 2023-10-06T04:37:51.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.944+0000 7f5f9aafe700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f940d0d20 con 0x7f5f940d08d0 2023-10-06T04:37:51.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.944+0000 7f5f9aafe700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f9415d460 con 0x7f5f940cb360 2023-10-06T04:37:51.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.944+0000 7f5f9889a700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f5f940af680 0x7f5f9415e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60238/0 (socket says 172.21.15.8:60238) 2023-10-06T04:37:51.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.944+0000 7f5f9889a700 1 -- 172.21.15.8:0/2443046264 learned_addr learned my addr 172.21.15.8:0/2443046264 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:51.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.944+0000 7f5f93fff700 1 --2- 172.21.15.8:0/2443046264 >> v2:172.21.15.184:3300/0 conn(0x7f5f940cb360 0x7f5f940d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:51.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.944+0000 7f5f937fe700 1 -- 172.21.15.8:0/2443046264 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 891291791 0 0) 0x7f5f940cc4c0 con 0x7f5f940af680 2023-10-06T04:37:51.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.944+0000 7f5f937fe700 1 -- 172.21.15.8:0/2443046264 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f7c003570 con 0x7f5f940af680 2023-10-06T04:37:51.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.944+0000 7f5f937fe700 1 -- 172.21.15.8:0/2443046264 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3018382583 0 0) 0x7f5f7c003570 con 0x7f5f940af680 2023-10-06T04:37:51.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.944+0000 7f5f937fe700 1 -- 172.21.15.8:0/2443046264 >> v2:172.21.15.184:3300/0 conn(0x7f5f940cb360 msgr2=0x7f5f940d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:51.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.944+0000 7f5f937fe700 1 --2- 172.21.15.8:0/2443046264 >> v2:172.21.15.184:3300/0 conn(0x7f5f940cb360 0x7f5f940d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:51.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.944+0000 7f5f937fe700 1 -- 172.21.15.8:0/2443046264 >> v1:172.21.15.184:6789/0 conn(0x7f5f940d08d0 legacy=0x7f5f940cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:51.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.944+0000 7f5f937fe700 1 -- 172.21.15.8:0/2443046264 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f940cb8b0 con 0x7f5f940af680 2023-10-06T04:37:51.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.944+0000 7f5f937fe700 1 -- 172.21.15.8:0/2443046264 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7f5f84001470 con 0x7f5f940af680 2023-10-06T04:37:51.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.944+0000 7f5f937fe700 1 -- 172.21.15.8:0/2443046264 >> v1:172.21.15.8:6789/0 conn(0x7f5f940af680 legacy=0x7f5f9415e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:51.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.944+0000 7f5f937fe700 1 --2- 172.21.15.8:0/2443046264 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f7c003a60 0x7f5f7c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:51.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.944+0000 7f5f937fe700 1 --2- 172.21.15.8:0/2443046264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f7c004810 0x7f5f7c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:51.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.944+0000 7f5f937fe700 1 --2- 172.21.15.8:0/2443046264 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f7c0051c0 0x7f5f7c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:51.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.944+0000 7f5f937fe700 1 -- 172.21.15.8:0/2443046264 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9415d460 con 0x7f5f7c004810 2023-10-06T04:37:51.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.944+0000 7f5f937fe700 1 -- 172.21.15.8:0/2443046264 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c00c050 con 0x7f5f7c0051c0 2023-10-06T04:37:51.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.944+0000 7f5f937fe700 1 -- 172.21.15.8:0/2443046264 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c00c210 con 0x7f5f7c003a60 2023-10-06T04:37:51.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.944+0000 7f5f93fff700 1 --2- 172.21.15.8:0/2443046264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f7c004810 0x7f5f7c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:51.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.945+0000 7f5f9889a700 1 --2- 172.21.15.8:0/2443046264 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f7c003a60 0x7f5f7c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:51.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.945+0000 7f5f9909b700 1 --2- 172.21.15.8:0/2443046264 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f7c0051c0 0x7f5f7c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:51.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.945+0000 7f5f93fff700 1 -- 172.21.15.8:0/2443046264 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f7c003a60 msgr2=0x7f5f7c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:51.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.945+0000 7f5f93fff700 1 --2- 172.21.15.8:0/2443046264 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f7c003a60 0x7f5f7c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:51.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.945+0000 7f5f93fff700 1 -- 172.21.15.8:0/2443046264 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f7c0051c0 msgr2=0x7f5f7c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:51.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.945+0000 7f5f93fff700 1 --2- 172.21.15.8:0/2443046264 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f7c0051c0 0x7f5f7c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:51.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.945+0000 7f5f93fff700 1 -- 172.21.15.8:0/2443046264 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7c003570 con 0x7f5f7c004810 2023-10-06T04:37:51.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.945+0000 7f5f9909b700 1 --2- 172.21.15.8:0/2443046264 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f7c0051c0 0x7f5f7c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:51.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.945+0000 7f5f9909b700 1 -- 172.21.15.8:0/2443046264 reap_dead start 2023-10-06T04:37:51.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.945+0000 7f5f93fff700 1 --2- 172.21.15.8:0/2443046264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f7c004810 0x7f5f7c004c80 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5f88009c00 tx=0x7f5f880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfb20334211b6b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:51.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.945+0000 7f5f937fe700 1 -- 172.21.15.8:0/2443046264 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8800e710 con 0x7f5f7c004810 2023-10-06T04:37:51.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.945+0000 7f5f937fe700 1 -- 172.21.15.8:0/2443046264 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8800e870 con 0x7f5f7c004810 2023-10-06T04:37:51.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.945+0000 7f5f937fe700 1 -- 172.21.15.8:0/2443046264 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8800ec30 con 0x7f5f7c004810 2023-10-06T04:37:51.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.946+0000 7f5f9aafe700 1 -- 172.21.15.8:0/2443046264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f7c004810 msgr2=0x7f5f7c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:51.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.946+0000 7f5f9aafe700 1 --2- 172.21.15.8:0/2443046264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f7c004810 0x7f5f7c004c80 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5f88009c00 tx=0x7f5f880091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:51.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.946+0000 7f5f9aafe700 1 -- 172.21.15.8:0/2443046264 shutdown_connections 2023-10-06T04:37:51.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.946+0000 7f5f9aafe700 1 --2- 172.21.15.8:0/2443046264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f7c004810 0x7f5f7c004c80 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:51.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.946+0000 7f5f9aafe700 1 -- 172.21.15.8:0/2443046264 >> 172.21.15.8:0/2443046264 conn(0x7f5f940633d0 msgr2=0x7f5f940637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:51.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.946+0000 7f5f9aafe700 1 -- 172.21.15.8:0/2443046264 shutdown_connections 2023-10-06T04:37:51.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.946+0000 7f5f9aafe700 1 -- 172.21.15.8:0/2443046264 wait complete. 2023-10-06T04:37:51.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.947+0000 7f5f9aafe700 1 Processor -- start 2023-10-06T04:37:51.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.947+0000 7f5f9aafe700 1 -- start start 2023-10-06T04:37:51.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.948+0000 7f5f9aafe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f7c004810 0x7f5f940c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:51.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.948+0000 7f5f9aafe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f9416ab40 0x7f5f9415bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:51.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.948+0000 7f5f9aafe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f940a88f0 0x7f5f940a8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:51.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.948+0000 7f5f9aafe700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f940a6ec0 con 0x7f5f940a88f0 2023-10-06T04:37:51.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.948+0000 7f5f9aafe700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f940a92b0 con 0x7f5f9416ab40 2023-10-06T04:37:51.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.948+0000 7f5f9aafe700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f940a7a00 con 0x7f5f7c004810 2023-10-06T04:37:51.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.948+0000 7f5f9909b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f940a88f0 0x7f5f940a8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:51.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.948+0000 7f5f9909b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f940a88f0 0x7f5f940a8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42704/0 (socket says 172.21.15.8:42704) 2023-10-06T04:37:51.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.948+0000 7f5f9909b700 1 -- 172.21.15.8:0/4109124646 learned_addr learned my addr 172.21.15.8:0/4109124646 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:51.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.948+0000 7f5f93fff700 1 --2- 172.21.15.8:0/4109124646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f9416ab40 0x7f5f9415bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:51.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.948+0000 7f5f9889a700 1 --2- 172.21.15.8:0/4109124646 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f7c004810 0x7f5f940c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:51.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.948+0000 7f5f9909b700 1 -- 172.21.15.8:0/4109124646 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f7c004810 msgr2=0x7f5f940c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:51.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.948+0000 7f5f9909b700 1 --2- 172.21.15.8:0/4109124646 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f7c004810 0x7f5f940c9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:51.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.948+0000 7f5f9909b700 1 -- 172.21.15.8:0/4109124646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f9416ab40 msgr2=0x7f5f9415bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:51.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.948+0000 7f5f9909b700 1 --2- 172.21.15.8:0/4109124646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f9416ab40 0x7f5f9415bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:51.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.948+0000 7f5f9909b700 1 -- 172.21.15.8:0/4109124646 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f940a70d0 con 0x7f5f940a88f0 2023-10-06T04:37:51.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.948+0000 7f5f9909b700 1 --2- 172.21.15.8:0/4109124646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f940a88f0 0x7f5f940a8d70 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f5f940cac70 tx=0x7f5f8c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:51.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.948+0000 7f5f90ff9700 1 -- 172.21.15.8:0/4109124646 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c012590 con 0x7f5f940a88f0 2023-10-06T04:37:51.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.948+0000 7f5f90ff9700 1 -- 172.21.15.8:0/4109124646 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8c012710 con 0x7f5f940a88f0 2023-10-06T04:37:51.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.948+0000 7f5f90ff9700 1 -- 172.21.15.8:0/4109124646 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c012ad0 con 0x7f5f940a88f0 2023-10-06T04:37:51.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.948+0000 7f5f9aafe700 1 -- 172.21.15.8:0/4109124646 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f940a73b0 con 0x7f5f940a88f0 2023-10-06T04:37:51.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.949+0000 7f5f9aafe700 1 -- 172.21.15.8:0/4109124646 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f940ca4c0 con 0x7f5f940a88f0 2023-10-06T04:37:51.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.949+0000 7f5f9aafe700 1 -- 172.21.15.8:0/4109124646 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f94071550 con 0x7f5f940a88f0 2023-10-06T04:37:51.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.950+0000 7f5f90ff9700 1 -- 172.21.15.8:0/4109124646 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f8c003030 con 0x7f5f940a88f0 2023-10-06T04:37:51.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.950+0000 7f5f90ff9700 1 --2- 172.21.15.8:0/4109124646 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5f80066f30 0x7f5f800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:51.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.950+0000 7f5f90ff9700 1 -- 172.21.15.8:0/4109124646 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7f5f8c084920 con 0x7f5f940a88f0 2023-10-06T04:37:51.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.950+0000 7f5f9889a700 1 --2- 172.21.15.8:0/4109124646 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5f80066f30 0x7f5f800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:51.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.951+0000 7f5f9889a700 1 --2- 172.21.15.8:0/4109124646 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5f80066f30 0x7f5f800693e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5f840015a0 tx=0x7f5f84009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:51.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:51.954+0000 7f5f90ff9700 1 -- 172.21.15.8:0/4109124646 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f8c0516d0 con 0x7f5f940a88f0 2023-10-06T04:37:52.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.149+0000 7f5f9aafe700 1 -- 172.21.15.8:0/4109124646 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f940a7b40 con 0x7f5f940a88f0 2023-10-06T04:37:52.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.150+0000 7f5f90ff9700 1 -- 172.21.15.8:0/4109124646 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+18779 (secure 0 0 0) 0x7f5f8c054cf0 con 0x7f5f940a88f0 2023-10-06T04:37:52.152 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:52.152 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":46,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:37:30.782691+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:36:10.148177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:36:10.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:37:15.099258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T04:37:15.902657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}}},{"pool":8,"pool_name":"recovery_fs_metadata","create_time":"2023-10-06T04:37:28.524294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}}}],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.555871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.490505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.504578+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.517217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:05.991135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.537329+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.543232+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.443715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6835/3478733664":"2023-10-07T04:37:26.044067+0000","172.21.15.8:6833/3478733664":"2023-10-07T04:37:26.044067+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:37:52.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.152+0000 7f5f9aafe700 1 -- 172.21.15.8:0/4109124646 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5f80066f30 msgr2=0x7f5f800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:52.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.152+0000 7f5f9aafe700 1 --2- 172.21.15.8:0/4109124646 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5f80066f30 0x7f5f800693e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5f840015a0 tx=0x7f5f84009040 comp rx=0 tx=0).stop 2023-10-06T04:37:52.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.152+0000 7f5f9aafe700 1 -- 172.21.15.8:0/4109124646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f940a88f0 msgr2=0x7f5f940a8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:52.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.152+0000 7f5f9aafe700 1 --2- 172.21.15.8:0/4109124646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f940a88f0 0x7f5f940a8d70 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f5f940cac70 tx=0x7f5f8c009040 comp rx=0 tx=0).stop 2023-10-06T04:37:52.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.152+0000 7f5f9aafe700 1 -- 172.21.15.8:0/4109124646 shutdown_connections 2023-10-06T04:37:52.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.152+0000 7f5f9aafe700 1 --2- 172.21.15.8:0/4109124646 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5f80066f30 0x7f5f800693e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:52.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.152+0000 7f5f9aafe700 1 --2- 172.21.15.8:0/4109124646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f940a88f0 0x7f5f940a8d70 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:52.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.152+0000 7f5f9aafe700 1 --2- 172.21.15.8:0/4109124646 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f7c004810 0x7f5f940c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:52.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.152+0000 7f5f9aafe700 1 --2- 172.21.15.8:0/4109124646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f9416ab40 0x7f5f9415bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:52.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.152+0000 7f5f9aafe700 1 -- 172.21.15.8:0/4109124646 >> 172.21.15.8:0/4109124646 conn(0x7f5f940633d0 msgr2=0x7f5f940cff50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:52.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.152+0000 7f5f9aafe700 1 -- 172.21.15.8:0/4109124646 shutdown_connections 2023-10-06T04:37:52.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.152+0000 7f5f9aafe700 1 -- 172.21.15.8:0/4109124646 wait complete. 2023-10-06T04:37:52.166 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T04:37:52.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.285+0000 7feeae8df700 1 Processor -- start 2023-10-06T04:37:52.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.285+0000 7feeae8df700 1 -- start start 2023-10-06T04:37:52.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.286+0000 7feeae8df700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feea815b490 0x7feea80b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:52.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.286+0000 7feeae8df700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea80b2620 con 0x7feea8156e30 2023-10-06T04:37:52.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.286+0000 7feeae8df700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea80cf370 con 0x7feea80b1c70 2023-10-06T04:37:52.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.286+0000 7feeae8df700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea80ce800 con 0x7feea815b490 2023-10-06T04:37:52.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.286+0000 7feead8dd700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7feea8156e30 0x7feea80cf800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60252/0 (socket says 172.21.15.8:60252) 2023-10-06T04:37:52.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.286+0000 7feead8dd700 1 -- 172.21.15.8:0/3748748694 learned_addr learned my addr 172.21.15.8:0/3748748694 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:52.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.286+0000 7feeae0de700 1 --2- 172.21.15.8:0/3748748694 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feea815b490 0x7feea80b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:52.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.286+0000 7feeac8db700 1 -- 172.21.15.8:0/3748748694 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3033065385 0 0) 0x7feea80b2620 con 0x7feea8156e30 2023-10-06T04:37:52.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.286+0000 7feeac8db700 1 -- 172.21.15.8:0/3748748694 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee94003570 con 0x7feea8156e30 2023-10-06T04:37:52.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.287+0000 7feeac8db700 1 -- 172.21.15.8:0/3748748694 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3116045009 0 0) 0x7fee94003570 con 0x7feea8156e30 2023-10-06T04:37:52.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.287+0000 7feeac8db700 1 -- 172.21.15.8:0/3748748694 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feea815b490 msgr2=0x7feea80b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:52.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.287+0000 7feeac8db700 1 --2- 172.21.15.8:0/3748748694 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feea815b490 0x7feea80b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:52.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.287+0000 7feeac8db700 1 -- 172.21.15.8:0/3748748694 >> v1:172.21.15.184:6789/0 conn(0x7feea80b1c70 legacy=0x7feea815ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:52.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.287+0000 7feeac8db700 1 -- 172.21.15.8:0/3748748694 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea80cea60 con 0x7feea8156e30 2023-10-06T04:37:52.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.287+0000 7feeac8db700 1 -- 172.21.15.8:0/3748748694 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7feea4001470 con 0x7feea8156e30 2023-10-06T04:37:52.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.287+0000 7feeae0de700 1 --2- 172.21.15.8:0/3748748694 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feea815b490 0x7feea80b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:37:52.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.287+0000 7feeac8db700 1 -- 172.21.15.8:0/3748748694 >> v1:172.21.15.8:6789/0 conn(0x7feea8156e30 legacy=0x7feea80cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:52.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.287+0000 7feeac8db700 1 --2- 172.21.15.8:0/3748748694 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee94003a90 0x7fee94003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:52.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.287+0000 7feeac8db700 1 --2- 172.21.15.8:0/3748748694 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feea815b490 0x7fee94004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:52.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.287+0000 7feeac8db700 1 --2- 172.21.15.8:0/3748748694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee94004d50 0x7fee940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:52.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.287+0000 7feeac8db700 1 -- 172.21.15.8:0/3748748694 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea80ce800 con 0x7fee94004d50 2023-10-06T04:37:52.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.287+0000 7feeac8db700 1 -- 172.21.15.8:0/3748748694 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9400bb10 con 0x7fee94003a90 2023-10-06T04:37:52.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.287+0000 7feeac8db700 1 -- 172.21.15.8:0/3748748694 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9400bca0 con 0x7feea815b490 2023-10-06T04:37:52.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.287+0000 7feeae0de700 1 --2- 172.21.15.8:0/3748748694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee94004d50 0x7fee940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:52.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.287+0000 7feead8dd700 1 --2- 172.21.15.8:0/3748748694 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee94003a90 0x7fee94003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:52.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.287+0000 7feead0dc700 1 --2- 172.21.15.8:0/3748748694 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feea815b490 0x7fee94004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:52.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.287+0000 7feeae0de700 1 -- 172.21.15.8:0/3748748694 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feea815b490 msgr2=0x7fee94004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:52.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.287+0000 7feeae0de700 1 --2- 172.21.15.8:0/3748748694 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feea815b490 0x7fee94004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:52.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.287+0000 7feeae0de700 1 -- 172.21.15.8:0/3748748694 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee94003a90 msgr2=0x7fee94003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:52.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.287+0000 7feeae0de700 1 --2- 172.21.15.8:0/3748748694 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee94003a90 0x7fee94003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:52.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.287+0000 7feeae0de700 1 -- 172.21.15.8:0/3748748694 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea0009a20 con 0x7fee94004d50 2023-10-06T04:37:52.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.287+0000 7feeae0de700 1 --2- 172.21.15.8:0/3748748694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee94004d50 0x7fee940051c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7feea000e3f0 tx=0x7feea000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c57d3834a9f877bd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:52.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.287+0000 7feeac8db700 1 -- 172.21.15.8:0/3748748694 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea0009c50 con 0x7fee94004d50 2023-10-06T04:37:52.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.287+0000 7feeac8db700 1 -- 172.21.15.8:0/3748748694 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea000f040 con 0x7fee94004d50 2023-10-06T04:37:52.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.287+0000 7feeac8db700 1 -- 172.21.15.8:0/3748748694 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea000eed0 con 0x7fee94004d50 2023-10-06T04:37:52.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.288+0000 7feeae8df700 1 -- 172.21.15.8:0/3748748694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee94004d50 msgr2=0x7fee940051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:52.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.288+0000 7feeae8df700 1 --2- 172.21.15.8:0/3748748694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee94004d50 0x7fee940051c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7feea000e3f0 tx=0x7feea000b040 comp rx=0 tx=0).stop 2023-10-06T04:37:52.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.288+0000 7feeae0de700 1 -- 172.21.15.8:0/3748748694 reap_dead start 2023-10-06T04:37:52.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.288+0000 7feeae8df700 1 -- 172.21.15.8:0/3748748694 shutdown_connections 2023-10-06T04:37:52.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.288+0000 7feeae8df700 1 -- 172.21.15.8:0/3748748694 >> 172.21.15.8:0/3748748694 conn(0x7feea806ed00 msgr2=0x7feea806f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:52.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.288+0000 7feeae8df700 1 -- 172.21.15.8:0/3748748694 shutdown_connections 2023-10-06T04:37:52.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.288+0000 7feeae8df700 1 -- 172.21.15.8:0/3748748694 wait complete. 2023-10-06T04:37:52.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.289+0000 7feeae8df700 1 Processor -- start 2023-10-06T04:37:52.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.289+0000 7feeae8df700 1 -- start start 2023-10-06T04:37:52.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.290+0000 7feeae8df700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee94004d50 0x7feea8157660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:52.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.290+0000 7feeae8df700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feea80b3820 0x7feea80b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:52.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.290+0000 7feeae8df700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feea8150930 0x7feea8150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:52.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.290+0000 7feeae8df700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea80b1520 con 0x7fee94004d50 2023-10-06T04:37:52.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.290+0000 7feeae8df700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea81696f0 con 0x7feea8150930 2023-10-06T04:37:52.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.290+0000 7feeae8df700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea80b41d0 con 0x7feea80b3820 2023-10-06T04:37:52.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.290+0000 7feead8dd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee94004d50 0x7feea8157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:52.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.290+0000 7feead8dd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee94004d50 0x7feea8157660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42720/0 (socket says 172.21.15.8:42720) 2023-10-06T04:37:52.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.290+0000 7feead8dd700 1 -- 172.21.15.8:0/3582850703 learned_addr learned my addr 172.21.15.8:0/3582850703 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:52.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.290+0000 7feead0dc700 1 --2- 172.21.15.8:0/3582850703 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feea80b3820 0x7feea80b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:52.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.290+0000 7feeae0de700 1 --2- 172.21.15.8:0/3582850703 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feea8150930 0x7feea8150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:52.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.290+0000 7feead8dd700 1 -- 172.21.15.8:0/3582850703 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feea80b3820 msgr2=0x7feea80b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:52.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.290+0000 7feead8dd700 1 --2- 172.21.15.8:0/3582850703 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feea80b3820 0x7feea80b3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:52.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.290+0000 7feead8dd700 1 -- 172.21.15.8:0/3582850703 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feea8150930 msgr2=0x7feea8150da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:52.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.290+0000 7feead8dd700 1 --2- 172.21.15.8:0/3582850703 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feea8150930 0x7feea8150da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:52.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.290+0000 7feead8dd700 1 -- 172.21.15.8:0/3582850703 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea80b4430 con 0x7fee94004d50 2023-10-06T04:37:52.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.290+0000 7feead8dd700 1 --2- 172.21.15.8:0/3582850703 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee94004d50 0x7feea8157660 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7feea4007390 tx=0x7feea80cf2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:52.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.290+0000 7fee9dffb700 1 -- 172.21.15.8:0/3582850703 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea4018030 con 0x7fee94004d50 2023-10-06T04:37:52.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.291+0000 7fee9dffb700 1 -- 172.21.15.8:0/3582850703 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea400f8d0 con 0x7fee94004d50 2023-10-06T04:37:52.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.291+0000 7feeae8df700 1 -- 172.21.15.8:0/3582850703 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea80b4710 con 0x7fee94004d50 2023-10-06T04:37:52.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.291+0000 7fee9dffb700 1 -- 172.21.15.8:0/3582850703 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea400fc90 con 0x7fee94004d50 2023-10-06T04:37:52.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.291+0000 7feeae8df700 1 -- 172.21.15.8:0/3582850703 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea80b4cd0 con 0x7fee94004d50 2023-10-06T04:37:52.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.292+0000 7feeae8df700 1 -- 172.21.15.8:0/3582850703 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea804c380 con 0x7fee94004d50 2023-10-06T04:37:52.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.292+0000 7fee9dffb700 1 -- 172.21.15.8:0/3582850703 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feea401b070 con 0x7fee94004d50 2023-10-06T04:37:52.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.292+0000 7fee9dffb700 1 --2- 172.21.15.8:0/3582850703 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fee8c066f30 0x7fee8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:52.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.292+0000 7fee9dffb700 1 -- 172.21.15.8:0/3582850703 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7feea4019070 con 0x7fee94004d50 2023-10-06T04:37:52.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.293+0000 7feead0dc700 1 --2- 172.21.15.8:0/3582850703 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fee8c066f30 0x7fee8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:52.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.293+0000 7feead0dc700 1 --2- 172.21.15.8:0/3582850703 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fee8c066f30 0x7fee8c0693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fee98000f60 tx=0x7fee98009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:52.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.297+0000 7fee9dffb700 1 -- 172.21.15.8:0/3582850703 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feea4051700 con 0x7fee94004d50 2023-10-06T04:37:52.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.538+0000 7feeae8df700 1 -- 172.21.15.8:0/3582850703 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7feea80b3600 con 0x7fee94004d50 2023-10-06T04:37:52.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.859+0000 7fee9dffb700 1 -- 172.21.15.8:0/3582850703 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v29) v1 ==== 161+0+0 (secure 0 0 0) 0x7feea4054d20 con 0x7fee94004d50 2023-10-06T04:37:52.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.862+0000 7feeae8df700 1 -- 172.21.15.8:0/3582850703 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fee8c066f30 msgr2=0x7fee8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:52.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.862+0000 7feeae8df700 1 --2- 172.21.15.8:0/3582850703 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fee8c066f30 0x7fee8c0693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fee98000f60 tx=0x7fee98009040 comp rx=0 tx=0).stop 2023-10-06T04:37:52.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.862+0000 7feeae8df700 1 -- 172.21.15.8:0/3582850703 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee94004d50 msgr2=0x7feea8157660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:52.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.862+0000 7feeae8df700 1 --2- 172.21.15.8:0/3582850703 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee94004d50 0x7feea8157660 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7feea4007390 tx=0x7feea80cf2e0 comp rx=0 tx=0).stop 2023-10-06T04:37:52.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.862+0000 7feeae8df700 1 -- 172.21.15.8:0/3582850703 shutdown_connections 2023-10-06T04:37:52.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.862+0000 7feeae8df700 1 --2- 172.21.15.8:0/3582850703 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fee8c066f30 0x7fee8c0693e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:52.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.862+0000 7feeae8df700 1 --2- 172.21.15.8:0/3582850703 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feea8150930 0x7feea8150da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:52.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.862+0000 7feeae8df700 1 --2- 172.21.15.8:0/3582850703 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee94004d50 0x7feea8157660 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:52.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.862+0000 7feeae8df700 1 --2- 172.21.15.8:0/3582850703 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feea80b3820 0x7feea80b3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:52.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.862+0000 7feeae8df700 1 -- 172.21.15.8:0/3582850703 >> 172.21.15.8:0/3582850703 conn(0x7feea806ed00 msgr2=0x7feea81515a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:52.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.862+0000 7feeae8df700 1 -- 172.21.15.8:0/3582850703 shutdown_connections 2023-10-06T04:37:52.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.862+0000 7feeae8df700 1 -- 172.21.15.8:0/3582850703 wait complete. 2023-10-06T04:37:52.865 INFO:teuthology.orchestra.run.smithi008.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T04:37:52.876 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T04:37:52.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.996+0000 7f93bdf73700 1 Processor -- start 2023-10-06T04:37:52.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.996+0000 7f93bdf73700 1 -- start start 2023-10-06T04:37:53.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.997+0000 7f93bdf73700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f93b8142cf0 0x7f93b80b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:53.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.997+0000 7f93bdf73700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f93b80b3790 0x7f93b80b3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:53.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.997+0000 7f93bdf73700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93b80cf510 con 0x7f93b81430c0 2023-10-06T04:37:53.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.997+0000 7f93bdf73700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b80ce6a0 con 0x7f93b80b3790 2023-10-06T04:37:53.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.997+0000 7f93bdf73700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b80b40d0 con 0x7f93b8142cf0 2023-10-06T04:37:53.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.997+0000 7f93b7fff700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f93b80b3790 0x7f93b80b3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:53.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.997+0000 7f93b7fff700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f93b80b3790 0x7f93b80b3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42724/0 (socket says 172.21.15.8:42724) 2023-10-06T04:37:53.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.997+0000 7f93b7fff700 1 -- 172.21.15.8:0/3566480066 learned_addr learned my addr 172.21.15.8:0/3566480066 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:53.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.997+0000 7f93b77fe700 1 --2- 172.21.15.8:0/3566480066 >> v2:172.21.15.184:3300/0 conn(0x7f93b8142cf0 0x7f93b80b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:53.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.997+0000 7f93b7fff700 1 -- 172.21.15.8:0/3566480066 >> v2:172.21.15.184:3300/0 conn(0x7f93b8142cf0 msgr2=0x7f93b80b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:53.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.997+0000 7f93b7fff700 1 --2- 172.21.15.8:0/3566480066 >> v2:172.21.15.184:3300/0 conn(0x7f93b8142cf0 0x7f93b80b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:53.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.997+0000 7f93b7fff700 1 -- 172.21.15.8:0/3566480066 >> v1:172.21.15.184:6789/0 conn(0x7f93b81430c0 legacy=0x7f93b80cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:53.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.997+0000 7f93b7fff700 1 -- 172.21.15.8:0/3566480066 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b80ce900 con 0x7f93b80b3790 2023-10-06T04:37:53.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.997+0000 7f93b77fe700 1 --2- 172.21.15.8:0/3566480066 >> v2:172.21.15.184:3300/0 conn(0x7f93b8142cf0 0x7f93b80b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:53.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.997+0000 7f93b7fff700 1 --2- 172.21.15.8:0/3566480066 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b80b3790 0x7f93b80b3b90 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f93b8089240 tx=0x7f93b0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b89d7c4a7422d798 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:53.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.997+0000 7f93b67fc700 1 -- 172.21.15.8:0/3566480066 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b000e070 con 0x7f93b80b3790 2023-10-06T04:37:53.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.997+0000 7f93b67fc700 1 -- 172.21.15.8:0/3566480066 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b000ba10 con 0x7f93b80b3790 2023-10-06T04:37:53.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.997+0000 7f93b67fc700 1 -- 172.21.15.8:0/3566480066 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b00092e0 con 0x7f93b80b3790 2023-10-06T04:37:53.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.998+0000 7f93bdf73700 1 -- 172.21.15.8:0/3566480066 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b80b3790 msgr2=0x7f93b80b3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:53.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.998+0000 7f93bdf73700 1 --2- 172.21.15.8:0/3566480066 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b80b3790 0x7f93b80b3b90 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f93b8089240 tx=0x7f93b0009840 comp rx=0 tx=0).stop 2023-10-06T04:37:53.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.998+0000 7f93bdf73700 1 -- 172.21.15.8:0/3566480066 shutdown_connections 2023-10-06T04:37:53.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.998+0000 7f93bdf73700 1 --2- 172.21.15.8:0/3566480066 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b80b3790 0x7f93b80b3b90 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:53.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.998+0000 7f93bdf73700 1 --2- 172.21.15.8:0/3566480066 >> v2:172.21.15.184:3300/0 conn(0x7f93b8142cf0 0x7f93b80b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:53.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.998+0000 7f93bdf73700 1 -- 172.21.15.8:0/3566480066 >> 172.21.15.8:0/3566480066 conn(0x7f93b806ed00 msgr2=0x7f93b806f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:53.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.998+0000 7f93bdf73700 1 -- 172.21.15.8:0/3566480066 shutdown_connections 2023-10-06T04:37:53.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.998+0000 7f93bdf73700 1 -- 172.21.15.8:0/3566480066 wait complete. 2023-10-06T04:37:53.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.999+0000 7f93bdf73700 1 Processor -- start 2023-10-06T04:37:53.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:52.999+0000 7f93bdf73700 1 -- start start 2023-10-06T04:37:53.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.000+0000 7f93bdf73700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93b80b3790 0x7f93b80ab630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:53.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.000+0000 7f93bdf73700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93b8142cf0 0x7f93b8158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:53.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.000+0000 7f93bdf73700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b81430c0 0x7f93b815ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:53.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.000+0000 7f93bdf73700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b815b1a0 con 0x7f93b81430c0 2023-10-06T04:37:53.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.000+0000 7f93bdf73700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b815b3b0 con 0x7f93b80b3790 2023-10-06T04:37:53.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.000+0000 7f93bdf73700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b815b690 con 0x7f93b8142cf0 2023-10-06T04:37:53.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.000+0000 7f93b7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b81430c0 0x7f93b815ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:53.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.000+0000 7f93b7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b81430c0 0x7f93b815ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42728/0 (socket says 172.21.15.8:42728) 2023-10-06T04:37:53.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.000+0000 7f93b7fff700 1 -- 172.21.15.8:0/3554480808 learned_addr learned my addr 172.21.15.8:0/3554480808 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:53.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.000+0000 7f93b77fe700 1 --2- 172.21.15.8:0/3554480808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93b80b3790 0x7f93b80ab630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:53.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.000+0000 7f93b6ffd700 1 --2- 172.21.15.8:0/3554480808 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93b8142cf0 0x7f93b8158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:53.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.000+0000 7f93b7fff700 1 -- 172.21.15.8:0/3554480808 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93b8142cf0 msgr2=0x7f93b8158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:53.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.000+0000 7f93b7fff700 1 --2- 172.21.15.8:0/3554480808 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93b8142cf0 0x7f93b8158f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:53.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.000+0000 7f93b7fff700 1 -- 172.21.15.8:0/3554480808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93b80b3790 msgr2=0x7f93b80ab630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:53.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.000+0000 7f93b7fff700 1 --2- 172.21.15.8:0/3554480808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93b80b3790 0x7f93b80ab630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:53.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.000+0000 7f93b7fff700 1 -- 172.21.15.8:0/3554480808 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b0009ae0 con 0x7f93b81430c0 2023-10-06T04:37:53.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.000+0000 7f93b77fe700 1 --2- 172.21.15.8:0/3554480808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93b80b3790 0x7f93b80ab630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:53.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.001+0000 7f93b7fff700 1 --2- 172.21.15.8:0/3554480808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b81430c0 0x7f93b815ac60 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f93b8067f40 tx=0x7f93b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:53.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.001+0000 7f939f7fe700 1 -- 172.21.15.8:0/3554480808 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b0012e60 con 0x7f93b81430c0 2023-10-06T04:37:53.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.001+0000 7f939f7fe700 1 -- 172.21.15.8:0/3554480808 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b001d420 con 0x7f93b81430c0 2023-10-06T04:37:53.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.001+0000 7f93bdf73700 1 -- 172.21.15.8:0/3554480808 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b815b970 con 0x7f93b81430c0 2023-10-06T04:37:53.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.001+0000 7f939f7fe700 1 -- 172.21.15.8:0/3554480808 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b001d7e0 con 0x7f93b81430c0 2023-10-06T04:37:53.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.001+0000 7f93bdf73700 1 -- 172.21.15.8:0/3554480808 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b80acfd0 con 0x7f93b81430c0 2023-10-06T04:37:53.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.002+0000 7f93bdf73700 1 -- 172.21.15.8:0/3554480808 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b80ad280 con 0x7f93b81430c0 2023-10-06T04:37:53.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.002+0000 7f939f7fe700 1 -- 172.21.15.8:0/3554480808 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f93b001db90 con 0x7f93b81430c0 2023-10-06T04:37:53.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.002+0000 7f939f7fe700 1 --2- 172.21.15.8:0/3554480808 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f93a4066f30 0x7f93a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:53.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.002+0000 7f939f7fe700 1 -- 172.21.15.8:0/3554480808 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7f93b0086350 con 0x7f93b81430c0 2023-10-06T04:37:53.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.003+0000 7f93b77fe700 1 --2- 172.21.15.8:0/3554480808 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f93a4066f30 0x7f93a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:53.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.003+0000 7f93b77fe700 1 --2- 172.21.15.8:0/3554480808 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f93a4066f30 0x7f93a40693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f93a8008b20 tx=0x7f93a8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:53.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.007+0000 7f939f7fe700 1 -- 172.21.15.8:0/3554480808 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f93b80ad280 con 0x7f93b81430c0 2023-10-06T04:37:53.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.243+0000 7f93bdf73700 1 -- 172.21.15.8:0/3554480808 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f93b815be10 con 0x7f93b81430c0 2023-10-06T04:37:53.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.861+0000 7f939f7fe700 1 -- 172.21.15.8:0/3554480808 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v30) v1 ==== 104+0+0 (secure 0 0 0) 0x7f93b815be10 con 0x7f93b81430c0 2023-10-06T04:37:53.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.863+0000 7f93bdf73700 1 -- 172.21.15.8:0/3554480808 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f93a4066f30 msgr2=0x7f93a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:53.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.864+0000 7f93bdf73700 1 --2- 172.21.15.8:0/3554480808 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f93a4066f30 0x7f93a40693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f93a8008b20 tx=0x7f93a8008040 comp rx=0 tx=0).stop 2023-10-06T04:37:53.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.864+0000 7f93bdf73700 1 -- 172.21.15.8:0/3554480808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b81430c0 msgr2=0x7f93b815ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:53.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.864+0000 7f93bdf73700 1 --2- 172.21.15.8:0/3554480808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b81430c0 0x7f93b815ac60 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f93b8067f40 tx=0x7f93b0017000 comp rx=0 tx=0).stop 2023-10-06T04:37:53.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.864+0000 7f93bdf73700 1 -- 172.21.15.8:0/3554480808 shutdown_connections 2023-10-06T04:37:53.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.864+0000 7f93bdf73700 1 --2- 172.21.15.8:0/3554480808 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f93a4066f30 0x7f93a40693e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:53.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.864+0000 7f93bdf73700 1 --2- 172.21.15.8:0/3554480808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b81430c0 0x7f93b815ac60 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:53.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.864+0000 7f93bdf73700 1 --2- 172.21.15.8:0/3554480808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93b80b3790 0x7f93b80ab630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:53.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.864+0000 7f93bdf73700 1 --2- 172.21.15.8:0/3554480808 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93b8142cf0 0x7f93b8158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:53.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.864+0000 7f93bdf73700 1 -- 172.21.15.8:0/3554480808 >> 172.21.15.8:0/3554480808 conn(0x7f93b806ed00 msgr2=0x7f93b80cf9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:53.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.864+0000 7f93bdf73700 1 -- 172.21.15.8:0/3554480808 shutdown_connections 2023-10-06T04:37:53.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:53.864+0000 7f93bdf73700 1 -- 172.21.15.8:0/3554480808 wait complete. 2023-10-06T04:37:53.880 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T04:37:54.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.007+0000 7f798e5c6700 1 Processor -- start 2023-10-06T04:37:54.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.007+0000 7f798e5c6700 1 -- start start 2023-10-06T04:37:54.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.007+0000 7f798e5c6700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f79880af5a0 0x7f798815d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:54.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.007+0000 7f798e5c6700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f79880cd210 0x7f798815a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:54.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.007+0000 7f798e5c6700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f798815e2b0 con 0x7f79880af970 2023-10-06T04:37:54.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.008+0000 7f798e5c6700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f798815ada0 con 0x7f79880cd210 2023-10-06T04:37:54.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.008+0000 7f798e5c6700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79880ce800 con 0x7f79880af5a0 2023-10-06T04:37:54.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.008+0000 7f798cb63700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f79880cd210 0x7f798815a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:54.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.008+0000 7f798cb63700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f79880cd210 0x7f798815a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42734/0 (socket says 172.21.15.8:42734) 2023-10-06T04:37:54.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.008+0000 7f798cb63700 1 -- 172.21.15.8:0/2972206870 learned_addr learned my addr 172.21.15.8:0/2972206870 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:54.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.008+0000 7f798cb63700 1 -- 172.21.15.8:0/2972206870 >> v2:172.21.15.184:3300/0 conn(0x7f79880af5a0 msgr2=0x7f798815d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:54.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.008+0000 7f7987fff700 1 --2- 172.21.15.8:0/2972206870 >> v2:172.21.15.184:3300/0 conn(0x7f79880af5a0 0x7f798815d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:54.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.008+0000 7f798cb63700 1 --2- 172.21.15.8:0/2972206870 >> v2:172.21.15.184:3300/0 conn(0x7f79880af5a0 0x7f798815d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:54.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.008+0000 7f798cb63700 1 -- 172.21.15.8:0/2972206870 >> v1:172.21.15.184:6789/0 conn(0x7f79880af970 legacy=0x7f79880ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:54.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.008+0000 7f798cb63700 1 -- 172.21.15.8:0/2972206870 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f798815da10 con 0x7f79880cd210 2023-10-06T04:37:54.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.008+0000 7f798cb63700 1 --2- 172.21.15.8:0/2972206870 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79880cd210 0x7f798815a860 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f79880893b0 tx=0x7f7980009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b0ed560497c27ee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:54.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.008+0000 7f7986ffd700 1 -- 172.21.15.8:0/2972206870 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798000e070 con 0x7f79880cd210 2023-10-06T04:37:54.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.008+0000 7f7986ffd700 1 -- 172.21.15.8:0/2972206870 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798000ba10 con 0x7f79880cd210 2023-10-06T04:37:54.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.008+0000 7f7986ffd700 1 -- 172.21.15.8:0/2972206870 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79800092e0 con 0x7f79880cd210 2023-10-06T04:37:54.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.009+0000 7f798e5c6700 1 -- 172.21.15.8:0/2972206870 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79880cd210 msgr2=0x7f798815a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:54.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.009+0000 7f798e5c6700 1 --2- 172.21.15.8:0/2972206870 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79880cd210 0x7f798815a860 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f79880893b0 tx=0x7f7980009840 comp rx=0 tx=0).stop 2023-10-06T04:37:54.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.009+0000 7f798e5c6700 1 -- 172.21.15.8:0/2972206870 shutdown_connections 2023-10-06T04:37:54.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.009+0000 7f798e5c6700 1 --2- 172.21.15.8:0/2972206870 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79880cd210 0x7f798815a860 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:54.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.009+0000 7f798e5c6700 1 --2- 172.21.15.8:0/2972206870 >> v2:172.21.15.184:3300/0 conn(0x7f79880af5a0 0x7f798815d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:54.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.009+0000 7f798e5c6700 1 -- 172.21.15.8:0/2972206870 >> 172.21.15.8:0/2972206870 conn(0x7f798806ed00 msgr2=0x7f798806f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:54.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.009+0000 7f798e5c6700 1 -- 172.21.15.8:0/2972206870 shutdown_connections 2023-10-06T04:37:54.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.009+0000 7f798e5c6700 1 -- 172.21.15.8:0/2972206870 wait complete. 2023-10-06T04:37:54.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.010+0000 7f798e5c6700 1 Processor -- start 2023-10-06T04:37:54.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.010+0000 7f798e5c6700 1 -- start start 2023-10-06T04:37:54.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.011+0000 7f798e5c6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79880af5a0 0x7f79881526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:54.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.011+0000 7f798e5c6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79880af970 0x7f79880b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:54.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.011+0000 7f798e5c6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79880cd210 0x7f79880c6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:54.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.011+0000 7f798e5c6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7988152c30 con 0x7f79880af970 2023-10-06T04:37:54.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.011+0000 7f798e5c6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7988160220 con 0x7f79880cd210 2023-10-06T04:37:54.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.011+0000 7f798e5c6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7988156340 con 0x7f79880af5a0 2023-10-06T04:37:54.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.011+0000 7f79877fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79880af970 0x7f79880b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:54.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.011+0000 7f79877fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79880af970 0x7f79880b31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42738/0 (socket says 172.21.15.8:42738) 2023-10-06T04:37:54.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.011+0000 7f79877fe700 1 -- 172.21.15.8:0/3326599646 learned_addr learned my addr 172.21.15.8:0/3326599646 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:54.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.011+0000 7f798cb63700 1 --2- 172.21.15.8:0/3326599646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79880cd210 0x7f79880c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:54.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.011+0000 7f7987fff700 1 --2- 172.21.15.8:0/3326599646 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79880af5a0 0x7f79881526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:54.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.011+0000 7f79877fe700 1 -- 172.21.15.8:0/3326599646 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79880af5a0 msgr2=0x7f79881526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:54.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.011+0000 7f79877fe700 1 --2- 172.21.15.8:0/3326599646 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79880af5a0 0x7f79881526f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:54.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.011+0000 7f79877fe700 1 -- 172.21.15.8:0/3326599646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79880cd210 msgr2=0x7f79880c6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:54.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.011+0000 7f79877fe700 1 --2- 172.21.15.8:0/3326599646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79880cd210 0x7f79880c6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:54.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.011+0000 7f79877fe700 1 -- 172.21.15.8:0/3326599646 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7980009ae0 con 0x7f79880af970 2023-10-06T04:37:54.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.011+0000 7f79877fe700 1 --2- 172.21.15.8:0/3326599646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79880af970 0x7f79880b31e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f797800c590 tx=0x7f7978007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:54.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.012+0000 7f797ffff700 1 -- 172.21.15.8:0/3326599646 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7978011590 con 0x7f79880af970 2023-10-06T04:37:54.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.012+0000 7f797ffff700 1 -- 172.21.15.8:0/3326599646 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79780116f0 con 0x7f79880af970 2023-10-06T04:37:54.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.012+0000 7f798e5c6700 1 -- 172.21.15.8:0/3326599646 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79880b3720 con 0x7f79880af970 2023-10-06T04:37:54.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.012+0000 7f797ffff700 1 -- 172.21.15.8:0/3326599646 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7978011ab0 con 0x7f79880af970 2023-10-06T04:37:54.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.012+0000 7f798e5c6700 1 -- 172.21.15.8:0/3326599646 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79880ca040 con 0x7f79880af970 2023-10-06T04:37:54.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.013+0000 7f798e5c6700 1 -- 172.21.15.8:0/3326599646 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7988071550 con 0x7f79880af970 2023-10-06T04:37:54.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.013+0000 7f797ffff700 1 -- 172.21.15.8:0/3326599646 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f797801c460 con 0x7f79880af970 2023-10-06T04:37:54.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.013+0000 7f797ffff700 1 --2- 172.21.15.8:0/3326599646 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7968066f30 0x7f79680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:54.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.014+0000 7f797ffff700 1 -- 172.21.15.8:0/3326599646 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6917+0+0 (secure 0 0 0) 0x7f79780845e0 con 0x7f79880af970 2023-10-06T04:37:54.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.014+0000 7f7987fff700 1 --2- 172.21.15.8:0/3326599646 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7968066f30 0x7f79680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:54.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.014+0000 7f7987fff700 1 --2- 172.21.15.8:0/3326599646 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7968066f30 0x7f79680693e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f797000acb0 tx=0x7f7970008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:54.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.018+0000 7f797ffff700 1 -- 172.21.15.8:0/3326599646 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7978051390 con 0x7f79880af970 2023-10-06T04:37:54.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.213+0000 7f798e5c6700 1 -- 172.21.15.8:0/3326599646 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f79880af0a0 con 0x7f79880af970 2023-10-06T04:37:54.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.870+0000 7f797ffff700 1 -- 172.21.15.8:0/3326599646 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v47) v1 ==== 181+0+0 (secure 0 0 0) 0x7f79780549b0 con 0x7f79880af970 2023-10-06T04:37:54.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.874+0000 7f798e5c6700 1 -- 172.21.15.8:0/3326599646 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7968066f30 msgr2=0x7f79680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:54.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.874+0000 7f798e5c6700 1 --2- 172.21.15.8:0/3326599646 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7968066f30 0x7f79680693e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f797000acb0 tx=0x7f7970008040 comp rx=0 tx=0).stop 2023-10-06T04:37:54.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.874+0000 7f798e5c6700 1 -- 172.21.15.8:0/3326599646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79880af970 msgr2=0x7f79880b31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:54.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.874+0000 7f798e5c6700 1 --2- 172.21.15.8:0/3326599646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79880af970 0x7f79880b31e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f797800c590 tx=0x7f7978007f30 comp rx=0 tx=0).stop 2023-10-06T04:37:54.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.874+0000 7f798e5c6700 1 -- 172.21.15.8:0/3326599646 shutdown_connections 2023-10-06T04:37:54.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.874+0000 7f798e5c6700 1 --2- 172.21.15.8:0/3326599646 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7968066f30 0x7f79680693e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:54.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.874+0000 7f798e5c6700 1 --2- 172.21.15.8:0/3326599646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79880cd210 0x7f79880c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:54.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.874+0000 7f798e5c6700 1 --2- 172.21.15.8:0/3326599646 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79880af5a0 0x7f79881526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:54.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.874+0000 7f798e5c6700 1 --2- 172.21.15.8:0/3326599646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79880af970 0x7f79880b31e0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:54.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.874+0000 7f798e5c6700 1 -- 172.21.15.8:0/3326599646 >> 172.21.15.8:0/3326599646 conn(0x7f798806ed00 msgr2=0x7f7988070990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:54.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.874+0000 7f798e5c6700 1 -- 172.21.15.8:0/3326599646 shutdown_connections 2023-10-06T04:37:54.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:54.874+0000 7f798e5c6700 1 -- 172.21.15.8:0/3326599646 wait complete. 2023-10-06T04:37:54.877 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_metadata' removed 2023-10-06T04:37:54.890 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T04:37:55.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.017+0000 7f6a5d83f700 1 Processor -- start 2023-10-06T04:37:55.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.017+0000 7f6a5d83f700 1 -- start start 2023-10-06T04:37:55.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.017+0000 7f6a5d83f700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6a580af5a0 0x7f6a5815d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:55.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.017+0000 7f6a5d83f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a580cd530 0x7f6a5815a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:55.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.017+0000 7f6a5d83f700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a580ce820 con 0x7f6a580af970 2023-10-06T04:37:55.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.017+0000 7f6a5d83f700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a5815e2d0 con 0x7f6a580af5a0 2023-10-06T04:37:55.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.017+0000 7f6a5d83f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5815ad10 con 0x7f6a580cd530 2023-10-06T04:37:55.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.018+0000 7f6a567fc700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f6a580af970 0x7f6a580cce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34564/0 (socket says 172.21.15.8:34564) 2023-10-06T04:37:55.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.018+0000 7f6a567fc700 1 -- 172.21.15.8:0/2226208071 learned_addr learned my addr 172.21.15.8:0/2226208071 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:55.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.018+0000 7f6a56ffd700 1 --2- 172.21.15.8:0/2226208071 >> v2:172.21.15.184:3300/0 conn(0x7f6a580af5a0 0x7f6a5815d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:55.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.018+0000 7f6a577fe700 1 --2- 172.21.15.8:0/2226208071 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a580cd530 0x7f6a5815a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:55.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.018+0000 7f6a55ffb700 1 -- 172.21.15.8:0/2226208071 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2180441538 0 0) 0x7f6a580ce820 con 0x7f6a580af970 2023-10-06T04:37:55.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.018+0000 7f6a55ffb700 1 -- 172.21.15.8:0/2226208071 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a44003570 con 0x7f6a580af970 2023-10-06T04:37:55.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.018+0000 7f6a55ffb700 1 -- 172.21.15.8:0/2226208071 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1568184347 0 0) 0x7f6a44003570 con 0x7f6a580af970 2023-10-06T04:37:55.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.018+0000 7f6a55ffb700 1 -- 172.21.15.8:0/2226208071 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a580cd530 msgr2=0x7f6a5815a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:55.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.018+0000 7f6a55ffb700 1 --2- 172.21.15.8:0/2226208071 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a580cd530 0x7f6a5815a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:55.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.018+0000 7f6a55ffb700 1 -- 172.21.15.8:0/2226208071 >> v2:172.21.15.184:3300/0 conn(0x7f6a580af5a0 msgr2=0x7f6a5815d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:55.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.018+0000 7f6a55ffb700 1 --2- 172.21.15.8:0/2226208071 >> v2:172.21.15.184:3300/0 conn(0x7f6a580af5a0 0x7f6a5815d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:55.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.018+0000 7f6a55ffb700 1 -- 172.21.15.8:0/2226208071 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a5815da30 con 0x7f6a580af970 2023-10-06T04:37:55.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.018+0000 7f6a55ffb700 1 -- 172.21.15.8:0/2226208071 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7f6a40001470 con 0x7f6a580af970 2023-10-06T04:37:55.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.018+0000 7f6a55ffb700 1 -- 172.21.15.8:0/2226208071 >> v1:172.21.15.8:6789/0 conn(0x7f6a580af970 legacy=0x7f6a580cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:55.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.018+0000 7f6a55ffb700 1 --2- 172.21.15.8:0/2226208071 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a580cd530 0x7f6a44003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:55.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.018+0000 7f6a55ffb700 1 --2- 172.21.15.8:0/2226208071 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a44004010 0x7f6a44004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:55.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.018+0000 7f6a55ffb700 1 --2- 172.21.15.8:0/2226208071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a44004d50 0x7f6a440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:55.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.018+0000 7f6a55ffb700 1 -- 172.21.15.8:0/2226208071 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5815e2d0 con 0x7f6a44004d50 2023-10-06T04:37:55.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.018+0000 7f6a55ffb700 1 -- 172.21.15.8:0/2226208071 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5815ad10 con 0x7f6a44004010 2023-10-06T04:37:55.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.018+0000 7f6a55ffb700 1 -- 172.21.15.8:0/2226208071 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4400bab0 con 0x7f6a580cd530 2023-10-06T04:37:55.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.018+0000 7f6a577fe700 1 --2- 172.21.15.8:0/2226208071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a44004d50 0x7f6a440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:55.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.018+0000 7f6a56ffd700 1 --2- 172.21.15.8:0/2226208071 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a580cd530 0x7f6a44003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:55.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.018+0000 7f6a567fc700 1 --2- 172.21.15.8:0/2226208071 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a44004010 0x7f6a44004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:55.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.019+0000 7f6a577fe700 1 -- 172.21.15.8:0/2226208071 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a580cd530 msgr2=0x7f6a44003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:55.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.019+0000 7f6a577fe700 1 --2- 172.21.15.8:0/2226208071 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a580cd530 0x7f6a44003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:55.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.019+0000 7f6a577fe700 1 -- 172.21.15.8:0/2226208071 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a44004010 msgr2=0x7f6a44004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:55.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.019+0000 7f6a577fe700 1 --2- 172.21.15.8:0/2226208071 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a44004010 0x7f6a44004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:55.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.019+0000 7f6a577fe700 1 -- 172.21.15.8:0/2226208071 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a44003570 con 0x7f6a44004d50 2023-10-06T04:37:55.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.019+0000 7f6a577fe700 1 --2- 172.21.15.8:0/2226208071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a44004d50 0x7f6a440051c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f6a580cd950 tx=0x7f6a500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edd58ef007e3e778 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:55.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.019+0000 7f6a55ffb700 1 -- 172.21.15.8:0/2226208071 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5000e710 con 0x7f6a44004d50 2023-10-06T04:37:55.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.019+0000 7f6a55ffb700 1 -- 172.21.15.8:0/2226208071 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5000e870 con 0x7f6a44004d50 2023-10-06T04:37:55.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.019+0000 7f6a55ffb700 1 -- 172.21.15.8:0/2226208071 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5000ec30 con 0x7f6a44004d50 2023-10-06T04:37:55.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.020+0000 7f6a5d83f700 1 -- 172.21.15.8:0/2226208071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a44004d50 msgr2=0x7f6a440051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:55.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.020+0000 7f6a5d83f700 1 --2- 172.21.15.8:0/2226208071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a44004d50 0x7f6a440051c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f6a580cd950 tx=0x7f6a500091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:55.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.020+0000 7f6a577fe700 1 -- 172.21.15.8:0/2226208071 reap_dead start 2023-10-06T04:37:55.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.020+0000 7f6a5d83f700 1 -- 172.21.15.8:0/2226208071 shutdown_connections 2023-10-06T04:37:55.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.020+0000 7f6a5d83f700 1 -- 172.21.15.8:0/2226208071 >> 172.21.15.8:0/2226208071 conn(0x7f6a5806ed00 msgr2=0x7f6a5806f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:55.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.020+0000 7f6a5d83f700 1 -- 172.21.15.8:0/2226208071 shutdown_connections 2023-10-06T04:37:55.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.020+0000 7f6a5d83f700 1 -- 172.21.15.8:0/2226208071 wait complete. 2023-10-06T04:37:55.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.021+0000 7f6a5d83f700 1 Processor -- start 2023-10-06T04:37:55.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.021+0000 7f6a5d83f700 1 -- start start 2023-10-06T04:37:55.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.022+0000 7f6a5d83f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a58146050 0x7f6a580b0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:55.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.022+0000 7f6a5d83f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a58146420 0x7f6a580b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:55.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.022+0000 7f6a5d83f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a581545e0 0x7f6a580b1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:55.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.022+0000 7f6a5d83f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a580b36a0 con 0x7f6a58146050 2023-10-06T04:37:55.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.022+0000 7f6a5d83f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a58154ad0 con 0x7f6a58146420 2023-10-06T04:37:55.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.022+0000 7f6a5d83f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a58154db0 con 0x7f6a581545e0 2023-10-06T04:37:55.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.022+0000 7f6a56ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a58146050 0x7f6a580b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:55.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.022+0000 7f6a56ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a58146050 0x7f6a580b0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47388/0 (socket says 172.21.15.8:47388) 2023-10-06T04:37:55.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.022+0000 7f6a56ffd700 1 -- 172.21.15.8:0/2587900737 learned_addr learned my addr 172.21.15.8:0/2587900737 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:55.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.022+0000 7f6a577fe700 1 --2- 172.21.15.8:0/2587900737 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a581545e0 0x7f6a580b1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:55.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.022+0000 7f6a567fc700 1 --2- 172.21.15.8:0/2587900737 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a58146420 0x7f6a580b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:55.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.022+0000 7f6a56ffd700 1 -- 172.21.15.8:0/2587900737 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a581545e0 msgr2=0x7f6a580b1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:55.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.022+0000 7f6a56ffd700 1 --2- 172.21.15.8:0/2587900737 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a581545e0 0x7f6a580b1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:55.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.022+0000 7f6a56ffd700 1 -- 172.21.15.8:0/2587900737 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a58146420 msgr2=0x7f6a580b0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:55.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.022+0000 7f6a56ffd700 1 --2- 172.21.15.8:0/2587900737 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a58146420 0x7f6a580b0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:55.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.022+0000 7f6a56ffd700 1 -- 172.21.15.8:0/2587900737 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a58155090 con 0x7f6a58146050 2023-10-06T04:37:55.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.022+0000 7f6a567fc700 1 --2- 172.21.15.8:0/2587900737 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a58146420 0x7f6a580b0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:55.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.022+0000 7f6a56ffd700 1 --2- 172.21.15.8:0/2587900737 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a58146050 0x7f6a580b0680 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6a48009fd0 tx=0x7f6a4800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:55.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.022+0000 7f6a4effd700 1 -- 172.21.15.8:0/2587900737 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4800e040 con 0x7f6a58146050 2023-10-06T04:37:55.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.022+0000 7f6a4effd700 1 -- 172.21.15.8:0/2587900737 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4800f040 con 0x7f6a58146050 2023-10-06T04:37:55.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.022+0000 7f6a4effd700 1 -- 172.21.15.8:0/2587900737 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a48015430 con 0x7f6a58146050 2023-10-06T04:37:55.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.022+0000 7f6a5d83f700 1 -- 172.21.15.8:0/2587900737 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a58155370 con 0x7f6a58146050 2023-10-06T04:37:55.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.022+0000 7f6a5d83f700 1 -- 172.21.15.8:0/2587900737 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a58157940 con 0x7f6a58146050 2023-10-06T04:37:55.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.023+0000 7f6a5d83f700 1 -- 172.21.15.8:0/2587900737 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a58071550 con 0x7f6a58146050 2023-10-06T04:37:55.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.024+0000 7f6a4effd700 1 -- 172.21.15.8:0/2587900737 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a48015860 con 0x7f6a58146050 2023-10-06T04:37:55.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.024+0000 7f6a4effd700 1 --2- 172.21.15.8:0/2587900737 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6a38066f30 0x7f6a380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:55.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.024+0000 7f6a4effd700 1 -- 172.21.15.8:0/2587900737 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6479+0+0 (secure 0 0 0) 0x7f6a480855b0 con 0x7f6a58146050 2023-10-06T04:37:55.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.024+0000 7f6a567fc700 1 --2- 172.21.15.8:0/2587900737 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6a38066f30 0x7f6a380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:55.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.025+0000 7f6a567fc700 1 --2- 172.21.15.8:0/2587900737 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6a38066f30 0x7f6a380693e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6a40004890 tx=0x7f6a40009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:55.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.028+0000 7f6a4effd700 1 -- 172.21.15.8:0/2587900737 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a48052520 con 0x7f6a58146050 2023-10-06T04:37:55.206 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:37:55.208 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:37:55.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.221+0000 7f6a5d83f700 1 -- 172.21.15.8:0/2587900737 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6a580b39b0 con 0x7f6a58146050 2023-10-06T04:37:55.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.222+0000 7f6a4effd700 1 -- 172.21.15.8:0/2587900737 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=-16 pool 'cephfs_data' is in use by CephFS v47) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6a48055b40 con 0x7f6a58146050 2023-10-06T04:37:55.225 INFO:teuthology.orchestra.run.smithi008.stderr:Error EBUSY: pool 'cephfs_data' is in use by CephFS 2023-10-06T04:37:55.229 DEBUG:teuthology.orchestra.run:got remote process result: 16 2023-10-06T04:37:55.229 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:37:55.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.389+0000 7f47a5517700 1 Processor -- start 2023-10-06T04:37:55.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.389+0000 7f47a5517700 1 -- start start 2023-10-06T04:37:55.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.390+0000 7f47a5517700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f47a0142e00 0x7f47a0068940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:55.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.390+0000 7f47a5517700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f47a00cc2e0 0x7f47a00d0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:55.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.390+0000 7f47a5517700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a00cf830 con 0x7f47a00d06a0 2023-10-06T04:37:55.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.390+0000 7f47a5517700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a00d0ae0 con 0x7f47a00cc2e0 2023-10-06T04:37:55.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.390+0000 7f47a5517700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a00cf530 con 0x7f47a0142e00 2023-10-06T04:37:55.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.390+0000 7f479e7fc700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f47a00cc2e0 0x7f47a00d0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:55.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.390+0000 7f479f7fe700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f47a00d06a0 0x7f47a00b3060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34572/0 (socket says 172.21.15.8:34572) 2023-10-06T04:37:55.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.390+0000 7f479f7fe700 1 -- 172.21.15.8:0/285570409 learned_addr learned my addr 172.21.15.8:0/285570409 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:55.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.390+0000 7f479effd700 1 --2- 172.21.15.8:0/285570409 >> v2:172.21.15.184:3300/0 conn(0x7f47a0142e00 0x7f47a0068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:55.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.390+0000 7f479e7fc700 1 -- 172.21.15.8:0/285570409 >> v2:172.21.15.184:3300/0 conn(0x7f47a0142e00 msgr2=0x7f47a0068940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:55.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.390+0000 7f479e7fc700 1 --2- 172.21.15.8:0/285570409 >> v2:172.21.15.184:3300/0 conn(0x7f47a0142e00 0x7f47a0068940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:55.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.390+0000 7f479e7fc700 1 -- 172.21.15.8:0/285570409 >> v1:172.21.15.8:6789/0 conn(0x7f47a00d06a0 legacy=0x7f47a00b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:55.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.390+0000 7f479dffb700 1 -- 172.21.15.8:0/285570409 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 300024631 0 0) 0x7f47a00cf830 con 0x7f47a00d06a0 2023-10-06T04:37:55.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.390+0000 7f479e7fc700 1 -- 172.21.15.8:0/285570409 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a0068e80 con 0x7f47a00cc2e0 2023-10-06T04:37:55.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.391+0000 7f479e7fc700 1 --2- 172.21.15.8:0/285570409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47a00cc2e0 0x7f47a00d0160 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f47a0071180 tx=0x7f47880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a61bd620c2a13e78 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:55.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.391+0000 7f479dffb700 1 -- 172.21.15.8:0/285570409 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478800b6b0 con 0x7f47a00cc2e0 2023-10-06T04:37:55.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.391+0000 7f479dffb700 1 -- 172.21.15.8:0/285570409 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478800b810 con 0x7f47a00cc2e0 2023-10-06T04:37:55.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.391+0000 7f479dffb700 1 -- 172.21.15.8:0/285570409 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478800bbb0 con 0x7f47a00cc2e0 2023-10-06T04:37:55.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.391+0000 7f47a5517700 1 -- 172.21.15.8:0/285570409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47a00cc2e0 msgr2=0x7f47a00d0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:55.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.391+0000 7f47a5517700 1 --2- 172.21.15.8:0/285570409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47a00cc2e0 0x7f47a00d0160 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f47a0071180 tx=0x7f47880091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:55.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.391+0000 7f47a5517700 1 -- 172.21.15.8:0/285570409 shutdown_connections 2023-10-06T04:37:55.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.391+0000 7f47a5517700 1 --2- 172.21.15.8:0/285570409 >> v2:172.21.15.184:3300/0 conn(0x7f47a0142e00 0x7f47a0068940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:55.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.391+0000 7f47a5517700 1 --2- 172.21.15.8:0/285570409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47a00cc2e0 0x7f47a00d0160 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:55.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.391+0000 7f47a5517700 1 -- 172.21.15.8:0/285570409 >> 172.21.15.8:0/285570409 conn(0x7f47a006f7d0 msgr2=0x7f47a0068230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:55.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.391+0000 7f47a5517700 1 -- 172.21.15.8:0/285570409 shutdown_connections 2023-10-06T04:37:55.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.391+0000 7f47a5517700 1 -- 172.21.15.8:0/285570409 wait complete. 2023-10-06T04:37:55.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.392+0000 7f47a5517700 1 Processor -- start 2023-10-06T04:37:55.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.393+0000 7f47a5517700 1 -- start start 2023-10-06T04:37:55.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.393+0000 7f47a5517700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47a00cc2e0 0x7f47a01599c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:55.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.393+0000 7f47a5517700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47a00d06a0 0x7f47a015c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:55.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.393+0000 7f47a5517700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47a0142e00 0x7f47a0158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:55.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.393+0000 7f47a5517700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a015abb0 con 0x7f47a0142e00 2023-10-06T04:37:55.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.393+0000 7f47a5517700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a0159fa0 con 0x7f47a00cc2e0 2023-10-06T04:37:55.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.393+0000 7f47a5517700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a015a280 con 0x7f47a00d06a0 2023-10-06T04:37:55.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.393+0000 7f479f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47a0142e00 0x7f47a0158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:55.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.393+0000 7f479f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47a0142e00 0x7f47a0158ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47402/0 (socket says 172.21.15.8:47402) 2023-10-06T04:37:55.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.393+0000 7f479f7fe700 1 -- 172.21.15.8:0/2841846515 learned_addr learned my addr 172.21.15.8:0/2841846515 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:55.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.394+0000 7f479effd700 1 --2- 172.21.15.8:0/2841846515 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47a00cc2e0 0x7f47a01599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:55.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.394+0000 7f479e7fc700 1 --2- 172.21.15.8:0/2841846515 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47a00d06a0 0x7f47a015c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:55.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.394+0000 7f479f7fe700 1 -- 172.21.15.8:0/2841846515 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47a00d06a0 msgr2=0x7f47a015c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:55.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.394+0000 7f479f7fe700 1 --2- 172.21.15.8:0/2841846515 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47a00d06a0 0x7f47a015c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:55.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.394+0000 7f479f7fe700 1 -- 172.21.15.8:0/2841846515 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47a00cc2e0 msgr2=0x7f47a01599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:55.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.394+0000 7f479f7fe700 1 --2- 172.21.15.8:0/2841846515 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47a00cc2e0 0x7f47a01599c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:55.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.394+0000 7f479f7fe700 1 -- 172.21.15.8:0/2841846515 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4788009420 con 0x7f47a0142e00 2023-10-06T04:37:55.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.394+0000 7f479effd700 1 --2- 172.21.15.8:0/2841846515 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47a00cc2e0 0x7f47a01599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:55.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.394+0000 7f479f7fe700 1 --2- 172.21.15.8:0/2841846515 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47a0142e00 0x7f47a0158ea0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f479800c7e0 tx=0x7f4798007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:55.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.394+0000 7f4796ffd700 1 -- 172.21.15.8:0/2841846515 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4798005c00 con 0x7f47a0142e00 2023-10-06T04:37:55.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.394+0000 7f4796ffd700 1 -- 172.21.15.8:0/2841846515 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4798005d60 con 0x7f47a0142e00 2023-10-06T04:37:55.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.394+0000 7f47a5517700 1 -- 172.21.15.8:0/2841846515 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a015a560 con 0x7f47a0142e00 2023-10-06T04:37:55.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.394+0000 7f4796ffd700 1 -- 172.21.15.8:0/2841846515 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4798004a80 con 0x7f47a0142e00 2023-10-06T04:37:55.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.394+0000 7f47a5517700 1 -- 172.21.15.8:0/2841846515 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a015cc50 con 0x7f47a0142e00 2023-10-06T04:37:55.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.395+0000 7f47a5517700 1 -- 172.21.15.8:0/2841846515 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a004c380 con 0x7f47a0142e00 2023-10-06T04:37:55.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.395+0000 7f4796ffd700 1 -- 172.21.15.8:0/2841846515 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4798005030 con 0x7f47a0142e00 2023-10-06T04:37:55.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.396+0000 7f4796ffd700 1 --2- 172.21.15.8:0/2841846515 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4780066f30 0x7f47800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:55.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.396+0000 7f4796ffd700 1 -- 172.21.15.8:0/2841846515 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6479+0+0 (secure 0 0 0) 0x7f4798083ca0 con 0x7f47a0142e00 2023-10-06T04:37:55.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.396+0000 7f479effd700 1 --2- 172.21.15.8:0/2841846515 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4780066f30 0x7f47800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:55.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.396+0000 7f479effd700 1 --2- 172.21.15.8:0/2841846515 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4780066f30 0x7f47800693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4790009fd0 tx=0x7f4790009740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:55.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.400+0000 7f4796ffd700 1 -- 172.21.15.8:0/2841846515 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f479804b5a0 con 0x7f47a0142e00 2023-10-06T04:37:55.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.596+0000 7f47a5517700 1 -- 172.21.15.8:0/2841846515 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47a00ccdf0 con 0x7f47a0142e00 2023-10-06T04:37:55.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.597+0000 7f4796ffd700 1 -- 172.21.15.8:0/2841846515 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+17165 (secure 0 0 0) 0x7f4798050c10 con 0x7f47a0142e00 2023-10-06T04:37:55.598 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:55.598 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":47,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:37:54.863783+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:36:10.148177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:36:10.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T04:37:15.902657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}}},{"pool":8,"pool_name":"recovery_fs_metadata","create_time":"2023-10-06T04:37:28.524294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}}}],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.555871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.490505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.504578+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.517217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:05.991135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.537329+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.543232+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.443715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6835/3478733664":"2023-10-07T04:37:26.044067+0000","172.21.15.8:6833/3478733664":"2023-10-07T04:37:26.044067+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:37:55.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.599+0000 7f47a5517700 1 -- 172.21.15.8:0/2841846515 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4780066f30 msgr2=0x7f47800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:55.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.599+0000 7f47a5517700 1 --2- 172.21.15.8:0/2841846515 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4780066f30 0x7f47800693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4790009fd0 tx=0x7f4790009740 comp rx=0 tx=0).stop 2023-10-06T04:37:55.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.599+0000 7f47a5517700 1 -- 172.21.15.8:0/2841846515 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47a0142e00 msgr2=0x7f47a0158ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:55.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.599+0000 7f47a5517700 1 --2- 172.21.15.8:0/2841846515 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47a0142e00 0x7f47a0158ea0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f479800c7e0 tx=0x7f4798007d90 comp rx=0 tx=0).stop 2023-10-06T04:37:55.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.599+0000 7f47a5517700 1 -- 172.21.15.8:0/2841846515 shutdown_connections 2023-10-06T04:37:55.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.599+0000 7f47a5517700 1 --2- 172.21.15.8:0/2841846515 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4780066f30 0x7f47800693e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:55.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.599+0000 7f47a5517700 1 --2- 172.21.15.8:0/2841846515 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47a0142e00 0x7f47a0158ea0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:55.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.599+0000 7f47a5517700 1 --2- 172.21.15.8:0/2841846515 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47a00cc2e0 0x7f47a01599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:55.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.599+0000 7f47a5517700 1 --2- 172.21.15.8:0/2841846515 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47a00d06a0 0x7f47a015c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:55.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.599+0000 7f47a5517700 1 -- 172.21.15.8:0/2841846515 >> 172.21.15.8:0/2841846515 conn(0x7f47a006f7d0 msgr2=0x7f47a0141ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:55.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.599+0000 7f47a5517700 1 -- 172.21.15.8:0/2841846515 shutdown_connections 2023-10-06T04:37:55.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.599+0000 7f47a5517700 1 -- 172.21.15.8:0/2841846515 wait complete. 2023-10-06T04:37:55.612 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:36:10.148177+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:36:10.684157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:37:15.902657+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'recovery_fs'}}}, {'pool': 8, 'pool_name': 'recovery_fs_metadata', 'create_time': '2023-10-06T04:37:28.524294+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'recovery_fs'}}}] 2023-10-06T04:37:55.613 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:37:55.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.734+0000 7fcef114f700 1 Processor -- start 2023-10-06T04:37:55.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.734+0000 7fcef114f700 1 -- start start 2023-10-06T04:37:55.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.734+0000 7fcef114f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fceec142da0 0x7fceec15d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:55.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.734+0000 7fcef114f700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceec06a5e0 con 0x7fceec06d1f0 2023-10-06T04:37:55.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.734+0000 7fcef114f700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceec1599c0 con 0x7fceec06d5c0 2023-10-06T04:37:55.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.734+0000 7fcef114f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceec15e0b0 con 0x7fceec142da0 2023-10-06T04:37:55.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.734+0000 7fceead9d700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fceec06d1f0 0x7fceec142690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34580/0 (socket says 172.21.15.8:34580) 2023-10-06T04:37:55.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.735+0000 7fceead9d700 1 -- 172.21.15.8:0/2044554292 learned_addr learned my addr 172.21.15.8:0/2044554292 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:55.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.735+0000 7fceea59c700 1 --2- 172.21.15.8:0/2044554292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fceec142da0 0x7fceec15d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:55.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.735+0000 7fcee9d9b700 1 -- 172.21.15.8:0/2044554292 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 29476577 0 0) 0x7fceec06a5e0 con 0x7fceec06d1f0 2023-10-06T04:37:55.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.735+0000 7fcee9d9b700 1 -- 172.21.15.8:0/2044554292 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fced8003570 con 0x7fceec06d1f0 2023-10-06T04:37:55.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.735+0000 7fcee9d9b700 1 -- 172.21.15.8:0/2044554292 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3752728398 0 0) 0x7fced8003570 con 0x7fceec06d1f0 2023-10-06T04:37:55.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.735+0000 7fcee9d9b700 1 -- 172.21.15.8:0/2044554292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fceec142da0 msgr2=0x7fceec15d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:55.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.735+0000 7fcee9d9b700 1 --2- 172.21.15.8:0/2044554292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fceec142da0 0x7fceec15d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:55.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.735+0000 7fcee9d9b700 1 -- 172.21.15.8:0/2044554292 >> v1:172.21.15.184:6789/0 conn(0x7fceec06d5c0 legacy=0x7fceec15d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:55.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.735+0000 7fcee9d9b700 1 -- 172.21.15.8:0/2044554292 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceec068810 con 0x7fceec06d1f0 2023-10-06T04:37:55.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.735+0000 7fcee9d9b700 1 -- 172.21.15.8:0/2044554292 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7fcedc0017f0 con 0x7fceec06d1f0 2023-10-06T04:37:55.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.735+0000 7fcee9d9b700 1 -- 172.21.15.8:0/2044554292 >> v1:172.21.15.8:6789/0 conn(0x7fceec06d1f0 legacy=0x7fceec142690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:55.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.735+0000 7fcee9d9b700 1 --2- 172.21.15.8:0/2044554292 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fced8003a90 0x7fced8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:55.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.735+0000 7fcee9d9b700 1 --2- 172.21.15.8:0/2044554292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fceec142da0 0x7fced8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:55.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.735+0000 7fcee9d9b700 1 --2- 172.21.15.8:0/2044554292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fced8004d50 0x7fced80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:55.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.735+0000 7fcee9d9b700 1 -- 172.21.15.8:0/2044554292 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec15e0b0 con 0x7fced8003a90 2023-10-06T04:37:55.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.735+0000 7fcee9d9b700 1 -- 172.21.15.8:0/2044554292 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced800bb70 con 0x7fced8004d50 2023-10-06T04:37:55.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.735+0000 7fcee9d9b700 1 -- 172.21.15.8:0/2044554292 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced800bd30 con 0x7fceec142da0 2023-10-06T04:37:55.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.735+0000 7fceead9d700 1 --2- 172.21.15.8:0/2044554292 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fced8003a90 0x7fced8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:55.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.735+0000 7fceea59c700 1 --2- 172.21.15.8:0/2044554292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fceec142da0 0x7fced8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:55.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.735+0000 7fceeb59e700 1 --2- 172.21.15.8:0/2044554292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fced8004d50 0x7fced80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:55.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.736+0000 7fceead9d700 1 -- 172.21.15.8:0/2044554292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fceec142da0 msgr2=0x7fced8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:55.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.736+0000 7fceead9d700 1 --2- 172.21.15.8:0/2044554292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fceec142da0 0x7fced8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:55.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.736+0000 7fceead9d700 1 -- 172.21.15.8:0/2044554292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fced8004d50 msgr2=0x7fced80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:55.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.736+0000 7fceead9d700 1 --2- 172.21.15.8:0/2044554292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fced8004d50 0x7fced80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:55.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.736+0000 7fceead9d700 1 -- 172.21.15.8:0/2044554292 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced8003570 con 0x7fced8003a90 2023-10-06T04:37:55.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.736+0000 7fceead9d700 1 --2- 172.21.15.8:0/2044554292 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fced8003a90 0x7fced8003ea0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fcedc00a930 tx=0x7fcedc0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc94b68a9c9031b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:55.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.736+0000 7fcee9d9b700 1 -- 172.21.15.8:0/2044554292 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcedc0070d0 con 0x7fced8003a90 2023-10-06T04:37:55.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.736+0000 7fcee9d9b700 1 -- 172.21.15.8:0/2044554292 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcedc007230 con 0x7fced8003a90 2023-10-06T04:37:55.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.736+0000 7fcee9d9b700 1 -- 172.21.15.8:0/2044554292 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcedc0075d0 con 0x7fced8003a90 2023-10-06T04:37:55.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.736+0000 7fcef114f700 1 -- 172.21.15.8:0/2044554292 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fced8003a90 msgr2=0x7fced8003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:55.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.736+0000 7fcef114f700 1 --2- 172.21.15.8:0/2044554292 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fced8003a90 0x7fced8003ea0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fcedc00a930 tx=0x7fcedc0021d0 comp rx=0 tx=0).stop 2023-10-06T04:37:55.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.736+0000 7fceeb59e700 1 -- 172.21.15.8:0/2044554292 reap_dead start 2023-10-06T04:37:55.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.736+0000 7fcef114f700 1 -- 172.21.15.8:0/2044554292 shutdown_connections 2023-10-06T04:37:55.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.736+0000 7fcef114f700 1 -- 172.21.15.8:0/2044554292 >> 172.21.15.8:0/2044554292 conn(0x7fceec0680a0 msgr2=0x7fceec0ce210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:55.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.736+0000 7fcef114f700 1 -- 172.21.15.8:0/2044554292 shutdown_connections 2023-10-06T04:37:55.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.736+0000 7fcef114f700 1 -- 172.21.15.8:0/2044554292 wait complete. 2023-10-06T04:37:55.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.738+0000 7fcef114f700 1 Processor -- start 2023-10-06T04:37:55.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.738+0000 7fcef114f700 1 -- start start 2023-10-06T04:37:55.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.738+0000 7fcef114f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fced8003a90 0x7fceec155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:55.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.738+0000 7fcef114f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fceec0ca6f0 0x7fceec0cab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:55.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.738+0000 7fcef114f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fceec0c6590 0x7fceec0c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:55.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.738+0000 7fcef114f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec0cb0a0 con 0x7fceec0c6590 2023-10-06T04:37:55.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.738+0000 7fcef114f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec0c7f10 con 0x7fceec0ca6f0 2023-10-06T04:37:55.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.738+0000 7fcef114f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceec0c7300 con 0x7fced8003a90 2023-10-06T04:37:55.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.739+0000 7fceeb59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fceec0c6590 0x7fceec0c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:55.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.739+0000 7fceeb59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fceec0c6590 0x7fceec0c6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47418/0 (socket says 172.21.15.8:47418) 2023-10-06T04:37:55.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.739+0000 7fceeb59e700 1 -- 172.21.15.8:0/612209109 learned_addr learned my addr 172.21.15.8:0/612209109 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:55.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.739+0000 7fceead9d700 1 --2- 172.21.15.8:0/612209109 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fced8003a90 0x7fceec155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:55.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.739+0000 7fceea59c700 1 --2- 172.21.15.8:0/612209109 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fceec0ca6f0 0x7fceec0cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:55.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.739+0000 7fceeb59e700 1 -- 172.21.15.8:0/612209109 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fced8003a90 msgr2=0x7fceec155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:55.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.739+0000 7fceeb59e700 1 --2- 172.21.15.8:0/612209109 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fced8003a90 0x7fceec155c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:55.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.739+0000 7fceeb59e700 1 -- 172.21.15.8:0/612209109 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fceec0ca6f0 msgr2=0x7fceec0cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:55.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.739+0000 7fceeb59e700 1 --2- 172.21.15.8:0/612209109 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fceec0ca6f0 0x7fceec0cab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:55.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.739+0000 7fceeb59e700 1 -- 172.21.15.8:0/612209109 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceec0c75e0 con 0x7fceec0c6590 2023-10-06T04:37:55.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.739+0000 7fceea59c700 1 --2- 172.21.15.8:0/612209109 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fceec0ca6f0 0x7fceec0cab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:55.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.739+0000 7fceeb59e700 1 --2- 172.21.15.8:0/612209109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fceec0c6590 0x7fceec0c6a30 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fceec06da90 tx=0x7fcee4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:55.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.739+0000 7fcee2ffd700 1 -- 172.21.15.8:0/612209109 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee400ee60 con 0x7fceec0c6590 2023-10-06T04:37:55.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.739+0000 7fcee2ffd700 1 -- 172.21.15.8:0/612209109 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee4012590 con 0x7fceec0c6590 2023-10-06T04:37:55.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.739+0000 7fcee2ffd700 1 -- 172.21.15.8:0/612209109 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee4012950 con 0x7fceec0c6590 2023-10-06T04:37:55.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.739+0000 7fcef114f700 1 -- 172.21.15.8:0/612209109 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceec0c78c0 con 0x7fceec0c6590 2023-10-06T04:37:55.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.739+0000 7fcef114f700 1 -- 172.21.15.8:0/612209109 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceec1561b0 con 0x7fceec0c6590 2023-10-06T04:37:55.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.740+0000 7fcef114f700 1 -- 172.21.15.8:0/612209109 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceec071550 con 0x7fceec0c6590 2023-10-06T04:37:55.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.741+0000 7fcee2ffd700 1 -- 172.21.15.8:0/612209109 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcee4012d00 con 0x7fceec0c6590 2023-10-06T04:37:55.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.741+0000 7fcee2ffd700 1 --2- 172.21.15.8:0/612209109 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fcecc066f30 0x7fcecc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:55.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.741+0000 7fcee2ffd700 1 -- 172.21.15.8:0/612209109 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6479+0+0 (secure 0 0 0) 0x7fcee4084620 con 0x7fceec0c6590 2023-10-06T04:37:55.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.741+0000 7fceead9d700 1 --2- 172.21.15.8:0/612209109 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fcecc066f30 0x7fcecc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:55.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.742+0000 7fceead9d700 1 --2- 172.21.15.8:0/612209109 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fcecc066f30 0x7fcecc0693e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcedc00a3f0 tx=0x7fcedc016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:55.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.745+0000 7fcee2ffd700 1 -- 172.21.15.8:0/612209109 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcee4051590 con 0x7fceec0c6590 2023-10-06T04:37:55.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.941+0000 7fcef114f700 1 -- 172.21.15.8:0/612209109 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fceec068af0 con 0x7fceec0c6590 2023-10-06T04:37:55.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.941+0000 7fcee2ffd700 1 -- 172.21.15.8:0/612209109 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v47) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcee4054bb0 con 0x7fceec0c6590 2023-10-06T04:37:55.943 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 8 2023-10-06T04:37:55.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.943+0000 7fcef114f700 1 -- 172.21.15.8:0/612209109 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fcecc066f30 msgr2=0x7fcecc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:55.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.943+0000 7fcef114f700 1 --2- 172.21.15.8:0/612209109 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fcecc066f30 0x7fcecc0693e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcedc00a3f0 tx=0x7fcedc016000 comp rx=0 tx=0).stop 2023-10-06T04:37:55.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.943+0000 7fcef114f700 1 -- 172.21.15.8:0/612209109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fceec0c6590 msgr2=0x7fceec0c6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:55.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.943+0000 7fcef114f700 1 --2- 172.21.15.8:0/612209109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fceec0c6590 0x7fceec0c6a30 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fceec06da90 tx=0x7fcee4009040 comp rx=0 tx=0).stop 2023-10-06T04:37:55.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.943+0000 7fcef114f700 1 -- 172.21.15.8:0/612209109 shutdown_connections 2023-10-06T04:37:55.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.943+0000 7fcef114f700 1 --2- 172.21.15.8:0/612209109 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fcecc066f30 0x7fcecc0693e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:55.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.943+0000 7fcef114f700 1 --2- 172.21.15.8:0/612209109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fceec0c6590 0x7fceec0c6a30 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:55.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.943+0000 7fcef114f700 1 --2- 172.21.15.8:0/612209109 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fced8003a90 0x7fceec155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:55.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.943+0000 7fcef114f700 1 --2- 172.21.15.8:0/612209109 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fceec0ca6f0 0x7fceec0cab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:55.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.943+0000 7fcef114f700 1 -- 172.21.15.8:0/612209109 >> 172.21.15.8:0/612209109 conn(0x7fceec0680a0 msgr2=0x7fceec158d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:55.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.943+0000 7fcef114f700 1 -- 172.21.15.8:0/612209109 shutdown_connections 2023-10-06T04:37:55.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:55.943+0000 7fcef114f700 1 -- 172.21.15.8:0/612209109 wait complete. 2023-10-06T04:37:55.957 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:37:56.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.077+0000 7fa134c92700 1 Processor -- start 2023-10-06T04:37:56.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.077+0000 7fa134c92700 1 -- start start 2023-10-06T04:37:56.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.078+0000 7fa134c92700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa13015bc20 0x7fa130140890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:56.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.078+0000 7fa134c92700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1300cc3b0 con 0x7fa1300c5300 2023-10-06T04:37:56.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.078+0000 7fa134c92700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa13006bea0 con 0x7fa13015b170 2023-10-06T04:37:56.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.078+0000 7fa134c92700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa13006c100 con 0x7fa13015bc20 2023-10-06T04:37:56.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.078+0000 7fa12dd9b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa13015bc20 0x7fa130140890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:56.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.078+0000 7fa12ed9d700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fa1300c5300 0x7fa1300cc840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34590/0 (socket says 172.21.15.8:34590) 2023-10-06T04:37:56.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.078+0000 7fa12ed9d700 1 -- 172.21.15.8:0/3704583556 learned_addr learned my addr 172.21.15.8:0/3704583556 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:56.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.078+0000 7fa12dd9b700 1 -- 172.21.15.8:0/3704583556 >> v1:172.21.15.184:6789/0 conn(0x7fa13015b170 legacy=0x7fa13006b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:56.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.078+0000 7fa12dd9b700 1 -- 172.21.15.8:0/3704583556 >> v1:172.21.15.8:6789/0 conn(0x7fa1300c5300 legacy=0x7fa1300cc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:56.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.078+0000 7fa12dd9b700 1 -- 172.21.15.8:0/3704583556 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa13006c3e0 con 0x7fa13015bc20 2023-10-06T04:37:56.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.078+0000 7fa12d59a700 1 -- 172.21.15.8:0/3704583556 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3144037409 0 0) 0x7fa1300cc3b0 con 0x7fa1300c5300 2023-10-06T04:37:56.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.078+0000 7fa12dd9b700 1 --2- 172.21.15.8:0/3704583556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa13015bc20 0x7fa130140890 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa1180098e0 tx=0x7fa1180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebdfd9693af9576f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:56.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.079+0000 7fa12d59a700 1 -- 172.21.15.8:0/3704583556 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa118009e80 con 0x7fa13015bc20 2023-10-06T04:37:56.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.079+0000 7fa12d59a700 1 -- 172.21.15.8:0/3704583556 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11800b820 con 0x7fa13015bc20 2023-10-06T04:37:56.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.079+0000 7fa12d59a700 1 -- 172.21.15.8:0/3704583556 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11800bba0 con 0x7fa13015bc20 2023-10-06T04:37:56.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.079+0000 7fa134c92700 1 -- 172.21.15.8:0/3704583556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa13015bc20 msgr2=0x7fa130140890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:56.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.079+0000 7fa134c92700 1 --2- 172.21.15.8:0/3704583556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa13015bc20 0x7fa130140890 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa1180098e0 tx=0x7fa1180091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:56.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.079+0000 7fa134c92700 1 -- 172.21.15.8:0/3704583556 shutdown_connections 2023-10-06T04:37:56.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.079+0000 7fa134c92700 1 --2- 172.21.15.8:0/3704583556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa13015bc20 0x7fa130140890 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:56.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.079+0000 7fa134c92700 1 -- 172.21.15.8:0/3704583556 >> 172.21.15.8:0/3704583556 conn(0x7fa1300ce250 msgr2=0x7fa1300ce650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:56.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.079+0000 7fa134c92700 1 -- 172.21.15.8:0/3704583556 shutdown_connections 2023-10-06T04:37:56.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.079+0000 7fa134c92700 1 -- 172.21.15.8:0/3704583556 wait complete. 2023-10-06T04:37:56.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.080+0000 7fa134c92700 1 Processor -- start 2023-10-06T04:37:56.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.080+0000 7fa134c92700 1 -- start start 2023-10-06T04:37:56.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.081+0000 7fa134c92700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1300c5300 0x7fa130137bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:56.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.081+0000 7fa134c92700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa13015b170 0x7fa1300c61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:56.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.081+0000 7fa134c92700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa13015bc20 0x7fa130158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:56.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.081+0000 7fa134c92700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1301586c0 con 0x7fa1300c5300 2023-10-06T04:37:56.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.081+0000 7fa134c92700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1300c6bd0 con 0x7fa13015b170 2023-10-06T04:37:56.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.081+0000 7fa134c92700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1300c6eb0 con 0x7fa13015bc20 2023-10-06T04:37:56.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.081+0000 7fa12e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1300c5300 0x7fa130137bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:56.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.081+0000 7fa12e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1300c5300 0x7fa130137bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47444/0 (socket says 172.21.15.8:47444) 2023-10-06T04:37:56.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.081+0000 7fa12e59c700 1 -- 172.21.15.8:0/2280586581 learned_addr learned my addr 172.21.15.8:0/2280586581 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:56.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.081+0000 7fa12dd9b700 1 --2- 172.21.15.8:0/2280586581 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa13015b170 0x7fa1300c61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:56.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.081+0000 7fa12e59c700 1 -- 172.21.15.8:0/2280586581 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa13015bc20 msgr2=0x7fa130158b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:56.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.081+0000 7fa12e59c700 1 --2- 172.21.15.8:0/2280586581 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa13015bc20 0x7fa130158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:56.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.081+0000 7fa12e59c700 1 -- 172.21.15.8:0/2280586581 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa13015b170 msgr2=0x7fa1300c61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:56.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.081+0000 7fa12e59c700 1 --2- 172.21.15.8:0/2280586581 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa13015b170 0x7fa1300c61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:56.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.081+0000 7fa12e59c700 1 -- 172.21.15.8:0/2280586581 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa118009420 con 0x7fa1300c5300 2023-10-06T04:37:56.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.082+0000 7fa12e59c700 1 --2- 172.21.15.8:0/2280586581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1300c5300 0x7fa130137bf0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fa12000c950 tx=0x7fa120002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:56.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.082+0000 7fa1267fc700 1 -- 172.21.15.8:0/2280586581 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12000a7e0 con 0x7fa1300c5300 2023-10-06T04:37:56.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.082+0000 7fa1267fc700 1 -- 172.21.15.8:0/2280586581 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12000a940 con 0x7fa1300c5300 2023-10-06T04:37:56.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.082+0000 7fa134c92700 1 -- 172.21.15.8:0/2280586581 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1300c7190 con 0x7fa1300c5300 2023-10-06T04:37:56.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.082+0000 7fa1267fc700 1 -- 172.21.15.8:0/2280586581 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12000ad00 con 0x7fa1300c5300 2023-10-06T04:37:56.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.082+0000 7fa134c92700 1 -- 172.21.15.8:0/2280586581 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa130155630 con 0x7fa1300c5300 2023-10-06T04:37:56.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.083+0000 7fa134c92700 1 -- 172.21.15.8:0/2280586581 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1301589a0 con 0x7fa1300c5300 2023-10-06T04:37:56.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.083+0000 7fa1267fc700 1 -- 172.21.15.8:0/2280586581 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa120012630 con 0x7fa1300c5300 2023-10-06T04:37:56.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.083+0000 7fa1267fc700 1 --2- 172.21.15.8:0/2280586581 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa110066f30 0x7fa1100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:56.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.084+0000 7fa1267fc700 1 -- 172.21.15.8:0/2280586581 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6479+0+0 (secure 0 0 0) 0x7fa120084d90 con 0x7fa1300c5300 2023-10-06T04:37:56.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.084+0000 7fa12dd9b700 1 --2- 172.21.15.8:0/2280586581 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa110066f30 0x7fa1100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:56.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.084+0000 7fa12dd9b700 1 --2- 172.21.15.8:0/2280586581 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa110066f30 0x7fa1100693e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa13015bff0 tx=0x7fa118016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:56.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.088+0000 7fa1267fc700 1 -- 172.21.15.8:0/2280586581 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa120051db0 con 0x7fa1300c5300 2023-10-06T04:37:56.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.280+0000 7fa134c92700 1 -- 172.21.15.8:0/2280586581 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa130071550 con 0x7fa1300c5300 2023-10-06T04:37:56.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.280+0000 7fa1267fc700 1 -- 172.21.15.8:0/2280586581 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa12000ae60 con 0x7fa1300c5300 2023-10-06T04:37:56.282 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-06T04:37:56.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.282+0000 7fa134c92700 1 -- 172.21.15.8:0/2280586581 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa110066f30 msgr2=0x7fa1100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:56.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.282+0000 7fa134c92700 1 --2- 172.21.15.8:0/2280586581 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa110066f30 0x7fa1100693e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa13015bff0 tx=0x7fa118016000 comp rx=0 tx=0).stop 2023-10-06T04:37:56.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.282+0000 7fa134c92700 1 -- 172.21.15.8:0/2280586581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1300c5300 msgr2=0x7fa130137bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:56.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.282+0000 7fa134c92700 1 --2- 172.21.15.8:0/2280586581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1300c5300 0x7fa130137bf0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fa12000c950 tx=0x7fa120002760 comp rx=0 tx=0).stop 2023-10-06T04:37:56.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.282+0000 7fa134c92700 1 -- 172.21.15.8:0/2280586581 shutdown_connections 2023-10-06T04:37:56.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.282+0000 7fa134c92700 1 --2- 172.21.15.8:0/2280586581 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fa110066f30 0x7fa1100693e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:56.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.282+0000 7fa134c92700 1 --2- 172.21.15.8:0/2280586581 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa13015bc20 0x7fa130158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:56.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.282+0000 7fa134c92700 1 --2- 172.21.15.8:0/2280586581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1300c5300 0x7fa130137bf0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:56.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.282+0000 7fa134c92700 1 --2- 172.21.15.8:0/2280586581 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa13015b170 0x7fa1300c61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:56.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.282+0000 7fa134c92700 1 -- 172.21.15.8:0/2280586581 >> 172.21.15.8:0/2280586581 conn(0x7fa1300ce250 msgr2=0x7fa130157050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:56.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.282+0000 7fa134c92700 1 -- 172.21.15.8:0/2280586581 shutdown_connections 2023-10-06T04:37:56.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.282+0000 7fa134c92700 1 -- 172.21.15.8:0/2280586581 wait complete. 2023-10-06T04:37:56.296 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:37:56.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.416+0000 7fe5649eb700 1 Processor -- start 2023-10-06T04:37:56.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.416+0000 7fe5649eb700 1 -- start start 2023-10-06T04:37:56.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.417+0000 7fe5649eb700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe560156e30 0x7fe5600cf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:56.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.417+0000 7fe5649eb700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe5600b1c70 0x7fe5600b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:56.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.417+0000 7fe5649eb700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5600b2620 con 0x7fe56015ad80 2023-10-06T04:37:56.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.417+0000 7fe5649eb700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5600cf370 con 0x7fe560156e30 2023-10-06T04:37:56.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.417+0000 7fe5649eb700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5600ce800 con 0x7fe5600b1c70 2023-10-06T04:37:56.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.417+0000 7fe55f7fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe560156e30 0x7fe5600cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:56.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.417+0000 7fe55f7fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe560156e30 0x7fe5600cf800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47450/0 (socket says 172.21.15.8:47450) 2023-10-06T04:37:56.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.417+0000 7fe55f7fe700 1 -- 172.21.15.8:0/1102713867 learned_addr learned my addr 172.21.15.8:0/1102713867 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:56.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.417+0000 7fe55effd700 1 --2- 172.21.15.8:0/1102713867 >> v2:172.21.15.184:3300/0 conn(0x7fe5600b1c70 0x7fe5600b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:56.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.417+0000 7fe55f7fe700 1 -- 172.21.15.8:0/1102713867 >> v2:172.21.15.184:3300/0 conn(0x7fe5600b1c70 msgr2=0x7fe5600b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:56.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.417+0000 7fe55f7fe700 1 --2- 172.21.15.8:0/1102713867 >> v2:172.21.15.184:3300/0 conn(0x7fe5600b1c70 0x7fe5600b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:56.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.417+0000 7fe55f7fe700 1 -- 172.21.15.8:0/1102713867 >> v1:172.21.15.184:6789/0 conn(0x7fe56015ad80 legacy=0x7fe56015b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:56.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.417+0000 7fe55f7fe700 1 -- 172.21.15.8:0/1102713867 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5600cea60 con 0x7fe560156e30 2023-10-06T04:37:56.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.418+0000 7fe55f7fe700 1 --2- 172.21.15.8:0/1102713867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe560156e30 0x7fe5600cf800 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe560067f30 tx=0x7fe550009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7680cdc92a8b5a8c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:56.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.418+0000 7fe55e7fc700 1 -- 172.21.15.8:0/1102713867 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55000b860 con 0x7fe560156e30 2023-10-06T04:37:56.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.418+0000 7fe55e7fc700 1 -- 172.21.15.8:0/1102713867 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55000b9c0 con 0x7fe560156e30 2023-10-06T04:37:56.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.418+0000 7fe55e7fc700 1 -- 172.21.15.8:0/1102713867 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55000bd60 con 0x7fe560156e30 2023-10-06T04:37:56.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.418+0000 7fe5649eb700 1 -- 172.21.15.8:0/1102713867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe560156e30 msgr2=0x7fe5600cf800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:56.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.418+0000 7fe5649eb700 1 --2- 172.21.15.8:0/1102713867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe560156e30 0x7fe5600cf800 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe560067f30 tx=0x7fe550009250 comp rx=0 tx=0).stop 2023-10-06T04:37:56.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.418+0000 7fe5649eb700 1 -- 172.21.15.8:0/1102713867 shutdown_connections 2023-10-06T04:37:56.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.418+0000 7fe5649eb700 1 --2- 172.21.15.8:0/1102713867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe560156e30 0x7fe5600cf800 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:56.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.418+0000 7fe5649eb700 1 --2- 172.21.15.8:0/1102713867 >> v2:172.21.15.184:3300/0 conn(0x7fe5600b1c70 0x7fe5600b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:56.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.418+0000 7fe5649eb700 1 -- 172.21.15.8:0/1102713867 >> 172.21.15.8:0/1102713867 conn(0x7fe56006ed00 msgr2=0x7fe56006f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:56.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.418+0000 7fe5649eb700 1 -- 172.21.15.8:0/1102713867 shutdown_connections 2023-10-06T04:37:56.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.418+0000 7fe5649eb700 1 -- 172.21.15.8:0/1102713867 wait complete. 2023-10-06T04:37:56.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.420+0000 7fe5649eb700 1 Processor -- start 2023-10-06T04:37:56.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.420+0000 7fe5649eb700 1 -- start start 2023-10-06T04:37:56.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.420+0000 7fe5649eb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5600b1c70 0x7fe560153710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:56.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.421+0000 7fe5649eb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe560156e30 0x7fe56014da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:56.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.421+0000 7fe5649eb700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe56015ad80 0x7fe56014df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:56.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.421+0000 7fe5649eb700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56014c000 con 0x7fe560156e30 2023-10-06T04:37:56.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.421+0000 7fe5649eb700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56014c4f0 con 0x7fe56015ad80 2023-10-06T04:37:56.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.421+0000 7fe5649eb700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe560153280 con 0x7fe5600b1c70 2023-10-06T04:37:56.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.421+0000 7fe55effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe560156e30 0x7fe56014da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:56.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.421+0000 7fe55effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe560156e30 0x7fe56014da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47454/0 (socket says 172.21.15.8:47454) 2023-10-06T04:37:56.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.421+0000 7fe55effd700 1 -- 172.21.15.8:0/922099812 learned_addr learned my addr 172.21.15.8:0/922099812 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:56.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.421+0000 7fe55f7fe700 1 --2- 172.21.15.8:0/922099812 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5600b1c70 0x7fe560153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:56.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.421+0000 7fe55ffff700 1 --2- 172.21.15.8:0/922099812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe56015ad80 0x7fe56014df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:56.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.421+0000 7fe55effd700 1 -- 172.21.15.8:0/922099812 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5600b1c70 msgr2=0x7fe560153710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:56.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.421+0000 7fe55effd700 1 --2- 172.21.15.8:0/922099812 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5600b1c70 0x7fe560153710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:56.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.421+0000 7fe55effd700 1 -- 172.21.15.8:0/922099812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe56015ad80 msgr2=0x7fe56014df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:56.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.421+0000 7fe55effd700 1 --2- 172.21.15.8:0/922099812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe56015ad80 0x7fe56014df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:56.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.421+0000 7fe55effd700 1 -- 172.21.15.8:0/922099812 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5500094f0 con 0x7fe560156e30 2023-10-06T04:37:56.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.421+0000 7fe55ffff700 1 --2- 172.21.15.8:0/922099812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe56015ad80 0x7fe56014df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:37:56.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.421+0000 7fe55effd700 1 --2- 172.21.15.8:0/922099812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe560156e30 0x7fe56014da40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe55400d8c0 tx=0x7fe554008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:56.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.421+0000 7fe5477fe700 1 -- 172.21.15.8:0/922099812 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55400de60 con 0x7fe560156e30 2023-10-06T04:37:56.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.421+0000 7fe5477fe700 1 -- 172.21.15.8:0/922099812 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55400b780 con 0x7fe560156e30 2023-10-06T04:37:56.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.421+0000 7fe5649eb700 1 -- 172.21.15.8:0/922099812 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe56014e4c0 con 0x7fe560156e30 2023-10-06T04:37:56.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.421+0000 7fe5477fe700 1 -- 172.21.15.8:0/922099812 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55400bb20 con 0x7fe560156e30 2023-10-06T04:37:56.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.421+0000 7fe5649eb700 1 -- 172.21.15.8:0/922099812 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe560152c30 con 0x7fe560156e30 2023-10-06T04:37:56.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.422+0000 7fe5649eb700 1 -- 172.21.15.8:0/922099812 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe56004c380 con 0x7fe560156e30 2023-10-06T04:37:56.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.423+0000 7fe5477fe700 1 -- 172.21.15.8:0/922099812 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe55401e460 con 0x7fe560156e30 2023-10-06T04:37:56.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.423+0000 7fe5477fe700 1 --2- 172.21.15.8:0/922099812 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe54c066f30 0x7fe54c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:56.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.423+0000 7fe5477fe700 1 -- 172.21.15.8:0/922099812 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6479+0+0 (secure 0 0 0) 0x7fe554084ed0 con 0x7fe560156e30 2023-10-06T04:37:56.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.423+0000 7fe55f7fe700 1 --2- 172.21.15.8:0/922099812 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe54c066f30 0x7fe54c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:56.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.424+0000 7fe55f7fe700 1 --2- 172.21.15.8:0/922099812 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe54c066f30 0x7fe54c0693e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe560067f30 tx=0x7fe550017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:56.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.427+0000 7fe5477fe700 1 -- 172.21.15.8:0/922099812 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe554051e40 con 0x7fe560156e30 2023-10-06T04:37:56.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.620+0000 7fe5649eb700 1 -- 172.21.15.8:0/922099812 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe5601533c0 con 0x7fe560156e30 2023-10-06T04:37:56.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.621+0000 7fe5477fe700 1 -- 172.21.15.8:0/922099812 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe554055460 con 0x7fe560156e30 2023-10-06T04:37:56.622 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-06T04:37:56.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.623+0000 7fe5649eb700 1 -- 172.21.15.8:0/922099812 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe54c066f30 msgr2=0x7fe54c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:56.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.623+0000 7fe5649eb700 1 --2- 172.21.15.8:0/922099812 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe54c066f30 0x7fe54c0693e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe560067f30 tx=0x7fe550017000 comp rx=0 tx=0).stop 2023-10-06T04:37:56.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.623+0000 7fe5649eb700 1 -- 172.21.15.8:0/922099812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe560156e30 msgr2=0x7fe56014da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:56.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.623+0000 7fe5649eb700 1 --2- 172.21.15.8:0/922099812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe560156e30 0x7fe56014da40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe55400d8c0 tx=0x7fe554008040 comp rx=0 tx=0).stop 2023-10-06T04:37:56.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.623+0000 7fe5649eb700 1 -- 172.21.15.8:0/922099812 shutdown_connections 2023-10-06T04:37:56.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.623+0000 7fe5649eb700 1 --2- 172.21.15.8:0/922099812 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe54c066f30 0x7fe54c0693e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:56.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.623+0000 7fe5649eb700 1 --2- 172.21.15.8:0/922099812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe56015ad80 0x7fe56014df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:56.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.623+0000 7fe5649eb700 1 --2- 172.21.15.8:0/922099812 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5600b1c70 0x7fe560153710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:56.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.623+0000 7fe5649eb700 1 --2- 172.21.15.8:0/922099812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe560156e30 0x7fe56014da40 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:56.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.623+0000 7fe5649eb700 1 -- 172.21.15.8:0/922099812 >> 172.21.15.8:0/922099812 conn(0x7fe56006ed00 msgr2=0x7fe5600d0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:56.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.623+0000 7fe5649eb700 1 -- 172.21.15.8:0/922099812 shutdown_connections 2023-10-06T04:37:56.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.623+0000 7fe5649eb700 1 -- 172.21.15.8:0/922099812 wait complete. 2023-10-06T04:37:56.636 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get recovery_fs_metadata pg_num 2023-10-06T04:37:56.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.756+0000 7f7dabbee700 1 Processor -- start 2023-10-06T04:37:56.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.757+0000 7f7dabbee700 1 -- start start 2023-10-06T04:37:56.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.757+0000 7f7dabbee700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7da4142cf0 0x7f7da40b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:56.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.757+0000 7f7dabbee700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7da41430c0 0x7f7da40cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:56.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.757+0000 7f7dabbee700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7da40cfee0 0x7f7da40b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:56.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.757+0000 7f7dabbee700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7da40cf510 con 0x7f7da40cfee0 2023-10-06T04:37:56.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.757+0000 7f7dabbee700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7da40ce6a0 con 0x7f7da41430c0 2023-10-06T04:37:56.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.757+0000 7f7dabbee700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7da40ce900 con 0x7f7da4142cf0 2023-10-06T04:37:56.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.757+0000 7f7daa18b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7da40cfee0 0x7f7da40b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:56.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.758+0000 7f7daa18b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7da40cfee0 0x7f7da40b3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47466/0 (socket says 172.21.15.8:47466) 2023-10-06T04:37:56.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.758+0000 7f7daa18b700 1 -- 172.21.15.8:0/3298088636 learned_addr learned my addr 172.21.15.8:0/3298088636 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:56.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.758+0000 7f7da9189700 1 --2- 172.21.15.8:0/3298088636 >> v2:172.21.15.184:3300/0 conn(0x7f7da41430c0 0x7f7da40cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:56.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.758+0000 7f7da998a700 1 --2- 172.21.15.8:0/3298088636 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7da4142cf0 0x7f7da40b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:56.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.758+0000 7f7daa18b700 1 -- 172.21.15.8:0/3298088636 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7da4142cf0 msgr2=0x7f7da40b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:56.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.758+0000 7f7daa18b700 1 --2- 172.21.15.8:0/3298088636 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7da4142cf0 0x7f7da40b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:56.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.758+0000 7f7daa18b700 1 -- 172.21.15.8:0/3298088636 >> v2:172.21.15.184:3300/0 conn(0x7f7da41430c0 msgr2=0x7f7da40cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:56.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.758+0000 7f7daa18b700 1 --2- 172.21.15.8:0/3298088636 >> v2:172.21.15.184:3300/0 conn(0x7f7da41430c0 0x7f7da40cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:56.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.758+0000 7f7daa18b700 1 -- 172.21.15.8:0/3298088636 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da40cebe0 con 0x7f7da40cfee0 2023-10-06T04:37:56.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.758+0000 7f7daa18b700 1 --2- 172.21.15.8:0/3298088636 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7da40cfee0 0x7f7da40b3790 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f7da4068010 tx=0x7f7d94009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4543185edadeb475 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:56.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.758+0000 7f7da8988700 1 -- 172.21.15.8:0/3298088636 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9400e070 con 0x7f7da40cfee0 2023-10-06T04:37:56.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.758+0000 7f7da8988700 1 -- 172.21.15.8:0/3298088636 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d9400ba50 con 0x7f7da40cfee0 2023-10-06T04:37:56.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.758+0000 7f7da8988700 1 -- 172.21.15.8:0/3298088636 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d940092e0 con 0x7f7da40cfee0 2023-10-06T04:37:56.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.759+0000 7f7dabbee700 1 -- 172.21.15.8:0/3298088636 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7da40cfee0 msgr2=0x7f7da40b3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:56.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.759+0000 7f7dabbee700 1 --2- 172.21.15.8:0/3298088636 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7da40cfee0 0x7f7da40b3790 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f7da4068010 tx=0x7f7d94009840 comp rx=0 tx=0).stop 2023-10-06T04:37:56.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.759+0000 7f7dabbee700 1 -- 172.21.15.8:0/3298088636 shutdown_connections 2023-10-06T04:37:56.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.759+0000 7f7dabbee700 1 --2- 172.21.15.8:0/3298088636 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7da40cfee0 0x7f7da40b3790 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:56.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.759+0000 7f7dabbee700 1 --2- 172.21.15.8:0/3298088636 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7da4142cf0 0x7f7da40b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:56.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.759+0000 7f7dabbee700 1 --2- 172.21.15.8:0/3298088636 >> v2:172.21.15.184:3300/0 conn(0x7f7da41430c0 0x7f7da40cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:56.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.759+0000 7f7dabbee700 1 -- 172.21.15.8:0/3298088636 >> 172.21.15.8:0/3298088636 conn(0x7f7da406ed00 msgr2=0x7f7da406f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:56.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.759+0000 7f7dabbee700 1 -- 172.21.15.8:0/3298088636 shutdown_connections 2023-10-06T04:37:56.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.759+0000 7f7dabbee700 1 -- 172.21.15.8:0/3298088636 wait complete. 2023-10-06T04:37:56.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.760+0000 7f7dabbee700 1 Processor -- start 2023-10-06T04:37:56.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.760+0000 7f7dabbee700 1 -- start start 2023-10-06T04:37:56.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.761+0000 7f7dabbee700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7da40cfee0 0x7f7da413d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:56.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.761+0000 7f7dabbee700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7da4142cf0 0x7f7da40b4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:56.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.761+0000 7f7dabbee700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7da41430c0 0x7f7da40b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:56.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.761+0000 7f7dabbee700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da415d990 con 0x7f7da40cfee0 2023-10-06T04:37:56.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.761+0000 7f7dabbee700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da4141ba0 con 0x7f7da4142cf0 2023-10-06T04:37:56.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.761+0000 7f7dabbee700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7da415d060 con 0x7f7da41430c0 2023-10-06T04:37:56.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.761+0000 7f7da998a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7da40cfee0 0x7f7da413d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:56.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.761+0000 7f7da998a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7da40cfee0 0x7f7da413d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47476/0 (socket says 172.21.15.8:47476) 2023-10-06T04:37:56.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.761+0000 7f7da998a700 1 -- 172.21.15.8:0/2358963178 learned_addr learned my addr 172.21.15.8:0/2358963178 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:56.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.761+0000 7f7da9189700 1 --2- 172.21.15.8:0/2358963178 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7da4142cf0 0x7f7da40b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:56.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.761+0000 7f7daa18b700 1 --2- 172.21.15.8:0/2358963178 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7da41430c0 0x7f7da40b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:56.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.761+0000 7f7da998a700 1 -- 172.21.15.8:0/2358963178 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7da41430c0 msgr2=0x7f7da40b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:56.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.761+0000 7f7da998a700 1 --2- 172.21.15.8:0/2358963178 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7da41430c0 0x7f7da40b48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:56.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.761+0000 7f7da998a700 1 -- 172.21.15.8:0/2358963178 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7da4142cf0 msgr2=0x7f7da40b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:56.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.761+0000 7f7da998a700 1 --2- 172.21.15.8:0/2358963178 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7da4142cf0 0x7f7da40b4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:56.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.761+0000 7f7da998a700 1 -- 172.21.15.8:0/2358963178 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d94009ae0 con 0x7f7da40cfee0 2023-10-06T04:37:56.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.761+0000 7f7da998a700 1 --2- 172.21.15.8:0/2358963178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7da40cfee0 0x7f7da413d9f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c00d890 tx=0x7f7d9c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:56.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.761+0000 7f7da1ffb700 1 -- 172.21.15.8:0/2358963178 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c0125f0 con 0x7f7da40cfee0 2023-10-06T04:37:56.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.761+0000 7f7da1ffb700 1 -- 172.21.15.8:0/2358963178 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d9c012750 con 0x7f7da40cfee0 2023-10-06T04:37:56.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.761+0000 7f7dabbee700 1 -- 172.21.15.8:0/2358963178 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7da415d340 con 0x7f7da40cfee0 2023-10-06T04:37:56.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.761+0000 7f7da1ffb700 1 -- 172.21.15.8:0/2358963178 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c012af0 con 0x7f7da40cfee0 2023-10-06T04:37:56.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.762+0000 7f7dabbee700 1 -- 172.21.15.8:0/2358963178 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7da413df30 con 0x7f7da40cfee0 2023-10-06T04:37:56.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.763+0000 7f7dabbee700 1 -- 172.21.15.8:0/2358963178 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7da415dc70 con 0x7f7da40cfee0 2023-10-06T04:37:56.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.763+0000 7f7da1ffb700 1 -- 172.21.15.8:0/2358963178 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d9c01e460 con 0x7f7da40cfee0 2023-10-06T04:37:56.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.763+0000 7f7da1ffb700 1 --2- 172.21.15.8:0/2358963178 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7d90066f30 0x7f7d900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:56.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.763+0000 7f7da1ffb700 1 -- 172.21.15.8:0/2358963178 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6479+0+0 (secure 0 0 0) 0x7f7d9c084da0 con 0x7f7da40cfee0 2023-10-06T04:37:56.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.763+0000 7f7da9189700 1 --2- 172.21.15.8:0/2358963178 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7d90066f30 0x7f7d900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:56.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.764+0000 7f7da9189700 1 --2- 172.21.15.8:0/2358963178 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7d90066f30 0x7f7d900693e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7da40b5110 tx=0x7f7d98008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:56.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.767+0000 7f7da1ffb700 1 -- 172.21.15.8:0/2358963178 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d9c051d10 con 0x7f7da40cfee0 2023-10-06T04:37:56.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.959+0000 7f7dabbee700 1 -- 172.21.15.8:0/2358963178 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "recovery_fs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7da40cd180 con 0x7f7da40cfee0 2023-10-06T04:37:56.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.959+0000 7f7da1ffb700 1 -- 172.21.15.8:0/2358963178 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "recovery_fs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 109+0+11 (secure 0 0 0) 0x7f7d9c055330 con 0x7f7da40cfee0 2023-10-06T04:37:56.961 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-06T04:37:56.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.961+0000 7f7dabbee700 1 -- 172.21.15.8:0/2358963178 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7d90066f30 msgr2=0x7f7d900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:56.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.961+0000 7f7dabbee700 1 --2- 172.21.15.8:0/2358963178 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7d90066f30 0x7f7d900693e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7da40b5110 tx=0x7f7d98008040 comp rx=0 tx=0).stop 2023-10-06T04:37:56.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.961+0000 7f7dabbee700 1 -- 172.21.15.8:0/2358963178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7da40cfee0 msgr2=0x7f7da413d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:56.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.961+0000 7f7dabbee700 1 --2- 172.21.15.8:0/2358963178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7da40cfee0 0x7f7da413d9f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c00d890 tx=0x7f7d9c008040 comp rx=0 tx=0).stop 2023-10-06T04:37:56.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.961+0000 7f7dabbee700 1 -- 172.21.15.8:0/2358963178 shutdown_connections 2023-10-06T04:37:56.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.961+0000 7f7dabbee700 1 --2- 172.21.15.8:0/2358963178 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7d90066f30 0x7f7d900693e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:56.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.961+0000 7f7dabbee700 1 --2- 172.21.15.8:0/2358963178 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7da41430c0 0x7f7da40b48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:56.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.961+0000 7f7dabbee700 1 --2- 172.21.15.8:0/2358963178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7da40cfee0 0x7f7da413d9f0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:56.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.961+0000 7f7dabbee700 1 --2- 172.21.15.8:0/2358963178 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7da4142cf0 0x7f7da40b4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:56.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.961+0000 7f7dabbee700 1 -- 172.21.15.8:0/2358963178 >> 172.21.15.8:0/2358963178 conn(0x7f7da406ed00 msgr2=0x7f7da40b11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:56.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.961+0000 7f7dabbee700 1 -- 172.21.15.8:0/2358963178 shutdown_connections 2023-10-06T04:37:56.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:56.961+0000 7f7dabbee700 1 -- 172.21.15.8:0/2358963178 wait complete. 2023-10-06T04:37:56.974 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:37:57.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.093+0000 7f88e502a700 1 Processor -- start 2023-10-06T04:37:57.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.093+0000 7f88e502a700 1 -- start start 2023-10-06T04:37:57.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.093+0000 7f88e502a700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f88e00af680 0x7f88e015e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:57.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.093+0000 7f88e502a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88e00d0aa0 0x7f88e00cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:57.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.093+0000 7f88e502a700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e00cc4c0 con 0x7f88e00cb360 2023-10-06T04:37:57.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.093+0000 7f88e502a700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e015d460 con 0x7f88e00af680 2023-10-06T04:37:57.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.093+0000 7f88e502a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e015e580 con 0x7f88e00d0aa0 2023-10-06T04:37:57.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.093+0000 7f88ded9d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f88e00af680 0x7f88e015e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:57.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.094+0000 7f88ded9d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f88e00af680 0x7f88e015e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47492/0 (socket says 172.21.15.8:47492) 2023-10-06T04:37:57.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.094+0000 7f88ded9d700 1 -- 172.21.15.8:0/908768653 learned_addr learned my addr 172.21.15.8:0/908768653 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:57.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.094+0000 7f88df59e700 1 --2- 172.21.15.8:0/908768653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88e00d0aa0 0x7f88e00cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:57.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.094+0000 7f88ded9d700 1 -- 172.21.15.8:0/908768653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88e00d0aa0 msgr2=0x7f88e00cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:57.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.094+0000 7f88ded9d700 1 --2- 172.21.15.8:0/908768653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88e00d0aa0 0x7f88e00cc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:57.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.094+0000 7f88ded9d700 1 -- 172.21.15.8:0/908768653 >> v1:172.21.15.184:6789/0 conn(0x7f88e00cb360 legacy=0x7f88e00d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:57.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.094+0000 7f88ded9d700 1 -- 172.21.15.8:0/908768653 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e00cb8b0 con 0x7f88e00af680 2023-10-06T04:37:57.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.094+0000 7f88ded9d700 1 --2- 172.21.15.8:0/908768653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88e00af680 0x7f88e015e040 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f88d0009f20 tx=0x7f88d0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f73dd01c1998f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:57.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.094+0000 7f88ddd9b700 1 -- 172.21.15.8:0/908768653 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d000e070 con 0x7f88e00af680 2023-10-06T04:37:57.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.094+0000 7f88ddd9b700 1 -- 172.21.15.8:0/908768653 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d000b9d0 con 0x7f88e00af680 2023-10-06T04:37:57.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.094+0000 7f88ddd9b700 1 -- 172.21.15.8:0/908768653 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d00092e0 con 0x7f88e00af680 2023-10-06T04:37:57.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.095+0000 7f88e502a700 1 -- 172.21.15.8:0/908768653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88e00af680 msgr2=0x7f88e015e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:57.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.095+0000 7f88e502a700 1 --2- 172.21.15.8:0/908768653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88e00af680 0x7f88e015e040 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f88d0009f20 tx=0x7f88d0009840 comp rx=0 tx=0).stop 2023-10-06T04:37:57.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.095+0000 7f88e502a700 1 -- 172.21.15.8:0/908768653 shutdown_connections 2023-10-06T04:37:57.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.095+0000 7f88e502a700 1 --2- 172.21.15.8:0/908768653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88e00d0aa0 0x7f88e00cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:57.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.095+0000 7f88e502a700 1 --2- 172.21.15.8:0/908768653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88e00af680 0x7f88e015e040 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:57.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.095+0000 7f88e502a700 1 -- 172.21.15.8:0/908768653 >> 172.21.15.8:0/908768653 conn(0x7f88e00633d0 msgr2=0x7f88e00637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:57.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.095+0000 7f88e502a700 1 -- 172.21.15.8:0/908768653 shutdown_connections 2023-10-06T04:37:57.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.095+0000 7f88e502a700 1 -- 172.21.15.8:0/908768653 wait complete. 2023-10-06T04:37:57.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.096+0000 7f88e502a700 1 Processor -- start 2023-10-06T04:37:57.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.096+0000 7f88e502a700 1 -- start start 2023-10-06T04:37:57.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.097+0000 7f88e502a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88e00af680 0x7f88e00ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:57.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.097+0000 7f88e502a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88e00cb360 0x7f88e0149a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:57.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.097+0000 7f88e502a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88e00d0aa0 0x7f88e00c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:57.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.097+0000 7f88e502a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e00a7880 con 0x7f88e00d0aa0 2023-10-06T04:37:57.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.097+0000 7f88e502a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e00c9da0 con 0x7f88e00cb360 2023-10-06T04:37:57.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.097+0000 7f88e502a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e0149fa0 con 0x7f88e00af680 2023-10-06T04:37:57.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.097+0000 7f88df59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88e00d0aa0 0x7f88e00c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:57.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.097+0000 7f88df59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88e00d0aa0 0x7f88e00c8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47496/0 (socket says 172.21.15.8:47496) 2023-10-06T04:37:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.097+0000 7f88df59e700 1 -- 172.21.15.8:0/1254120549 learned_addr learned my addr 172.21.15.8:0/1254120549 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.097+0000 7f88ded9d700 1 --2- 172.21.15.8:0/1254120549 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88e00af680 0x7f88e00ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.097+0000 7f88de59c700 1 --2- 172.21.15.8:0/1254120549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88e00cb360 0x7f88e0149a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.097+0000 7f88df59e700 1 -- 172.21.15.8:0/1254120549 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88e00af680 msgr2=0x7f88e00ca230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.097+0000 7f88df59e700 1 --2- 172.21.15.8:0/1254120549 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88e00af680 0x7f88e00ca230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.097+0000 7f88df59e700 1 -- 172.21.15.8:0/1254120549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88e00cb360 msgr2=0x7f88e0149a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.097+0000 7f88df59e700 1 --2- 172.21.15.8:0/1254120549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88e00cb360 0x7f88e0149a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.097+0000 7f88df59e700 1 -- 172.21.15.8:0/1254120549 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d0009ae0 con 0x7f88e00d0aa0 2023-10-06T04:37:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.097+0000 7f88de59c700 1 --2- 172.21.15.8:0/1254120549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88e00cb360 0x7f88e0149a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.097+0000 7f88df59e700 1 --2- 172.21.15.8:0/1254120549 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88e00d0aa0 0x7f88e00c8680 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f88d800ea50 tx=0x7f88d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.097+0000 7f88d6ffd700 1 -- 172.21.15.8:0/1254120549 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d800c7f0 con 0x7f88e00d0aa0 2023-10-06T04:37:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.098+0000 7f88d6ffd700 1 -- 172.21.15.8:0/1254120549 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d800c970 con 0x7f88e00d0aa0 2023-10-06T04:37:57.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.098+0000 7f88e502a700 1 -- 172.21.15.8:0/1254120549 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e00c9190 con 0x7f88e00d0aa0 2023-10-06T04:37:57.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.098+0000 7f88d6ffd700 1 -- 172.21.15.8:0/1254120549 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d800cd30 con 0x7f88e00d0aa0 2023-10-06T04:37:57.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.098+0000 7f88e502a700 1 -- 172.21.15.8:0/1254120549 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e00c97d0 con 0x7f88e00d0aa0 2023-10-06T04:37:57.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.098+0000 7f88e502a700 1 -- 172.21.15.8:0/1254120549 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88e00c9b50 con 0x7f88e00d0aa0 2023-10-06T04:37:57.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.099+0000 7f88d6ffd700 1 -- 172.21.15.8:0/1254120549 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f88d8013680 con 0x7f88e00d0aa0 2023-10-06T04:37:57.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.099+0000 7f88d6ffd700 1 --2- 172.21.15.8:0/1254120549 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f88c0066f30 0x7f88c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:57.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.099+0000 7f88d6ffd700 1 -- 172.21.15.8:0/1254120549 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6479+0+0 (secure 0 0 0) 0x7f88d8084a90 con 0x7f88e00d0aa0 2023-10-06T04:37:57.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.100+0000 7f88ded9d700 1 --2- 172.21.15.8:0/1254120549 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f88c0066f30 0x7f88c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:57.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.100+0000 7f88ded9d700 1 --2- 172.21.15.8:0/1254120549 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f88c0066f30 0x7f88c00693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f88d0009880 tx=0x7f88d0018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:57.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.104+0000 7f88d6ffd700 1 -- 172.21.15.8:0/1254120549 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f88d8051a00 con 0x7f88e00d0aa0 2023-10-06T04:37:57.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.339+0000 7f88e502a700 1 -- 172.21.15.8:0/1254120549 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88e00d1130 con 0x7f88e00d0aa0 2023-10-06T04:37:57.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.340+0000 7f88d6ffd700 1 -- 172.21.15.8:0/1254120549 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f88d8055020 con 0x7f88e00d0aa0 2023-10-06T04:37:57.341 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:57.341 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":30,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/867081044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":867081044},{"type":"v1","addr":"172.21.15.184:6835","nonce":867081044}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5176,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2754847040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2754847040},{"type":"v1","addr":"172.21.15.184:6837","nonce":2754847040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5358,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/1957165234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1957165234},{"type":"v1","addr":"172.21.15.8:6834","nonce":1957165234}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:37:29.514098+0000","modified":"2023-10-06T04:37:43.827602+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5361":{"gid":5361,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.8:6835/1173304661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1173304661},{"type":"v1","addr":"172.21.15.8:6835","nonce":1173304661}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":8,"enabled":true,"fs_name":"recovery_fs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T04:37:57.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.342+0000 7f88e502a700 1 -- 172.21.15.8:0/1254120549 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f88c0066f30 msgr2=0x7f88c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:57.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.342+0000 7f88e502a700 1 --2- 172.21.15.8:0/1254120549 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f88c0066f30 0x7f88c00693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f88d0009880 tx=0x7f88d0018000 comp rx=0 tx=0).stop 2023-10-06T04:37:57.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.342+0000 7f88e502a700 1 -- 172.21.15.8:0/1254120549 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88e00d0aa0 msgr2=0x7f88e00c8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:57.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.342+0000 7f88e502a700 1 --2- 172.21.15.8:0/1254120549 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88e00d0aa0 0x7f88e00c8680 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f88d800ea50 tx=0x7f88d80091a0 comp rx=0 tx=0).stop 2023-10-06T04:37:57.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.342+0000 7f88e502a700 1 -- 172.21.15.8:0/1254120549 shutdown_connections 2023-10-06T04:37:57.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.342+0000 7f88e502a700 1 --2- 172.21.15.8:0/1254120549 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f88c0066f30 0x7f88c00693e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:57.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.342+0000 7f88e502a700 1 --2- 172.21.15.8:0/1254120549 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88e00d0aa0 0x7f88e00c8680 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:57.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.342+0000 7f88e502a700 1 --2- 172.21.15.8:0/1254120549 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88e00af680 0x7f88e00ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:57.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.342+0000 7f88e502a700 1 --2- 172.21.15.8:0/1254120549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88e00cb360 0x7f88e0149a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:57.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.342+0000 7f88e502a700 1 -- 172.21.15.8:0/1254120549 >> 172.21.15.8:0/1254120549 conn(0x7f88e00633d0 msgr2=0x7f88e00b51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:57.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.342+0000 7f88e502a700 1 -- 172.21.15.8:0/1254120549 shutdown_connections 2023-10-06T04:37:57.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.342+0000 7f88e502a700 1 -- 172.21.15.8:0/1254120549 wait complete. 2023-10-06T04:37:57.345 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 30 2023-10-06T04:37:57.355 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:37:57.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.473+0000 7feebcd20700 1 Processor -- start 2023-10-06T04:37:57.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.473+0000 7feebcd20700 1 -- start start 2023-10-06T04:37:57.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.474+0000 7feebcd20700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7feeb8142cc0 0x7feeb80686e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:57.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.474+0000 7feebcd20700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feeb80cc530 0x7feeb8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:57.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.474+0000 7feebcd20700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb8069f70 con 0x7feeb8143090 2023-10-06T04:37:57.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.474+0000 7feebcd20700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb8069160 con 0x7feeb8142cc0 2023-10-06T04:37:57.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.474+0000 7feebcd20700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb8069360 con 0x7feeb80cc530 2023-10-06T04:37:57.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.474+0000 7feeb659c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7feeb8142cc0 0x7feeb80686e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:57.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.474+0000 7feeb6d9d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feeb80cc530 0x7feeb8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:57.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.474+0000 7feeb5d9b700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7feeb8143090 0x7feeb80cbe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.8:49608/0 (socket says 172.21.15.8:49608) 2023-10-06T04:37:57.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.474+0000 7feeb5d9b700 1 -- 172.21.15.8:0/1629731986 learned_addr learned my addr 172.21.15.8:0/1629731986 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:57.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.475+0000 7feeb659c700 1 -- 172.21.15.8:0/1629731986 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feeb80cc530 msgr2=0x7feeb8068c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:57.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.475+0000 7feeb659c700 1 --2- 172.21.15.8:0/1629731986 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feeb80cc530 0x7feeb8068c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:57.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.475+0000 7feeb659c700 1 -- 172.21.15.8:0/1629731986 >> v1:172.21.15.184:6789/0 conn(0x7feeb8143090 legacy=0x7feeb80cbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:57.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.475+0000 7feeb659c700 1 -- 172.21.15.8:0/1629731986 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb8069640 con 0x7feeb8142cc0 2023-10-06T04:37:57.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.475+0000 7feeb6d9d700 1 --2- 172.21.15.8:0/1629731986 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feeb80cc530 0x7feeb8068c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:37:57.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.475+0000 7feeb659c700 1 --2- 172.21.15.8:0/1629731986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feeb8142cc0 0x7feeb80686e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7feea8009eb0 tx=0x7feea8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9164c48a17b5ce92 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:57.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.475+0000 7feeb559a700 1 -- 172.21.15.8:0/1629731986 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea800e070 con 0x7feeb8142cc0 2023-10-06T04:37:57.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.475+0000 7feeb559a700 1 -- 172.21.15.8:0/1629731986 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea800bc30 con 0x7feeb8142cc0 2023-10-06T04:37:57.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.475+0000 7feeb559a700 1 -- 172.21.15.8:0/1629731986 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea8012430 con 0x7feeb8142cc0 2023-10-06T04:37:57.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.476+0000 7feebcd20700 1 -- 172.21.15.8:0/1629731986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feeb8142cc0 msgr2=0x7feeb80686e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:57.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.476+0000 7feebcd20700 1 --2- 172.21.15.8:0/1629731986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feeb8142cc0 0x7feeb80686e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7feea8009eb0 tx=0x7feea8009780 comp rx=0 tx=0).stop 2023-10-06T04:37:57.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.476+0000 7feebcd20700 1 -- 172.21.15.8:0/1629731986 shutdown_connections 2023-10-06T04:37:57.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.476+0000 7feebcd20700 1 --2- 172.21.15.8:0/1629731986 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feeb80cc530 0x7feeb8068c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:57.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.476+0000 7feebcd20700 1 --2- 172.21.15.8:0/1629731986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feeb8142cc0 0x7feeb80686e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:57.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.476+0000 7feebcd20700 1 -- 172.21.15.8:0/1629731986 >> 172.21.15.8:0/1629731986 conn(0x7feeb80ce250 msgr2=0x7feeb80ce650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:57.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.476+0000 7feebcd20700 1 -- 172.21.15.8:0/1629731986 shutdown_connections 2023-10-06T04:37:57.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.476+0000 7feebcd20700 1 -- 172.21.15.8:0/1629731986 wait complete. 2023-10-06T04:37:57.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.477+0000 7feebcd20700 1 Processor -- start 2023-10-06T04:37:57.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.477+0000 7feebcd20700 1 -- start start 2023-10-06T04:37:57.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.478+0000 7feebcd20700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feeb80cc530 0x7feeb8158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:57.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.478+0000 7feebcd20700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feeb8142cc0 0x7feeb80b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:57.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.478+0000 7feebcd20700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feeb8143090 0x7feeb80b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:57.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.478+0000 7feebcd20700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb80b3700 con 0x7feeb8142cc0 2023-10-06T04:37:57.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.478+0000 7feebcd20700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb80b2af0 con 0x7feeb8143090 2023-10-06T04:37:57.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.478+0000 7feebcd20700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb80b2dd0 con 0x7feeb80cc530 2023-10-06T04:37:57.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.478+0000 7feeb5d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feeb8142cc0 0x7feeb80b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:57.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.478+0000 7feeb5d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feeb8142cc0 0x7feeb80b1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47512/0 (socket says 172.21.15.8:47512) 2023-10-06T04:37:57.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.478+0000 7feeb5d9b700 1 -- 172.21.15.8:0/180053889 learned_addr learned my addr 172.21.15.8:0/180053889 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:57.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.478+0000 7feeb6d9d700 1 --2- 172.21.15.8:0/180053889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feeb8143090 0x7feeb80b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:57.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.478+0000 7feeb659c700 1 --2- 172.21.15.8:0/180053889 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feeb80cc530 0x7feeb8158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:57.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.478+0000 7feeb5d9b700 1 -- 172.21.15.8:0/180053889 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feeb80cc530 msgr2=0x7feeb8158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:57.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.478+0000 7feeb5d9b700 1 --2- 172.21.15.8:0/180053889 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feeb80cc530 0x7feeb8158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:57.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.478+0000 7feeb5d9b700 1 -- 172.21.15.8:0/180053889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feeb8143090 msgr2=0x7feeb80b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:57.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.478+0000 7feeb5d9b700 1 --2- 172.21.15.8:0/180053889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feeb8143090 0x7feeb80b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:57.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.478+0000 7feeb5d9b700 1 -- 172.21.15.8:0/180053889 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb0009420 con 0x7feeb8142cc0 2023-10-06T04:37:57.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.479+0000 7feeb5d9b700 1 --2- 172.21.15.8:0/180053889 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feeb8142cc0 0x7feeb80b1fc0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7feea000c560 tx=0x7feea0001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:57.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.479+0000 7feeae7fc700 1 -- 172.21.15.8:0/180053889 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea0005b30 con 0x7feeb8142cc0 2023-10-06T04:37:57.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.479+0000 7feeae7fc700 1 -- 172.21.15.8:0/180053889 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea0005cb0 con 0x7feeb8142cc0 2023-10-06T04:37:57.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.479+0000 7feeae7fc700 1 -- 172.21.15.8:0/180053889 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea0007320 con 0x7feeb8142cc0 2023-10-06T04:37:57.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.479+0000 7feebcd20700 1 -- 172.21.15.8:0/180053889 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea8009a20 con 0x7feeb8142cc0 2023-10-06T04:37:57.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.479+0000 7feebcd20700 1 -- 172.21.15.8:0/180053889 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb80b3390 con 0x7feeb8142cc0 2023-10-06T04:37:57.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.480+0000 7feebcd20700 1 -- 172.21.15.8:0/180053889 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb80b3870 con 0x7feeb8142cc0 2023-10-06T04:37:57.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.480+0000 7feeae7fc700 1 -- 172.21.15.8:0/180053889 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feea001b3b0 con 0x7feeb8142cc0 2023-10-06T04:37:57.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.480+0000 7feeae7fc700 1 --2- 172.21.15.8:0/180053889 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fee98066f30 0x7fee980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:57.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.481+0000 7feeae7fc700 1 -- 172.21.15.8:0/180053889 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6479+0+0 (secure 0 0 0) 0x7feea0083d50 con 0x7feeb8142cc0 2023-10-06T04:37:57.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.481+0000 7feeb659c700 1 --2- 172.21.15.8:0/180053889 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fee98066f30 0x7fee980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:57.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.481+0000 7feeb659c700 1 --2- 172.21.15.8:0/180053889 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fee98066f30 0x7fee980693e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7feea8009eb0 tx=0x7feea8019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:57.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.485+0000 7feeae7fc700 1 -- 172.21.15.8:0/180053889 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feea0087030 con 0x7feeb8142cc0 2023-10-06T04:37:57.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.681+0000 7feebcd20700 1 -- 172.21.15.8:0/180053889 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feeb8071550 con 0x7feeb8142cc0 2023-10-06T04:37:57.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.682+0000 7feeae7fc700 1 -- 172.21.15.8:0/180053889 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+17165 (secure 0 0 0) 0x7feea0017090 con 0x7feeb8142cc0 2023-10-06T04:37:57.683 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:57.684 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":47,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:37:54.863783+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:36:10.148177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:36:10.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T04:37:15.902657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}}},{"pool":8,"pool_name":"recovery_fs_metadata","create_time":"2023-10-06T04:37:28.524294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}}}],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.555871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.490505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.504578+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.517217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:05.991135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.537329+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.543232+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.443715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6835/3478733664":"2023-10-07T04:37:26.044067+0000","172.21.15.8:6833/3478733664":"2023-10-07T04:37:26.044067+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:37:57.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.684+0000 7feebcd20700 1 -- 172.21.15.8:0/180053889 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fee98066f30 msgr2=0x7fee980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:57.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.684+0000 7feebcd20700 1 --2- 172.21.15.8:0/180053889 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fee98066f30 0x7fee980693e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7feea8009eb0 tx=0x7feea8019000 comp rx=0 tx=0).stop 2023-10-06T04:37:57.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.684+0000 7feebcd20700 1 -- 172.21.15.8:0/180053889 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feeb8142cc0 msgr2=0x7feeb80b1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:57.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.684+0000 7feebcd20700 1 --2- 172.21.15.8:0/180053889 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feeb8142cc0 0x7feeb80b1fc0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7feea000c560 tx=0x7feea0001020 comp rx=0 tx=0).stop 2023-10-06T04:37:57.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.684+0000 7feebcd20700 1 -- 172.21.15.8:0/180053889 shutdown_connections 2023-10-06T04:37:57.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.684+0000 7feebcd20700 1 --2- 172.21.15.8:0/180053889 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fee98066f30 0x7fee980693e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:57.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.684+0000 7feebcd20700 1 --2- 172.21.15.8:0/180053889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feeb8143090 0x7feeb80b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:57.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.684+0000 7feebcd20700 1 --2- 172.21.15.8:0/180053889 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feeb80cc530 0x7feeb8158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:57.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.684+0000 7feebcd20700 1 --2- 172.21.15.8:0/180053889 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feeb8142cc0 0x7feeb80b1fc0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:57.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.684+0000 7feebcd20700 1 -- 172.21.15.8:0/180053889 >> 172.21.15.8:0/180053889 conn(0x7feeb80ce250 msgr2=0x7feeb80c37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:57.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.684+0000 7feebcd20700 1 -- 172.21.15.8:0/180053889 shutdown_connections 2023-10-06T04:37:57.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.684+0000 7feebcd20700 1 -- 172.21.15.8:0/180053889 wait complete. 2023-10-06T04:37:57.697 INFO:tasks.cephfs.filesystem:Destroying file system recovery_fs and related pools 2023-10-06T04:37:57.698 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:37:57.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.814+0000 7fe7c571d700 1 Processor -- start 2023-10-06T04:37:57.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.815+0000 7fe7c571d700 1 -- start start 2023-10-06T04:37:57.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.815+0000 7fe7c571d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe7c00ada10 0x7fe7c00ab720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:57.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.815+0000 7fe7c571d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe7c00afde0 0x7fe7c00b0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:57.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.815+0000 7fe7c571d700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7c00acca0 con 0x7fe7c0155c50 2023-10-06T04:37:57.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.815+0000 7fe7c571d700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7c00b07a0 con 0x7fe7c00afde0 2023-10-06T04:37:57.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.815+0000 7fe7c571d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7c00ac090 con 0x7fe7c00ada10 2023-10-06T04:37:57.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.815+0000 7fe7bf7fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe7c00afde0 0x7fe7c00b0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:57.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.815+0000 7fe7beffd700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe7c0155c50 0x7fe7c00ad130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34596/0 (socket says 172.21.15.8:34596) 2023-10-06T04:37:57.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.815+0000 7fe7beffd700 1 -- 172.21.15.8:0/546311686 learned_addr learned my addr 172.21.15.8:0/546311686 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:57.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.816+0000 7fe7be7fc700 1 --2- 172.21.15.8:0/546311686 >> v2:172.21.15.184:3300/0 conn(0x7fe7c00ada10 0x7fe7c00ab720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:57.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.816+0000 7fe7bf7fe700 1 -- 172.21.15.8:0/546311686 >> v2:172.21.15.184:3300/0 conn(0x7fe7c00ada10 msgr2=0x7fe7c00ab720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:57.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.816+0000 7fe7bf7fe700 1 --2- 172.21.15.8:0/546311686 >> v2:172.21.15.184:3300/0 conn(0x7fe7c00ada10 0x7fe7c00ab720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:57.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.816+0000 7fe7bf7fe700 1 -- 172.21.15.8:0/546311686 >> v1:172.21.15.8:6789/0 conn(0x7fe7c0155c50 legacy=0x7fe7c00ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:57.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.816+0000 7fe7bf7fe700 1 -- 172.21.15.8:0/546311686 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c00ac370 con 0x7fe7c00afde0 2023-10-06T04:37:57.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.816+0000 7fe7bdffb700 1 -- 172.21.15.8:0/546311686 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2325860122 0 0) 0x7fe7c00acca0 con 0x7fe7c0155c50 2023-10-06T04:37:57.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.816+0000 7fe7bf7fe700 1 --2- 172.21.15.8:0/546311686 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7c00afde0 0x7fe7c00b0260 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0009e90 tx=0x7fe7b0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e766f592937bfbe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:57.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.816+0000 7fe7bdffb700 1 -- 172.21.15.8:0/546311686 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b000e070 con 0x7fe7c00afde0 2023-10-06T04:37:57.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.816+0000 7fe7bdffb700 1 -- 172.21.15.8:0/546311686 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b000bbb0 con 0x7fe7c00afde0 2023-10-06T04:37:57.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.816+0000 7fe7bdffb700 1 -- 172.21.15.8:0/546311686 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0012430 con 0x7fe7c00afde0 2023-10-06T04:37:57.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.817+0000 7fe7c571d700 1 -- 172.21.15.8:0/546311686 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7c00afde0 msgr2=0x7fe7c00b0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:57.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.817+0000 7fe7c571d700 1 --2- 172.21.15.8:0/546311686 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7c00afde0 0x7fe7c00b0260 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0009e90 tx=0x7fe7b0009780 comp rx=0 tx=0).stop 2023-10-06T04:37:57.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.817+0000 7fe7c571d700 1 -- 172.21.15.8:0/546311686 shutdown_connections 2023-10-06T04:37:57.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.817+0000 7fe7c571d700 1 --2- 172.21.15.8:0/546311686 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7c00afde0 0x7fe7c00b0260 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:57.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.817+0000 7fe7c571d700 1 --2- 172.21.15.8:0/546311686 >> v2:172.21.15.184:3300/0 conn(0x7fe7c00ada10 0x7fe7c00ab720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:57.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.817+0000 7fe7c571d700 1 -- 172.21.15.8:0/546311686 >> 172.21.15.8:0/546311686 conn(0x7fe7c0068070 msgr2=0x7fe7c00cc000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:57.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.817+0000 7fe7c571d700 1 -- 172.21.15.8:0/546311686 shutdown_connections 2023-10-06T04:37:57.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.817+0000 7fe7c571d700 1 -- 172.21.15.8:0/546311686 wait complete. 2023-10-06T04:37:57.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.818+0000 7fe7c571d700 1 Processor -- start 2023-10-06T04:37:57.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.818+0000 7fe7c571d700 1 -- start start 2023-10-06T04:37:57.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.819+0000 7fe7c571d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7c00ada10 0x7fe7c0150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:57.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.819+0000 7fe7c571d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7c00afde0 0x7fe7c0157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:57.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.819+0000 7fe7c571d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7c0155c50 0x7fe7c00cc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:57.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.819+0000 7fe7c571d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c00ab530 con 0x7fe7c00ada10 2023-10-06T04:37:57.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.819+0000 7fe7c571d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c00aa920 con 0x7fe7c0155c50 2023-10-06T04:37:57.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.819+0000 7fe7c571d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c00aac00 con 0x7fe7c00afde0 2023-10-06T04:37:57.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.819+0000 7fe7beffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7c00ada10 0x7fe7c0150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:57.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.819+0000 7fe7beffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7c00ada10 0x7fe7c0150ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47540/0 (socket says 172.21.15.8:47540) 2023-10-06T04:37:57.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.819+0000 7fe7beffd700 1 -- 172.21.15.8:0/4263420534 learned_addr learned my addr 172.21.15.8:0/4263420534 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:57.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.819+0000 7fe7beffd700 1 -- 172.21.15.8:0/4263420534 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7c00afde0 msgr2=0x7fe7c0157330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:57.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.819+0000 7fe7beffd700 1 --2- 172.21.15.8:0/4263420534 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7c00afde0 0x7fe7c0157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:57.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.819+0000 7fe7beffd700 1 -- 172.21.15.8:0/4263420534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7c0155c50 msgr2=0x7fe7c00cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:57.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.819+0000 7fe7beffd700 1 --2- 172.21.15.8:0/4263420534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7c0155c50 0x7fe7c00cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:57.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.819+0000 7fe7beffd700 1 -- 172.21.15.8:0/4263420534 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b0009a20 con 0x7fe7c00ada10 2023-10-06T04:37:57.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.819+0000 7fe7beffd700 1 --2- 172.21.15.8:0/4263420534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7c00ada10 0x7fe7c0150ea0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe7b800c5b0 tx=0x7fe7b8001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:57.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.819+0000 7fe7b6ffd700 1 -- 172.21.15.8:0/4263420534 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b8005b30 con 0x7fe7c00ada10 2023-10-06T04:37:57.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.819+0000 7fe7b6ffd700 1 -- 172.21.15.8:0/4263420534 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b8005c90 con 0x7fe7c00ada10 2023-10-06T04:37:57.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.819+0000 7fe7c571d700 1 -- 172.21.15.8:0/4263420534 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c00aaee0 con 0x7fe7c00ada10 2023-10-06T04:37:57.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.819+0000 7fe7b6ffd700 1 -- 172.21.15.8:0/4263420534 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b8007300 con 0x7fe7c00ada10 2023-10-06T04:37:57.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.819+0000 7fe7c571d700 1 -- 172.21.15.8:0/4263420534 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c00ab9c0 con 0x7fe7c00ada10 2023-10-06T04:37:57.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.820+0000 7fe7c571d700 1 -- 172.21.15.8:0/4263420534 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7c00ab810 con 0x7fe7c00ada10 2023-10-06T04:37:57.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.821+0000 7fe7b6ffd700 1 -- 172.21.15.8:0/4263420534 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe7b801b3b0 con 0x7fe7c00ada10 2023-10-06T04:37:57.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.821+0000 7fe7b6ffd700 1 --2- 172.21.15.8:0/4263420534 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe7a0066f30 0x7fe7a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:57.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.821+0000 7fe7b6ffd700 1 -- 172.21.15.8:0/4263420534 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6479+0+0 (secure 0 0 0) 0x7fe7b8083d70 con 0x7fe7c00ada10 2023-10-06T04:37:57.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.821+0000 7fe7be7fc700 1 --2- 172.21.15.8:0/4263420534 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe7a0066f30 0x7fe7a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:57.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.822+0000 7fe7be7fc700 1 --2- 172.21.15.8:0/4263420534 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe7a0066f30 0x7fe7a00693e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00af3a0 tx=0x7fe7a8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:57.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:57.825+0000 7fe7b6ffd700 1 -- 172.21.15.8:0/4263420534 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe7b8050ce0 con 0x7fe7c00ada10 2023-10-06T04:37:58.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.062+0000 7fe7c571d700 1 -- 172.21.15.8:0/4263420534 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7c006b340 con 0x7fe7c00ada10 2023-10-06T04:37:58.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.062+0000 7fe7b6ffd700 1 -- 172.21.15.8:0/4263420534 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fe7b8017090 con 0x7fe7c00ada10 2023-10-06T04:37:58.064 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:58.064 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":30,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/867081044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":867081044},{"type":"v1","addr":"172.21.15.184:6835","nonce":867081044}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5176,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2754847040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2754847040},{"type":"v1","addr":"172.21.15.184:6837","nonce":2754847040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5358,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/1957165234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1957165234},{"type":"v1","addr":"172.21.15.8:6834","nonce":1957165234}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:37:29.514098+0000","modified":"2023-10-06T04:37:43.827602+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5361":{"gid":5361,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.8:6835/1173304661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1173304661},{"type":"v1","addr":"172.21.15.8:6835","nonce":1173304661}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":8,"enabled":true,"fs_name":"recovery_fs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T04:37:58.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.064+0000 7fe7c571d700 1 -- 172.21.15.8:0/4263420534 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe7a0066f30 msgr2=0x7fe7a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:58.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.064+0000 7fe7c571d700 1 --2- 172.21.15.8:0/4263420534 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe7a0066f30 0x7fe7a00693e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00af3a0 tx=0x7fe7a8008040 comp rx=0 tx=0).stop 2023-10-06T04:37:58.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.064+0000 7fe7c571d700 1 -- 172.21.15.8:0/4263420534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7c00ada10 msgr2=0x7fe7c0150ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:58.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.064+0000 7fe7c571d700 1 --2- 172.21.15.8:0/4263420534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7c00ada10 0x7fe7c0150ea0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe7b800c5b0 tx=0x7fe7b8001070 comp rx=0 tx=0).stop 2023-10-06T04:37:58.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.064+0000 7fe7c571d700 1 -- 172.21.15.8:0/4263420534 shutdown_connections 2023-10-06T04:37:58.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.064+0000 7fe7c571d700 1 --2- 172.21.15.8:0/4263420534 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe7a0066f30 0x7fe7a00693e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:58.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.064+0000 7fe7c571d700 1 --2- 172.21.15.8:0/4263420534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7c0155c50 0x7fe7c00cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:58.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.064+0000 7fe7c571d700 1 --2- 172.21.15.8:0/4263420534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7c00ada10 0x7fe7c0150ea0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:58.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.064+0000 7fe7c571d700 1 --2- 172.21.15.8:0/4263420534 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7c00afde0 0x7fe7c0157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:58.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.064+0000 7fe7c571d700 1 -- 172.21.15.8:0/4263420534 >> 172.21.15.8:0/4263420534 conn(0x7fe7c0068070 msgr2=0x7fe7c0152c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:58.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.064+0000 7fe7c571d700 1 -- 172.21.15.8:0/4263420534 shutdown_connections 2023-10-06T04:37:58.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.064+0000 7fe7c571d700 1 -- 172.21.15.8:0/4263420534 wait complete. 2023-10-06T04:37:58.067 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 30 2023-10-06T04:37:58.078 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:37:58.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.195+0000 7fd15a8ab700 1 Processor -- start 2023-10-06T04:37:58.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.195+0000 7fd15a8ab700 1 -- start start 2023-10-06T04:37:58.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.196+0000 7fd15a8ab700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd154142c30 0x7fd15406c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:58.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.196+0000 7fd15a8ab700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd154159c60 0x7fd15415a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:58.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.196+0000 7fd15a8ab700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd15415a5c0 con 0x7fd1540686e0 2023-10-06T04:37:58.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.196+0000 7fd15a8ab700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1540699f0 con 0x7fd154142c30 2023-10-06T04:37:58.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.196+0000 7fd15a8ab700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd154068b80 con 0x7fd154159c60 2023-10-06T04:37:58.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.196+0000 7fd153fff700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd154142c30 0x7fd15406c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:58.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.196+0000 7fd153fff700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd154142c30 0x7fd15406c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47548/0 (socket says 172.21.15.8:47548) 2023-10-06T04:37:58.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.196+0000 7fd153fff700 1 -- 172.21.15.8:0/4268633306 learned_addr learned my addr 172.21.15.8:0/4268633306 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:58.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.196+0000 7fd158e48700 1 --2- 172.21.15.8:0/4268633306 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd154159c60 0x7fd15415a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:58.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.196+0000 7fd153fff700 1 -- 172.21.15.8:0/4268633306 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd154159c60 msgr2=0x7fd15415a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:58.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.196+0000 7fd153fff700 1 --2- 172.21.15.8:0/4268633306 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd154159c60 0x7fd15415a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:58.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.196+0000 7fd153fff700 1 -- 172.21.15.8:0/4268633306 >> v1:172.21.15.184:6789/0 conn(0x7fd1540686e0 legacy=0x7fd154069e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:58.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.196+0000 7fd153fff700 1 -- 172.21.15.8:0/4268633306 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd154068de0 con 0x7fd154142c30 2023-10-06T04:37:58.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.196+0000 7fd153fff700 1 --2- 172.21.15.8:0/4268633306 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd154142c30 0x7fd15406c3e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd1440099b0 tx=0x7fd144009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dbd42b291d857e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:58.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.197+0000 7fd152ffd700 1 -- 172.21.15.8:0/4268633306 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd144009ea0 con 0x7fd154142c30 2023-10-06T04:37:58.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.197+0000 7fd152ffd700 1 -- 172.21.15.8:0/4268633306 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14400b860 con 0x7fd154142c30 2023-10-06T04:37:58.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.197+0000 7fd152ffd700 1 -- 172.21.15.8:0/4268633306 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14400bc00 con 0x7fd154142c30 2023-10-06T04:37:58.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.197+0000 7fd15a8ab700 1 -- 172.21.15.8:0/4268633306 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd154142c30 msgr2=0x7fd15406c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:58.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.197+0000 7fd15a8ab700 1 --2- 172.21.15.8:0/4268633306 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd154142c30 0x7fd15406c3e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd1440099b0 tx=0x7fd144009250 comp rx=0 tx=0).stop 2023-10-06T04:37:58.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.197+0000 7fd15a8ab700 1 -- 172.21.15.8:0/4268633306 shutdown_connections 2023-10-06T04:37:58.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.197+0000 7fd15a8ab700 1 --2- 172.21.15.8:0/4268633306 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd154159c60 0x7fd15415a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:58.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.197+0000 7fd15a8ab700 1 --2- 172.21.15.8:0/4268633306 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd154142c30 0x7fd15406c3e0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:58.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.197+0000 7fd15a8ab700 1 -- 172.21.15.8:0/4268633306 >> 172.21.15.8:0/4268633306 conn(0x7fd1540675d0 msgr2=0x7fd1540679d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:58.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.197+0000 7fd15a8ab700 1 -- 172.21.15.8:0/4268633306 shutdown_connections 2023-10-06T04:37:58.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.197+0000 7fd15a8ab700 1 -- 172.21.15.8:0/4268633306 wait complete. 2023-10-06T04:37:58.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.198+0000 7fd15a8ab700 1 Processor -- start 2023-10-06T04:37:58.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.199+0000 7fd15a8ab700 1 -- start start 2023-10-06T04:37:58.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.199+0000 7fd15a8ab700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1540686e0 0x7fd154158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:58.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.199+0000 7fd15a8ab700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd154142c30 0x7fd15413bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:58.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.199+0000 7fd15a8ab700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd154159c60 0x7fd15415f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:58.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.199+0000 7fd15a8ab700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1540aee10 con 0x7fd154159c60 2023-10-06T04:37:58.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.199+0000 7fd15a8ab700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1540af0b0 con 0x7fd154142c30 2023-10-06T04:37:58.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.199+0000 7fd15a8ab700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1540af390 con 0x7fd1540686e0 2023-10-06T04:37:58.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.199+0000 7fd158e48700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd154159c60 0x7fd15415f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:58.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.199+0000 7fd158e48700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd154159c60 0x7fd15415f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47554/0 (socket says 172.21.15.8:47554) 2023-10-06T04:37:58.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.199+0000 7fd158e48700 1 -- 172.21.15.8:0/1052607520 learned_addr learned my addr 172.21.15.8:0/1052607520 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:58.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.199+0000 7fd153fff700 1 --2- 172.21.15.8:0/1052607520 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1540686e0 0x7fd154158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:58.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.199+0000 7fd1537fe700 1 --2- 172.21.15.8:0/1052607520 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd154142c30 0x7fd15413bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:58.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.200+0000 7fd158e48700 1 -- 172.21.15.8:0/1052607520 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1540686e0 msgr2=0x7fd154158c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:58.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.200+0000 7fd158e48700 1 --2- 172.21.15.8:0/1052607520 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1540686e0 0x7fd154158c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:58.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.200+0000 7fd158e48700 1 -- 172.21.15.8:0/1052607520 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd154142c30 msgr2=0x7fd15413bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:58.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.200+0000 7fd158e48700 1 --2- 172.21.15.8:0/1052607520 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd154142c30 0x7fd15413bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:58.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.200+0000 7fd158e48700 1 -- 172.21.15.8:0/1052607520 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1440094f0 con 0x7fd154159c60 2023-10-06T04:37:58.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.200+0000 7fd153fff700 1 --2- 172.21.15.8:0/1052607520 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1540686e0 0x7fd154158c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:58.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.200+0000 7fd158e48700 1 --2- 172.21.15.8:0/1052607520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd154159c60 0x7fd15415f320 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fd14c009df0 tx=0x7fd14c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:58.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.200+0000 7fd13bfff700 1 -- 172.21.15.8:0/1052607520 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c00cb50 con 0x7fd154159c60 2023-10-06T04:37:58.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.200+0000 7fd13bfff700 1 -- 172.21.15.8:0/1052607520 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14c00f040 con 0x7fd154159c60 2023-10-06T04:37:58.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.200+0000 7fd15a8ab700 1 -- 172.21.15.8:0/1052607520 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1540af670 con 0x7fd154159c60 2023-10-06T04:37:58.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.200+0000 7fd13bfff700 1 -- 172.21.15.8:0/1052607520 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c014480 con 0x7fd154159c60 2023-10-06T04:37:58.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.200+0000 7fd15a8ab700 1 -- 172.21.15.8:0/1052607520 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd15413ca50 con 0x7fd154159c60 2023-10-06T04:37:58.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.201+0000 7fd15a8ab700 1 -- 172.21.15.8:0/1052607520 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd154071550 con 0x7fd154159c60 2023-10-06T04:37:58.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.201+0000 7fd13bfff700 1 -- 172.21.15.8:0/1052607520 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd14c014830 con 0x7fd154159c60 2023-10-06T04:37:58.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.202+0000 7fd13bfff700 1 --2- 172.21.15.8:0/1052607520 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd140066f30 0x7fd1400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:58.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.202+0000 7fd13bfff700 1 -- 172.21.15.8:0/1052607520 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6479+0+0 (secure 0 0 0) 0x7fd14c0851b0 con 0x7fd154159c60 2023-10-06T04:37:58.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.202+0000 7fd153fff700 1 --2- 172.21.15.8:0/1052607520 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd140066f30 0x7fd1400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:58.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.203+0000 7fd153fff700 1 --2- 172.21.15.8:0/1052607520 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd140066f30 0x7fd1400693e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd1440099b0 tx=0x7fd144017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:58.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.206+0000 7fd13bfff700 1 -- 172.21.15.8:0/1052607520 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd14c052120 con 0x7fd154159c60 2023-10-06T04:37:58.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.441+0000 7fd15a8ab700 1 -- 172.21.15.8:0/1052607520 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd15406a3b0 con 0x7fd154159c60 2023-10-06T04:37:58.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.441+0000 7fd13bfff700 1 -- 172.21.15.8:0/1052607520 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fd14c055740 con 0x7fd154159c60 2023-10-06T04:37:58.444 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:58.444 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":30,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/867081044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":867081044},{"type":"v1","addr":"172.21.15.184:6835","nonce":867081044}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5176,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2754847040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2754847040},{"type":"v1","addr":"172.21.15.184:6837","nonce":2754847040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5358,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/1957165234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1957165234},{"type":"v1","addr":"172.21.15.8:6834","nonce":1957165234}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:37:29.514098+0000","modified":"2023-10-06T04:37:43.827602+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5361":{"gid":5361,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.8:6835/1173304661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1173304661},{"type":"v1","addr":"172.21.15.8:6835","nonce":1173304661}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":8,"enabled":true,"fs_name":"recovery_fs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T04:37:58.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.443+0000 7fd15a8ab700 1 -- 172.21.15.8:0/1052607520 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd140066f30 msgr2=0x7fd1400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:58.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.443+0000 7fd15a8ab700 1 --2- 172.21.15.8:0/1052607520 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd140066f30 0x7fd1400693e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd1440099b0 tx=0x7fd144017000 comp rx=0 tx=0).stop 2023-10-06T04:37:58.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.443+0000 7fd15a8ab700 1 -- 172.21.15.8:0/1052607520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd154159c60 msgr2=0x7fd15415f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:58.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.443+0000 7fd15a8ab700 1 --2- 172.21.15.8:0/1052607520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd154159c60 0x7fd15415f320 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fd14c009df0 tx=0x7fd14c00b040 comp rx=0 tx=0).stop 2023-10-06T04:37:58.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.443+0000 7fd15a8ab700 1 -- 172.21.15.8:0/1052607520 shutdown_connections 2023-10-06T04:37:58.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.443+0000 7fd15a8ab700 1 --2- 172.21.15.8:0/1052607520 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd140066f30 0x7fd1400693e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:58.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.443+0000 7fd15a8ab700 1 --2- 172.21.15.8:0/1052607520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd154159c60 0x7fd15415f320 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:58.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.443+0000 7fd15a8ab700 1 --2- 172.21.15.8:0/1052607520 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1540686e0 0x7fd154158c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:58.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.443+0000 7fd15a8ab700 1 --2- 172.21.15.8:0/1052607520 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd154142c30 0x7fd15413bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:58.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.443+0000 7fd15a8ab700 1 -- 172.21.15.8:0/1052607520 >> 172.21.15.8:0/1052607520 conn(0x7fd1540675d0 msgr2=0x7fd154070790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:58.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.443+0000 7fd15a8ab700 1 -- 172.21.15.8:0/1052607520 shutdown_connections 2023-10-06T04:37:58.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.443+0000 7fd15a8ab700 1 -- 172.21.15.8:0/1052607520 wait complete. 2023-10-06T04:37:58.447 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 30 2023-10-06T04:37:58.458 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:37:58.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.575+0000 7f496a09c700 1 Processor -- start 2023-10-06T04:37:58.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.575+0000 7f496a09c700 1 -- start start 2023-10-06T04:37:58.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.576+0000 7f496a09c700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f49640af680 0x7f496415e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:58.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.576+0000 7f496a09c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49640cb360 0x7f49640d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:58.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.576+0000 7f496a09c700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49640cc4c0 con 0x7f49640d08d0 2023-10-06T04:37:58.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.576+0000 7f496a09c700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f496415d460 con 0x7f49640af680 2023-10-06T04:37:58.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.576+0000 7f496a09c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49640d0d50 con 0x7f49640cb360 2023-10-06T04:37:58.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.576+0000 7f49637fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f49640af680 0x7f496415e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:58.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.576+0000 7f49637fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f49640af680 0x7f496415e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47564/0 (socket says 172.21.15.8:47564) 2023-10-06T04:37:58.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.576+0000 7f49637fe700 1 -- 172.21.15.8:0/1366255938 learned_addr learned my addr 172.21.15.8:0/1366255938 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:58.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.576+0000 7f49637fe700 1 -- 172.21.15.8:0/1366255938 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49640cb360 msgr2=0x7f49640d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:58.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.576+0000 7f4962ffd700 1 --2- 172.21.15.8:0/1366255938 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49640cb360 0x7f49640d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:58.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.576+0000 7f49637fe700 1 --2- 172.21.15.8:0/1366255938 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49640cb360 0x7f49640d0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:58.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.576+0000 7f49637fe700 1 -- 172.21.15.8:0/1366255938 >> v1:172.21.15.184:6789/0 conn(0x7f49640d08d0 legacy=0x7f49640b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:58.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.576+0000 7f49637fe700 1 -- 172.21.15.8:0/1366255938 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496415e580 con 0x7f49640af680 2023-10-06T04:37:58.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.576+0000 7f49637fe700 1 --2- 172.21.15.8:0/1366255938 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49640af680 0x7f496415e040 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f49540099e0 tx=0x7f4954009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e450e96ce6d9bb31 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:58.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.576+0000 7f49627fc700 1 -- 172.21.15.8:0/1366255938 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495400b7e0 con 0x7f49640af680 2023-10-06T04:37:58.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.576+0000 7f49627fc700 1 -- 172.21.15.8:0/1366255938 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495400b940 con 0x7f49640af680 2023-10-06T04:37:58.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.576+0000 7f49627fc700 1 -- 172.21.15.8:0/1366255938 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495400bce0 con 0x7f49640af680 2023-10-06T04:37:58.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.577+0000 7f496a09c700 1 -- 172.21.15.8:0/1366255938 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49640af680 msgr2=0x7f496415e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:58.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.577+0000 7f496a09c700 1 --2- 172.21.15.8:0/1366255938 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49640af680 0x7f496415e040 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f49540099e0 tx=0x7f4954009250 comp rx=0 tx=0).stop 2023-10-06T04:37:58.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.577+0000 7f496a09c700 1 -- 172.21.15.8:0/1366255938 shutdown_connections 2023-10-06T04:37:58.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.577+0000 7f496a09c700 1 --2- 172.21.15.8:0/1366255938 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49640af680 0x7f496415e040 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:58.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.577+0000 7f496a09c700 1 --2- 172.21.15.8:0/1366255938 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49640cb360 0x7f49640d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:58.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.577+0000 7f496a09c700 1 -- 172.21.15.8:0/1366255938 >> 172.21.15.8:0/1366255938 conn(0x7f49640633d0 msgr2=0x7f49640637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:58.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.577+0000 7f496a09c700 1 -- 172.21.15.8:0/1366255938 shutdown_connections 2023-10-06T04:37:58.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.577+0000 7f496a09c700 1 -- 172.21.15.8:0/1366255938 wait complete. 2023-10-06T04:37:58.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.578+0000 7f496a09c700 1 Processor -- start 2023-10-06T04:37:58.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.578+0000 7f496a09c700 1 -- start start 2023-10-06T04:37:58.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.579+0000 7f496a09c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49640af680 0x7f49640c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:58.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.579+0000 7f496a09c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49640cb360 0x7f49640ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:58.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.579+0000 7f496a09c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49640d08d0 0x7f496414dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:58.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.579+0000 7f496a09c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49640c9e60 con 0x7f49640cb360 2023-10-06T04:37:58.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.579+0000 7f496a09c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49640c9250 con 0x7f49640af680 2023-10-06T04:37:58.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.579+0000 7f496a09c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49640c9530 con 0x7f49640d08d0 2023-10-06T04:37:58.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.579+0000 7f4962ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49640cb360 0x7f49640ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:58.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.579+0000 7f4962ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49640cb360 0x7f49640ca2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47574/0 (socket says 172.21.15.8:47574) 2023-10-06T04:37:58.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.579+0000 7f4962ffd700 1 -- 172.21.15.8:0/3639390769 learned_addr learned my addr 172.21.15.8:0/3639390769 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:58.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.579+0000 7f49637fe700 1 --2- 172.21.15.8:0/3639390769 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49640af680 0x7f49640c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:58.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.579+0000 7f4963fff700 1 --2- 172.21.15.8:0/3639390769 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49640d08d0 0x7f496414dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:58.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.580+0000 7f4962ffd700 1 -- 172.21.15.8:0/3639390769 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49640d08d0 msgr2=0x7f496414dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:58.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.580+0000 7f4962ffd700 1 --2- 172.21.15.8:0/3639390769 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49640d08d0 0x7f496414dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:58.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.580+0000 7f4962ffd700 1 -- 172.21.15.8:0/3639390769 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49640af680 msgr2=0x7f49640c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:58.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.580+0000 7f4962ffd700 1 --2- 172.21.15.8:0/3639390769 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49640af680 0x7f49640c8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:58.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.580+0000 7f4962ffd700 1 -- 172.21.15.8:0/3639390769 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49540094f0 con 0x7f49640cb360 2023-10-06T04:37:58.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.580+0000 7f4962ffd700 1 --2- 172.21.15.8:0/3639390769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49640cb360 0x7f49640ca2f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f495800c7d0 tx=0x7f4958008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:58.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.580+0000 7f494b7fe700 1 -- 172.21.15.8:0/3639390769 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4958011600 con 0x7f49640cb360 2023-10-06T04:37:58.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.580+0000 7f494b7fe700 1 -- 172.21.15.8:0/3639390769 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4958011760 con 0x7f49640cb360 2023-10-06T04:37:58.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.580+0000 7f496a09c700 1 -- 172.21.15.8:0/3639390769 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49640c9810 con 0x7f49640cb360 2023-10-06T04:37:58.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.580+0000 7f494b7fe700 1 -- 172.21.15.8:0/3639390769 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4958011b20 con 0x7f49640cb360 2023-10-06T04:37:58.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.580+0000 7f496a09c700 1 -- 172.21.15.8:0/3639390769 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f496414e0e0 con 0x7f49640cb360 2023-10-06T04:37:58.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.581+0000 7f496a09c700 1 -- 172.21.15.8:0/3639390769 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49640ca010 con 0x7f49640cb360 2023-10-06T04:37:58.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.581+0000 7f494b7fe700 1 -- 172.21.15.8:0/3639390769 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f49580193f0 con 0x7f49640cb360 2023-10-06T04:37:58.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.582+0000 7f494b7fe700 1 --2- 172.21.15.8:0/3639390769 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4950066f30 0x7f49500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:58.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.582+0000 7f494b7fe700 1 -- 172.21.15.8:0/3639390769 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6479+0+0 (secure 0 0 0) 0x7f4958084b60 con 0x7f49640cb360 2023-10-06T04:37:58.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.582+0000 7f49637fe700 1 --2- 172.21.15.8:0/3639390769 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4950066f30 0x7f49500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:58.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.582+0000 7f49637fe700 1 --2- 172.21.15.8:0/3639390769 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4950066f30 0x7f49500693e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f49540099e0 tx=0x7f4954016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:58.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.586+0000 7f494b7fe700 1 -- 172.21.15.8:0/3639390769 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49640ca010 con 0x7f49640cb360 2023-10-06T04:37:58.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.783+0000 7f496a09c700 1 -- 172.21.15.8:0/3639390769 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4964071550 con 0x7f49640cb360 2023-10-06T04:37:58.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.784+0000 7f494b7fe700 1 -- 172.21.15.8:0/3639390769 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+17165 (secure 0 0 0) 0x7f4958055560 con 0x7f49640cb360 2023-10-06T04:37:58.787 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:37:58.787 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":47,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:37:54.863783+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:36:10.148177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:36:10.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T04:37:15.902657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}}},{"pool":8,"pool_name":"recovery_fs_metadata","create_time":"2023-10-06T04:37:28.524294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}}}],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.555871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.490505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.504578+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.517217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:05.991135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.537329+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.543232+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.443715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6835/3478733664":"2023-10-07T04:37:26.044067+0000","172.21.15.8:6833/3478733664":"2023-10-07T04:37:26.044067+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:37:58.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.786+0000 7f496a09c700 1 -- 172.21.15.8:0/3639390769 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4950066f30 msgr2=0x7f49500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:58.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.786+0000 7f496a09c700 1 --2- 172.21.15.8:0/3639390769 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4950066f30 0x7f49500693e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f49540099e0 tx=0x7f4954016000 comp rx=0 tx=0).stop 2023-10-06T04:37:58.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.786+0000 7f496a09c700 1 -- 172.21.15.8:0/3639390769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49640cb360 msgr2=0x7f49640ca2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:58.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.786+0000 7f496a09c700 1 --2- 172.21.15.8:0/3639390769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49640cb360 0x7f49640ca2f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f495800c7d0 tx=0x7f4958008040 comp rx=0 tx=0).stop 2023-10-06T04:37:58.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.786+0000 7f496a09c700 1 -- 172.21.15.8:0/3639390769 shutdown_connections 2023-10-06T04:37:58.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.786+0000 7f496a09c700 1 --2- 172.21.15.8:0/3639390769 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4950066f30 0x7f49500693e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:58.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.786+0000 7f496a09c700 1 --2- 172.21.15.8:0/3639390769 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49640d08d0 0x7f496414dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:58.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.786+0000 7f496a09c700 1 --2- 172.21.15.8:0/3639390769 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49640af680 0x7f49640c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:58.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.786+0000 7f496a09c700 1 --2- 172.21.15.8:0/3639390769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49640cb360 0x7f49640ca2f0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:58.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.786+0000 7f496a09c700 1 -- 172.21.15.8:0/3639390769 >> 172.21.15.8:0/3639390769 conn(0x7f49640633d0 msgr2=0x7f49640cf840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:58.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.786+0000 7f496a09c700 1 -- 172.21.15.8:0/3639390769 shutdown_connections 2023-10-06T04:37:58.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.786+0000 7f496a09c700 1 -- 172.21.15.8:0/3639390769 wait complete. 2023-10-06T04:37:58.803 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail recovery_fs 2023-10-06T04:37:58.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.921+0000 7ff5dba83700 1 Processor -- start 2023-10-06T04:37:58.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.922+0000 7ff5dba83700 1 -- start start 2023-10-06T04:37:58.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.922+0000 7ff5dba83700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5d4153aa0 0x7ff5d40c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:58.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.922+0000 7ff5dba83700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff5d40c8ce0 0x7ff5d4159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:58.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.922+0000 7ff5dba83700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff5d4159fc0 0x7ff5d406cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:58.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.922+0000 7ff5dba83700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d415aad0 con 0x7ff5d4159fc0 2023-10-06T04:37:58.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.922+0000 7ff5dba83700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d4068e60 con 0x7ff5d40c8ce0 2023-10-06T04:37:58.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.922+0000 7ff5dba83700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d415a7f0 con 0x7ff5d4153aa0 2023-10-06T04:37:58.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.922+0000 7ff5da020700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff5d4159fc0 0x7ff5d406cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:58.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.923+0000 7ff5da020700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff5d4159fc0 0x7ff5d406cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47584/0 (socket says 172.21.15.8:47584) 2023-10-06T04:37:58.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.923+0000 7ff5da020700 1 -- 172.21.15.8:0/2435503455 learned_addr learned my addr 172.21.15.8:0/2435503455 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:58.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.923+0000 7ff5d901e700 1 --2- 172.21.15.8:0/2435503455 >> v2:172.21.15.184:3300/0 conn(0x7ff5d40c8ce0 0x7ff5d4159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:58.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.923+0000 7ff5d981f700 1 --2- 172.21.15.8:0/2435503455 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5d4153aa0 0x7ff5d40c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:58.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.923+0000 7ff5da020700 1 -- 172.21.15.8:0/2435503455 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5d4153aa0 msgr2=0x7ff5d40c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:58.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.923+0000 7ff5da020700 1 --2- 172.21.15.8:0/2435503455 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5d4153aa0 0x7ff5d40c87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:58.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.923+0000 7ff5da020700 1 -- 172.21.15.8:0/2435503455 >> v2:172.21.15.184:3300/0 conn(0x7ff5d40c8ce0 msgr2=0x7ff5d4159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:58.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.923+0000 7ff5da020700 1 --2- 172.21.15.8:0/2435503455 >> v2:172.21.15.184:3300/0 conn(0x7ff5d40c8ce0 0x7ff5d4159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:58.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.923+0000 7ff5da020700 1 -- 172.21.15.8:0/2435503455 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d4068810 con 0x7ff5d4159fc0 2023-10-06T04:37:58.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.923+0000 7ff5da020700 1 --2- 172.21.15.8:0/2435503455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5d4159fc0 0x7ff5d406cbb0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff5d406f250 tx=0x7ff5c4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=566e082a49fd7b0a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:58.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.923+0000 7ff5d881d700 1 -- 172.21.15.8:0/2435503455 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c400e070 con 0x7ff5d4159fc0 2023-10-06T04:37:58.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.923+0000 7ff5d881d700 1 -- 172.21.15.8:0/2435503455 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c400ba50 con 0x7ff5d4159fc0 2023-10-06T04:37:58.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.923+0000 7ff5d881d700 1 -- 172.21.15.8:0/2435503455 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c40092e0 con 0x7ff5d4159fc0 2023-10-06T04:37:58.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.924+0000 7ff5dba83700 1 -- 172.21.15.8:0/2435503455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5d4159fc0 msgr2=0x7ff5d406cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:58.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.924+0000 7ff5dba83700 1 --2- 172.21.15.8:0/2435503455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5d4159fc0 0x7ff5d406cbb0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff5d406f250 tx=0x7ff5c4009840 comp rx=0 tx=0).stop 2023-10-06T04:37:58.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.924+0000 7ff5dba83700 1 -- 172.21.15.8:0/2435503455 shutdown_connections 2023-10-06T04:37:58.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.924+0000 7ff5dba83700 1 --2- 172.21.15.8:0/2435503455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5d4159fc0 0x7ff5d406cbb0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:58.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.924+0000 7ff5dba83700 1 --2- 172.21.15.8:0/2435503455 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5d4153aa0 0x7ff5d40c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:58.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.924+0000 7ff5dba83700 1 --2- 172.21.15.8:0/2435503455 >> v2:172.21.15.184:3300/0 conn(0x7ff5d40c8ce0 0x7ff5d4159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:58.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.924+0000 7ff5dba83700 1 -- 172.21.15.8:0/2435503455 >> 172.21.15.8:0/2435503455 conn(0x7ff5d40ce200 msgr2=0x7ff5d40ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:58.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.924+0000 7ff5dba83700 1 -- 172.21.15.8:0/2435503455 shutdown_connections 2023-10-06T04:37:58.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.924+0000 7ff5dba83700 1 -- 172.21.15.8:0/2435503455 wait complete. 2023-10-06T04:37:58.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.925+0000 7ff5dba83700 1 Processor -- start 2023-10-06T04:37:58.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.925+0000 7ff5dba83700 1 -- start start 2023-10-06T04:37:58.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.926+0000 7ff5dba83700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5d40c8ce0 0x7ff5d415e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:58.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.926+0000 7ff5dba83700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5d4153aa0 0x7ff5d4151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:58.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.926+0000 7ff5dba83700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5d4159fc0 0x7ff5d40cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:58.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.926+0000 7ff5dba83700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d40c43c0 con 0x7ff5d4153aa0 2023-10-06T04:37:58.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.926+0000 7ff5dba83700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d415d250 con 0x7ff5d40c8ce0 2023-10-06T04:37:58.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.926+0000 7ff5dba83700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d4152350 con 0x7ff5d4159fc0 2023-10-06T04:37:58.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.926+0000 7ff5d901e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5d4153aa0 0x7ff5d4151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:58.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.926+0000 7ff5d901e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5d4153aa0 0x7ff5d4151730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47592/0 (socket says 172.21.15.8:47592) 2023-10-06T04:37:58.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.926+0000 7ff5d901e700 1 -- 172.21.15.8:0/778696730 learned_addr learned my addr 172.21.15.8:0/778696730 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:58.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.926+0000 7ff5d981f700 1 --2- 172.21.15.8:0/778696730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5d40c8ce0 0x7ff5d415e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:58.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.926+0000 7ff5da020700 1 --2- 172.21.15.8:0/778696730 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5d4159fc0 0x7ff5d40cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:58.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.926+0000 7ff5d901e700 1 -- 172.21.15.8:0/778696730 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5d4159fc0 msgr2=0x7ff5d40cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:58.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.926+0000 7ff5d901e700 1 --2- 172.21.15.8:0/778696730 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5d4159fc0 0x7ff5d40cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:58.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.926+0000 7ff5d901e700 1 -- 172.21.15.8:0/778696730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5d40c8ce0 msgr2=0x7ff5d415e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:58.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.926+0000 7ff5d901e700 1 --2- 172.21.15.8:0/778696730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5d40c8ce0 0x7ff5d415e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:58.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.926+0000 7ff5d901e700 1 -- 172.21.15.8:0/778696730 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c4009ae0 con 0x7ff5d4153aa0 2023-10-06T04:37:58.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.926+0000 7ff5d981f700 1 --2- 172.21.15.8:0/778696730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5d40c8ce0 0x7ff5d415e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:58.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.926+0000 7ff5d901e700 1 --2- 172.21.15.8:0/778696730 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5d4153aa0 0x7ff5d4151730 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff5c800d860 tx=0x7ff5c8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:58.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.926+0000 7ff5d1ffb700 1 -- 172.21.15.8:0/778696730 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c80125f0 con 0x7ff5d4153aa0 2023-10-06T04:37:58.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.926+0000 7ff5d1ffb700 1 -- 172.21.15.8:0/778696730 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c8012750 con 0x7ff5d4153aa0 2023-10-06T04:37:58.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.926+0000 7ff5dba83700 1 -- 172.21.15.8:0/778696730 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d415aec0 con 0x7ff5d4153aa0 2023-10-06T04:37:58.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.927+0000 7ff5d1ffb700 1 -- 172.21.15.8:0/778696730 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c8012b10 con 0x7ff5d4153aa0 2023-10-06T04:37:58.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.927+0000 7ff5dba83700 1 -- 172.21.15.8:0/778696730 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d40c40e0 con 0x7ff5d4153aa0 2023-10-06T04:37:58.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.928+0000 7ff5dba83700 1 -- 172.21.15.8:0/778696730 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d415b050 con 0x7ff5d4153aa0 2023-10-06T04:37:58.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.928+0000 7ff5d1ffb700 1 -- 172.21.15.8:0/778696730 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff5c801e460 con 0x7ff5d4153aa0 2023-10-06T04:37:58.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.928+0000 7ff5d1ffb700 1 --2- 172.21.15.8:0/778696730 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff5c0066f30 0x7ff5c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:58.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.928+0000 7ff5d1ffb700 1 -- 172.21.15.8:0/778696730 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6479+0+0 (secure 0 0 0) 0x7ff5c8084dd0 con 0x7ff5d4153aa0 2023-10-06T04:37:58.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.929+0000 7ff5d981f700 1 --2- 172.21.15.8:0/778696730 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff5c0066f30 0x7ff5c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:58.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.929+0000 7ff5d981f700 1 --2- 172.21.15.8:0/778696730 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff5c0066f30 0x7ff5c00693e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc006fd0 tx=0x7ff5cc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:58.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:58.933+0000 7ff5d1ffb700 1 -- 172.21.15.8:0/778696730 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5c8051d40 con 0x7ff5d4153aa0 2023-10-06T04:37:59.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.171+0000 7ff5dba83700 1 -- 172.21.15.8:0/778696730 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "recovery_fs"} v 0) v1 -- 0x7ff5d4071550 con 0x7ff5d4153aa0 2023-10-06T04:37:59.174 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-06T04:37:59.172+0000 7f590ad7d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T04:37:59.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.176+0000 7ff5d1ffb700 1 -- 172.21.15.8:0/778696730 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "recovery_fs"}]=0 recovery_fs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) v1 ==== 171+0+0 (secure 0 0 0) 0x7ff5c8086020 con 0x7ff5d4153aa0 2023-10-06T04:37:59.179 INFO:tasks.ceph.mds.a.smithi008.stderr: -3628> 2023-10-06T04:37:40.822+0000 7f592e8a3700 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2023-10-06T04:37:59.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.178+0000 7ff5dba83700 1 -- 172.21.15.8:0/778696730 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff5c0066f30 msgr2=0x7ff5c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:59.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.178+0000 7ff5dba83700 1 --2- 172.21.15.8:0/778696730 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff5c0066f30 0x7ff5c00693e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc006fd0 tx=0x7ff5cc008040 comp rx=0 tx=0).stop 2023-10-06T04:37:59.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.178+0000 7ff5dba83700 1 -- 172.21.15.8:0/778696730 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5d4153aa0 msgr2=0x7ff5d4151730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:59.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.178+0000 7ff5dba83700 1 --2- 172.21.15.8:0/778696730 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5d4153aa0 0x7ff5d4151730 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff5c800d860 tx=0x7ff5c8008040 comp rx=0 tx=0).stop 2023-10-06T04:37:59.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.178+0000 7ff5dba83700 1 -- 172.21.15.8:0/778696730 shutdown_connections 2023-10-06T04:37:59.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.178+0000 7ff5dba83700 1 --2- 172.21.15.8:0/778696730 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff5c0066f30 0x7ff5c00693e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:59.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.178+0000 7ff5dba83700 1 --2- 172.21.15.8:0/778696730 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5d4159fc0 0x7ff5d40cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:59.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.178+0000 7ff5dba83700 1 --2- 172.21.15.8:0/778696730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5d40c8ce0 0x7ff5d415e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:59.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.178+0000 7ff5dba83700 1 --2- 172.21.15.8:0/778696730 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5d4153aa0 0x7ff5d4151730 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:59.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.178+0000 7ff5dba83700 1 -- 172.21.15.8:0/778696730 >> 172.21.15.8:0/778696730 conn(0x7ff5d40ce200 msgr2=0x7ff5d406d440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:59.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.178+0000 7ff5dba83700 1 -- 172.21.15.8:0/778696730 shutdown_connections 2023-10-06T04:37:59.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.178+0000 7ff5dba83700 1 -- 172.21.15.8:0/778696730 wait complete. 2023-10-06T04:37:59.182 INFO:tasks.ceph.mds.a.smithi008.stderr: -2032> 2023-10-06T04:37:45.901+0000 7f592e8a3700 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000000 2023-10-06T04:37:59.183 INFO:tasks.ceph.mds.a.smithi008.stderr: -1844> 2023-10-06T04:37:45.902+0000 7f592e8a3700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /subdir/ auth v1 pv4 ap=3 DIRTYPARENT f(v0 1=1+0) n() (inest lock dirty) (ifile lock->sync w=1 flushing) (iversion lock) | dirtyscattered=2 lock=1 dirfrag=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x563a0179ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000000:[<0x1/subdir v1>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 1=1+0)","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 1=1+0)","memory_value.rstat":"n()","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-61} 2023-10-06T04:37:59.183 INFO:teuthology.orchestra.run.smithi008.stderr:recovery_fs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T04:37:59.183 INFO:tasks.ceph.mds.a.smithi008.stderr: -1826> 2023-10-06T04:37:45.902+0000 7f592e8a3700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/sixmegs auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x563a01801080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(7)0x10000000001:[<0x10000000000/sixmegs v10>,<0x1/subdir v12>]//[]","memoryvalue":"(7)0x10000000001:[<0x10000000000/sixmegs v1>,<0x1/subdir v1>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-06T04:37:59.183 INFO:tasks.ceph.mds.a.smithi008.stderr: -1586> 2023-10-06T04:37:45.906+0000 7f592e8a3700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1 [...2,head] / auth v4 ap=5 snaprealm=0x563a009fb000 DIRTYPARENT f(v1 1=0+1) n(v0 1=0+1)/n() (idft sync r=1) (inest sync r=1) (ifile sync->mix r=1) (iversion lock) | dirtyscattered=0 lock=3 dirfrag=1 openingsnapparents=0 dirtyparent=1 dirty=1 waiter=1 authpin=1 scrubqueue=0 0x563a0179a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x1:[]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 1=0+1)","ondisk_value.rstat":"n(v0 2=0+2)","memory_value.dirstat":"f(v1 1=0+1)","memory_value.rstat":"n(v0 1=0+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-61} 2023-10-06T04:37:59.184 INFO:tasks.ceph.mds.a.smithi008.stderr: -1295> 2023-10-06T04:37:47.054+0000 7f59320aa700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T04:37:59.193 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm recovery_fs --yes-i-really-mean-it 2023-10-06T04:37:59.205 INFO:tasks.ceph.mds.a.smithi008.stdout:starting mds.a at 2023-10-06T04:37:59.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.313+0000 7fb20be21700 1 Processor -- start 2023-10-06T04:37:59.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.313+0000 7fb20be21700 1 -- start start 2023-10-06T04:37:59.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.314+0000 7fb20be21700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2040b3790 0x7fb2040b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:59.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.314+0000 7fb20be21700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2040cf510 con 0x7fb2041430c0 2023-10-06T04:37:59.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.314+0000 7fb20be21700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2040ce6a0 con 0x7fb204142cf0 2023-10-06T04:37:59.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.314+0000 7fb20be21700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2040b4110 con 0x7fb2040b3790 2023-10-06T04:37:59.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.314+0000 7fb2093bc700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fb2041430c0 0x7fb2040cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34624/0 (socket says 172.21.15.8:34624) 2023-10-06T04:37:59.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.314+0000 7fb2093bc700 1 -- 172.21.15.8:0/2620164553 learned_addr learned my addr 172.21.15.8:0/2620164553 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:37:59.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.314+0000 7fb208bbb700 1 -- 172.21.15.8:0/2620164553 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3207457814 0 0) 0x7fb2040cf510 con 0x7fb2041430c0 2023-10-06T04:37:59.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.314+0000 7fb20a3be700 1 --2- 172.21.15.8:0/2620164553 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2040b3790 0x7fb2040b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:59.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.314+0000 7fb208bbb700 1 -- 172.21.15.8:0/2620164553 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1f0003570 con 0x7fb2041430c0 2023-10-06T04:37:59.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.314+0000 7fb208bbb700 1 -- 172.21.15.8:0/2620164553 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3414122036 0 0) 0x7fb1f0003570 con 0x7fb2041430c0 2023-10-06T04:37:59.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.314+0000 7fb208bbb700 1 -- 172.21.15.8:0/2620164553 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2040b3790 msgr2=0x7fb2040b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:59.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.314+0000 7fb208bbb700 1 --2- 172.21.15.8:0/2620164553 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2040b3790 0x7fb2040b3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:59.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.314+0000 7fb208bbb700 1 -- 172.21.15.8:0/2620164553 >> v1:172.21.15.184:6789/0 conn(0x7fb204142cf0 legacy=0x7fb2040b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:59.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.314+0000 7fb208bbb700 1 -- 172.21.15.8:0/2620164553 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2040ce900 con 0x7fb2041430c0 2023-10-06T04:37:59.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.314+0000 7fb208bbb700 1 -- 172.21.15.8:0/2620164553 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7fb1f4001470 con 0x7fb2041430c0 2023-10-06T04:37:59.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.314+0000 7fb208bbb700 1 -- 172.21.15.8:0/2620164553 >> v1:172.21.15.8:6789/0 conn(0x7fb2041430c0 legacy=0x7fb2040cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:59.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.314+0000 7fb208bbb700 1 --2- 172.21.15.8:0/2620164553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1f0003a90 0x7fb1f0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:59.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.314+0000 7fb208bbb700 1 --2- 172.21.15.8:0/2620164553 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2040b3790 0x7fb1f0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:59.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.314+0000 7fb208bbb700 1 --2- 172.21.15.8:0/2620164553 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1f0004d50 0x7fb1f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:59.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.314+0000 7fb208bbb700 1 -- 172.21.15.8:0/2620164553 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2040b4110 con 0x7fb1f0003a90 2023-10-06T04:37:59.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.314+0000 7fb208bbb700 1 -- 172.21.15.8:0/2620164553 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f000bb70 con 0x7fb1f0004d50 2023-10-06T04:37:59.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.314+0000 7fb208bbb700 1 -- 172.21.15.8:0/2620164553 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f000bd30 con 0x7fb2040b3790 2023-10-06T04:37:59.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.315+0000 7fb209bbd700 1 --2- 172.21.15.8:0/2620164553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1f0003a90 0x7fb1f0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:59.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.315+0000 7fb2093bc700 1 --2- 172.21.15.8:0/2620164553 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2040b3790 0x7fb1f0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:59.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.315+0000 7fb20a3be700 1 --2- 172.21.15.8:0/2620164553 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1f0004d50 0x7fb1f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:59.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.315+0000 7fb209bbd700 1 -- 172.21.15.8:0/2620164553 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2040b3790 msgr2=0x7fb1f0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:59.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.315+0000 7fb209bbd700 1 --2- 172.21.15.8:0/2620164553 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2040b3790 0x7fb1f0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:59.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.315+0000 7fb209bbd700 1 -- 172.21.15.8:0/2620164553 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1f0004d50 msgr2=0x7fb1f00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:37:59.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.315+0000 7fb209bbd700 1 --2- 172.21.15.8:0/2620164553 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1f0004d50 0x7fb1f00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:59.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.315+0000 7fb209bbd700 1 -- 172.21.15.8:0/2620164553 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f0003570 con 0x7fb1f0003a90 2023-10-06T04:37:59.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.315+0000 7fb20a3be700 1 --2- 172.21.15.8:0/2620164553 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1f0004d50 0x7fb1f00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:59.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.315+0000 7fb209bbd700 1 --2- 172.21.15.8:0/2620164553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1f0003a90 0x7fb1f0003ea0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fb2000018b0 tx=0x7fb200007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5281b34b383ed18e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:59.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.315+0000 7fb208bbb700 1 -- 172.21.15.8:0/2620164553 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb200012420 con 0x7fb1f0003a90 2023-10-06T04:37:59.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.315+0000 7fb208bbb700 1 -- 172.21.15.8:0/2620164553 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb200012580 con 0x7fb1f0003a90 2023-10-06T04:37:59.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.315+0000 7fb208bbb700 1 -- 172.21.15.8:0/2620164553 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb200012920 con 0x7fb1f0003a90 2023-10-06T04:37:59.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.316+0000 7fb20be21700 1 -- 172.21.15.8:0/2620164553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1f0003a90 msgr2=0x7fb1f0003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:59.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.316+0000 7fb20be21700 1 --2- 172.21.15.8:0/2620164553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1f0003a90 0x7fb1f0003ea0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fb2000018b0 tx=0x7fb200007d30 comp rx=0 tx=0).stop 2023-10-06T04:37:59.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.316+0000 7fb20a3be700 1 -- 172.21.15.8:0/2620164553 reap_dead start 2023-10-06T04:37:59.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.316+0000 7fb20be21700 1 -- 172.21.15.8:0/2620164553 shutdown_connections 2023-10-06T04:37:59.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.316+0000 7fb20be21700 1 -- 172.21.15.8:0/2620164553 >> 172.21.15.8:0/2620164553 conn(0x7fb20406ed00 msgr2=0x7fb20406f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:37:59.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.316+0000 7fb20be21700 1 -- 172.21.15.8:0/2620164553 shutdown_connections 2023-10-06T04:37:59.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.316+0000 7fb20be21700 1 -- 172.21.15.8:0/2620164553 wait complete. 2023-10-06T04:37:59.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.317+0000 7fb20be21700 1 Processor -- start 2023-10-06T04:37:59.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.317+0000 7fb20be21700 1 -- start start 2023-10-06T04:37:59.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.318+0000 7fb20be21700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1f0003a90 0x7fb20416a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:59.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.318+0000 7fb20be21700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb20415b820 0x7fb204140870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:59.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.318+0000 7fb20be21700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb204140db0 0x7fb2040cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:59.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.318+0000 7fb20be21700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20415a950 con 0x7fb204140db0 2023-10-06T04:37:59.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.318+0000 7fb20be21700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20416aa70 con 0x7fb1f0003a90 2023-10-06T04:37:59.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.318+0000 7fb20be21700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb204159cd0 con 0x7fb20415b820 2023-10-06T04:37:59.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.318+0000 7fb20a3be700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb204140db0 0x7fb2040cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:59.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.318+0000 7fb20a3be700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb204140db0 0x7fb2040cfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47624/0 (socket says 172.21.15.8:47624) 2023-10-06T04:37:59.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.318+0000 7fb20a3be700 1 -- 172.21.15.8:0/2686821873 learned_addr learned my addr 172.21.15.8:0/2686821873 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:37:59.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.318+0000 7fb2093bc700 1 --2- 172.21.15.8:0/2686821873 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb20415b820 0x7fb204140870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:59.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.318+0000 7fb209bbd700 1 --2- 172.21.15.8:0/2686821873 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1f0003a90 0x7fb20416a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:59.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.318+0000 7fb20a3be700 1 -- 172.21.15.8:0/2686821873 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb20415b820 msgr2=0x7fb204140870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:59.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.318+0000 7fb20a3be700 1 --2- 172.21.15.8:0/2686821873 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb20415b820 0x7fb204140870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:59.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.318+0000 7fb20a3be700 1 -- 172.21.15.8:0/2686821873 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1f0003a90 msgr2=0x7fb20416a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:37:59.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.318+0000 7fb20a3be700 1 --2- 172.21.15.8:0/2686821873 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1f0003a90 0x7fb20416a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:37:59.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.318+0000 7fb20a3be700 1 -- 172.21.15.8:0/2686821873 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb204159fb0 con 0x7fb204140db0 2023-10-06T04:37:59.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.318+0000 7fb2093bc700 1 --2- 172.21.15.8:0/2686821873 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb20415b820 0x7fb204140870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:37:59.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.318+0000 7fb20a3be700 1 --2- 172.21.15.8:0/2686821873 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb204140db0 0x7fb2040cfee0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fb20406fc80 tx=0x7fb1fc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:59.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.318+0000 7fb1f9ffb700 1 -- 172.21.15.8:0/2686821873 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc00e050 con 0x7fb204140db0 2023-10-06T04:37:59.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.318+0000 7fb1f9ffb700 1 -- 172.21.15.8:0/2686821873 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1fc00f040 con 0x7fb204140db0 2023-10-06T04:37:59.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.318+0000 7fb20be21700 1 -- 172.21.15.8:0/2686821873 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb20415a290 con 0x7fb204140db0 2023-10-06T04:37:59.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.318+0000 7fb1f9ffb700 1 -- 172.21.15.8:0/2686821873 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc010e60 con 0x7fb204140db0 2023-10-06T04:37:59.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.319+0000 7fb20be21700 1 -- 172.21.15.8:0/2686821873 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2040d0420 con 0x7fb204140db0 2023-10-06T04:37:59.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.320+0000 7fb20be21700 1 -- 172.21.15.8:0/2686821873 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb20415aa90 con 0x7fb204140db0 2023-10-06T04:37:59.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.320+0000 7fb1f9ffb700 1 -- 172.21.15.8:0/2686821873 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb1fc003020 con 0x7fb204140db0 2023-10-06T04:37:59.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.321+0000 7fb1f9ffb700 1 --2- 172.21.15.8:0/2686821873 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb1e8066f60 0x7fb1e8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:37:59.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.321+0000 7fb1f9ffb700 1 -- 172.21.15.8:0/2686821873 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb1fc084bc0 con 0x7fb204140db0 2023-10-06T04:37:59.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.321+0000 7fb209bbd700 1 --2- 172.21.15.8:0/2686821873 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb1e8066f60 0x7fb1e8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:37:59.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.321+0000 7fb209bbd700 1 --2- 172.21.15.8:0/2686821873 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb1e8066f60 0x7fb1e8069410 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb200001010 tx=0x7fb200015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:37:59.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.325+0000 7fb1f9ffb700 1 -- 172.21.15.8:0/2686821873 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb20415aa90 con 0x7fb204140db0 2023-10-06T04:37:59.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:37:59.561+0000 7fb20be21700 1 -- 172.21.15.8:0/2686821873 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "recovery_fs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb20415aa90 con 0x7fb204140db0 2023-10-06T04:38:00.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.176+0000 7fb1f9ffb700 1 -- 172.21.15.8:0/2686821873 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "recovery_fs", "yes_i_really_mean_it": true}]=0 v32) v1 ==== 109+0+0 (secure 0 0 0) 0x7fb20415aa90 con 0x7fb204140db0 2023-10-06T04:38:00.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.179+0000 7fb20be21700 1 -- 172.21.15.8:0/2686821873 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb1e8066f60 msgr2=0x7fb1e8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:00.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.179+0000 7fb20be21700 1 --2- 172.21.15.8:0/2686821873 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb1e8066f60 0x7fb1e8069410 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb200001010 tx=0x7fb200015000 comp rx=0 tx=0).stop 2023-10-06T04:38:00.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.179+0000 7fb20be21700 1 -- 172.21.15.8:0/2686821873 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb204140db0 msgr2=0x7fb2040cfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:00.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.179+0000 7fb20be21700 1 --2- 172.21.15.8:0/2686821873 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb204140db0 0x7fb2040cfee0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fb20406fc80 tx=0x7fb1fc00b040 comp rx=0 tx=0).stop 2023-10-06T04:38:00.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.179+0000 7fb20be21700 1 -- 172.21.15.8:0/2686821873 shutdown_connections 2023-10-06T04:38:00.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.179+0000 7fb20be21700 1 --2- 172.21.15.8:0/2686821873 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb1e8066f60 0x7fb1e8069410 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:00.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.179+0000 7fb20be21700 1 --2- 172.21.15.8:0/2686821873 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb204140db0 0x7fb2040cfee0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:00.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.179+0000 7fb20be21700 1 --2- 172.21.15.8:0/2686821873 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1f0003a90 0x7fb20416a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:00.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.179+0000 7fb20be21700 1 --2- 172.21.15.8:0/2686821873 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb20415b820 0x7fb204140870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:00.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.179+0000 7fb20be21700 1 -- 172.21.15.8:0/2686821873 >> 172.21.15.8:0/2686821873 conn(0x7fb20406ed00 msgr2=0x7fb204158b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:00.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.179+0000 7fb20be21700 1 -- 172.21.15.8:0/2686821873 shutdown_connections 2023-10-06T04:38:00.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.179+0000 7fb20be21700 1 -- 172.21.15.8:0/2686821873 wait complete. 2023-10-06T04:38:00.196 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm recovery_fs_metadata recovery_fs_metadata --yes-i-really-really-mean-it 2023-10-06T04:38:00.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.362+0000 7fe1b4823700 1 Processor -- start 2023-10-06T04:38:00.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.362+0000 7fe1b4823700 1 -- start start 2023-10-06T04:38:00.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.363+0000 7fe1b4823700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe1b00cd530 0x7fe1b015d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:00.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.363+0000 7fe1b4823700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe1b00af970 0x7fe1b015a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:00.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.363+0000 7fe1b4823700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b00ce820 con 0x7fe1b00af5a0 2023-10-06T04:38:00.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.363+0000 7fe1b4823700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b015e2d0 con 0x7fe1b00af970 2023-10-06T04:38:00.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.363+0000 7fe1b4823700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b015ad10 con 0x7fe1b00cd530 2023-10-06T04:38:00.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.363+0000 7fe1aed9d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe1b00af970 0x7fe1b015a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:00.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.363+0000 7fe1aed9d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe1b00af970 0x7fe1b015a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47636/0 (socket says 172.21.15.8:47636) 2023-10-06T04:38:00.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.363+0000 7fe1aed9d700 1 -- 172.21.15.8:0/1234231743 learned_addr learned my addr 172.21.15.8:0/1234231743 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:00.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.363+0000 7fe1add9b700 1 --2- 172.21.15.8:0/1234231743 >> v2:172.21.15.184:3300/0 conn(0x7fe1b00cd530 0x7fe1b015d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:00.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.363+0000 7fe1aed9d700 1 -- 172.21.15.8:0/1234231743 >> v2:172.21.15.184:3300/0 conn(0x7fe1b00cd530 msgr2=0x7fe1b015d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:00.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.363+0000 7fe1aed9d700 1 --2- 172.21.15.8:0/1234231743 >> v2:172.21.15.184:3300/0 conn(0x7fe1b00cd530 0x7fe1b015d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:00.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.363+0000 7fe1aed9d700 1 -- 172.21.15.8:0/1234231743 >> v1:172.21.15.184:6789/0 conn(0x7fe1b00af5a0 legacy=0x7fe1b00cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:00.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.363+0000 7fe1aed9d700 1 -- 172.21.15.8:0/1234231743 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b015da30 con 0x7fe1b00af970 2023-10-06T04:38:00.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.364+0000 7fe1aed9d700 1 --2- 172.21.15.8:0/1234231743 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1b00af970 0x7fe1b015a7d0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0089450 tx=0x7fe1a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee60499d2d846508 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:00.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.364+0000 7fe1ad59a700 1 -- 172.21.15.8:0/1234231743 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a8009ea0 con 0x7fe1b00af970 2023-10-06T04:38:00.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.364+0000 7fe1ad59a700 1 -- 172.21.15.8:0/1234231743 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a800b820 con 0x7fe1b00af970 2023-10-06T04:38:00.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.364+0000 7fe1ad59a700 1 -- 172.21.15.8:0/1234231743 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a800bbc0 con 0x7fe1b00af970 2023-10-06T04:38:00.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.364+0000 7fe1b4823700 1 -- 172.21.15.8:0/1234231743 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1b00af970 msgr2=0x7fe1b015a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:00.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.364+0000 7fe1b4823700 1 --2- 172.21.15.8:0/1234231743 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1b00af970 0x7fe1b015a7d0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0089450 tx=0x7fe1a8009250 comp rx=0 tx=0).stop 2023-10-06T04:38:00.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.364+0000 7fe1b4823700 1 -- 172.21.15.8:0/1234231743 shutdown_connections 2023-10-06T04:38:00.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.364+0000 7fe1b4823700 1 --2- 172.21.15.8:0/1234231743 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1b00af970 0x7fe1b015a7d0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:00.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.364+0000 7fe1b4823700 1 --2- 172.21.15.8:0/1234231743 >> v2:172.21.15.184:3300/0 conn(0x7fe1b00cd530 0x7fe1b015d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:00.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.364+0000 7fe1b4823700 1 -- 172.21.15.8:0/1234231743 >> 172.21.15.8:0/1234231743 conn(0x7fe1b006ed00 msgr2=0x7fe1b006f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:00.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.364+0000 7fe1b4823700 1 -- 172.21.15.8:0/1234231743 shutdown_connections 2023-10-06T04:38:00.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.364+0000 7fe1b4823700 1 -- 172.21.15.8:0/1234231743 wait complete. 2023-10-06T04:38:00.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.365+0000 7fe1b4823700 1 Processor -- start 2023-10-06T04:38:00.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.366+0000 7fe1b4823700 1 -- start start 2023-10-06T04:38:00.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.366+0000 7fe1b4823700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1b00af5a0 0x7fe1b014c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:00.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.366+0000 7fe1b4823700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1b00af970 0x7fe1b00c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:00.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.366+0000 7fe1b4823700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1b00cd530 0x7fe1b015c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:00.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.366+0000 7fe1b4823700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b014cf20 con 0x7fe1b00af5a0 2023-10-06T04:38:00.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.366+0000 7fe1b4823700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b0149ec0 con 0x7fe1b00af970 2023-10-06T04:38:00.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.366+0000 7fe1b4823700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b00c8f10 con 0x7fe1b00cd530 2023-10-06T04:38:00.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.366+0000 7fe1ae59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1b00af5a0 0x7fe1b014c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:00.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.366+0000 7fe1ae59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1b00af5a0 0x7fe1b014c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47646/0 (socket says 172.21.15.8:47646) 2023-10-06T04:38:00.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.366+0000 7fe1ae59c700 1 -- 172.21.15.8:0/2741905461 learned_addr learned my addr 172.21.15.8:0/2741905461 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:00.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.367+0000 7fe1add9b700 1 --2- 172.21.15.8:0/2741905461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1b00af970 0x7fe1b00c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:00.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.367+0000 7fe1aed9d700 1 --2- 172.21.15.8:0/2741905461 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1b00cd530 0x7fe1b015c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:00.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.367+0000 7fe1ae59c700 1 -- 172.21.15.8:0/2741905461 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1b00cd530 msgr2=0x7fe1b015c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:00.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.367+0000 7fe1ae59c700 1 --2- 172.21.15.8:0/2741905461 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1b00cd530 0x7fe1b015c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:00.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.367+0000 7fe1ae59c700 1 -- 172.21.15.8:0/2741905461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1b00af970 msgr2=0x7fe1b00c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:00.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.367+0000 7fe1ae59c700 1 --2- 172.21.15.8:0/2741905461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1b00af970 0x7fe1b00c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:00.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.367+0000 7fe1ae59c700 1 -- 172.21.15.8:0/2741905461 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a80094f0 con 0x7fe1b00af5a0 2023-10-06T04:38:00.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.367+0000 7fe1ae59c700 1 --2- 172.21.15.8:0/2741905461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1b00af5a0 0x7fe1b014c9e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000c8e0 tx=0x7fe1a0001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:00.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.367+0000 7fe1a67fc700 1 -- 172.21.15.8:0/2741905461 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a000ce80 con 0x7fe1b00af5a0 2023-10-06T04:38:00.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.367+0000 7fe1a67fc700 1 -- 172.21.15.8:0/2741905461 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a000a7e0 con 0x7fe1b00af5a0 2023-10-06T04:38:00.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.367+0000 7fe1a67fc700 1 -- 172.21.15.8:0/2741905461 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a000aba0 con 0x7fe1b00af5a0 2023-10-06T04:38:00.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.367+0000 7fe1b4823700 1 -- 172.21.15.8:0/2741905461 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b00b41b0 con 0x7fe1b00af5a0 2023-10-06T04:38:00.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.367+0000 7fe1b4823700 1 -- 172.21.15.8:0/2741905461 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b00b4770 con 0x7fe1b00af5a0 2023-10-06T04:38:00.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.368+0000 7fe1b4823700 1 -- 172.21.15.8:0/2741905461 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b0071550 con 0x7fe1b00af5a0 2023-10-06T04:38:00.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.368+0000 7fe1a67fc700 1 -- 172.21.15.8:0/2741905461 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe1a0003030 con 0x7fe1b00af5a0 2023-10-06T04:38:00.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.369+0000 7fe1a67fc700 1 --2- 172.21.15.8:0/2741905461 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe190066f30 0x7fe1900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:00.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.369+0000 7fe1a67fc700 1 -- 172.21.15.8:0/2741905461 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe1a00848f0 con 0x7fe1b00af5a0 2023-10-06T04:38:00.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.369+0000 7fe1add9b700 1 --2- 172.21.15.8:0/2741905461 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe190066f30 0x7fe1900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:00.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.369+0000 7fe1add9b700 1 --2- 172.21.15.8:0/2741905461 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe190066f30 0x7fe1900693e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe1b00aedb0 tx=0x7fe198008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:00.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.373+0000 7fe1a67fc700 1 -- 172.21.15.8:0/2741905461 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe1a0055290 con 0x7fe1b00af5a0 2023-10-06T04:38:00.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:00.569+0000 7fe1b4823700 1 -- 172.21.15.8:0/2741905461 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "recovery_fs_metadata", "pool2": "recovery_fs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe1b00ce210 con 0x7fe1b00af5a0 2023-10-06T04:38:01.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.181+0000 7fe1a67fc700 1 -- 172.21.15.8:0/2741905461 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "recovery_fs_metadata", "pool2": "recovery_fs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'recovery_fs_metadata' removed v49) v1 ==== 196+0+0 (secure 0 0 0) 0x7fe1a0054e20 con 0x7fe1b00af5a0 2023-10-06T04:38:01.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.184+0000 7fe1b4823700 1 -- 172.21.15.8:0/2741905461 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe190066f30 msgr2=0x7fe1900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:01.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.184+0000 7fe1b4823700 1 --2- 172.21.15.8:0/2741905461 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe190066f30 0x7fe1900693e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe1b00aedb0 tx=0x7fe198008040 comp rx=0 tx=0).stop 2023-10-06T04:38:01.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.184+0000 7fe1b4823700 1 -- 172.21.15.8:0/2741905461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1b00af5a0 msgr2=0x7fe1b014c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:01.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.185+0000 7fe1b4823700 1 --2- 172.21.15.8:0/2741905461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1b00af5a0 0x7fe1b014c9e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000c8e0 tx=0x7fe1a0001710 comp rx=0 tx=0).stop 2023-10-06T04:38:01.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.185+0000 7fe1b4823700 1 -- 172.21.15.8:0/2741905461 shutdown_connections 2023-10-06T04:38:01.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.185+0000 7fe1b4823700 1 --2- 172.21.15.8:0/2741905461 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe190066f30 0x7fe1900693e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:01.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.185+0000 7fe1b4823700 1 --2- 172.21.15.8:0/2741905461 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1b00cd530 0x7fe1b015c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:01.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.185+0000 7fe1b4823700 1 --2- 172.21.15.8:0/2741905461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1b00af5a0 0x7fe1b014c9e0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:01.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.185+0000 7fe1b4823700 1 --2- 172.21.15.8:0/2741905461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1b00af970 0x7fe1b00c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:01.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.185+0000 7fe1b4823700 1 -- 172.21.15.8:0/2741905461 >> 172.21.15.8:0/2741905461 conn(0x7fe1b006ed00 msgr2=0x7fe1b0158fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:01.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.185+0000 7fe1b4823700 1 -- 172.21.15.8:0/2741905461 shutdown_connections 2023-10-06T04:38:01.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.185+0000 7fe1b4823700 1 -- 172.21.15.8:0/2741905461 wait complete. 2023-10-06T04:38:01.189 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'recovery_fs_metadata' removed 2023-10-06T04:38:01.202 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T04:38:01.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.328+0000 7f89d7863700 1 Processor -- start 2023-10-06T04:38:01.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.329+0000 7f89d7863700 1 -- start start 2023-10-06T04:38:01.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.329+0000 7f89d7863700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f89d00cd530 0x7f89d015d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:01.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.329+0000 7f89d7863700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f89d00af970 0x7f89d015a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:01.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.329+0000 7f89d7863700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89d00ce820 con 0x7f89d00af5a0 2023-10-06T04:38:01.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.329+0000 7f89d7863700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89d015e2d0 con 0x7f89d00af970 2023-10-06T04:38:01.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.329+0000 7f89d7863700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89d015ad10 con 0x7f89d00cd530 2023-10-06T04:38:01.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.330+0000 7f89d55ff700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f89d00af5a0 0x7f89d00cce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34632/0 (socket says 172.21.15.8:34632) 2023-10-06T04:38:01.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.330+0000 7f89d55ff700 1 -- 172.21.15.8:0/1522422322 learned_addr learned my addr 172.21.15.8:0/1522422322 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:38:01.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.330+0000 7f89d5e00700 1 --2- 172.21.15.8:0/1522422322 >> v2:172.21.15.8:3300/0 conn(0x7f89d00af970 0x7f89d015a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:01.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.330+0000 7f89c7fff700 1 -- 172.21.15.8:0/1522422322 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2715154041 0 0) 0x7f89d00ce820 con 0x7f89d00af5a0 2023-10-06T04:38:01.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.330+0000 7f89c7fff700 1 -- 172.21.15.8:0/1522422322 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89bc003570 con 0x7f89d00af5a0 2023-10-06T04:38:01.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.330+0000 7f89d4dfe700 1 --2- 172.21.15.8:0/1522422322 >> v2:172.21.15.184:3300/0 conn(0x7f89d00cd530 0x7f89d015d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:01.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.330+0000 7f89d5e00700 1 -- 172.21.15.8:0/1522422322 >> v2:172.21.15.184:3300/0 conn(0x7f89d00cd530 msgr2=0x7f89d015d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:01.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.330+0000 7f89d5e00700 1 --2- 172.21.15.8:0/1522422322 >> v2:172.21.15.184:3300/0 conn(0x7f89d00cd530 0x7f89d015d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:01.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.330+0000 7f89d5e00700 1 -- 172.21.15.8:0/1522422322 >> v1:172.21.15.8:6789/0 conn(0x7f89d00af5a0 legacy=0x7f89d00cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:01.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.330+0000 7f89d5e00700 1 -- 172.21.15.8:0/1522422322 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d015da30 con 0x7f89d00af970 2023-10-06T04:38:01.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.330+0000 7f89d4dfe700 1 --2- 172.21.15.8:0/1522422322 >> v2:172.21.15.184:3300/0 conn(0x7f89d00cd530 0x7f89d015d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:38:01.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.330+0000 7f89d5e00700 1 --2- 172.21.15.8:0/1522422322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89d00af970 0x7f89d015a7d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f89d0089450 tx=0x7f89c8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e7fdcdf3efc980b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:01.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.330+0000 7f89c7fff700 1 -- 172.21.15.8:0/1522422322 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c800e070 con 0x7f89d00af970 2023-10-06T04:38:01.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.330+0000 7f89c7fff700 1 -- 172.21.15.8:0/1522422322 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c800bb20 con 0x7f89d00af970 2023-10-06T04:38:01.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.330+0000 7f89c7fff700 1 -- 172.21.15.8:0/1522422322 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c8012430 con 0x7f89d00af970 2023-10-06T04:38:01.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.331+0000 7f89d7863700 1 -- 172.21.15.8:0/1522422322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89d00af970 msgr2=0x7f89d015a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:01.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.331+0000 7f89d7863700 1 --2- 172.21.15.8:0/1522422322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89d00af970 0x7f89d015a7d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f89d0089450 tx=0x7f89c8009780 comp rx=0 tx=0).stop 2023-10-06T04:38:01.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.331+0000 7f89d7863700 1 -- 172.21.15.8:0/1522422322 shutdown_connections 2023-10-06T04:38:01.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.331+0000 7f89d7863700 1 --2- 172.21.15.8:0/1522422322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89d00af970 0x7f89d015a7d0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:01.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.331+0000 7f89d7863700 1 --2- 172.21.15.8:0/1522422322 >> v2:172.21.15.184:3300/0 conn(0x7f89d00cd530 0x7f89d015d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:01.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.331+0000 7f89d7863700 1 -- 172.21.15.8:0/1522422322 >> 172.21.15.8:0/1522422322 conn(0x7f89d006ed00 msgr2=0x7f89d006f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:01.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.331+0000 7f89d7863700 1 -- 172.21.15.8:0/1522422322 shutdown_connections 2023-10-06T04:38:01.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.331+0000 7f89d7863700 1 -- 172.21.15.8:0/1522422322 wait complete. 2023-10-06T04:38:01.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.332+0000 7f89d7863700 1 Processor -- start 2023-10-06T04:38:01.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.332+0000 7f89d7863700 1 -- start start 2023-10-06T04:38:01.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.333+0000 7f89d7863700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89d00af5a0 0x7f89d00b5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:01.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.333+0000 7f89d7863700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89d00af970 0x7f89d0158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:01.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.333+0000 7f89d7863700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89d00cd530 0x7f89d00c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:01.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.333+0000 7f89d7863700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d00c7a30 con 0x7f89d00cd530 2023-10-06T04:38:01.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.333+0000 7f89d7863700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d00c8870 con 0x7f89d00af970 2023-10-06T04:38:01.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.333+0000 7f89d7863700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d00c7c60 con 0x7f89d00af5a0 2023-10-06T04:38:01.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.333+0000 7f89d5e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89d00cd530 0x7f89d00c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:01.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.333+0000 7f89d5e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89d00cd530 0x7f89d00c74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47668/0 (socket says 172.21.15.8:47668) 2023-10-06T04:38:01.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.333+0000 7f89d5e00700 1 -- 172.21.15.8:0/3480018689 learned_addr learned my addr 172.21.15.8:0/3480018689 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:01.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.333+0000 7f89d55ff700 1 --2- 172.21.15.8:0/3480018689 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89d00af5a0 0x7f89d00b5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:01.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.333+0000 7f89d4dfe700 1 --2- 172.21.15.8:0/3480018689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89d00af970 0x7f89d0158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:01.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.333+0000 7f89d5e00700 1 -- 172.21.15.8:0/3480018689 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89d00af5a0 msgr2=0x7f89d00b5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:01.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.333+0000 7f89d5e00700 1 --2- 172.21.15.8:0/3480018689 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89d00af5a0 0x7f89d00b5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:01.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.333+0000 7f89d5e00700 1 -- 172.21.15.8:0/3480018689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89d00af970 msgr2=0x7f89d0158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:01.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.333+0000 7f89d5e00700 1 --2- 172.21.15.8:0/3480018689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89d00af970 0x7f89d0158390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:01.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.334+0000 7f89d5e00700 1 -- 172.21.15.8:0/3480018689 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c8009a20 con 0x7f89d00cd530 2023-10-06T04:38:01.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.334+0000 7f89d5e00700 1 --2- 172.21.15.8:0/3480018689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89d00cd530 0x7f89d00c74f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f89c8013000 tx=0x7f89c8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:01.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.334+0000 7f89c57fa700 1 -- 172.21.15.8:0/3480018689 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c8012e80 con 0x7f89d00cd530 2023-10-06T04:38:01.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.334+0000 7f89c57fa700 1 -- 172.21.15.8:0/3480018689 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c801d630 con 0x7f89d00cd530 2023-10-06T04:38:01.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.334+0000 7f89d7863700 1 -- 172.21.15.8:0/3480018689 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89d00c7f40 con 0x7f89d00cd530 2023-10-06T04:38:01.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.334+0000 7f89c57fa700 1 -- 172.21.15.8:0/3480018689 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c801d9f0 con 0x7f89d00cd530 2023-10-06T04:38:01.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.334+0000 7f89d7863700 1 -- 172.21.15.8:0/3480018689 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89d00c8500 con 0x7f89d00cd530 2023-10-06T04:38:01.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.335+0000 7f89d7863700 1 -- 172.21.15.8:0/3480018689 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89d00c8a20 con 0x7f89d00cd530 2023-10-06T04:38:01.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.335+0000 7f89c57fa700 1 -- 172.21.15.8:0/3480018689 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f89c8024070 con 0x7f89d00cd530 2023-10-06T04:38:01.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.336+0000 7f89c57fa700 1 --2- 172.21.15.8:0/3480018689 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f89b4066f30 0x7f89b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:01.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.336+0000 7f89c57fa700 1 -- 172.21.15.8:0/3480018689 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6117+0+0 (secure 0 0 0) 0x7f89c8086e70 con 0x7f89d00cd530 2023-10-06T04:38:01.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.336+0000 7f89d55ff700 1 --2- 172.21.15.8:0/3480018689 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f89b4066f30 0x7f89b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:01.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.336+0000 7f89d55ff700 1 --2- 172.21.15.8:0/3480018689 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f89b4066f30 0x7f89b40693e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f89d015b7f0 tx=0x7f89c0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:01.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.340+0000 7f89c57fa700 1 -- 172.21.15.8:0/3480018689 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f89d00c8a20 con 0x7f89d00cd530 2023-10-06T04:38:01.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:01.540+0000 7f89d7863700 1 -- 172.21.15.8:0/3480018689 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f89d00c89e0 con 0x7f89d00cd530 2023-10-06T04:38:02.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.185+0000 7f89c57fa700 1 -- 172.21.15.8:0/3480018689 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v50) v1 ==== 169+0+0 (secure 0 0 0) 0x7f89c8053f40 con 0x7f89d00cd530 2023-10-06T04:38:02.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.189+0000 7f89d7863700 1 -- 172.21.15.8:0/3480018689 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f89b4066f30 msgr2=0x7f89b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:02.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.189+0000 7f89d7863700 1 --2- 172.21.15.8:0/3480018689 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f89b4066f30 0x7f89b40693e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f89d015b7f0 tx=0x7f89c0009040 comp rx=0 tx=0).stop 2023-10-06T04:38:02.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.189+0000 7f89d7863700 1 -- 172.21.15.8:0/3480018689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89d00cd530 msgr2=0x7f89d00c74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:02.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.189+0000 7f89d7863700 1 --2- 172.21.15.8:0/3480018689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89d00cd530 0x7f89d00c74f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f89c8013000 tx=0x7f89c8019000 comp rx=0 tx=0).stop 2023-10-06T04:38:02.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.189+0000 7f89d7863700 1 -- 172.21.15.8:0/3480018689 shutdown_connections 2023-10-06T04:38:02.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.189+0000 7f89d7863700 1 --2- 172.21.15.8:0/3480018689 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f89b4066f30 0x7f89b40693e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:02.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.189+0000 7f89d7863700 1 --2- 172.21.15.8:0/3480018689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89d00cd530 0x7f89d00c74f0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:02.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.189+0000 7f89d7863700 1 --2- 172.21.15.8:0/3480018689 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89d00af5a0 0x7f89d00b5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:02.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.189+0000 7f89d7863700 1 --2- 172.21.15.8:0/3480018689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89d00af970 0x7f89d0158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:02.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.189+0000 7f89d7863700 1 -- 172.21.15.8:0/3480018689 >> 172.21.15.8:0/3480018689 conn(0x7f89d006ed00 msgr2=0x7f89d0158fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:02.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.189+0000 7f89d7863700 1 -- 172.21.15.8:0/3480018689 shutdown_connections 2023-10-06T04:38:02.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.189+0000 7f89d7863700 1 -- 172.21.15.8:0/3480018689 wait complete. 2023-10-06T04:38:02.193 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_data' removed 2023-10-06T04:38:02.207 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds debug_mds 2023-10-06T04:38:02.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.337+0000 7f3987738700 1 Processor -- start 2023-10-06T04:38:02.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.337+0000 7f3987738700 1 -- start start 2023-10-06T04:38:02.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.338+0000 7f3987738700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f398006e7a0 0x7f398006b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:02.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.338+0000 7f3987738700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f39800c84c0 0x7f398013fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:02.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.338+0000 7f3987738700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39800c89a0 con 0x7f398006b8c0 2023-10-06T04:38:02.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.338+0000 7f3987738700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39800c9620 con 0x7f398006e7a0 2023-10-06T04:38:02.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.338+0000 7f3987738700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39800c9a40 con 0x7f39800c84c0 2023-10-06T04:38:02.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.338+0000 7f39854d4700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f398006e7a0 0x7f398006b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:02.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.338+0000 7f39854d4700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f398006e7a0 0x7f398006b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47680/0 (socket says 172.21.15.8:47680) 2023-10-06T04:38:02.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.338+0000 7f39854d4700 1 -- 172.21.15.8:0/1714607354 learned_addr learned my addr 172.21.15.8:0/1714607354 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:02.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.339+0000 7f39854d4700 1 -- 172.21.15.8:0/1714607354 >> v2:172.21.15.184:3300/0 conn(0x7f39800c84c0 msgr2=0x7f398013fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:02.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.339+0000 7f3985cd5700 1 --2- 172.21.15.8:0/1714607354 >> v2:172.21.15.184:3300/0 conn(0x7f39800c84c0 0x7f398013fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:02.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.339+0000 7f39854d4700 1 --2- 172.21.15.8:0/1714607354 >> v2:172.21.15.184:3300/0 conn(0x7f39800c84c0 0x7f398013fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:02.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.339+0000 7f39854d4700 1 -- 172.21.15.8:0/1714607354 >> v1:172.21.15.184:6789/0 conn(0x7f398006b8c0 legacy=0x7f398013f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:02.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.339+0000 7f39854d4700 1 -- 172.21.15.8:0/1714607354 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39800c8c80 con 0x7f398006e7a0 2023-10-06T04:38:02.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.339+0000 7f3985cd5700 1 --2- 172.21.15.8:0/1714607354 >> v2:172.21.15.184:3300/0 conn(0x7f39800c84c0 0x7f398013fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:38:02.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.339+0000 7f39854d4700 1 --2- 172.21.15.8:0/1714607354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f398006e7a0 0x7f398006b380 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f39800c7d50 tx=0x7f397c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b30a74c21b3fcf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:02.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.339+0000 7f3977fff700 1 -- 172.21.15.8:0/1714607354 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c00b7e0 con 0x7f398006e7a0 2023-10-06T04:38:02.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.339+0000 7f3977fff700 1 -- 172.21.15.8:0/1714607354 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397c00b940 con 0x7f398006e7a0 2023-10-06T04:38:02.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.339+0000 7f3977fff700 1 -- 172.21.15.8:0/1714607354 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c00bce0 con 0x7f398006e7a0 2023-10-06T04:38:02.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.340+0000 7f3987738700 1 -- 172.21.15.8:0/1714607354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f398006e7a0 msgr2=0x7f398006b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:02.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.340+0000 7f3987738700 1 --2- 172.21.15.8:0/1714607354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f398006e7a0 0x7f398006b380 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f39800c7d50 tx=0x7f397c009250 comp rx=0 tx=0).stop 2023-10-06T04:38:02.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.340+0000 7f3987738700 1 -- 172.21.15.8:0/1714607354 shutdown_connections 2023-10-06T04:38:02.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.340+0000 7f3987738700 1 --2- 172.21.15.8:0/1714607354 >> v2:172.21.15.184:3300/0 conn(0x7f39800c84c0 0x7f398013fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:02.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.340+0000 7f3987738700 1 --2- 172.21.15.8:0/1714607354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f398006e7a0 0x7f398006b380 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:02.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.340+0000 7f3987738700 1 -- 172.21.15.8:0/1714607354 >> 172.21.15.8:0/1714607354 conn(0x7f39800cd120 msgr2=0x7f39800cd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:02.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.340+0000 7f3987738700 1 -- 172.21.15.8:0/1714607354 shutdown_connections 2023-10-06T04:38:02.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.340+0000 7f3987738700 1 -- 172.21.15.8:0/1714607354 wait complete. 2023-10-06T04:38:02.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.341+0000 7f3987738700 1 Processor -- start 2023-10-06T04:38:02.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.341+0000 7f3987738700 1 -- start start 2023-10-06T04:38:02.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.342+0000 7f3987738700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f398006b8c0 0x7f398013e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:02.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.342+0000 7f3987738700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f398006e7a0 0x7f39800ae110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:02.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.342+0000 7f3987738700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39800c84c0 0x7f39800c28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:02.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.342+0000 7f3987738700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39800aebd0 con 0x7f398006e7a0 2023-10-06T04:38:02.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.342+0000 7f3987738700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39800aeeb0 con 0x7f398006b8c0 2023-10-06T04:38:02.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.342+0000 7f3987738700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39800af190 con 0x7f39800c84c0 2023-10-06T04:38:02.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.342+0000 7f3984cd3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f398006e7a0 0x7f39800ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:02.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.342+0000 7f3984cd3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f398006e7a0 0x7f39800ae110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47684/0 (socket says 172.21.15.8:47684) 2023-10-06T04:38:02.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.342+0000 7f3984cd3700 1 -- 172.21.15.8:0/1863814253 learned_addr learned my addr 172.21.15.8:0/1863814253 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:02.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.342+0000 7f39854d4700 1 --2- 172.21.15.8:0/1863814253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f398006b8c0 0x7f398013e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:02.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.342+0000 7f3985cd5700 1 --2- 172.21.15.8:0/1863814253 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39800c84c0 0x7f39800c28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:02.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.342+0000 7f3984cd3700 1 -- 172.21.15.8:0/1863814253 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39800c84c0 msgr2=0x7f39800c28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:02.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.342+0000 7f3984cd3700 1 --2- 172.21.15.8:0/1863814253 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39800c84c0 0x7f39800c28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:02.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.342+0000 7f3984cd3700 1 -- 172.21.15.8:0/1863814253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f398006b8c0 msgr2=0x7f398013e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:02.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.342+0000 7f3984cd3700 1 --2- 172.21.15.8:0/1863814253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f398006b8c0 0x7f398013e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:02.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.342+0000 7f3984cd3700 1 -- 172.21.15.8:0/1863814253 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f397c0094f0 con 0x7f398006e7a0 2023-10-06T04:38:02.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.342+0000 7f3985cd5700 1 --2- 172.21.15.8:0/1863814253 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39800c84c0 0x7f39800c28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:38:02.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.343+0000 7f3984cd3700 1 --2- 172.21.15.8:0/1863814253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f398006e7a0 0x7f39800ae110 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f397000b600 tx=0x7f39700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:02.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.343+0000 7f39757fa700 1 -- 172.21.15.8:0/1863814253 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397000f510 con 0x7f398006e7a0 2023-10-06T04:38:02.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.343+0000 7f39757fa700 1 -- 172.21.15.8:0/1863814253 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397000f690 con 0x7f398006e7a0 2023-10-06T04:38:02.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.343+0000 7f39757fa700 1 -- 172.21.15.8:0/1863814253 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397000fa50 con 0x7f398006e7a0 2023-10-06T04:38:02.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.343+0000 7f3987738700 1 -- 172.21.15.8:0/1863814253 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39800af470 con 0x7f398006e7a0 2023-10-06T04:38:02.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.343+0000 7f3987738700 1 -- 172.21.15.8:0/1863814253 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3980156c70 con 0x7f398006e7a0 2023-10-06T04:38:02.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.344+0000 7f3987738700 1 -- 172.21.15.8:0/1863814253 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3980071550 con 0x7f398006e7a0 2023-10-06T04:38:02.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.344+0000 7f39757fa700 1 -- 172.21.15.8:0/1863814253 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f397001a400 con 0x7f398006e7a0 2023-10-06T04:38:02.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.345+0000 7f39757fa700 1 --2- 172.21.15.8:0/1863814253 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3964066f30 0x7f39640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:02.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.345+0000 7f39757fa700 1 -- 172.21.15.8:0/1863814253 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f3970084010 con 0x7f398006e7a0 2023-10-06T04:38:02.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.345+0000 7f39854d4700 1 --2- 172.21.15.8:0/1863814253 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3964066f30 0x7f39640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:02.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.345+0000 7f39854d4700 1 --2- 172.21.15.8:0/1863814253 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3964066f30 0x7f39640693e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f39800c7d50 tx=0x7f397c016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:02.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.349+0000 7f39757fa700 1 -- 172.21.15.8:0/1863814253 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3970051300 con 0x7f398006e7a0 2023-10-06T04:38:02.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.546+0000 7f3987738700 1 -- 172.21.15.8:0/1863814253 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "debug_mds"} v 0) v1 -- 0x7f39800aed10 con 0x7f398006e7a0 2023-10-06T04:38:02.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.550+0000 7f39757fa700 1 -- 172.21.15.8:0/1863814253 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "debug_mds"}]=0 v12) v1 ==== 92+0+0 (secure 0 0 0) 0x7f39800aed10 con 0x7f398006e7a0 2023-10-06T04:38:02.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.551+0000 7f3987738700 1 -- 172.21.15.8:0/1863814253 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3964066f30 msgr2=0x7f39640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:02.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.551+0000 7f3987738700 1 --2- 172.21.15.8:0/1863814253 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3964066f30 0x7f39640693e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f39800c7d50 tx=0x7f397c016000 comp rx=0 tx=0).stop 2023-10-06T04:38:02.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.551+0000 7f3987738700 1 -- 172.21.15.8:0/1863814253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f398006e7a0 msgr2=0x7f39800ae110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:02.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.551+0000 7f3987738700 1 --2- 172.21.15.8:0/1863814253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f398006e7a0 0x7f39800ae110 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f397000b600 tx=0x7f39700091a0 comp rx=0 tx=0).stop 2023-10-06T04:38:02.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.552+0000 7f3987738700 1 -- 172.21.15.8:0/1863814253 shutdown_connections 2023-10-06T04:38:02.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.552+0000 7f3987738700 1 --2- 172.21.15.8:0/1863814253 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3964066f30 0x7f39640693e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:02.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.552+0000 7f3987738700 1 --2- 172.21.15.8:0/1863814253 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39800c84c0 0x7f39800c28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:02.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.552+0000 7f3987738700 1 --2- 172.21.15.8:0/1863814253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f398006b8c0 0x7f398013e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:02.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.552+0000 7f3987738700 1 --2- 172.21.15.8:0/1863814253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f398006e7a0 0x7f39800ae110 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:02.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.552+0000 7f3987738700 1 -- 172.21.15.8:0/1863814253 >> 172.21.15.8:0/1863814253 conn(0x7f39800cd120 msgr2=0x7f39800c3520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:02.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.552+0000 7f3987738700 1 -- 172.21.15.8:0/1863814253 shutdown_connections 2023-10-06T04:38:02.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.552+0000 7f3987738700 1 -- 172.21.15.8:0/1863814253 wait complete. 2023-10-06T04:38:02.566 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T04:38:02.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.684+0000 7f59fd282700 1 Processor -- start 2023-10-06T04:38:02.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.684+0000 7f59fd282700 1 -- start start 2023-10-06T04:38:02.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.685+0000 7f59fd282700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59f80b1c70 0x7f59f80b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:02.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.685+0000 7f59fd282700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f59f815ad80 0x7f59f815b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:02.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.685+0000 7f59fd282700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59f80b2620 con 0x7f59f8156e30 2023-10-06T04:38:02.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.685+0000 7f59fd282700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59f80cf370 con 0x7f59f815ad80 2023-10-06T04:38:02.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.685+0000 7f59fd282700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f80ce800 con 0x7f59f80b1c70 2023-10-06T04:38:02.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.685+0000 7f59f7fff700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f59f8156e30 0x7f59f80cf800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34648/0 (socket says 172.21.15.8:34648) 2023-10-06T04:38:02.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.685+0000 7f59f7fff700 1 -- 172.21.15.8:0/336518123 learned_addr learned my addr 172.21.15.8:0/336518123 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:38:02.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.686+0000 7f59f6ffd700 1 -- 172.21.15.8:0/336518123 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3414699341 0 0) 0x7f59f80b2620 con 0x7f59f8156e30 2023-10-06T04:38:02.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.686+0000 7f59f6ffd700 1 -- 172.21.15.8:0/336518123 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59e4003570 con 0x7f59f8156e30 2023-10-06T04:38:02.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.686+0000 7f59fca81700 1 --2- 172.21.15.8:0/336518123 >> v2:172.21.15.184:3300/0 conn(0x7f59f815ad80 0x7f59f815b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:02.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.686+0000 7f59f77fe700 1 --2- 172.21.15.8:0/336518123 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59f80b1c70 0x7f59f80b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:02.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.686+0000 7f59f6ffd700 1 -- 172.21.15.8:0/336518123 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1243099269 0 0) 0x7f59e4003570 con 0x7f59f8156e30 2023-10-06T04:38:02.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.686+0000 7f59f6ffd700 1 -- 172.21.15.8:0/336518123 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59f80b1c70 msgr2=0x7f59f80b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:02.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.686+0000 7f59f6ffd700 1 --2- 172.21.15.8:0/336518123 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59f80b1c70 0x7f59f80b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:02.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.686+0000 7f59f6ffd700 1 -- 172.21.15.8:0/336518123 >> v2:172.21.15.184:3300/0 conn(0x7f59f815ad80 msgr2=0x7f59f815b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:02.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.686+0000 7f59f6ffd700 1 --2- 172.21.15.8:0/336518123 >> v2:172.21.15.184:3300/0 conn(0x7f59f815ad80 0x7f59f815b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:02.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.686+0000 7f59f6ffd700 1 -- 172.21.15.8:0/336518123 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f80cea60 con 0x7f59f8156e30 2023-10-06T04:38:02.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.686+0000 7f59f6ffd700 1 -- 172.21.15.8:0/336518123 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7f59e8001470 con 0x7f59f8156e30 2023-10-06T04:38:02.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.686+0000 7f59f6ffd700 1 -- 172.21.15.8:0/336518123 >> v1:172.21.15.8:6789/0 conn(0x7f59f8156e30 legacy=0x7f59f80cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:02.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.686+0000 7f59f6ffd700 1 --2- 172.21.15.8:0/336518123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59e4003a60 0x7f59e4003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:02.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.686+0000 7f59f6ffd700 1 --2- 172.21.15.8:0/336518123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59e4004810 0x7f59e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:02.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.686+0000 7f59f6ffd700 1 --2- 172.21.15.8:0/336518123 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59e40051c0 0x7f59e400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:02.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.686+0000 7f59f6ffd700 1 -- 172.21.15.8:0/336518123 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f80cf370 con 0x7f59e4003a60 2023-10-06T04:38:02.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.686+0000 7f59f6ffd700 1 -- 172.21.15.8:0/336518123 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f80ce800 con 0x7f59e4004810 2023-10-06T04:38:02.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.686+0000 7f59f6ffd700 1 -- 172.21.15.8:0/336518123 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59e400bfd0 con 0x7f59e40051c0 2023-10-06T04:38:02.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.686+0000 7f59f77fe700 1 --2- 172.21.15.8:0/336518123 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59f80b1c70 0x7f59f80b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:38:02.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.686+0000 7f59f7fff700 1 --2- 172.21.15.8:0/336518123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59e4003a60 0x7f59e4003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:02.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.686+0000 7f59fca81700 1 --2- 172.21.15.8:0/336518123 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59e40051c0 0x7f59e400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:02.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.686+0000 7f59f77fe700 1 --2- 172.21.15.8:0/336518123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59e4004810 0x7f59e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:02.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.686+0000 7f59f7fff700 1 -- 172.21.15.8:0/336518123 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59e40051c0 msgr2=0x7f59e400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:02.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.686+0000 7f59f7fff700 1 --2- 172.21.15.8:0/336518123 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59e40051c0 0x7f59e400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:02.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.686+0000 7f59f7fff700 1 -- 172.21.15.8:0/336518123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59e4004810 msgr2=0x7f59e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:02.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.686+0000 7f59f7fff700 1 --2- 172.21.15.8:0/336518123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59e4004810 0x7f59e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:02.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.686+0000 7f59f7fff700 1 -- 172.21.15.8:0/336518123 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e4003570 con 0x7f59e4003a60 2023-10-06T04:38:02.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.686+0000 7f59fca81700 1 --2- 172.21.15.8:0/336518123 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59e40051c0 0x7f59e400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:38:02.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.686+0000 7f59f77fe700 1 --2- 172.21.15.8:0/336518123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59e4004810 0x7f59e4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:38:02.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.687+0000 7f59f7fff700 1 --2- 172.21.15.8:0/336518123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59e4003a60 0x7f59e4003e90 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f59e800c3c0 tx=0x7f59f81599a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5373cb8b60a29506 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:02.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.687+0000 7f59f6ffd700 1 -- 172.21.15.8:0/336518123 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e800cc30 con 0x7f59e4003a60 2023-10-06T04:38:02.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.687+0000 7f59f6ffd700 1 -- 172.21.15.8:0/336518123 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e800cd90 con 0x7f59e4003a60 2023-10-06T04:38:02.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.687+0000 7f59f6ffd700 1 -- 172.21.15.8:0/336518123 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e8005b70 con 0x7f59e4003a60 2023-10-06T04:38:02.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.687+0000 7f59fd282700 1 -- 172.21.15.8:0/336518123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59e4003a60 msgr2=0x7f59e4003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:02.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.687+0000 7f59fd282700 1 --2- 172.21.15.8:0/336518123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59e4003a60 0x7f59e4003e90 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f59e800c3c0 tx=0x7f59f81599a0 comp rx=0 tx=0).stop 2023-10-06T04:38:02.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.687+0000 7f59fca81700 1 -- 172.21.15.8:0/336518123 reap_dead start 2023-10-06T04:38:02.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.687+0000 7f59fd282700 1 -- 172.21.15.8:0/336518123 shutdown_connections 2023-10-06T04:38:02.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.687+0000 7f59fd282700 1 -- 172.21.15.8:0/336518123 >> 172.21.15.8:0/336518123 conn(0x7f59f806ed00 msgr2=0x7f59f806f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:02.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.687+0000 7f59fd282700 1 -- 172.21.15.8:0/336518123 shutdown_connections 2023-10-06T04:38:02.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.687+0000 7f59fd282700 1 -- 172.21.15.8:0/336518123 wait complete. 2023-10-06T04:38:02.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.688+0000 7f59fd282700 1 Processor -- start 2023-10-06T04:38:02.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.688+0000 7f59fd282700 1 -- start start 2023-10-06T04:38:02.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.689+0000 7f59fd282700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59e4003a60 0x7f59f814dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:02.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.689+0000 7f59fd282700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59f80ae460 0x7f59f8150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:02.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.689+0000 7f59fd282700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59f815c300 0x7f59f815c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:02.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.689+0000 7f59fd282700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f8157370 con 0x7f59f80ae460 2023-10-06T04:38:02.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.689+0000 7f59fd282700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f814f7a0 con 0x7f59e4003a60 2023-10-06T04:38:02.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.689+0000 7f59fd282700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f815cca0 con 0x7f59f815c300 2023-10-06T04:38:02.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.689+0000 7f59f77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59f80ae460 0x7f59f8150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:02.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.689+0000 7f59f77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59f80ae460 0x7f59f8150cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47696/0 (socket says 172.21.15.8:47696) 2023-10-06T04:38:02.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.689+0000 7f59f77fe700 1 -- 172.21.15.8:0/2095635268 learned_addr learned my addr 172.21.15.8:0/2095635268 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:02.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.689+0000 7f59f7fff700 1 --2- 172.21.15.8:0/2095635268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59e4003a60 0x7f59f814dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:02.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.689+0000 7f59fca81700 1 --2- 172.21.15.8:0/2095635268 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59f815c300 0x7f59f815c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:02.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.690+0000 7f59f77fe700 1 -- 172.21.15.8:0/2095635268 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59f815c300 msgr2=0x7f59f815c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:02.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.690+0000 7f59f77fe700 1 --2- 172.21.15.8:0/2095635268 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59f815c300 0x7f59f815c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:02.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.690+0000 7f59f77fe700 1 -- 172.21.15.8:0/2095635268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59e4003a60 msgr2=0x7f59f814dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:02.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.690+0000 7f59f77fe700 1 --2- 172.21.15.8:0/2095635268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59e4003a60 0x7f59f814dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:02.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.690+0000 7f59f77fe700 1 -- 172.21.15.8:0/2095635268 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f8151210 con 0x7f59f80ae460 2023-10-06T04:38:02.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.690+0000 7f59f77fe700 1 --2- 172.21.15.8:0/2095635268 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59f80ae460 0x7f59f8150cd0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f59e000f5e0 tx=0x7f59e0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:02.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.690+0000 7f59effff700 1 -- 172.21.15.8:0/2095635268 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e0014690 con 0x7f59f80ae460 2023-10-06T04:38:02.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.690+0000 7f59effff700 1 -- 172.21.15.8:0/2095635268 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e000c030 con 0x7f59f80ae460 2023-10-06T04:38:02.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.690+0000 7f59fd282700 1 -- 172.21.15.8:0/2095635268 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59f8151460 con 0x7f59f80ae460 2023-10-06T04:38:02.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.690+0000 7f59effff700 1 -- 172.21.15.8:0/2095635268 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e0014a20 con 0x7f59f80ae460 2023-10-06T04:38:02.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.690+0000 7f59fd282700 1 -- 172.21.15.8:0/2095635268 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59f8151a20 con 0x7f59f80ae460 2023-10-06T04:38:02.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.691+0000 7f59fd282700 1 -- 172.21.15.8:0/2095635268 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59f81574e0 con 0x7f59f80ae460 2023-10-06T04:38:02.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.691+0000 7f59effff700 1 -- 172.21.15.8:0/2095635268 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f59e001d400 con 0x7f59f80ae460 2023-10-06T04:38:02.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.692+0000 7f59effff700 1 --2- 172.21.15.8:0/2095635268 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f59d8066f30 0x7f59d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:02.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.692+0000 7f59effff700 1 -- 172.21.15.8:0/2095635268 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f59e00849c0 con 0x7f59f80ae460 2023-10-06T04:38:02.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.692+0000 7f59f7fff700 1 --2- 172.21.15.8:0/2095635268 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f59d8066f30 0x7f59d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:02.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.692+0000 7f59f7fff700 1 --2- 172.21.15.8:0/2095635268 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f59d8066f30 0x7f59d80693e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f59e8007d10 tx=0x7f59e8015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:02.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.696+0000 7f59effff700 1 -- 172.21.15.8:0/2095635268 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59f81574e0 con 0x7f59f80ae460 2023-10-06T04:38:02.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.890+0000 7f59fd282700 1 -- 172.21.15.8:0/2095635268 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f59f81574b0 con 0x7f59f80ae460 2023-10-06T04:38:02.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.893+0000 7f59effff700 1 -- 172.21.15.8:0/2095635268 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f59e0051c30 con 0x7f59f80ae460 2023-10-06T04:38:02.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.895+0000 7f59fd282700 1 -- 172.21.15.8:0/2095635268 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f59d8066f30 msgr2=0x7f59d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:02.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.895+0000 7f59fd282700 1 --2- 172.21.15.8:0/2095635268 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f59d8066f30 0x7f59d80693e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f59e8007d10 tx=0x7f59e8015000 comp rx=0 tx=0).stop 2023-10-06T04:38:02.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.895+0000 7f59fd282700 1 -- 172.21.15.8:0/2095635268 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59f80ae460 msgr2=0x7f59f8150cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:02.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.895+0000 7f59fd282700 1 --2- 172.21.15.8:0/2095635268 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59f80ae460 0x7f59f8150cd0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f59e000f5e0 tx=0x7f59e0008040 comp rx=0 tx=0).stop 2023-10-06T04:38:02.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.895+0000 7f59fd282700 1 -- 172.21.15.8:0/2095635268 shutdown_connections 2023-10-06T04:38:02.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.895+0000 7f59fd282700 1 --2- 172.21.15.8:0/2095635268 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f59d8066f30 0x7f59d80693e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:02.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.895+0000 7f59fd282700 1 --2- 172.21.15.8:0/2095635268 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59f815c300 0x7f59f815c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:02.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.895+0000 7f59fd282700 1 --2- 172.21.15.8:0/2095635268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59e4003a60 0x7f59f814dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:02.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.895+0000 7f59fd282700 1 --2- 172.21.15.8:0/2095635268 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f59f80ae460 0x7f59f8150cd0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:02.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.895+0000 7f59fd282700 1 -- 172.21.15.8:0/2095635268 >> 172.21.15.8:0/2095635268 conn(0x7f59f806ed00 msgr2=0x7f59f80b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:02.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.896+0000 7f59fd282700 1 -- 172.21.15.8:0/2095635268 shutdown_connections 2023-10-06T04:38:02.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:02.896+0000 7f59fd282700 1 -- 172.21.15.8:0/2095635268 wait complete. 2023-10-06T04:38:02.910 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_recovery_pool.TestRecoveryPool.test_rebuild_simple' 2023-10-06T04:38:03.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.027+0000 7fe459496700 1 Processor -- start 2023-10-06T04:38:03.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.027+0000 7fe459496700 1 -- start start 2023-10-06T04:38:03.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.028+0000 7fe459496700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe4540cb360 0x7fe4540d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:03.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.028+0000 7fe459496700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4540d08d0 0x7fe4540cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:03.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.028+0000 7fe459496700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4540cc4c0 con 0x7fe4540af680 2023-10-06T04:38:03.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.028+0000 7fe459496700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe45415d460 con 0x7fe4540cb360 2023-10-06T04:38:03.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.028+0000 7fe459496700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4540d0d20 con 0x7fe4540d08d0 2023-10-06T04:38:03.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.028+0000 7fe4527fc700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe4540cb360 0x7fe4540d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:03.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.028+0000 7fe452ffd700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe4540af680 0x7fe45415e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34656/0 (socket says 172.21.15.8:34656) 2023-10-06T04:38:03.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.028+0000 7fe452ffd700 1 -- 172.21.15.8:0/161040423 learned_addr learned my addr 172.21.15.8:0/161040423 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:38:03.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.028+0000 7fe4537fe700 1 --2- 172.21.15.8:0/161040423 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4540d08d0 0x7fe4540cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:03.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.028+0000 7fe4527fc700 1 -- 172.21.15.8:0/161040423 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4540d08d0 msgr2=0x7fe4540cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:03.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.028+0000 7fe4527fc700 1 --2- 172.21.15.8:0/161040423 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4540d08d0 0x7fe4540cc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:03.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.028+0000 7fe4527fc700 1 -- 172.21.15.8:0/161040423 >> v1:172.21.15.8:6789/0 conn(0x7fe4540af680 legacy=0x7fe45415e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:03.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.028+0000 7fe4527fc700 1 -- 172.21.15.8:0/161040423 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4540cb8b0 con 0x7fe4540cb360 2023-10-06T04:38:03.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.028+0000 7fe451ffb700 1 -- 172.21.15.8:0/161040423 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2310030639 0 0) 0x7fe4540cc4c0 con 0x7fe4540af680 2023-10-06T04:38:03.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.028+0000 7fe4527fc700 1 --2- 172.21.15.8:0/161040423 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4540cb360 0x7fe4540d0390 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fe43c0098e0 tx=0x7fe43c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e375642fd236ffae server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:03.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.029+0000 7fe451ffb700 1 -- 172.21.15.8:0/161040423 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c009e80 con 0x7fe4540cb360 2023-10-06T04:38:03.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.029+0000 7fe451ffb700 1 -- 172.21.15.8:0/161040423 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43c00b860 con 0x7fe4540cb360 2023-10-06T04:38:03.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.029+0000 7fe451ffb700 1 -- 172.21.15.8:0/161040423 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c00bbe0 con 0x7fe4540cb360 2023-10-06T04:38:03.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.029+0000 7fe459496700 1 -- 172.21.15.8:0/161040423 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4540cb360 msgr2=0x7fe4540d0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:03.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.029+0000 7fe459496700 1 --2- 172.21.15.8:0/161040423 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4540cb360 0x7fe4540d0390 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fe43c0098e0 tx=0x7fe43c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:38:03.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.029+0000 7fe459496700 1 -- 172.21.15.8:0/161040423 shutdown_connections 2023-10-06T04:38:03.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.029+0000 7fe459496700 1 --2- 172.21.15.8:0/161040423 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4540d08d0 0x7fe4540cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:03.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.029+0000 7fe459496700 1 --2- 172.21.15.8:0/161040423 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4540cb360 0x7fe4540d0390 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:03.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.029+0000 7fe459496700 1 -- 172.21.15.8:0/161040423 >> 172.21.15.8:0/161040423 conn(0x7fe4540633d0 msgr2=0x7fe4540637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:03.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.029+0000 7fe459496700 1 -- 172.21.15.8:0/161040423 shutdown_connections 2023-10-06T04:38:03.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.029+0000 7fe459496700 1 -- 172.21.15.8:0/161040423 wait complete. 2023-10-06T04:38:03.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.030+0000 7fe459496700 1 Processor -- start 2023-10-06T04:38:03.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.030+0000 7fe459496700 1 -- start start 2023-10-06T04:38:03.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.031+0000 7fe459496700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4540af680 0x7fe454159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:03.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.031+0000 7fe459496700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4540cb360 0x7fe4540b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:03.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.031+0000 7fe459496700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4540d08d0 0x7fe4540cce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:03.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.031+0000 7fe459496700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4540c8380 con 0x7fe4540af680 2023-10-06T04:38:03.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.031+0000 7fe459496700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4541597c0 con 0x7fe4540cb360 2023-10-06T04:38:03.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.031+0000 7fe459496700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4540b3ad0 con 0x7fe4540d08d0 2023-10-06T04:38:03.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.031+0000 7fe452ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4540af680 0x7fe454159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:03.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.031+0000 7fe452ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4540af680 0x7fe454159280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47704/0 (socket says 172.21.15.8:47704) 2023-10-06T04:38:03.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.031+0000 7fe452ffd700 1 -- 172.21.15.8:0/421183393 learned_addr learned my addr 172.21.15.8:0/421183393 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:03.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.031+0000 7fe4537fe700 1 --2- 172.21.15.8:0/421183393 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4540d08d0 0x7fe4540cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:03.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.031+0000 7fe4527fc700 1 --2- 172.21.15.8:0/421183393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4540cb360 0x7fe4540b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:03.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.031+0000 7fe452ffd700 1 -- 172.21.15.8:0/421183393 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4540d08d0 msgr2=0x7fe4540cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:03.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.031+0000 7fe452ffd700 1 --2- 172.21.15.8:0/421183393 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4540d08d0 0x7fe4540cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:03.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.031+0000 7fe452ffd700 1 -- 172.21.15.8:0/421183393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4540cb360 msgr2=0x7fe4540b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:03.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.031+0000 7fe452ffd700 1 --2- 172.21.15.8:0/421183393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4540cb360 0x7fe4540b31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:03.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.031+0000 7fe452ffd700 1 -- 172.21.15.8:0/421183393 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe43c009420 con 0x7fe4540af680 2023-10-06T04:38:03.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.032+0000 7fe452ffd700 1 --2- 172.21.15.8:0/421183393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4540af680 0x7fe454159280 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fe44400cd80 tx=0x7fe444001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:03.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.032+0000 7fe44affd700 1 -- 172.21.15.8:0/421183393 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44400ab10 con 0x7fe4540af680 2023-10-06T04:38:03.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.032+0000 7fe44affd700 1 -- 172.21.15.8:0/421183393 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe44400ac70 con 0x7fe4540af680 2023-10-06T04:38:03.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.032+0000 7fe459496700 1 -- 172.21.15.8:0/421183393 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4540b3db0 con 0x7fe4540af680 2023-10-06T04:38:03.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.032+0000 7fe44affd700 1 -- 172.21.15.8:0/421183393 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4440070f0 con 0x7fe4540af680 2023-10-06T04:38:03.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.032+0000 7fe459496700 1 -- 172.21.15.8:0/421183393 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4540c8010 con 0x7fe4540af680 2023-10-06T04:38:03.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.033+0000 7fe459496700 1 -- 172.21.15.8:0/421183393 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4540c7e70 con 0x7fe4540af680 2023-10-06T04:38:03.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.033+0000 7fe44affd700 1 -- 172.21.15.8:0/421183393 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe4440074e0 con 0x7fe4540af680 2023-10-06T04:38:03.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.034+0000 7fe44affd700 1 --2- 172.21.15.8:0/421183393 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe434066f30 0x7fe4340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:03.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.034+0000 7fe44affd700 1 -- 172.21.15.8:0/421183393 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fe444084a60 con 0x7fe4540af680 2023-10-06T04:38:03.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.034+0000 7fe4527fc700 1 --2- 172.21.15.8:0/421183393 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe434066f30 0x7fe4340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:03.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.034+0000 7fe4527fc700 1 --2- 172.21.15.8:0/421183393 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe434066f30 0x7fe4340693e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe43c0091e0 tx=0x7fe43c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:03.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.038+0000 7fe44affd700 1 -- 172.21.15.8:0/421183393 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe4540c7e70 con 0x7fe4540af680 2023-10-06T04:38:03.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:03.314+0000 7fe459496700 1 -- 172.21.15.8:0/421183393 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_recovery_pool.TestRecoveryPool.test_rebuild_simple"]} v 0) v1 -- 0x7fe4540c7e70 con 0x7fe4540af680 2023-10-06T04:38:04.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:04.186+0000 7fe44affd700 1 -- 172.21.15.8:0/421183393 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_recovery_pool.TestRecoveryPool.test_rebuild_simple"]}]=0 v121) v1 ==== 147+0+0 (secure 0 0 0) 0x7fe4540c7e70 con 0x7fe4540af680 2023-10-06T04:38:04.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:04.188+0000 7fe459496700 1 -- 172.21.15.8:0/421183393 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe434066f30 msgr2=0x7fe4340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:04.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:04.188+0000 7fe459496700 1 --2- 172.21.15.8:0/421183393 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe434066f30 0x7fe4340693e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe43c0091e0 tx=0x7fe43c017000 comp rx=0 tx=0).stop 2023-10-06T04:38:04.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:04.188+0000 7fe459496700 1 -- 172.21.15.8:0/421183393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4540af680 msgr2=0x7fe454159280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:04.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:04.188+0000 7fe459496700 1 --2- 172.21.15.8:0/421183393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4540af680 0x7fe454159280 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fe44400cd80 tx=0x7fe444001ae0 comp rx=0 tx=0).stop 2023-10-06T04:38:04.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:04.188+0000 7fe459496700 1 -- 172.21.15.8:0/421183393 shutdown_connections 2023-10-06T04:38:04.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:04.188+0000 7fe459496700 1 --2- 172.21.15.8:0/421183393 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fe434066f30 0x7fe4340693e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:04.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:04.188+0000 7fe459496700 1 --2- 172.21.15.8:0/421183393 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4540d08d0 0x7fe4540cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:04.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:04.188+0000 7fe459496700 1 --2- 172.21.15.8:0/421183393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4540af680 0x7fe454159280 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:04.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:04.188+0000 7fe459496700 1 --2- 172.21.15.8:0/421183393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4540cb360 0x7fe4540b31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:04.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:04.188+0000 7fe459496700 1 -- 172.21.15.8:0/421183393 >> 172.21.15.8:0/421183393 conn(0x7fe4540633d0 msgr2=0x7fe4540ce320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:04.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:04.188+0000 7fe459496700 1 -- 172.21.15.8:0/421183393 shutdown_connections 2023-10-06T04:38:04.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:04.188+0000 7fe459496700 1 -- 172.21.15.8:0/421183393 wait complete. 2023-10-06T04:38:04.205 INFO:tasks.cephfs_test_runner:test_rebuild_simple (tasks.cephfs.test_recovery_pool.TestRecoveryPool) ... ok 2023-10-06T04:38:04.206 INFO:tasks.cephfs_test_runner: 2023-10-06T04:38:04.206 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-06T04:38:04.206 INFO:tasks.cephfs_test_runner:Ran 1 test in 65.650s 2023-10-06T04:38:04.206 INFO:tasks.cephfs_test_runner: 2023-10-06T04:38:04.206 INFO:tasks.cephfs_test_runner:OK 2023-10-06T04:38:04.207 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-06T04:38:04.216 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-06T04:38:04.234 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-06T04:38:04.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:38:04.234 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2023-10-06T04:38:04.252 INFO:teuthology.orchestra.run.smithi008.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T04:38:04.252 INFO:teuthology.orchestra.run.smithi008.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T04:38:04.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:38:04.252 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T04:38:04.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:38:04.327 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T04:38:04.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:38:04.410 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link delete ceph-brx 2023-10-06T04:38:04.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:38:04.509 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2023-10-06T04:38:04.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:38:04.525 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link delete ceph-brx 2023-10-06T04:38:04.595 INFO:teuthology.orchestra.run.smithi008.stderr:Cannot find device "ceph-brx" 2023-10-06T04:38:04.596 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:38:04.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:38:04.596 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-10-06T04:38:04.614 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T04:38:04.615 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T04:38:04.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:38:04.615 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T04:38:04.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:38:04.699 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T04:38:04.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:38:04.766 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link delete ceph-brx 2023-10-06T04:38:04.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:38:04.841 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-10-06T04:38:04.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:38:04.857 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link delete ceph-brx 2023-10-06T04:38:04.926 INFO:teuthology.orchestra.run.smithi184.stderr:Cannot find device "ceph-brx" 2023-10-06T04:38:04.927 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:38:04.928 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-06T04:38:04.937 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-06T04:38:04.937 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:38:05.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.059+0000 7f3a4c49d700 1 Processor -- start 2023-10-06T04:38:05.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.059+0000 7f3a4c49d700 1 -- start start 2023-10-06T04:38:05.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.060+0000 7f3a4c49d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3a440afde0 0x7f3a440b0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:05.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.060+0000 7f3a4c49d700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a440acca0 con 0x7f3a440ada10 2023-10-06T04:38:05.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.060+0000 7f3a4c49d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a440abe30 con 0x7f3a44155c50 2023-10-06T04:38:05.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.060+0000 7f3a4c49d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a440b07a0 con 0x7f3a440afde0 2023-10-06T04:38:05.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.061+0000 7f3a4aa3a700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3a440afde0 0x7f3a440b0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:05.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.061+0000 7f3a4a239700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f3a44155c50 0x7f3a440ad130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.8:57038/0 (socket says 172.21.15.8:57038) 2023-10-06T04:38:05.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.061+0000 7f3a4a239700 1 -- 172.21.15.8:0/4111192267 learned_addr learned my addr 172.21.15.8:0/4111192267 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:38:05.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.061+0000 7f3a49237700 1 -- 172.21.15.8:0/4111192267 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3560317881 0 0) 0x7f3a440acca0 con 0x7f3a440ada10 2023-10-06T04:38:05.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.061+0000 7f3a49237700 1 -- 172.21.15.8:0/4111192267 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a2c003570 con 0x7f3a440ada10 2023-10-06T04:38:05.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.061+0000 7f3a4aa3a700 1 -- 172.21.15.8:0/4111192267 >> v1:172.21.15.184:6789/0 conn(0x7f3a44155c50 legacy=0x7f3a440ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:05.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.061+0000 7f3a49237700 1 -- 172.21.15.8:0/4111192267 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4162837706 0 0) 0x7f3a440abe30 con 0x7f3a44155c50 2023-10-06T04:38:05.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.061+0000 7f3a4aa3a700 1 -- 172.21.15.8:0/4111192267 >> v1:172.21.15.8:6789/0 conn(0x7f3a440ada10 legacy=0x7f3a440ab720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:05.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.061+0000 7f3a4aa3a700 1 -- 172.21.15.8:0/4111192267 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a440ac090 con 0x7f3a440afde0 2023-10-06T04:38:05.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.061+0000 7f3a4aa3a700 1 --2- 172.21.15.8:0/4111192267 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a440afde0 0x7f3a440b0260 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3a34009910 tx=0x7f3a340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a929d4624dc84509 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:05.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.062+0000 7f3a49237700 1 -- 172.21.15.8:0/4111192267 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3400b640 con 0x7f3a440afde0 2023-10-06T04:38:05.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.062+0000 7f3a49237700 1 -- 172.21.15.8:0/4111192267 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3400b7a0 con 0x7f3a440afde0 2023-10-06T04:38:05.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.062+0000 7f3a49237700 1 -- 172.21.15.8:0/4111192267 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3400bb60 con 0x7f3a440afde0 2023-10-06T04:38:05.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.062+0000 7f3a4c49d700 1 -- 172.21.15.8:0/4111192267 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a440afde0 msgr2=0x7f3a440b0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:05.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.062+0000 7f3a4c49d700 1 --2- 172.21.15.8:0/4111192267 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a440afde0 0x7f3a440b0260 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3a34009910 tx=0x7f3a340091a0 comp rx=0 tx=0).stop 2023-10-06T04:38:05.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.062+0000 7f3a4c49d700 1 -- 172.21.15.8:0/4111192267 shutdown_connections 2023-10-06T04:38:05.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.062+0000 7f3a4c49d700 1 --2- 172.21.15.8:0/4111192267 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a440afde0 0x7f3a440b0260 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:05.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.062+0000 7f3a4c49d700 1 -- 172.21.15.8:0/4111192267 >> 172.21.15.8:0/4111192267 conn(0x7f3a44068070 msgr2=0x7f3a440cc000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:05.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.062+0000 7f3a4c49d700 1 -- 172.21.15.8:0/4111192267 shutdown_connections 2023-10-06T04:38:05.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.062+0000 7f3a4c49d700 1 -- 172.21.15.8:0/4111192267 wait complete. 2023-10-06T04:38:05.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.063+0000 7f3a4c49d700 1 Processor -- start 2023-10-06T04:38:05.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.063+0000 7f3a4c49d700 1 -- start start 2023-10-06T04:38:05.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.064+0000 7f3a4c49d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a440ada10 0x7f3a44146be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:05.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.064+0000 7f3a4c49d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a440afde0 0x7f3a440a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:05.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.064+0000 7f3a4c49d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a44155c50 0x7f3a44153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:05.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.064+0000 7f3a4c49d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a44147120 con 0x7f3a440afde0 2023-10-06T04:38:05.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.064+0000 7f3a4c49d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a440ab0d0 con 0x7f3a44155c50 2023-10-06T04:38:05.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.064+0000 7f3a4c49d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a440ab3b0 con 0x7f3a440ada10 2023-10-06T04:38:05.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.064+0000 7f3a49a38700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a440afde0 0x7f3a440a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:05.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.064+0000 7f3a49a38700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a440afde0 0x7f3a440a84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38358/0 (socket says 172.21.15.8:38358) 2023-10-06T04:38:05.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.064+0000 7f3a49a38700 1 -- 172.21.15.8:0/3054964966 learned_addr learned my addr 172.21.15.8:0/3054964966 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:05.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.064+0000 7f3a4aa3a700 1 --2- 172.21.15.8:0/3054964966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a44155c50 0x7f3a44153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:05.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.064+0000 7f3a4a239700 1 --2- 172.21.15.8:0/3054964966 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a440ada10 0x7f3a44146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:05.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.064+0000 7f3a49a38700 1 -- 172.21.15.8:0/3054964966 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a440ada10 msgr2=0x7f3a44146be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:05.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.064+0000 7f3a49a38700 1 --2- 172.21.15.8:0/3054964966 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a440ada10 0x7f3a44146be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.064+0000 7f3a49a38700 1 -- 172.21.15.8:0/3054964966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a44155c50 msgr2=0x7f3a44153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.064+0000 7f3a49a38700 1 --2- 172.21.15.8:0/3054964966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a44155c50 0x7f3a44153f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.065+0000 7f3a49a38700 1 -- 172.21.15.8:0/3054964966 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a34009420 con 0x7f3a440afde0 2023-10-06T04:38:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.065+0000 7f3a49a38700 1 --2- 172.21.15.8:0/3054964966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a440afde0 0x7f3a440a84d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3a3800c5b0 tx=0x7f3a38007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.065+0000 7f3a427fc700 1 -- 172.21.15.8:0/3054964966 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a380105c0 con 0x7f3a440afde0 2023-10-06T04:38:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.065+0000 7f3a427fc700 1 -- 172.21.15.8:0/3054964966 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a38010720 con 0x7f3a440afde0 2023-10-06T04:38:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.065+0000 7f3a4c49d700 1 -- 172.21.15.8:0/3054964966 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a440ab690 con 0x7f3a440afde0 2023-10-06T04:38:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.065+0000 7f3a427fc700 1 -- 172.21.15.8:0/3054964966 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a38010ae0 con 0x7f3a440afde0 2023-10-06T04:38:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.065+0000 7f3a4c49d700 1 -- 172.21.15.8:0/3054964966 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a440abc50 con 0x7f3a440afde0 2023-10-06T04:38:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.066+0000 7f3a4c49d700 1 -- 172.21.15.8:0/3054964966 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a4406b340 con 0x7f3a440afde0 2023-10-06T04:38:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.066+0000 7f3a427fc700 1 -- 172.21.15.8:0/3054964966 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3a380123e0 con 0x7f3a440afde0 2023-10-06T04:38:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.067+0000 7f3a427fc700 1 --2- 172.21.15.8:0/3054964966 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3a30066f30 0x7f3a300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.067+0000 7f3a427fc700 1 -- 172.21.15.8:0/3054964966 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f3a380840d0 con 0x7f3a440afde0 2023-10-06T04:38:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.067+0000 7f3a4a239700 1 --2- 172.21.15.8:0/3054964966 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3a30066f30 0x7f3a300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.067+0000 7f3a4a239700 1 --2- 172.21.15.8:0/3054964966 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3a30066f30 0x7f3a300693e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c006d60 tx=0x7f3a3c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:05.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.071+0000 7f3a427fc700 1 -- 172.21.15.8:0/3054964966 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3a38051340 con 0x7f3a440afde0 2023-10-06T04:38:05.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.265+0000 7f3a4c49d700 1 -- 172.21.15.8:0/3054964966 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a440648a0 con 0x7f3a440afde0 2023-10-06T04:38:05.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.266+0000 7f3a427fc700 1 -- 172.21.15.8:0/3054964966 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+14062 (secure 0 0 0) 0x7f3a38054960 con 0x7f3a440afde0 2023-10-06T04:38:05.269 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:38:05.269 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":50,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:38:02.181466+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:36:10.148177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:36:10.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.555871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.490505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.504578+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.517217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:05.991135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.537329+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.543232+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.443715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6833/1173304661":"2023-10-07T04:37:59.173758+0000","172.21.15.8:6835/1173304661":"2023-10-07T04:37:59.173758+0000","172.21.15.8:6833/3478733664":"2023-10-07T04:37:26.044067+0000","172.21.15.8:6835/3478733664":"2023-10-07T04:37:26.044067+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:38:05.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.268+0000 7f3a4c49d700 1 -- 172.21.15.8:0/3054964966 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3a30066f30 msgr2=0x7f3a300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:05.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.268+0000 7f3a4c49d700 1 --2- 172.21.15.8:0/3054964966 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3a30066f30 0x7f3a300693e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c006d60 tx=0x7f3a3c009040 comp rx=0 tx=0).stop 2023-10-06T04:38:05.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.268+0000 7f3a4c49d700 1 -- 172.21.15.8:0/3054964966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a440afde0 msgr2=0x7f3a440a84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:05.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.268+0000 7f3a4c49d700 1 --2- 172.21.15.8:0/3054964966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a440afde0 0x7f3a440a84d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3a3800c5b0 tx=0x7f3a38007d90 comp rx=0 tx=0).stop 2023-10-06T04:38:05.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.268+0000 7f3a4c49d700 1 -- 172.21.15.8:0/3054964966 shutdown_connections 2023-10-06T04:38:05.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.268+0000 7f3a4c49d700 1 --2- 172.21.15.8:0/3054964966 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3a30066f30 0x7f3a300693e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:05.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.268+0000 7f3a4c49d700 1 --2- 172.21.15.8:0/3054964966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a44155c50 0x7f3a44153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:05.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.268+0000 7f3a4c49d700 1 --2- 172.21.15.8:0/3054964966 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a440ada10 0x7f3a44146be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:05.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.268+0000 7f3a4c49d700 1 --2- 172.21.15.8:0/3054964966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a440afde0 0x7f3a440a84d0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:05.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.268+0000 7f3a4c49d700 1 -- 172.21.15.8:0/3054964966 >> 172.21.15.8:0/3054964966 conn(0x7f3a44068070 msgr2=0x7f3a44154c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:05.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.268+0000 7f3a4c49d700 1 -- 172.21.15.8:0/3054964966 shutdown_connections 2023-10-06T04:38:05.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.268+0000 7f3a4c49d700 1 -- 172.21.15.8:0/3054964966 wait complete. 2023-10-06T04:38:05.283 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T04:38:05.283 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:38:05.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.400+0000 7fb208744700 1 Processor -- start 2023-10-06T04:38:05.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.400+0000 7fb208744700 1 -- start start 2023-10-06T04:38:05.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.401+0000 7fb208744700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb2000cb360 0x7fb2000d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:05.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.401+0000 7fb208744700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb2000d08d0 0x7fb2000cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:05.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.401+0000 7fb208744700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2000cc4c0 con 0x7fb2000af680 2023-10-06T04:38:05.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.401+0000 7fb208744700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb20015d460 con 0x7fb2000cb360 2023-10-06T04:38:05.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.401+0000 7fb208744700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2000d0d20 con 0x7fb2000d08d0 2023-10-06T04:38:05.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.401+0000 7fb205cdf700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb2000cb360 0x7fb2000d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:05.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.401+0000 7fb205cdf700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb2000cb360 0x7fb2000d0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38368/0 (socket says 172.21.15.8:38368) 2023-10-06T04:38:05.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.401+0000 7fb205cdf700 1 -- 172.21.15.8:0/381498418 learned_addr learned my addr 172.21.15.8:0/381498418 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:05.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.401+0000 7fb206ce1700 1 --2- 172.21.15.8:0/381498418 >> v2:172.21.15.184:3300/0 conn(0x7fb2000d08d0 0x7fb2000cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:05.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.401+0000 7fb205cdf700 1 -- 172.21.15.8:0/381498418 >> v2:172.21.15.184:3300/0 conn(0x7fb2000d08d0 msgr2=0x7fb2000cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:05.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.401+0000 7fb205cdf700 1 --2- 172.21.15.8:0/381498418 >> v2:172.21.15.184:3300/0 conn(0x7fb2000d08d0 0x7fb2000cc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:05.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.401+0000 7fb205cdf700 1 -- 172.21.15.8:0/381498418 >> v1:172.21.15.184:6789/0 conn(0x7fb2000af680 legacy=0x7fb20015e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:05.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.401+0000 7fb205cdf700 1 -- 172.21.15.8:0/381498418 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2000cb8b0 con 0x7fb2000cb360 2023-10-06T04:38:05.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.401+0000 7fb2054de700 1 -- 172.21.15.8:0/381498418 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 764138458 0 0) 0x7fb2000cc4c0 con 0x7fb2000af680 2023-10-06T04:38:05.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.402+0000 7fb205cdf700 1 --2- 172.21.15.8:0/381498418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2000cb360 0x7fb2000d0390 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fb2000b21a0 tx=0x7fb1f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e9e462c77c19ad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:05.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.402+0000 7fb2054de700 1 -- 172.21.15.8:0/381498418 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4009e70 con 0x7fb2000cb360 2023-10-06T04:38:05.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.402+0000 7fb2054de700 1 -- 172.21.15.8:0/381498418 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f400b860 con 0x7fb2000cb360 2023-10-06T04:38:05.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.402+0000 7fb2054de700 1 -- 172.21.15.8:0/381498418 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f400bc00 con 0x7fb2000cb360 2023-10-06T04:38:05.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.402+0000 7fb208744700 1 -- 172.21.15.8:0/381498418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2000cb360 msgr2=0x7fb2000d0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:05.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.402+0000 7fb208744700 1 --2- 172.21.15.8:0/381498418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2000cb360 0x7fb2000d0390 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fb2000b21a0 tx=0x7fb1f4009250 comp rx=0 tx=0).stop 2023-10-06T04:38:05.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.402+0000 7fb208744700 1 -- 172.21.15.8:0/381498418 shutdown_connections 2023-10-06T04:38:05.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.402+0000 7fb208744700 1 --2- 172.21.15.8:0/381498418 >> v2:172.21.15.184:3300/0 conn(0x7fb2000d08d0 0x7fb2000cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:05.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.402+0000 7fb208744700 1 --2- 172.21.15.8:0/381498418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2000cb360 0x7fb2000d0390 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:05.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.402+0000 7fb208744700 1 -- 172.21.15.8:0/381498418 >> 172.21.15.8:0/381498418 conn(0x7fb2000633d0 msgr2=0x7fb2000637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:05.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.402+0000 7fb208744700 1 -- 172.21.15.8:0/381498418 shutdown_connections 2023-10-06T04:38:05.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.402+0000 7fb208744700 1 -- 172.21.15.8:0/381498418 wait complete. 2023-10-06T04:38:05.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.403+0000 7fb208744700 1 Processor -- start 2023-10-06T04:38:05.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.404+0000 7fb208744700 1 -- start start 2023-10-06T04:38:05.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.404+0000 7fb208744700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2000af680 0x7fb20014bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:05.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.404+0000 7fb208744700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2000cb360 0x7fb2000b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:05.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.404+0000 7fb208744700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2000d08d0 0x7fb2000b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:05.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.404+0000 7fb208744700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb200159400 con 0x7fb2000af680 2023-10-06T04:38:05.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.404+0000 7fb208744700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2000c4b30 con 0x7fb2000d08d0 2023-10-06T04:38:05.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.404+0000 7fb208744700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2000c3f20 con 0x7fb2000cb360 2023-10-06T04:38:05.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.404+0000 7fb2064e0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2000af680 0x7fb20014bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:05.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.404+0000 7fb2064e0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2000af680 0x7fb20014bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38374/0 (socket says 172.21.15.8:38374) 2023-10-06T04:38:05.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.404+0000 7fb2064e0700 1 -- 172.21.15.8:0/583597697 learned_addr learned my addr 172.21.15.8:0/583597697 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:05.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.404+0000 7fb205cdf700 1 --2- 172.21.15.8:0/583597697 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2000cb360 0x7fb2000b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:05.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.404+0000 7fb206ce1700 1 --2- 172.21.15.8:0/583597697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2000d08d0 0x7fb2000b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:05.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.405+0000 7fb2064e0700 1 -- 172.21.15.8:0/583597697 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2000cb360 msgr2=0x7fb2000b3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:05.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.405+0000 7fb2064e0700 1 --2- 172.21.15.8:0/583597697 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2000cb360 0x7fb2000b3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:05.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.405+0000 7fb2064e0700 1 -- 172.21.15.8:0/583597697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2000d08d0 msgr2=0x7fb2000b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:05.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.405+0000 7fb2064e0700 1 --2- 172.21.15.8:0/583597697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2000d08d0 0x7fb2000b40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:05.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.405+0000 7fb2064e0700 1 -- 172.21.15.8:0/583597697 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f40094f0 con 0x7fb2000af680 2023-10-06T04:38:05.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.405+0000 7fb205cdf700 1 --2- 172.21.15.8:0/583597697 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2000cb360 0x7fb2000b3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:38:05.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.405+0000 7fb206ce1700 1 --2- 172.21.15.8:0/583597697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2000d08d0 0x7fb2000b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:38:05.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.405+0000 7fb2064e0700 1 --2- 172.21.15.8:0/583597697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2000af680 0x7fb20014bb90 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb1f000c530 tx=0x7fb1f000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:05.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.405+0000 7fb1fe7fc700 1 -- 172.21.15.8:0/583597697 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0011590 con 0x7fb2000af680 2023-10-06T04:38:05.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.405+0000 7fb1fe7fc700 1 -- 172.21.15.8:0/583597697 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f00116f0 con 0x7fb2000af680 2023-10-06T04:38:05.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.405+0000 7fb1fe7fc700 1 -- 172.21.15.8:0/583597697 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0011ab0 con 0x7fb2000af680 2023-10-06T04:38:05.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.405+0000 7fb208744700 1 -- 172.21.15.8:0/583597697 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2000c4200 con 0x7fb2000af680 2023-10-06T04:38:05.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.405+0000 7fb208744700 1 -- 172.21.15.8:0/583597697 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2000c47c0 con 0x7fb2000af680 2023-10-06T04:38:05.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.406+0000 7fb208744700 1 -- 172.21.15.8:0/583597697 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb200071550 con 0x7fb2000af680 2023-10-06T04:38:05.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.406+0000 7fb1fe7fc700 1 -- 172.21.15.8:0/583597697 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb1f001b3b0 con 0x7fb2000af680 2023-10-06T04:38:05.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.407+0000 7fb1fe7fc700 1 --2- 172.21.15.8:0/583597697 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb1ec066f30 0x7fb1ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:05.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.407+0000 7fb1fe7fc700 1 -- 172.21.15.8:0/583597697 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fb1f0083b00 con 0x7fb2000af680 2023-10-06T04:38:05.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.407+0000 7fb205cdf700 1 --2- 172.21.15.8:0/583597697 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb1ec066f30 0x7fb1ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:05.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.407+0000 7fb205cdf700 1 --2- 172.21.15.8:0/583597697 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb1ec066f30 0x7fb1ec0693e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb2000b21a0 tx=0x7fb1f4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:05.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.411+0000 7fb1fe7fc700 1 -- 172.21.15.8:0/583597697 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1f0050d70 con 0x7fb2000af680 2023-10-06T04:38:05.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.601+0000 7fb208744700 1 -- 172.21.15.8:0/583597697 --> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb2000c4c70 con 0x7fb1ec066f30 2023-10-06T04:38:05.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.604+0000 7fb1fe7fc700 1 -- 172.21.15.8:0/583597697 <== mgr.4105 v2:172.21.15.184:6832/90283 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73854 (secure 0 0 0) 0x7fb1f400b9d0 con 0x7fb1ec066f30 2023-10-06T04:38:05.608 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:38:05.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.606+0000 7fb208744700 1 -- 172.21.15.8:0/583597697 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb1ec066f30 msgr2=0x7fb1ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:05.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.606+0000 7fb208744700 1 --2- 172.21.15.8:0/583597697 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb1ec066f30 0x7fb1ec0693e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb2000b21a0 tx=0x7fb1f4017000 comp rx=0 tx=0).stop 2023-10-06T04:38:05.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.606+0000 7fb208744700 1 -- 172.21.15.8:0/583597697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2000af680 msgr2=0x7fb20014bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:05.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.606+0000 7fb208744700 1 --2- 172.21.15.8:0/583597697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2000af680 0x7fb20014bb90 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb1f000c530 tx=0x7fb1f000c8f0 comp rx=0 tx=0).stop 2023-10-06T04:38:05.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.606+0000 7fb208744700 1 -- 172.21.15.8:0/583597697 shutdown_connections 2023-10-06T04:38:05.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.606+0000 7fb208744700 1 --2- 172.21.15.8:0/583597697 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fb1ec066f30 0x7fb1ec0693e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:05.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.606+0000 7fb208744700 1 --2- 172.21.15.8:0/583597697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2000d08d0 0x7fb2000b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:05.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.606+0000 7fb208744700 1 --2- 172.21.15.8:0/583597697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2000af680 0x7fb20014bb90 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:05.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.606+0000 7fb208744700 1 --2- 172.21.15.8:0/583597697 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2000cb360 0x7fb2000b3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:05.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.606+0000 7fb208744700 1 -- 172.21.15.8:0/583597697 >> 172.21.15.8:0/583597697 conn(0x7fb2000633d0 msgr2=0x7fb2000b0820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:05.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.606+0000 7fb208744700 1 -- 172.21.15.8:0/583597697 shutdown_connections 2023-10-06T04:38:05.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.606+0000 7fb208744700 1 -- 172.21.15.8:0/583597697 wait complete. 2023-10-06T04:38:05.610 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-06T04:38:05.621 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2023-10-06T04:38:04.657898+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":217,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2396184,"kb_used_data":17880,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752578536,"statfs":{"total":773094113280,"available":770640420864,"internally_reserved":0,"allocated":18309120,"data_stored":15894505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6321510,"num_objects":-15,"num_object_clones":0,"num_object_copies":-30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-15,"num_whiteouts":0,"num_read":-50,"num_read_kb":-37,"num_write":-46,"num_write_kb":-6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001446"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":39,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T04:37:55.349139+0000","last_change":"2023-10-06T04:36:11.192215+0000","last_active":"2023-10-06T04:37:55.349139+0000","last_peered":"2023-10-06T04:37:55.349139+0000","last_clean":"2023-10-06T04:37:55.349139+0000","last_became_active":"2023-10-06T04:36:11.191953+0000","last_became_peered":"2023-10-06T04:36:11.191953+0000","last_unstale":"2023-10-06T04:37:55.349139+0000","last_undegraded":"2023-10-06T04:37:55.349139+0000","last_fullsized":"2023-10-06T04:37:55.349139+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:37.026121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":35,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T04:37:31.543989+0000","last_change":"2023-10-06T04:36:11.184555+0000","last_active":"2023-10-06T04:37:31.543989+0000","last_peered":"2023-10-06T04:37:31.543989+0000","last_clean":"2023-10-06T04:37:31.543989+0000","last_became_active":"2023-10-06T04:36:11.184229+0000","last_became_peered":"2023-10-06T04:36:11.184229+0000","last_unstale":"2023-10-06T04:37:31.543989+0000","last_undegraded":"2023-10-06T04:37:31.543989+0000","last_fullsized":"2023-10-06T04:37:31.543989+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:19.938716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":35,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T04:37:55.348119+0000","last_change":"2023-10-06T04:36:11.184460+0000","last_active":"2023-10-06T04:37:55.348119+0000","last_peered":"2023-10-06T04:37:55.348119+0000","last_clean":"2023-10-06T04:37:55.348119+0000","last_became_active":"2023-10-06T04:36:11.184119+0000","last_became_peered":"2023-10-06T04:36:11.184119+0000","last_unstale":"2023-10-06T04:37:55.348119+0000","last_undegraded":"2023-10-06T04:37:55.348119+0000","last_fullsized":"2023-10-06T04:37:55.348119+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:37.026121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":182,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T04:37:31.929167+0000","last_change":"2023-10-06T04:36:12.183155+0000","last_active":"2023-10-06T04:37:31.929167+0000","last_peered":"2023-10-06T04:37:31.929167+0000","last_clean":"2023-10-06T04:37:31.929167+0000","last_became_active":"2023-10-06T04:36:12.182903+0000","last_became_peered":"2023-10-06T04:36:12.182903+0000","last_unstale":"2023-10-06T04:37:31.929167+0000","last_undegraded":"2023-10-06T04:37:31.929167+0000","last_fullsized":"2023-10-06T04:37:31.929167+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:11.171104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:11.171104+0000","last_clean_scrub_stamp":"2023-10-06T04:36:11.171104+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:38:54.323364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":33,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T04:37:31.929396+0000","last_change":"2023-10-06T04:36:11.193056+0000","last_active":"2023-10-06T04:37:31.929396+0000","last_peered":"2023-10-06T04:37:31.929396+0000","last_clean":"2023-10-06T04:37:31.929396+0000","last_became_active":"2023-10-06T04:36:11.192712+0000","last_became_peered":"2023-10-06T04:36:11.192712+0000","last_unstale":"2023-10-06T04:37:31.929396+0000","last_undegraded":"2023-10-06T04:37:31.929396+0000","last_fullsized":"2023-10-06T04:37:31.929396+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:00.008654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":33,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T04:37:31.929488+0000","last_change":"2023-10-06T04:36:11.192701+0000","last_active":"2023-10-06T04:37:31.929488+0000","last_peered":"2023-10-06T04:37:31.929488+0000","last_clean":"2023-10-06T04:37:31.929488+0000","last_became_active":"2023-10-06T04:36:11.192335+0000","last_became_peered":"2023-10-06T04:36:11.192335+0000","last_unstale":"2023-10-06T04:37:31.929488+0000","last_undegraded":"2023-10-06T04:37:31.929488+0000","last_fullsized":"2023-10-06T04:37:31.929488+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:18.643570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T04:37:30.789741+0000","last_change":"2023-10-06T04:36:11.193497+0000","last_active":"2023-10-06T04:37:30.789741+0000","last_peered":"2023-10-06T04:37:30.789741+0000","last_clean":"2023-10-06T04:37:30.789741+0000","last_became_active":"2023-10-06T04:36:11.193215+0000","last_became_peered":"2023-10-06T04:36:11.193215+0000","last_unstale":"2023-10-06T04:37:30.789741+0000","last_undegraded":"2023-10-06T04:37:30.789741+0000","last_fullsized":"2023-10-06T04:37:30.789741+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:07.497987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":32,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T04:37:31.133103+0000","last_change":"2023-10-06T04:36:11.193111+0000","last_active":"2023-10-06T04:37:31.133103+0000","last_peered":"2023-10-06T04:37:31.133103+0000","last_clean":"2023-10-06T04:37:31.133103+0000","last_became_active":"2023-10-06T04:36:11.192836+0000","last_became_peered":"2023-10-06T04:36:11.192836+0000","last_unstale":"2023-10-06T04:37:31.133103+0000","last_undegraded":"2023-10-06T04:37:31.133103+0000","last_fullsized":"2023-10-06T04:37:31.133103+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:19.938716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":32,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T04:37:31.133079+0000","last_change":"2023-10-06T04:36:11.182804+0000","last_active":"2023-10-06T04:37:31.133079+0000","last_peered":"2023-10-06T04:37:31.133079+0000","last_clean":"2023-10-06T04:37:31.133079+0000","last_became_active":"2023-10-06T04:36:11.182575+0000","last_became_peered":"2023-10-06T04:36:11.182575+0000","last_unstale":"2023-10-06T04:37:31.133079+0000","last_undegraded":"2023-10-06T04:37:31.133079+0000","last_fullsized":"2023-10-06T04:37:31.133079+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:07.497987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298416,"kb_used_data":1128,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073424,"statfs":{"total":96636764160,"available":96331186176,"internally_reserved":0,"allocated":1155072,"data_stored":848883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.36099999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.432}]},{"osd":2,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.54800000000000004}]},{"osd":3,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.46800000000000003}]},{"osd":4,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.498},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.60299999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.53600000000000003}]},{"osd":6,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.52700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301924,"kb_used_data":4636,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94069916,"statfs":{"total":96636764160,"available":96327593984,"internally_reserved":0,"allocated":4747264,"data_stored":4452659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":10.045999999999999,"5min":10.045999999999999,"15min":10.045999999999999},"last":0.41099999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":10.125999999999999,"5min":10.125999999999999,"15min":10.125999999999999},"last":0.434},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.45100000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":10.238,"5min":10.238,"15min":10.238},"last":0.498}]},{"osd":3,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":4.4870000000000001,"5min":4.4870000000000001,"15min":4.4870000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":10.393000000000001,"5min":10.393000000000001,"15min":10.393000000000001},"last":0.56899999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.60599999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.621}]},{"osd":7,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.64400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298412,"kb_used_data":1124,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073428,"statfs":{"total":96636764160,"available":96331190272,"internally_reserved":0,"allocated":1150976,"data_stored":848813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.249}]},{"osd":2,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.41899999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.315}]},{"osd":4,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.622},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.57999999999999996}]},{"osd":5,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56499999999999995}]},{"osd":6,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.55500000000000005}]},{"osd":7,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.498},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.60199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301960,"kb_used_data":4672,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94069880,"statfs":{"total":96636764160,"available":96327557120,"internally_reserved":0,"allocated":4784128,"data_stored":4481519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"last":0.247},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.443,"5min":0.443,"15min":0.443},"last":0.34499999999999997}]},{"osd":2,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.36299999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.39900000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.64200000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.66800000000000004}]},{"osd":6,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.65500000000000003}]},{"osd":7,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.60699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297832,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074008,"statfs":{"total":96636764160,"available":96331784192,"internally_reserved":0,"allocated":557056,"data_stored":257433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.24099999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.316}]},{"osd":3,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.28199999999999997}]},{"osd":4,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.5}]},{"osd":5,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.40100000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.435}]},{"osd":7,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.48999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297832,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074008,"statfs":{"total":96636764160,"available":96331784192,"internally_reserved":0,"allocated":557056,"data_stored":257433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.216},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.442,"5min":0.442,"15min":0.442},"last":0.29799999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.436,"5min":0.436,"15min":0.436},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.39700000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.56599999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.1070000000000002,"5min":2.1070000000000002,"15min":2.1070000000000002},"last":0.45200000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.505}]},{"osd":6,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.48599999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.433}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299924,"kb_used_data":2636,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071916,"statfs":{"total":96636764160,"available":96329641984,"internally_reserved":0,"allocated":2699264,"data_stored":2391634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":4.2919999999999998,"5min":4.2919999999999998,"15min":4.2919999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.47699999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":4.3520000000000003,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":0.52800000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.434}]},{"osd":3,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.61599999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.55600000000000005}]},{"osd":6,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.54400000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299884,"kb_used_data":2596,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071956,"statfs":{"total":96636764160,"available":96329682944,"internally_reserved":0,"allocated":2658304,"data_stored":2356131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.58199999999999996}]},{"osd":1,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.622}]},{"osd":2,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.379},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.56399999999999995}]},{"osd":3,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.439},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.495}]},{"osd":4,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.52500000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.59799999999999998}]},{"osd":7,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.60999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:38:05.623 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:38:05.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.739+0000 7f79326bb700 1 Processor -- start 2023-10-06T04:38:05.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.739+0000 7f79326bb700 1 -- start start 2023-10-06T04:38:05.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.740+0000 7f79326bb700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f792c153740 0x7f792c153b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:05.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.740+0000 7f79326bb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f792c15a7b0 0x7f792c0cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:05.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.740+0000 7f79326bb700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f792c15d170 con 0x7f792c15d8e0 2023-10-06T04:38:05.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.740+0000 7f79326bb700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f792c0ca990 con 0x7f792c153740 2023-10-06T04:38:05.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.740+0000 7f79326bb700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792c0cac70 con 0x7f792c15a7b0 2023-10-06T04:38:05.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.740+0000 7f7931eba700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f792c15d8e0 0x7f792c0696c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46936/0 (socket says 172.21.15.8:46936) 2023-10-06T04:38:05.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.740+0000 7f7931eba700 1 -- 172.21.15.8:0/206383458 learned_addr learned my addr 172.21.15.8:0/206383458 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:38:05.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.740+0000 7f79316b9700 1 --2- 172.21.15.8:0/206383458 >> v2:172.21.15.184:3300/0 conn(0x7f792c153740 0x7f792c153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:05.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.740+0000 7f7930eb8700 1 --2- 172.21.15.8:0/206383458 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f792c15a7b0 0x7f792c0cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:05.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.740+0000 7f792bfff700 1 -- 172.21.15.8:0/206383458 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2263248302 0 0) 0x7f792c15d170 con 0x7f792c15d8e0 2023-10-06T04:38:05.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.740+0000 7f792bfff700 1 -- 172.21.15.8:0/206383458 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7914003570 con 0x7f792c15d8e0 2023-10-06T04:38:05.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.741+0000 7f792bfff700 1 -- 172.21.15.8:0/206383458 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2192561720 0 0) 0x7f7914003570 con 0x7f792c15d8e0 2023-10-06T04:38:05.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.741+0000 7f792bfff700 1 -- 172.21.15.8:0/206383458 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f792c15a7b0 msgr2=0x7f792c0cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:05.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.741+0000 7f792bfff700 1 --2- 172.21.15.8:0/206383458 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f792c15a7b0 0x7f792c0cfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:05.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.741+0000 7f792bfff700 1 -- 172.21.15.8:0/206383458 >> v2:172.21.15.184:3300/0 conn(0x7f792c153740 msgr2=0x7f792c153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:05.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.741+0000 7f792bfff700 1 --2- 172.21.15.8:0/206383458 >> v2:172.21.15.184:3300/0 conn(0x7f792c153740 0x7f792c153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:05.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.741+0000 7f792bfff700 1 -- 172.21.15.8:0/206383458 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792c0caf50 con 0x7f792c15d8e0 2023-10-06T04:38:05.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.741+0000 7f792bfff700 1 -- 172.21.15.8:0/206383458 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7f791c0017f0 con 0x7f792c15d8e0 2023-10-06T04:38:05.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.741+0000 7f792bfff700 1 -- 172.21.15.8:0/206383458 >> v1:172.21.15.8:6789/0 conn(0x7f792c15d8e0 legacy=0x7f792c0696c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:05.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.741+0000 7f792bfff700 1 --2- 172.21.15.8:0/206383458 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7914003a60 0x7f7914003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:05.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.741+0000 7f792bfff700 1 --2- 172.21.15.8:0/206383458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7914004810 0x7f7914004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:05.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.741+0000 7f792bfff700 1 --2- 172.21.15.8:0/206383458 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f792c15a7b0 0x7f79140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:05.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.741+0000 7f792bfff700 1 -- 172.21.15.8:0/206383458 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792c0ca990 con 0x7f7914004810 2023-10-06T04:38:05.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.741+0000 7f792bfff700 1 -- 172.21.15.8:0/206383458 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792c0cac70 con 0x7f7914003a60 2023-10-06T04:38:05.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.741+0000 7f792bfff700 1 -- 172.21.15.8:0/206383458 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f791400ba60 con 0x7f792c15a7b0 2023-10-06T04:38:05.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.741+0000 7f7930eb8700 1 --2- 172.21.15.8:0/206383458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7914004810 0x7f7914004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:05.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.741+0000 7f79316b9700 1 --2- 172.21.15.8:0/206383458 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7914003a60 0x7f7914003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:05.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.741+0000 7f7931eba700 1 --2- 172.21.15.8:0/206383458 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f792c15a7b0 0x7f79140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:05.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.741+0000 7f7930eb8700 1 -- 172.21.15.8:0/206383458 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f792c15a7b0 msgr2=0x7f79140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:05.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.741+0000 7f7930eb8700 1 --2- 172.21.15.8:0/206383458 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f792c15a7b0 0x7f79140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:05.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.741+0000 7f7930eb8700 1 -- 172.21.15.8:0/206383458 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7914003a60 msgr2=0x7f7914003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:05.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.741+0000 7f7930eb8700 1 --2- 172.21.15.8:0/206383458 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7914003a60 0x7f7914003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:05.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.741+0000 7f7930eb8700 1 -- 172.21.15.8:0/206383458 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7914003570 con 0x7f7914004810 2023-10-06T04:38:05.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.741+0000 7f7930eb8700 1 --2- 172.21.15.8:0/206383458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7914004810 0x7f7914004c80 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f7920009c30 tx=0x7f79200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=884c86f80f32430a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:05.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.741+0000 7f792bfff700 1 -- 172.21.15.8:0/206383458 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792000e710 con 0x7f7914004810 2023-10-06T04:38:05.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.741+0000 7f792bfff700 1 -- 172.21.15.8:0/206383458 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792000e870 con 0x7f7914004810 2023-10-06T04:38:05.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.741+0000 7f792bfff700 1 -- 172.21.15.8:0/206383458 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792000ec30 con 0x7f7914004810 2023-10-06T04:38:05.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.742+0000 7f79326bb700 1 -- 172.21.15.8:0/206383458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7914004810 msgr2=0x7f7914004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:05.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.742+0000 7f79326bb700 1 --2- 172.21.15.8:0/206383458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7914004810 0x7f7914004c80 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f7920009c30 tx=0x7f79200091a0 comp rx=0 tx=0).stop 2023-10-06T04:38:05.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.742+0000 7f7931eba700 1 -- 172.21.15.8:0/206383458 reap_dead start 2023-10-06T04:38:05.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.742+0000 7f79326bb700 1 -- 172.21.15.8:0/206383458 shutdown_connections 2023-10-06T04:38:05.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.742+0000 7f79326bb700 1 -- 172.21.15.8:0/206383458 >> 172.21.15.8:0/206383458 conn(0x7f792c0d02b0 msgr2=0x7f792c0d06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:05.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.742+0000 7f79326bb700 1 -- 172.21.15.8:0/206383458 shutdown_connections 2023-10-06T04:38:05.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.742+0000 7f79326bb700 1 -- 172.21.15.8:0/206383458 wait complete. 2023-10-06T04:38:05.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.743+0000 7f79326bb700 1 Processor -- start 2023-10-06T04:38:05.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.743+0000 7f79326bb700 1 -- start start 2023-10-06T04:38:05.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.744+0000 7f79326bb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7914004810 0x7f792c151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:05.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.744+0000 7f79326bb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f792c15b900 0x7f792c0c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:05.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.744+0000 7f79326bb700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f792c0b0e00 0x7f792c0b1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:05.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.744+0000 7f79326bb700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792c0b17c0 con 0x7f792c15b900 2023-10-06T04:38:05.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.744+0000 7f79326bb700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792c0c8f90 con 0x7f792c0b0e00 2023-10-06T04:38:05.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.744+0000 7f79326bb700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792c0c9dd0 con 0x7f7914004810 2023-10-06T04:38:05.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.744+0000 7f7930eb8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f792c15b900 0x7f792c0c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:05.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.744+0000 7f7930eb8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f792c15b900 0x7f792c0c8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38390/0 (socket says 172.21.15.8:38390) 2023-10-06T04:38:05.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.744+0000 7f7930eb8700 1 -- 172.21.15.8:0/1598121209 learned_addr learned my addr 172.21.15.8:0/1598121209 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:05.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.744+0000 7f79316b9700 1 --2- 172.21.15.8:0/1598121209 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7914004810 0x7f792c151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:05.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.744+0000 7f7931eba700 1 --2- 172.21.15.8:0/1598121209 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f792c0b0e00 0x7f792c0b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:05.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.745+0000 7f7930eb8700 1 -- 172.21.15.8:0/1598121209 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7914004810 msgr2=0x7f792c151ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:05.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.745+0000 7f7930eb8700 1 --2- 172.21.15.8:0/1598121209 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7914004810 0x7f792c151ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:05.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.745+0000 7f7930eb8700 1 -- 172.21.15.8:0/1598121209 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f792c0b0e00 msgr2=0x7f792c0b1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:05.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.745+0000 7f7930eb8700 1 --2- 172.21.15.8:0/1598121209 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f792c0b0e00 0x7f792c0b1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:05.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.745+0000 7f7930eb8700 1 -- 172.21.15.8:0/1598121209 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792c15bd70 con 0x7f792c15b900 2023-10-06T04:38:05.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.745+0000 7f7931eba700 1 --2- 172.21.15.8:0/1598121209 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f792c0b0e00 0x7f792c0b1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:38:05.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.745+0000 7f7930eb8700 1 --2- 172.21.15.8:0/1598121209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f792c15b900 0x7f792c0c8a50 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f792000e4b0 tx=0x7f792001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:05.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.745+0000 7f79297fa700 1 -- 172.21.15.8:0/1598121209 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7920022070 con 0x7f792c15b900 2023-10-06T04:38:05.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.745+0000 7f79297fa700 1 -- 172.21.15.8:0/1598121209 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792000e9e0 con 0x7f792c15b900 2023-10-06T04:38:05.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.745+0000 7f79326bb700 1 -- 172.21.15.8:0/1598121209 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f792c0c91c0 con 0x7f792c15b900 2023-10-06T04:38:05.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.745+0000 7f79297fa700 1 -- 172.21.15.8:0/1598121209 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792001c450 con 0x7f792c15b900 2023-10-06T04:38:05.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.745+0000 7f79326bb700 1 -- 172.21.15.8:0/1598121209 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f792c0c9780 con 0x7f792c15b900 2023-10-06T04:38:05.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.746+0000 7f79326bb700 1 -- 172.21.15.8:0/1598121209 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f792c1551a0 con 0x7f792c15b900 2023-10-06T04:38:05.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.746+0000 7f79297fa700 1 -- 172.21.15.8:0/1598121209 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f792001c860 con 0x7f792c15b900 2023-10-06T04:38:05.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.747+0000 7f79297fa700 1 --2- 172.21.15.8:0/1598121209 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7918066f30 0x7f79180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:05.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.747+0000 7f79297fa700 1 -- 172.21.15.8:0/1598121209 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f7920085ca0 con 0x7f792c15b900 2023-10-06T04:38:05.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.747+0000 7f79316b9700 1 --2- 172.21.15.8:0/1598121209 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7918066f30 0x7f79180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:05.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.747+0000 7f79316b9700 1 --2- 172.21.15.8:0/1598121209 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7918066f30 0x7f79180693e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7924006f00 tx=0x7f79240091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:05.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.751+0000 7f79297fa700 1 -- 172.21.15.8:0/1598121209 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7920052f90 con 0x7f792c15b900 2023-10-06T04:38:05.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.940+0000 7f79326bb700 1 -- 172.21.15.8:0/1598121209 --> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f792c04c380 con 0x7f7918066f30 2023-10-06T04:38:05.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.944+0000 7f79297fa700 1 -- 172.21.15.8:0/1598121209 <== mgr.4105 v2:172.21.15.184:6832/90283 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73854 (secure 0 0 0) 0x7f792c04c380 con 0x7f7918066f30 2023-10-06T04:38:05.947 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:38:05.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.946+0000 7f79326bb700 1 -- 172.21.15.8:0/1598121209 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7918066f30 msgr2=0x7f79180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:05.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.946+0000 7f79326bb700 1 --2- 172.21.15.8:0/1598121209 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7918066f30 0x7f79180693e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7924006f00 tx=0x7f79240091a0 comp rx=0 tx=0).stop 2023-10-06T04:38:05.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.946+0000 7f79326bb700 1 -- 172.21.15.8:0/1598121209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f792c15b900 msgr2=0x7f792c0c8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:05.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.946+0000 7f79326bb700 1 --2- 172.21.15.8:0/1598121209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f792c15b900 0x7f792c0c8a50 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f792000e4b0 tx=0x7f792001a000 comp rx=0 tx=0).stop 2023-10-06T04:38:05.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.946+0000 7f79326bb700 1 -- 172.21.15.8:0/1598121209 shutdown_connections 2023-10-06T04:38:05.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.946+0000 7f79326bb700 1 --2- 172.21.15.8:0/1598121209 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7918066f30 0x7f79180693e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:05.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.946+0000 7f79326bb700 1 --2- 172.21.15.8:0/1598121209 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f792c0b0e00 0x7f792c0b1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:05.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.946+0000 7f79326bb700 1 --2- 172.21.15.8:0/1598121209 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7914004810 0x7f792c151ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:05.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.946+0000 7f79326bb700 1 --2- 172.21.15.8:0/1598121209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f792c15b900 0x7f792c0c8a50 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:05.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.946+0000 7f79326bb700 1 -- 172.21.15.8:0/1598121209 >> 172.21.15.8:0/1598121209 conn(0x7f792c0d02b0 msgr2=0x7f792c0d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:05.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.946+0000 7f79326bb700 1 -- 172.21.15.8:0/1598121209 shutdown_connections 2023-10-06T04:38:05.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:05.946+0000 7f79326bb700 1 -- 172.21.15.8:0/1598121209 wait complete. 2023-10-06T04:38:05.950 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-06T04:38:05.960 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2023-10-06T04:38:04.657898+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":217,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2396184,"kb_used_data":17880,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752578536,"statfs":{"total":773094113280,"available":770640420864,"internally_reserved":0,"allocated":18309120,"data_stored":15894505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6321510,"num_objects":-15,"num_object_clones":0,"num_object_copies":-30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-15,"num_whiteouts":0,"num_read":-50,"num_read_kb":-37,"num_write":-46,"num_write_kb":-6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001446"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":39,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T04:37:55.349139+0000","last_change":"2023-10-06T04:36:11.192215+0000","last_active":"2023-10-06T04:37:55.349139+0000","last_peered":"2023-10-06T04:37:55.349139+0000","last_clean":"2023-10-06T04:37:55.349139+0000","last_became_active":"2023-10-06T04:36:11.191953+0000","last_became_peered":"2023-10-06T04:36:11.191953+0000","last_unstale":"2023-10-06T04:37:55.349139+0000","last_undegraded":"2023-10-06T04:37:55.349139+0000","last_fullsized":"2023-10-06T04:37:55.349139+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:37.026121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":35,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T04:37:31.543989+0000","last_change":"2023-10-06T04:36:11.184555+0000","last_active":"2023-10-06T04:37:31.543989+0000","last_peered":"2023-10-06T04:37:31.543989+0000","last_clean":"2023-10-06T04:37:31.543989+0000","last_became_active":"2023-10-06T04:36:11.184229+0000","last_became_peered":"2023-10-06T04:36:11.184229+0000","last_unstale":"2023-10-06T04:37:31.543989+0000","last_undegraded":"2023-10-06T04:37:31.543989+0000","last_fullsized":"2023-10-06T04:37:31.543989+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:19.938716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":35,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T04:37:55.348119+0000","last_change":"2023-10-06T04:36:11.184460+0000","last_active":"2023-10-06T04:37:55.348119+0000","last_peered":"2023-10-06T04:37:55.348119+0000","last_clean":"2023-10-06T04:37:55.348119+0000","last_became_active":"2023-10-06T04:36:11.184119+0000","last_became_peered":"2023-10-06T04:36:11.184119+0000","last_unstale":"2023-10-06T04:37:55.348119+0000","last_undegraded":"2023-10-06T04:37:55.348119+0000","last_fullsized":"2023-10-06T04:37:55.348119+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:37.026121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":182,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T04:37:31.929167+0000","last_change":"2023-10-06T04:36:12.183155+0000","last_active":"2023-10-06T04:37:31.929167+0000","last_peered":"2023-10-06T04:37:31.929167+0000","last_clean":"2023-10-06T04:37:31.929167+0000","last_became_active":"2023-10-06T04:36:12.182903+0000","last_became_peered":"2023-10-06T04:36:12.182903+0000","last_unstale":"2023-10-06T04:37:31.929167+0000","last_undegraded":"2023-10-06T04:37:31.929167+0000","last_fullsized":"2023-10-06T04:37:31.929167+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:11.171104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:11.171104+0000","last_clean_scrub_stamp":"2023-10-06T04:36:11.171104+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:38:54.323364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":33,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T04:37:31.929396+0000","last_change":"2023-10-06T04:36:11.193056+0000","last_active":"2023-10-06T04:37:31.929396+0000","last_peered":"2023-10-06T04:37:31.929396+0000","last_clean":"2023-10-06T04:37:31.929396+0000","last_became_active":"2023-10-06T04:36:11.192712+0000","last_became_peered":"2023-10-06T04:36:11.192712+0000","last_unstale":"2023-10-06T04:37:31.929396+0000","last_undegraded":"2023-10-06T04:37:31.929396+0000","last_fullsized":"2023-10-06T04:37:31.929396+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:00.008654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":33,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T04:37:31.929488+0000","last_change":"2023-10-06T04:36:11.192701+0000","last_active":"2023-10-06T04:37:31.929488+0000","last_peered":"2023-10-06T04:37:31.929488+0000","last_clean":"2023-10-06T04:37:31.929488+0000","last_became_active":"2023-10-06T04:36:11.192335+0000","last_became_peered":"2023-10-06T04:36:11.192335+0000","last_unstale":"2023-10-06T04:37:31.929488+0000","last_undegraded":"2023-10-06T04:37:31.929488+0000","last_fullsized":"2023-10-06T04:37:31.929488+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:18.643570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T04:37:30.789741+0000","last_change":"2023-10-06T04:36:11.193497+0000","last_active":"2023-10-06T04:37:30.789741+0000","last_peered":"2023-10-06T04:37:30.789741+0000","last_clean":"2023-10-06T04:37:30.789741+0000","last_became_active":"2023-10-06T04:36:11.193215+0000","last_became_peered":"2023-10-06T04:36:11.193215+0000","last_unstale":"2023-10-06T04:37:30.789741+0000","last_undegraded":"2023-10-06T04:37:30.789741+0000","last_fullsized":"2023-10-06T04:37:30.789741+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:07.497987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":32,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T04:37:31.133103+0000","last_change":"2023-10-06T04:36:11.193111+0000","last_active":"2023-10-06T04:37:31.133103+0000","last_peered":"2023-10-06T04:37:31.133103+0000","last_clean":"2023-10-06T04:37:31.133103+0000","last_became_active":"2023-10-06T04:36:11.192836+0000","last_became_peered":"2023-10-06T04:36:11.192836+0000","last_unstale":"2023-10-06T04:37:31.133103+0000","last_undegraded":"2023-10-06T04:37:31.133103+0000","last_fullsized":"2023-10-06T04:37:31.133103+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:19.938716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":32,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T04:37:31.133079+0000","last_change":"2023-10-06T04:36:11.182804+0000","last_active":"2023-10-06T04:37:31.133079+0000","last_peered":"2023-10-06T04:37:31.133079+0000","last_clean":"2023-10-06T04:37:31.133079+0000","last_became_active":"2023-10-06T04:36:11.182575+0000","last_became_peered":"2023-10-06T04:36:11.182575+0000","last_unstale":"2023-10-06T04:37:31.133079+0000","last_undegraded":"2023-10-06T04:37:31.133079+0000","last_fullsized":"2023-10-06T04:37:31.133079+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:07.497987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298416,"kb_used_data":1128,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073424,"statfs":{"total":96636764160,"available":96331186176,"internally_reserved":0,"allocated":1155072,"data_stored":848883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.36099999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.432}]},{"osd":2,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.54800000000000004}]},{"osd":3,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.46800000000000003}]},{"osd":4,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.498},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.60299999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.53600000000000003}]},{"osd":6,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.52700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301924,"kb_used_data":4636,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94069916,"statfs":{"total":96636764160,"available":96327593984,"internally_reserved":0,"allocated":4747264,"data_stored":4452659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":10.045999999999999,"5min":10.045999999999999,"15min":10.045999999999999},"last":0.41099999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":10.125999999999999,"5min":10.125999999999999,"15min":10.125999999999999},"last":0.434},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.45100000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":10.238,"5min":10.238,"15min":10.238},"last":0.498}]},{"osd":3,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":4.4870000000000001,"5min":4.4870000000000001,"15min":4.4870000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":10.393000000000001,"5min":10.393000000000001,"15min":10.393000000000001},"last":0.56899999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.60599999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.621}]},{"osd":7,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.64400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298412,"kb_used_data":1124,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073428,"statfs":{"total":96636764160,"available":96331190272,"internally_reserved":0,"allocated":1150976,"data_stored":848813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.249}]},{"osd":2,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.41899999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.315}]},{"osd":4,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.622},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.57999999999999996}]},{"osd":5,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56499999999999995}]},{"osd":6,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.55500000000000005}]},{"osd":7,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.498},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.60199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301960,"kb_used_data":4672,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94069880,"statfs":{"total":96636764160,"available":96327557120,"internally_reserved":0,"allocated":4784128,"data_stored":4481519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"last":0.247},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.443,"5min":0.443,"15min":0.443},"last":0.34499999999999997}]},{"osd":2,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.36299999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.39900000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.64200000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.66800000000000004}]},{"osd":6,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.65500000000000003}]},{"osd":7,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.60699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297832,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074008,"statfs":{"total":96636764160,"available":96331784192,"internally_reserved":0,"allocated":557056,"data_stored":257433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.24099999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.316}]},{"osd":3,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.28199999999999997}]},{"osd":4,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.5}]},{"osd":5,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.40100000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.435}]},{"osd":7,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.48999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297832,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074008,"statfs":{"total":96636764160,"available":96331784192,"internally_reserved":0,"allocated":557056,"data_stored":257433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.216},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.442,"5min":0.442,"15min":0.442},"last":0.29799999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.436,"5min":0.436,"15min":0.436},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.39700000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.56599999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.1070000000000002,"5min":2.1070000000000002,"15min":2.1070000000000002},"last":0.45200000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.505}]},{"osd":6,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.48599999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.433}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299924,"kb_used_data":2636,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071916,"statfs":{"total":96636764160,"available":96329641984,"internally_reserved":0,"allocated":2699264,"data_stored":2391634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":4.2919999999999998,"5min":4.2919999999999998,"15min":4.2919999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.47699999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":4.3520000000000003,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":0.52800000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.434}]},{"osd":3,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.61599999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.55600000000000005}]},{"osd":6,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.54400000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299884,"kb_used_data":2596,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071956,"statfs":{"total":96636764160,"available":96329682944,"internally_reserved":0,"allocated":2658304,"data_stored":2356131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.58199999999999996}]},{"osd":1,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.622}]},{"osd":2,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.379},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.56399999999999995}]},{"osd":3,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.439},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.495}]},{"osd":4,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.52500000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.59799999999999998}]},{"osd":7,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.60999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:38:05.963 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T04:38:05.963 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:38:06.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.079+0000 7ff12f59e700 1 Processor -- start 2023-10-06T04:38:06.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.079+0000 7ff12f59e700 1 -- start start 2023-10-06T04:38:06.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.080+0000 7ff12f59e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff13006be70 0x7ff1300cc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:06.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.080+0000 7ff12f59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff130140f40 0x7ff1300cc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:06.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.080+0000 7ff12f59e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1300ccf00 con 0x7ff13006baa0 2023-10-06T04:38:06.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.080+0000 7ff12f59e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1300b2610 con 0x7ff13006be70 2023-10-06T04:38:06.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.080+0000 7ff12f59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1300cd1e0 con 0x7ff130140f40 2023-10-06T04:38:06.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.080+0000 7ff12ed9d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff130140f40 0x7ff1300cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:06.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.081+0000 7ff12dd9b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff13006be70 0x7ff1300cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:06.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.081+0000 7ff12e59c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7ff13006baa0 0x7ff130140830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.8:57064/0 (socket says 172.21.15.8:57064) 2023-10-06T04:38:06.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.081+0000 7ff12e59c700 1 -- 172.21.15.8:0/833992661 learned_addr learned my addr 172.21.15.8:0/833992661 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:38:06.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.081+0000 7ff12dd9b700 1 -- 172.21.15.8:0/833992661 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff130140f40 msgr2=0x7ff1300cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:06.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.081+0000 7ff12dd9b700 1 --2- 172.21.15.8:0/833992661 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff130140f40 0x7ff1300cc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:06.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.081+0000 7ff12dd9b700 1 -- 172.21.15.8:0/833992661 >> v1:172.21.15.184:6789/0 conn(0x7ff13006baa0 legacy=0x7ff130140830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:06.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.081+0000 7ff12dd9b700 1 -- 172.21.15.8:0/833992661 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1300cd4c0 con 0x7ff13006be70 2023-10-06T04:38:06.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.081+0000 7ff12d59a700 1 -- 172.21.15.8:0/833992661 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 934982543 0 0) 0x7ff1300ccf00 con 0x7ff13006baa0 2023-10-06T04:38:06.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.081+0000 7ff12ed9d700 1 --2- 172.21.15.8:0/833992661 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff130140f40 0x7ff1300cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:38:06.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.081+0000 7ff12dd9b700 1 --2- 172.21.15.8:0/833992661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff13006be70 0x7ff1300cc110 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff1180098e0 tx=0x7ff1180091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecd51fce04e5609d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:06.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.081+0000 7ff12d59a700 1 -- 172.21.15.8:0/833992661 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11800b640 con 0x7ff13006be70 2023-10-06T04:38:06.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.081+0000 7ff12d59a700 1 -- 172.21.15.8:0/833992661 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11800b7a0 con 0x7ff13006be70 2023-10-06T04:38:06.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.081+0000 7ff12d59a700 1 -- 172.21.15.8:0/833992661 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11800bb40 con 0x7ff13006be70 2023-10-06T04:38:06.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.082+0000 7ff12f59e700 1 -- 172.21.15.8:0/833992661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff13006be70 msgr2=0x7ff1300cc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:06.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.082+0000 7ff12f59e700 1 --2- 172.21.15.8:0/833992661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff13006be70 0x7ff1300cc110 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff1180098e0 tx=0x7ff1180091a0 comp rx=0 tx=0).stop 2023-10-06T04:38:06.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.082+0000 7ff12f59e700 1 -- 172.21.15.8:0/833992661 shutdown_connections 2023-10-06T04:38:06.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.082+0000 7ff12f59e700 1 --2- 172.21.15.8:0/833992661 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff130140f40 0x7ff1300cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:06.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.082+0000 7ff12f59e700 1 --2- 172.21.15.8:0/833992661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff13006be70 0x7ff1300cc110 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:06.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.082+0000 7ff12f59e700 1 -- 172.21.15.8:0/833992661 >> 172.21.15.8:0/833992661 conn(0x7ff1300ce2f0 msgr2=0x7ff1300ce6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:06.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.082+0000 7ff12f59e700 1 -- 172.21.15.8:0/833992661 shutdown_connections 2023-10-06T04:38:06.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.082+0000 7ff12f59e700 1 -- 172.21.15.8:0/833992661 wait complete. 2023-10-06T04:38:06.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.083+0000 7ff12f59e700 1 Processor -- start 2023-10-06T04:38:06.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.083+0000 7ff12f59e700 1 -- start start 2023-10-06T04:38:06.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.084+0000 7ff12f59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff13006baa0 0x7ff1300c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:06.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.084+0000 7ff12f59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff13006be70 0x7ff13015a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:06.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.084+0000 7ff12f59e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff130140f40 0x7ff1300c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:06.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.084+0000 7ff12f59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1300c80f0 con 0x7ff13006baa0 2023-10-06T04:38:06.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.084+0000 7ff12f59e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1300c83d0 con 0x7ff130140f40 2023-10-06T04:38:06.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.084+0000 7ff12f59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1300c86b0 con 0x7ff13006be70 2023-10-06T04:38:06.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.084+0000 7ff12e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff13006baa0 0x7ff1300c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:06.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.084+0000 7ff12e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff13006baa0 0x7ff1300c9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38396/0 (socket says 172.21.15.8:38396) 2023-10-06T04:38:06.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.084+0000 7ff12e59c700 1 -- 172.21.15.8:0/1493191320 learned_addr learned my addr 172.21.15.8:0/1493191320 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:06.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.084+0000 7ff12ed9d700 1 --2- 172.21.15.8:0/1493191320 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff130140f40 0x7ff1300c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:06.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.084+0000 7ff12dd9b700 1 --2- 172.21.15.8:0/1493191320 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff13006be70 0x7ff13015a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:06.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.084+0000 7ff12e59c700 1 -- 172.21.15.8:0/1493191320 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff13006be70 msgr2=0x7ff13015a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:06.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.084+0000 7ff12e59c700 1 --2- 172.21.15.8:0/1493191320 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff13006be70 0x7ff13015a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:06.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.084+0000 7ff12e59c700 1 -- 172.21.15.8:0/1493191320 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff130140f40 msgr2=0x7ff1300c76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:06.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.084+0000 7ff12e59c700 1 --2- 172.21.15.8:0/1493191320 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff130140f40 0x7ff1300c76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:06.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.084+0000 7ff12e59c700 1 -- 172.21.15.8:0/1493191320 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff128009a20 con 0x7ff13006baa0 2023-10-06T04:38:06.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.084+0000 7ff12ed9d700 1 --2- 172.21.15.8:0/1493191320 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff130140f40 0x7ff1300c76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:38:06.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.084+0000 7ff12e59c700 1 --2- 172.21.15.8:0/1493191320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff13006baa0 0x7ff1300c9190 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff12000c7e0 tx=0x7ff120007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:06.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.085+0000 7ff1267fc700 1 -- 172.21.15.8:0/1493191320 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff120005b30 con 0x7ff13006baa0 2023-10-06T04:38:06.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.085+0000 7ff1267fc700 1 -- 172.21.15.8:0/1493191320 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff120005c90 con 0x7ff13006baa0 2023-10-06T04:38:06.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.085+0000 7ff12f59e700 1 -- 172.21.15.8:0/1493191320 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff118009420 con 0x7ff13006baa0 2023-10-06T04:38:06.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.085+0000 7ff1267fc700 1 -- 172.21.15.8:0/1493191320 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff120007300 con 0x7ff13006baa0 2023-10-06T04:38:06.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.085+0000 7ff12f59e700 1 -- 172.21.15.8:0/1493191320 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1300c8c70 con 0x7ff13006baa0 2023-10-06T04:38:06.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.086+0000 7ff12f59e700 1 -- 172.21.15.8:0/1493191320 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff13004c380 con 0x7ff13006baa0 2023-10-06T04:38:06.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.086+0000 7ff1267fc700 1 -- 172.21.15.8:0/1493191320 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff12001b400 con 0x7ff13006baa0 2023-10-06T04:38:06.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.086+0000 7ff1267fc700 1 --2- 172.21.15.8:0/1493191320 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff110066f30 0x7ff1100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:06.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.087+0000 7ff1267fc700 1 -- 172.21.15.8:0/1493191320 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5698+0+0 (secure 0 0 0) 0x7ff120084040 con 0x7ff13006baa0 2023-10-06T04:38:06.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.087+0000 7ff12dd9b700 1 --2- 172.21.15.8:0/1493191320 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff110066f30 0x7ff1100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:06.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.087+0000 7ff12dd9b700 1 --2- 172.21.15.8:0/1493191320 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff110066f30 0x7ff1100693e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff1180093f0 tx=0x7ff118017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:06.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.091+0000 7ff1267fc700 1 -- 172.21.15.8:0/1493191320 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff120051330 con 0x7ff13006baa0 2023-10-06T04:38:06.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.280+0000 7ff12f59e700 1 -- 172.21.15.8:0/1493191320 --> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff1300cd7a0 con 0x7ff110066f30 2023-10-06T04:38:06.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.284+0000 7ff1267fc700 1 -- 172.21.15.8:0/1493191320 <== mgr.4105 v2:172.21.15.184:6832/90283 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73854 (secure 0 0 0) 0x7ff1300cd7a0 con 0x7ff110066f30 2023-10-06T04:38:06.287 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:38:06.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.285+0000 7ff12f59e700 1 -- 172.21.15.8:0/1493191320 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff110066f30 msgr2=0x7ff1100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:06.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.285+0000 7ff12f59e700 1 --2- 172.21.15.8:0/1493191320 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff110066f30 0x7ff1100693e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff1180093f0 tx=0x7ff118017000 comp rx=0 tx=0).stop 2023-10-06T04:38:06.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.285+0000 7ff12f59e700 1 -- 172.21.15.8:0/1493191320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff13006baa0 msgr2=0x7ff1300c9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:06.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.285+0000 7ff12f59e700 1 --2- 172.21.15.8:0/1493191320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff13006baa0 0x7ff1300c9190 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff12000c7e0 tx=0x7ff120007df0 comp rx=0 tx=0).stop 2023-10-06T04:38:06.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.286+0000 7ff12f59e700 1 -- 172.21.15.8:0/1493191320 shutdown_connections 2023-10-06T04:38:06.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.286+0000 7ff12f59e700 1 --2- 172.21.15.8:0/1493191320 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff110066f30 0x7ff1100693e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:06.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.286+0000 7ff12f59e700 1 --2- 172.21.15.8:0/1493191320 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff130140f40 0x7ff1300c76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:06.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.286+0000 7ff12f59e700 1 --2- 172.21.15.8:0/1493191320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff13006baa0 0x7ff1300c9190 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:06.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.286+0000 7ff12f59e700 1 --2- 172.21.15.8:0/1493191320 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff13006be70 0x7ff13015a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:06.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.286+0000 7ff12f59e700 1 -- 172.21.15.8:0/1493191320 >> 172.21.15.8:0/1493191320 conn(0x7ff1300ce2f0 msgr2=0x7ff1300ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:06.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.286+0000 7ff12f59e700 1 -- 172.21.15.8:0/1493191320 shutdown_connections 2023-10-06T04:38:06.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.286+0000 7ff12f59e700 1 -- 172.21.15.8:0/1493191320 wait complete. 2023-10-06T04:38:06.290 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-06T04:38:06.300 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2023-10-06T04:38:04.657898+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":217,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2396184,"kb_used_data":17880,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752578536,"statfs":{"total":773094113280,"available":770640420864,"internally_reserved":0,"allocated":18309120,"data_stored":15894505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6321510,"num_objects":-15,"num_object_clones":0,"num_object_copies":-30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-15,"num_whiteouts":0,"num_read":-50,"num_read_kb":-37,"num_write":-46,"num_write_kb":-6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001446"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":39,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T04:37:55.349139+0000","last_change":"2023-10-06T04:36:11.192215+0000","last_active":"2023-10-06T04:37:55.349139+0000","last_peered":"2023-10-06T04:37:55.349139+0000","last_clean":"2023-10-06T04:37:55.349139+0000","last_became_active":"2023-10-06T04:36:11.191953+0000","last_became_peered":"2023-10-06T04:36:11.191953+0000","last_unstale":"2023-10-06T04:37:55.349139+0000","last_undegraded":"2023-10-06T04:37:55.349139+0000","last_fullsized":"2023-10-06T04:37:55.349139+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:37.026121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":35,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T04:37:31.543989+0000","last_change":"2023-10-06T04:36:11.184555+0000","last_active":"2023-10-06T04:37:31.543989+0000","last_peered":"2023-10-06T04:37:31.543989+0000","last_clean":"2023-10-06T04:37:31.543989+0000","last_became_active":"2023-10-06T04:36:11.184229+0000","last_became_peered":"2023-10-06T04:36:11.184229+0000","last_unstale":"2023-10-06T04:37:31.543989+0000","last_undegraded":"2023-10-06T04:37:31.543989+0000","last_fullsized":"2023-10-06T04:37:31.543989+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:19.938716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":35,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T04:37:55.348119+0000","last_change":"2023-10-06T04:36:11.184460+0000","last_active":"2023-10-06T04:37:55.348119+0000","last_peered":"2023-10-06T04:37:55.348119+0000","last_clean":"2023-10-06T04:37:55.348119+0000","last_became_active":"2023-10-06T04:36:11.184119+0000","last_became_peered":"2023-10-06T04:36:11.184119+0000","last_unstale":"2023-10-06T04:37:55.348119+0000","last_undegraded":"2023-10-06T04:37:55.348119+0000","last_fullsized":"2023-10-06T04:37:55.348119+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:37.026121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":182,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T04:37:31.929167+0000","last_change":"2023-10-06T04:36:12.183155+0000","last_active":"2023-10-06T04:37:31.929167+0000","last_peered":"2023-10-06T04:37:31.929167+0000","last_clean":"2023-10-06T04:37:31.929167+0000","last_became_active":"2023-10-06T04:36:12.182903+0000","last_became_peered":"2023-10-06T04:36:12.182903+0000","last_unstale":"2023-10-06T04:37:31.929167+0000","last_undegraded":"2023-10-06T04:37:31.929167+0000","last_fullsized":"2023-10-06T04:37:31.929167+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:11.171104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:11.171104+0000","last_clean_scrub_stamp":"2023-10-06T04:36:11.171104+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:38:54.323364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":33,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T04:37:31.929396+0000","last_change":"2023-10-06T04:36:11.193056+0000","last_active":"2023-10-06T04:37:31.929396+0000","last_peered":"2023-10-06T04:37:31.929396+0000","last_clean":"2023-10-06T04:37:31.929396+0000","last_became_active":"2023-10-06T04:36:11.192712+0000","last_became_peered":"2023-10-06T04:36:11.192712+0000","last_unstale":"2023-10-06T04:37:31.929396+0000","last_undegraded":"2023-10-06T04:37:31.929396+0000","last_fullsized":"2023-10-06T04:37:31.929396+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:00.008654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":33,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T04:37:31.929488+0000","last_change":"2023-10-06T04:36:11.192701+0000","last_active":"2023-10-06T04:37:31.929488+0000","last_peered":"2023-10-06T04:37:31.929488+0000","last_clean":"2023-10-06T04:37:31.929488+0000","last_became_active":"2023-10-06T04:36:11.192335+0000","last_became_peered":"2023-10-06T04:36:11.192335+0000","last_unstale":"2023-10-06T04:37:31.929488+0000","last_undegraded":"2023-10-06T04:37:31.929488+0000","last_fullsized":"2023-10-06T04:37:31.929488+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:18.643570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T04:37:30.789741+0000","last_change":"2023-10-06T04:36:11.193497+0000","last_active":"2023-10-06T04:37:30.789741+0000","last_peered":"2023-10-06T04:37:30.789741+0000","last_clean":"2023-10-06T04:37:30.789741+0000","last_became_active":"2023-10-06T04:36:11.193215+0000","last_became_peered":"2023-10-06T04:36:11.193215+0000","last_unstale":"2023-10-06T04:37:30.789741+0000","last_undegraded":"2023-10-06T04:37:30.789741+0000","last_fullsized":"2023-10-06T04:37:30.789741+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:07.497987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":32,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T04:37:31.133103+0000","last_change":"2023-10-06T04:36:11.193111+0000","last_active":"2023-10-06T04:37:31.133103+0000","last_peered":"2023-10-06T04:37:31.133103+0000","last_clean":"2023-10-06T04:37:31.133103+0000","last_became_active":"2023-10-06T04:36:11.192836+0000","last_became_peered":"2023-10-06T04:36:11.192836+0000","last_unstale":"2023-10-06T04:37:31.133103+0000","last_undegraded":"2023-10-06T04:37:31.133103+0000","last_fullsized":"2023-10-06T04:37:31.133103+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:19.938716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":32,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T04:37:31.133079+0000","last_change":"2023-10-06T04:36:11.182804+0000","last_active":"2023-10-06T04:37:31.133079+0000","last_peered":"2023-10-06T04:37:31.133079+0000","last_clean":"2023-10-06T04:37:31.133079+0000","last_became_active":"2023-10-06T04:36:11.182575+0000","last_became_peered":"2023-10-06T04:36:11.182575+0000","last_unstale":"2023-10-06T04:37:31.133079+0000","last_undegraded":"2023-10-06T04:37:31.133079+0000","last_fullsized":"2023-10-06T04:37:31.133079+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:07.497987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298416,"kb_used_data":1128,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073424,"statfs":{"total":96636764160,"available":96331186176,"internally_reserved":0,"allocated":1155072,"data_stored":848883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.36099999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.432}]},{"osd":2,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.54800000000000004}]},{"osd":3,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.46800000000000003}]},{"osd":4,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.498},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.60299999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.53600000000000003}]},{"osd":6,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.52700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301924,"kb_used_data":4636,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94069916,"statfs":{"total":96636764160,"available":96327593984,"internally_reserved":0,"allocated":4747264,"data_stored":4452659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":10.045999999999999,"5min":10.045999999999999,"15min":10.045999999999999},"last":0.41099999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":10.125999999999999,"5min":10.125999999999999,"15min":10.125999999999999},"last":0.434},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.45100000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":10.238,"5min":10.238,"15min":10.238},"last":0.498}]},{"osd":3,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":4.4870000000000001,"5min":4.4870000000000001,"15min":4.4870000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":10.393000000000001,"5min":10.393000000000001,"15min":10.393000000000001},"last":0.56899999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.60599999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.621}]},{"osd":7,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.64400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298412,"kb_used_data":1124,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073428,"statfs":{"total":96636764160,"available":96331190272,"internally_reserved":0,"allocated":1150976,"data_stored":848813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.249}]},{"osd":2,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.41899999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.315}]},{"osd":4,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.622},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.57999999999999996}]},{"osd":5,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56499999999999995}]},{"osd":6,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.55500000000000005}]},{"osd":7,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.498},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.60199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301960,"kb_used_data":4672,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94069880,"statfs":{"total":96636764160,"available":96327557120,"internally_reserved":0,"allocated":4784128,"data_stored":4481519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"last":0.247},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.443,"5min":0.443,"15min":0.443},"last":0.34499999999999997}]},{"osd":2,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.36299999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.39900000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.64200000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.66800000000000004}]},{"osd":6,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.65500000000000003}]},{"osd":7,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.60699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297832,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074008,"statfs":{"total":96636764160,"available":96331784192,"internally_reserved":0,"allocated":557056,"data_stored":257433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.24099999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.316}]},{"osd":3,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.28199999999999997}]},{"osd":4,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.5}]},{"osd":5,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.40100000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.435}]},{"osd":7,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.48999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297832,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074008,"statfs":{"total":96636764160,"available":96331784192,"internally_reserved":0,"allocated":557056,"data_stored":257433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.216},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.442,"5min":0.442,"15min":0.442},"last":0.29799999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.436,"5min":0.436,"15min":0.436},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.39700000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.56599999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.1070000000000002,"5min":2.1070000000000002,"15min":2.1070000000000002},"last":0.45200000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.505}]},{"osd":6,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.48599999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.433}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299924,"kb_used_data":2636,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071916,"statfs":{"total":96636764160,"available":96329641984,"internally_reserved":0,"allocated":2699264,"data_stored":2391634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":4.2919999999999998,"5min":4.2919999999999998,"15min":4.2919999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.47699999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":4.3520000000000003,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":0.52800000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.434}]},{"osd":3,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.61599999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.55600000000000005}]},{"osd":6,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.54400000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299884,"kb_used_data":2596,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071956,"statfs":{"total":96636764160,"available":96329682944,"internally_reserved":0,"allocated":2658304,"data_stored":2356131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.58199999999999996}]},{"osd":1,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.622}]},{"osd":2,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.379},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.56399999999999995}]},{"osd":3,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.439},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.495}]},{"osd":4,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.52500000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.59799999999999998}]},{"osd":7,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.60999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:38:06.303 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:38:06.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.419+0000 7f5e474c7700 1 Processor -- start 2023-10-06T04:38:06.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.419+0000 7f5e474c7700 1 -- start start 2023-10-06T04:38:06.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.420+0000 7f5e474c7700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5e400caf40 0x7f5e400c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:06.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.420+0000 7f5e474c7700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5e40142850 0x7f5e40142c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:06.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.420+0000 7f5e474c7700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e4006ad70 con 0x7f5e400cb310 2023-10-06T04:38:06.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.420+0000 7f5e474c7700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e40067ce0 con 0x7f5e40142850 2023-10-06T04:38:06.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.420+0000 7f5e474c7700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e4006a760 con 0x7f5e400caf40 2023-10-06T04:38:06.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.420+0000 7f5e45a64700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5e40142850 0x7f5e40142c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:06.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.420+0000 7f5e44a62700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f5e400cb310 0x7f5e400675d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46944/0 (socket says 172.21.15.8:46944) 2023-10-06T04:38:06.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.420+0000 7f5e44a62700 1 -- 172.21.15.8:0/1479446138 learned_addr learned my addr 172.21.15.8:0/1479446138 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:38:06.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.420+0000 7f5e45263700 1 --2- 172.21.15.8:0/1479446138 >> v2:172.21.15.184:3300/0 conn(0x7f5e400caf40 0x7f5e400c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:06.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.420+0000 7f5e45a64700 1 -- 172.21.15.8:0/1479446138 >> v2:172.21.15.184:3300/0 conn(0x7f5e400caf40 msgr2=0x7f5e400c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:06.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.420+0000 7f5e45a64700 1 --2- 172.21.15.8:0/1479446138 >> v2:172.21.15.184:3300/0 conn(0x7f5e400caf40 0x7f5e400c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:06.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.420+0000 7f5e45a64700 1 -- 172.21.15.8:0/1479446138 >> v1:172.21.15.8:6789/0 conn(0x7f5e400cb310 legacy=0x7f5e400675d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:06.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.420+0000 7f5e45a64700 1 -- 172.21.15.8:0/1479446138 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e40067f40 con 0x7f5e40142850 2023-10-06T04:38:06.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.420+0000 7f5e37fff700 1 -- 172.21.15.8:0/1479446138 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 726403456 0 0) 0x7f5e4006ad70 con 0x7f5e400cb310 2023-10-06T04:38:06.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.420+0000 7f5e45263700 1 --2- 172.21.15.8:0/1479446138 >> v2:172.21.15.184:3300/0 conn(0x7f5e400caf40 0x7f5e400c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:38:06.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.420+0000 7f5e45a64700 1 --2- 172.21.15.8:0/1479446138 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e40142850 0x7f5e40142c90 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f5e38009e60 tx=0x7f5e38009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=703e347246d37bfa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:06.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.421+0000 7f5e37fff700 1 -- 172.21.15.8:0/1479446138 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3800e070 con 0x7f5e40142850 2023-10-06T04:38:06.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.421+0000 7f5e37fff700 1 -- 172.21.15.8:0/1479446138 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3800bbf0 con 0x7f5e40142850 2023-10-06T04:38:06.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.421+0000 7f5e37fff700 1 -- 172.21.15.8:0/1479446138 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e38012430 con 0x7f5e40142850 2023-10-06T04:38:06.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.421+0000 7f5e474c7700 1 -- 172.21.15.8:0/1479446138 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e40142850 msgr2=0x7f5e40142c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:06.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.421+0000 7f5e474c7700 1 --2- 172.21.15.8:0/1479446138 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e40142850 0x7f5e40142c90 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f5e38009e60 tx=0x7f5e38009780 comp rx=0 tx=0).stop 2023-10-06T04:38:06.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.421+0000 7f5e474c7700 1 -- 172.21.15.8:0/1479446138 shutdown_connections 2023-10-06T04:38:06.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.421+0000 7f5e474c7700 1 --2- 172.21.15.8:0/1479446138 >> v2:172.21.15.184:3300/0 conn(0x7f5e400caf40 0x7f5e400c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:06.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.421+0000 7f5e474c7700 1 --2- 172.21.15.8:0/1479446138 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e40142850 0x7f5e40142c90 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:06.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.421+0000 7f5e474c7700 1 -- 172.21.15.8:0/1479446138 >> 172.21.15.8:0/1479446138 conn(0x7f5e400cd120 msgr2=0x7f5e400cd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:06.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.421+0000 7f5e474c7700 1 -- 172.21.15.8:0/1479446138 shutdown_connections 2023-10-06T04:38:06.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.421+0000 7f5e474c7700 1 -- 172.21.15.8:0/1479446138 wait complete. 2023-10-06T04:38:06.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.422+0000 7f5e474c7700 1 Processor -- start 2023-10-06T04:38:06.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.422+0000 7f5e474c7700 1 -- start start 2023-10-06T04:38:06.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.423+0000 7f5e474c7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e400caf40 0x7f5e40159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:06.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.423+0000 7f5e474c7700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e400cb310 0x7f5e4016d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:06.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.423+0000 7f5e474c7700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5e40142850 0x7f5e4015a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:06.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.423+0000 7f5e474c7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e400af240 con 0x7f5e400caf40 2023-10-06T04:38:06.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.423+0000 7f5e474c7700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e400c5b30 con 0x7f5e400cb310 2023-10-06T04:38:06.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.423+0000 7f5e474c7700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e400c5240 con 0x7f5e40142850 2023-10-06T04:38:06.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.423+0000 7f5e45263700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e400caf40 0x7f5e40159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:06.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.423+0000 7f5e45263700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e400caf40 0x7f5e40159fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38420/0 (socket says 172.21.15.8:38420) 2023-10-06T04:38:06.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.423+0000 7f5e45263700 1 -- 172.21.15.8:0/3187832834 learned_addr learned my addr 172.21.15.8:0/3187832834 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:06.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.423+0000 7f5e44a62700 1 --2- 172.21.15.8:0/3187832834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e400cb310 0x7f5e4016d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:06.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.423+0000 7f5e45a64700 1 --2- 172.21.15.8:0/3187832834 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5e40142850 0x7f5e4015a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:06.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.424+0000 7f5e45263700 1 -- 172.21.15.8:0/3187832834 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5e40142850 msgr2=0x7f5e4015a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:06.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.424+0000 7f5e45263700 1 --2- 172.21.15.8:0/3187832834 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5e40142850 0x7f5e4015a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:06.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.424+0000 7f5e45263700 1 -- 172.21.15.8:0/3187832834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e400cb310 msgr2=0x7f5e4016d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:06.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.424+0000 7f5e45263700 1 --2- 172.21.15.8:0/3187832834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e400cb310 0x7f5e4016d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:06.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.424+0000 7f5e45263700 1 -- 172.21.15.8:0/3187832834 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e38009a20 con 0x7f5e400caf40 2023-10-06T04:38:06.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.424+0000 7f5e44a62700 1 --2- 172.21.15.8:0/3187832834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e400cb310 0x7f5e4016d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:38:06.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.424+0000 7f5e45263700 1 --2- 172.21.15.8:0/3187832834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e400caf40 0x7f5e40159fe0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c00c830 tx=0x7f5e3c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:06.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.424+0000 7f5e357fa700 1 -- 172.21.15.8:0/3187832834 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c011600 con 0x7f5e400caf40 2023-10-06T04:38:06.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.424+0000 7f5e357fa700 1 -- 172.21.15.8:0/3187832834 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3c011760 con 0x7f5e400caf40 2023-10-06T04:38:06.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.424+0000 7f5e474c7700 1 -- 172.21.15.8:0/3187832834 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e40159230 con 0x7f5e400caf40 2023-10-06T04:38:06.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.424+0000 7f5e357fa700 1 -- 172.21.15.8:0/3187832834 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c011b20 con 0x7f5e400caf40 2023-10-06T04:38:06.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.424+0000 7f5e474c7700 1 -- 172.21.15.8:0/3187832834 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e400c57c0 con 0x7f5e400caf40 2023-10-06T04:38:06.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.425+0000 7f5e474c7700 1 -- 172.21.15.8:0/3187832834 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e400c9450 con 0x7f5e400caf40 2023-10-06T04:38:06.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.425+0000 7f5e357fa700 1 -- 172.21.15.8:0/3187832834 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5e3c00a3e0 con 0x7f5e400caf40 2023-10-06T04:38:06.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.426+0000 7f5e357fa700 1 --2- 172.21.15.8:0/3187832834 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5e24066f30 0x7f5e240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:06.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.426+0000 7f5e357fa700 1 -- 172.21.15.8:0/3187832834 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f5e3c0849f0 con 0x7f5e400caf40 2023-10-06T04:38:06.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.426+0000 7f5e44a62700 1 --2- 172.21.15.8:0/3187832834 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5e24066f30 0x7f5e240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:06.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.426+0000 7f5e44a62700 1 --2- 172.21.15.8:0/3187832834 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5e24066f30 0x7f5e240693e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5e401424e0 tx=0x7f5e30009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:06.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.430+0000 7f5e357fa700 1 -- 172.21.15.8:0/3187832834 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5e3c051c60 con 0x7f5e400caf40 2023-10-06T04:38:06.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.623+0000 7f5e474c7700 1 -- 172.21.15.8:0/3187832834 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e400b2f80 con 0x7f5e400caf40 2023-10-06T04:38:06.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.624+0000 7f5e357fa700 1 -- 172.21.15.8:0/3187832834 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+14062 (secure 0 0 0) 0x7f5e3c015090 con 0x7f5e400caf40 2023-10-06T04:38:06.628 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:38:06.629 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":50,"fsid":"c030d94d-df8f-49bb-8df7-07e9e557d96b","created":"2023-10-06T04:35:58.983386+0000","modified":"2023-10-06T04:38:02.181466+0000","last_up_change":"2023-10-06T04:36:09.164314+0000","last_in_change":"2023-10-06T04:36:01.360785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:36:10.148177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:36:10.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"cc70f2a2-57bf-4613-b938-0d6f75fa57db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":90668},{"type":"v1","addr":"172.21.15.8:6809","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":90668},{"type":"v1","addr":"172.21.15.8:6811","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":90668},{"type":"v1","addr":"172.21.15.8:6815","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":90668},{"type":"v1","addr":"172.21.15.8:6813","nonce":90668}]},"public_addr":"172.21.15.8:6809/90668","cluster_addr":"172.21.15.8:6811/90668","heartbeat_back_addr":"172.21.15.8:6815/90668","heartbeat_front_addr":"172.21.15.8:6813/90668","state":["exists","up"]},{"osd":1,"uuid":"cf050fea-43b2-42ed-b37e-fd515a7ae30d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":90669},{"type":"v1","addr":"172.21.15.8:6817","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":90669},{"type":"v1","addr":"172.21.15.8:6819","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":90669},{"type":"v1","addr":"172.21.15.8:6824","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":90669},{"type":"v1","addr":"172.21.15.8:6821","nonce":90669}]},"public_addr":"172.21.15.8:6817/90669","cluster_addr":"172.21.15.8:6819/90669","heartbeat_back_addr":"172.21.15.8:6824/90669","heartbeat_front_addr":"172.21.15.8:6821/90669","state":["exists","up"]},{"osd":2,"uuid":"e71d8e7b-d99d-4063-bc2a-28e8e4a3eab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":90670},{"type":"v1","addr":"172.21.15.8:6801","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":90670},{"type":"v1","addr":"172.21.15.8:6803","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":90670},{"type":"v1","addr":"172.21.15.8:6807","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":90670},{"type":"v1","addr":"172.21.15.8:6805","nonce":90670}]},"public_addr":"172.21.15.8:6801/90670","cluster_addr":"172.21.15.8:6803/90670","heartbeat_back_addr":"172.21.15.8:6807/90670","heartbeat_front_addr":"172.21.15.8:6805/90670","state":["exists","up"]},{"osd":3,"uuid":"0813e948-63f5-4dfb-8012-4c7fe9529654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":90671},{"type":"v1","addr":"172.21.15.8:6825","nonce":90671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":90671},{"type":"v1","addr":"172.21.15.8:6827","nonce":90671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":90671},{"type":"v1","addr":"172.21.15.8:6831","nonce":90671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":90671},{"type":"v1","addr":"172.21.15.8:6829","nonce":90671}]},"public_addr":"172.21.15.8:6825/90671","cluster_addr":"172.21.15.8:6827/90671","heartbeat_back_addr":"172.21.15.8:6831/90671","heartbeat_front_addr":"172.21.15.8:6829/90671","state":["exists","up"]},{"osd":4,"uuid":"ea436a41-c5f3-49a6-9b2d-a7f0341fcdd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":90868},{"type":"v1","addr":"172.21.15.184:6801","nonce":90868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":90868},{"type":"v1","addr":"172.21.15.184:6803","nonce":90868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":90868},{"type":"v1","addr":"172.21.15.184:6807","nonce":90868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":90868},{"type":"v1","addr":"172.21.15.184:6805","nonce":90868}]},"public_addr":"172.21.15.184:6801/90868","cluster_addr":"172.21.15.184:6803/90868","heartbeat_back_addr":"172.21.15.184:6807/90868","heartbeat_front_addr":"172.21.15.184:6805/90868","state":["exists","up"]},{"osd":5,"uuid":"1ca606c6-033a-4f50-9787-1fa3e382eb2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":90894},{"type":"v1","addr":"172.21.15.184:6825","nonce":90894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":90894},{"type":"v1","addr":"172.21.15.184:6827","nonce":90894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":90894},{"type":"v1","addr":"172.21.15.184:6831","nonce":90894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":90894},{"type":"v1","addr":"172.21.15.184:6829","nonce":90894}]},"public_addr":"172.21.15.184:6825/90894","cluster_addr":"172.21.15.184:6827/90894","heartbeat_back_addr":"172.21.15.184:6831/90894","heartbeat_front_addr":"172.21.15.184:6829/90894","state":["exists","up"]},{"osd":6,"uuid":"c67e1a8a-42d9-4880-92f9-dc7f8d7d27e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":90899},{"type":"v1","addr":"172.21.15.184:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":90899},{"type":"v1","addr":"172.21.15.184:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":90899},{"type":"v1","addr":"172.21.15.184:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":90899},{"type":"v1","addr":"172.21.15.184:6821","nonce":90899}]},"public_addr":"172.21.15.184:6817/90899","cluster_addr":"172.21.15.184:6819/90899","heartbeat_back_addr":"172.21.15.184:6823/90899","heartbeat_front_addr":"172.21.15.184:6821/90899","state":["exists","up"]},{"osd":7,"uuid":"ae83ff3e-7051-42dd-9067-a4c870df0356","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":90869},{"type":"v1","addr":"172.21.15.184:6809","nonce":90869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":90869},{"type":"v1","addr":"172.21.15.184:6811","nonce":90869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":90869},{"type":"v1","addr":"172.21.15.184:6815","nonce":90869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":90869},{"type":"v1","addr":"172.21.15.184:6813","nonce":90869}]},"public_addr":"172.21.15.184:6809/90869","cluster_addr":"172.21.15.184:6811/90869","heartbeat_back_addr":"172.21.15.184:6815/90869","heartbeat_front_addr":"172.21.15.184:6813/90869","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.555871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.490505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.504578+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.517217+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:05.991135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.537329+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.543232+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:36:06.443715+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6833/1173304661":"2023-10-07T04:37:59.173758+0000","172.21.15.8:6835/1173304661":"2023-10-07T04:37:59.173758+0000","172.21.15.8:6833/3478733664":"2023-10-07T04:37:26.044067+0000","172.21.15.8:6835/3478733664":"2023-10-07T04:37:26.044067+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:38:06.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.626+0000 7f5e474c7700 1 -- 172.21.15.8:0/3187832834 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5e24066f30 msgr2=0x7f5e240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:06.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.626+0000 7f5e474c7700 1 --2- 172.21.15.8:0/3187832834 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5e24066f30 0x7f5e240693e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5e401424e0 tx=0x7f5e30009040 comp rx=0 tx=0).stop 2023-10-06T04:38:06.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.626+0000 7f5e474c7700 1 -- 172.21.15.8:0/3187832834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e400caf40 msgr2=0x7f5e40159fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:06.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.626+0000 7f5e474c7700 1 --2- 172.21.15.8:0/3187832834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e400caf40 0x7f5e40159fe0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c00c830 tx=0x7f5e3c008040 comp rx=0 tx=0).stop 2023-10-06T04:38:06.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.627+0000 7f5e474c7700 1 -- 172.21.15.8:0/3187832834 shutdown_connections 2023-10-06T04:38:06.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.627+0000 7f5e474c7700 1 --2- 172.21.15.8:0/3187832834 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f5e24066f30 0x7f5e240693e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:06.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.627+0000 7f5e474c7700 1 --2- 172.21.15.8:0/3187832834 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5e40142850 0x7f5e4015a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:06.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.627+0000 7f5e474c7700 1 --2- 172.21.15.8:0/3187832834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e400caf40 0x7f5e40159fe0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:06.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.627+0000 7f5e474c7700 1 --2- 172.21.15.8:0/3187832834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e400cb310 0x7f5e4016d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:06.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.627+0000 7f5e474c7700 1 -- 172.21.15.8:0/3187832834 >> 172.21.15.8:0/3187832834 conn(0x7f5e400cd120 msgr2=0x7f5e400cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:06.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.627+0000 7f5e474c7700 1 -- 172.21.15.8:0/3187832834 shutdown_connections 2023-10-06T04:38:06.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:06.627+0000 7f5e474c7700 1 -- 172.21.15.8:0/3187832834 wait complete. 2023-10-06T04:38:07.642 INFO:tasks.ceph:Scrubbing osd.0 2023-10-06T04:38:07.643 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:38:07.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.777+0000 7f0495d19700 1 Processor -- start 2023-10-06T04:38:07.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.777+0000 7f0495d19700 1 -- start start 2023-10-06T04:38:07.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.778+0000 7f0495d19700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f04900af6f0 0x7f049015a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:07.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.778+0000 7f0495d19700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f0490069720 0x7f0490069bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:07.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.778+0000 7f0495d19700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f049015e160 con 0x7f04900681b0 2023-10-06T04:38:07.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.778+0000 7f0495d19700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f049006a100 con 0x7f04900af6f0 2023-10-06T04:38:07.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.778+0000 7f0495d19700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04900afac0 con 0x7f0490069720 2023-10-06T04:38:07.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.778+0000 7f0494d17700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f04900af6f0 0x7f049015a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:07.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.778+0000 7f0494d17700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f04900af6f0 0x7f049015a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38436/0 (socket says 172.21.15.8:38436) 2023-10-06T04:38:07.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.778+0000 7f0494d17700 1 -- 172.21.15.8:0/374002090 learned_addr learned my addr 172.21.15.8:0/374002090 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:07.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.779+0000 7f048ffff700 1 --2- 172.21.15.8:0/374002090 >> v2:172.21.15.184:3300/0 conn(0x7f0490069720 0x7f0490069bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:07.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.779+0000 7f0494d17700 1 -- 172.21.15.8:0/374002090 >> v2:172.21.15.184:3300/0 conn(0x7f0490069720 msgr2=0x7f0490069bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:07.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.779+0000 7f0494d17700 1 --2- 172.21.15.8:0/374002090 >> v2:172.21.15.184:3300/0 conn(0x7f0490069720 0x7f0490069bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:07.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.779+0000 7f0494d17700 1 -- 172.21.15.8:0/374002090 >> v1:172.21.15.184:6789/0 conn(0x7f04900681b0 legacy=0x7f0490068580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:07.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.779+0000 7f0494d17700 1 -- 172.21.15.8:0/374002090 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049015ab50 con 0x7f04900af6f0 2023-10-06T04:38:07.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.779+0000 7f0494d17700 1 --2- 172.21.15.8:0/374002090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04900af6f0 0x7f049015a610 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f049015d120 tx=0x7f0480009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=387eca62b637e6de server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:07.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.779+0000 7f048f7fe700 1 -- 172.21.15.8:0/374002090 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048000b860 con 0x7f04900af6f0 2023-10-06T04:38:07.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.779+0000 7f048f7fe700 1 -- 172.21.15.8:0/374002090 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048000b9c0 con 0x7f04900af6f0 2023-10-06T04:38:07.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.779+0000 7f048f7fe700 1 -- 172.21.15.8:0/374002090 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048000bd60 con 0x7f04900af6f0 2023-10-06T04:38:07.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.780+0000 7f0495d19700 1 -- 172.21.15.8:0/374002090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04900af6f0 msgr2=0x7f049015a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:07.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.780+0000 7f0495d19700 1 --2- 172.21.15.8:0/374002090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04900af6f0 0x7f049015a610 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f049015d120 tx=0x7f0480009250 comp rx=0 tx=0).stop 2023-10-06T04:38:07.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.780+0000 7f0495d19700 1 -- 172.21.15.8:0/374002090 shutdown_connections 2023-10-06T04:38:07.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.780+0000 7f0495d19700 1 --2- 172.21.15.8:0/374002090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04900af6f0 0x7f049015a610 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:07.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.780+0000 7f0495d19700 1 --2- 172.21.15.8:0/374002090 >> v2:172.21.15.184:3300/0 conn(0x7f0490069720 0x7f0490069bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:07.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.780+0000 7f0495d19700 1 -- 172.21.15.8:0/374002090 >> 172.21.15.8:0/374002090 conn(0x7f04900d0280 msgr2=0x7f04900d0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:07.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.780+0000 7f0495d19700 1 -- 172.21.15.8:0/374002090 shutdown_connections 2023-10-06T04:38:07.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.780+0000 7f0495d19700 1 -- 172.21.15.8:0/374002090 wait complete. 2023-10-06T04:38:07.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.781+0000 7f0495d19700 1 Processor -- start 2023-10-06T04:38:07.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.781+0000 7f0495d19700 1 -- start start 2023-10-06T04:38:07.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.782+0000 7f0495d19700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04900681b0 0x7f04900b4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:07.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.782+0000 7f0495d19700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0490069720 0x7f0490157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:07.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.782+0000 7f0495d19700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04900af6f0 0x7f04900c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:07.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.782+0000 7f0495d19700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04900b3db0 con 0x7f04900681b0 2023-10-06T04:38:07.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.782+0000 7f0495d19700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04900b31a0 con 0x7f04900af6f0 2023-10-06T04:38:07.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.782+0000 7f0495d19700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04900b3480 con 0x7f0490069720 2023-10-06T04:38:07.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.782+0000 7f0494d17700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04900681b0 0x7f04900b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:07.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.782+0000 7f0494d17700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04900681b0 0x7f04900b4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38450/0 (socket says 172.21.15.8:38450) 2023-10-06T04:38:07.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.782+0000 7f0494d17700 1 -- 172.21.15.8:0/2317293895 learned_addr learned my addr 172.21.15.8:0/2317293895 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:07.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.782+0000 7f0495518700 1 --2- 172.21.15.8:0/2317293895 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04900af6f0 0x7f04900c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:07.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.782+0000 7f048ffff700 1 --2- 172.21.15.8:0/2317293895 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0490069720 0x7f0490157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:07.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.782+0000 7f0494d17700 1 -- 172.21.15.8:0/2317293895 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0490069720 msgr2=0x7f0490157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:07.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.782+0000 7f0494d17700 1 --2- 172.21.15.8:0/2317293895 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0490069720 0x7f0490157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:07.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.782+0000 7f0494d17700 1 -- 172.21.15.8:0/2317293895 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04900af6f0 msgr2=0x7f04900c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:07.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.782+0000 7f0494d17700 1 --2- 172.21.15.8:0/2317293895 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04900af6f0 0x7f04900c9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:07.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.782+0000 7f0494d17700 1 -- 172.21.15.8:0/2317293895 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04800094f0 con 0x7f04900681b0 2023-10-06T04:38:07.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.782+0000 7f0495518700 1 --2- 172.21.15.8:0/2317293895 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04900af6f0 0x7f04900c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:38:07.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.782+0000 7f0494d17700 1 --2- 172.21.15.8:0/2317293895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04900681b0 0x7f04900b4240 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f0490089370 tx=0x7f0480017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:07.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.782+0000 7f048cff9700 1 -- 172.21.15.8:0/2317293895 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0480011e60 con 0x7f04900681b0 2023-10-06T04:38:07.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.783+0000 7f048cff9700 1 -- 172.21.15.8:0/2317293895 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048001a630 con 0x7f04900681b0 2023-10-06T04:38:07.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.783+0000 7f0495d19700 1 -- 172.21.15.8:0/2317293895 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04900b3760 con 0x7f04900681b0 2023-10-06T04:38:07.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.783+0000 7f048cff9700 1 -- 172.21.15.8:0/2317293895 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048001a9f0 con 0x7f04900681b0 2023-10-06T04:38:07.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.783+0000 7f0495d19700 1 -- 172.21.15.8:0/2317293895 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04900b2180 con 0x7f04900681b0 2023-10-06T04:38:07.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.783+0000 7f0495d19700 1 -- 172.21.15.8:0/2317293895 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f049004c380 con 0x7f04900681b0 2023-10-06T04:38:07.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.784+0000 7f048cff9700 1 -- 172.21.15.8:0/2317293895 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f048002d440 con 0x7f04900681b0 2023-10-06T04:38:07.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.784+0000 7f048cff9700 1 --2- 172.21.15.8:0/2317293895 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f047c066f30 0x7f047c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:07.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.784+0000 7f048cff9700 1 -- 172.21.15.8:0/2317293895 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f0480086110 con 0x7f04900681b0 2023-10-06T04:38:07.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.784+0000 7f048cff9700 1 --2- 172.21.15.8:0/2317293895 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x7f047c06d8f0 0x7f047c06fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:07.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.784+0000 7f048ffff700 1 --2- 172.21.15.8:0/2317293895 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f047c066f30 0x7f047c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:07.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.785+0000 7f048cff9700 1 -- 172.21.15.8:0/2317293895 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f047c0703f0 con 0x7f047c06d8f0 2023-10-06T04:38:07.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.785+0000 7f048cff9700 1 -- 172.21.15.8:0/2317293895 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0480088750 con 0x7f04900681b0 2023-10-06T04:38:07.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.785+0000 7f0495518700 1 --2- 172.21.15.8:0/2317293895 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x7f047c06d8f0 0x7f047c06fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:07.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.785+0000 7f0495518700 1 --2- 172.21.15.8:0/2317293895 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x7f047c06d8f0 0x7f047c06fd20 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:07.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.785+0000 7f048ffff700 1 --2- 172.21.15.8:0/2317293895 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f047c066f30 0x7f047c0693e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0490069e20 tx=0x7f0484008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:07.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.786+0000 7f048cff9700 1 -- 172.21.15.8:0/2317293895 <== osd.0 v2:172.21.15.8:6808/90668 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f047c0703f0 con 0x7f047c06d8f0 2023-10-06T04:38:07.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.799+0000 7f0495d19700 1 -- 172.21.15.8:0/2317293895 --> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f04900ce090 con 0x7f047c06d8f0 2023-10-06T04:38:07.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.800+0000 7f048cff9700 1 -- 172.21.15.8:0/2317293895 <== osd.0 v2:172.21.15.8:6808/90668 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f04900ce090 con 0x7f047c06d8f0 2023-10-06T04:38:07.802 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T04:38:07.802 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:38:07.803 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T04:38:07.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.800+0000 7f0495d19700 1 -- 172.21.15.8:0/2317293895 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x7f047c06d8f0 msgr2=0x7f047c06fd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:07.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.800+0000 7f0495d19700 1 --2- 172.21.15.8:0/2317293895 >> [v2:172.21.15.8:6808/90668,v1:172.21.15.8:6809/90668] conn(0x7f047c06d8f0 0x7f047c06fd20 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:07.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.800+0000 7f0495d19700 1 -- 172.21.15.8:0/2317293895 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f047c066f30 msgr2=0x7f047c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:07.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.800+0000 7f0495d19700 1 --2- 172.21.15.8:0/2317293895 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f047c066f30 0x7f047c0693e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0490069e20 tx=0x7f0484008040 comp rx=0 tx=0).stop 2023-10-06T04:38:07.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.800+0000 7f0495d19700 1 -- 172.21.15.8:0/2317293895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04900681b0 msgr2=0x7f04900b4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:07.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.800+0000 7f0495d19700 1 --2- 172.21.15.8:0/2317293895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04900681b0 0x7f04900b4240 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f0490089370 tx=0x7f0480017000 comp rx=0 tx=0).stop 2023-10-06T04:38:07.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.800+0000 7f0495518700 1 -- 172.21.15.8:0/2317293895 reap_dead start 2023-10-06T04:38:07.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.800+0000 7f0495d19700 1 -- 172.21.15.8:0/2317293895 shutdown_connections 2023-10-06T04:38:07.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.800+0000 7f0495d19700 1 -- 172.21.15.8:0/2317293895 >> 172.21.15.8:0/2317293895 conn(0x7f04900d0280 msgr2=0x7f04901581a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:07.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.800+0000 7f0495d19700 1 -- 172.21.15.8:0/2317293895 shutdown_connections 2023-10-06T04:38:07.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.800+0000 7f0495d19700 1 -- 172.21.15.8:0/2317293895 wait complete. 2023-10-06T04:38:07.815 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-06T04:38:07.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.932+0000 7f609a651700 1 Processor -- start 2023-10-06T04:38:07.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.932+0000 7f609a651700 1 -- start start 2023-10-06T04:38:07.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.933+0000 7f609a651700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60940af410 0x7f60940cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:07.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.933+0000 7f609a651700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f60940af7e0 0x7f60940ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:07.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.933+0000 7f609a651700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f609415ddd0 con 0x7f60940cd2f0 2023-10-06T04:38:07.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.933+0000 7f609a651700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f609415e260 con 0x7f60940af7e0 2023-10-06T04:38:07.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.933+0000 7f609a651700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609415d4a0 con 0x7f60940af410 2023-10-06T04:38:07.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.933+0000 7f6093fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60940af410 0x7f60940cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:07.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.933+0000 7f60937fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f60940af7e0 0x7f60940ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:07.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.933+0000 7f6093fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60940af410 0x7f60940cb3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.8:35196/0 (socket says 172.21.15.8:35196) 2023-10-06T04:38:07.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.933+0000 7f6098bee700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f60940cd2f0 0x7f6094068470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.8:57076/0 (socket says 172.21.15.8:57076) 2023-10-06T04:38:07.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.933+0000 7f6093fff700 1 -- 172.21.15.8:0/1999378688 learned_addr learned my addr 172.21.15.8:0/1999378688 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:07.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.933+0000 7f60937fe700 1 --2- 172.21.15.8:0/1999378688 >> v2:172.21.15.184:3300/0 conn(0x7f60940af7e0 0x7f60940ccdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.8:41808/0 (socket says 172.21.15.8:41808) 2023-10-06T04:38:07.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.934+0000 7f6092ffd700 1 -- 172.21.15.8:0/1999378688 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3570191792 0 0) 0x7f609415ddd0 con 0x7f60940cd2f0 2023-10-06T04:38:07.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.934+0000 7f6092ffd700 1 -- 172.21.15.8:0/1999378688 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f607c003570 con 0x7f60940cd2f0 2023-10-06T04:38:07.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.934+0000 7f6093fff700 1 -- 172.21.15.8:0/1999378688 >> v2:172.21.15.184:3300/0 conn(0x7f60940af7e0 msgr2=0x7f60940ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:07.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.934+0000 7f6093fff700 1 --2- 172.21.15.8:0/1999378688 >> v2:172.21.15.184:3300/0 conn(0x7f60940af7e0 0x7f60940ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:07.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.934+0000 7f6093fff700 1 -- 172.21.15.8:0/1999378688 >> v1:172.21.15.184:6789/0 conn(0x7f60940cd2f0 legacy=0x7f6094068470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:07.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.934+0000 7f6093fff700 1 -- 172.21.15.8:0/1999378688 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609415d780 con 0x7f60940af410 2023-10-06T04:38:07.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.934+0000 7f60937fe700 1 --2- 172.21.15.8:0/1999378688 >> v2:172.21.15.184:3300/0 conn(0x7f60940af7e0 0x7f60940ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:38:07.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.934+0000 7f6093fff700 1 --2- 172.21.15.8:0/1999378688 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60940af410 0x7f60940cb3a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f60840099b0 tx=0x7f6084009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66c9932c5c95c065 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:07.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.934+0000 7f6092ffd700 1 -- 172.21.15.8:0/1999378688 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608400b710 con 0x7f60940af410 2023-10-06T04:38:07.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.934+0000 7f6092ffd700 1 -- 172.21.15.8:0/1999378688 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608400b870 con 0x7f60940af410 2023-10-06T04:38:07.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.934+0000 7f6092ffd700 1 -- 172.21.15.8:0/1999378688 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608400bc10 con 0x7f60940af410 2023-10-06T04:38:07.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.935+0000 7f609a651700 1 -- 172.21.15.8:0/1999378688 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60940af410 msgr2=0x7f60940cb3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:07.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.935+0000 7f609a651700 1 --2- 172.21.15.8:0/1999378688 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60940af410 0x7f60940cb3a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f60840099b0 tx=0x7f6084009250 comp rx=0 tx=0).stop 2023-10-06T04:38:07.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.935+0000 7f609a651700 1 -- 172.21.15.8:0/1999378688 shutdown_connections 2023-10-06T04:38:07.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.935+0000 7f609a651700 1 --2- 172.21.15.8:0/1999378688 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60940af410 0x7f60940cb3a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:07.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.935+0000 7f609a651700 1 --2- 172.21.15.8:0/1999378688 >> v2:172.21.15.184:3300/0 conn(0x7f60940af7e0 0x7f60940ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:07.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.935+0000 7f609a651700 1 -- 172.21.15.8:0/1999378688 >> 172.21.15.8:0/1999378688 conn(0x7f6094069890 msgr2=0x7f6094069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:07.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.935+0000 7f609a651700 1 -- 172.21.15.8:0/1999378688 shutdown_connections 2023-10-06T04:38:07.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.935+0000 7f609a651700 1 -- 172.21.15.8:0/1999378688 wait complete. 2023-10-06T04:38:07.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.936+0000 7f609a651700 1 Processor -- start 2023-10-06T04:38:07.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.936+0000 7f609a651700 1 -- start start 2023-10-06T04:38:07.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.937+0000 7f609a651700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60940af410 0x7f60941530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:07.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.937+0000 7f609a651700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60940af7e0 0x7f609414f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:07.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.937+0000 7f609a651700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60940cd2f0 0x7f60940cea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:07.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.937+0000 7f609a651700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60940b3cd0 con 0x7f60940af410 2023-10-06T04:38:07.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.937+0000 7f609a651700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60940b33a0 con 0x7f60940cd2f0 2023-10-06T04:38:07.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.937+0000 7f609a651700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60940b3680 con 0x7f60940af7e0 2023-10-06T04:38:07.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.937+0000 7f6093fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60940af410 0x7f60941530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:07.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.937+0000 7f6093fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60940af410 0x7f60941530b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38462/0 (socket says 172.21.15.8:38462) 2023-10-06T04:38:07.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.937+0000 7f6093fff700 1 -- 172.21.15.8:0/614368885 learned_addr learned my addr 172.21.15.8:0/614368885 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:07.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.937+0000 7f60937fe700 1 --2- 172.21.15.8:0/614368885 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60940af7e0 0x7f609414f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:07.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.937+0000 7f6093fff700 1 -- 172.21.15.8:0/614368885 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60940af7e0 msgr2=0x7f609414f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:07.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.937+0000 7f6093fff700 1 --2- 172.21.15.8:0/614368885 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60940af7e0 0x7f609414f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:07.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.937+0000 7f6098bee700 1 --2- 172.21.15.8:0/614368885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60940cd2f0 0x7f60940cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:07.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.937+0000 7f6093fff700 1 -- 172.21.15.8:0/614368885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60940cd2f0 msgr2=0x7f60940cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:07.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.937+0000 7f6093fff700 1 --2- 172.21.15.8:0/614368885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60940cd2f0 0x7f60940cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:07.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.937+0000 7f6093fff700 1 -- 172.21.15.8:0/614368885 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6088009420 con 0x7f60940af410 2023-10-06T04:38:07.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.937+0000 7f60937fe700 1 --2- 172.21.15.8:0/614368885 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60940af7e0 0x7f609414f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:38:07.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.937+0000 7f6098bee700 1 --2- 172.21.15.8:0/614368885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60940cd2f0 0x7f60940cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:38:07.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.937+0000 7f6093fff700 1 --2- 172.21.15.8:0/614368885 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60940af410 0x7f60941530b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f6084009290 tx=0x7f6084017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:07.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.938+0000 7f607bfff700 1 -- 172.21.15.8:0/614368885 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608400bbf0 con 0x7f60940af410 2023-10-06T04:38:07.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.938+0000 7f607bfff700 1 -- 172.21.15.8:0/614368885 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6084000cc0 con 0x7f60940af410 2023-10-06T04:38:07.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.938+0000 7f607bfff700 1 -- 172.21.15.8:0/614368885 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608401a660 con 0x7f60940af410 2023-10-06T04:38:07.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.938+0000 7f609a651700 1 -- 172.21.15.8:0/614368885 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60840094f0 con 0x7f60940af410 2023-10-06T04:38:07.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.938+0000 7f609a651700 1 -- 172.21.15.8:0/614368885 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60941535f0 con 0x7f60940af410 2023-10-06T04:38:07.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.939+0000 7f609a651700 1 -- 172.21.15.8:0/614368885 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6094071550 con 0x7f60940af410 2023-10-06T04:38:07.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.939+0000 7f607bfff700 1 -- 172.21.15.8:0/614368885 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f608401aa50 con 0x7f60940af410 2023-10-06T04:38:07.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.939+0000 7f607bfff700 1 --2- 172.21.15.8:0/614368885 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6080066f30 0x7f60800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:07.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.939+0000 7f607bfff700 1 -- 172.21.15.8:0/614368885 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f6084086260 con 0x7f60940af410 2023-10-06T04:38:07.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.940+0000 7f60937fe700 1 --2- 172.21.15.8:0/614368885 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6080066f30 0x7f60800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:07.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.940+0000 7f60937fe700 1 --2- 172.21.15.8:0/614368885 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6080066f30 0x7f60800693e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f60880093f0 tx=0x7f6088008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:07.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:07.944+0000 7f607bfff700 1 -- 172.21.15.8:0/614368885 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f60840534d0 con 0x7f60940af410 2023-10-06T04:38:08.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.137+0000 7f609a651700 1 -- 172.21.15.8:0/614368885 --> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f60940b3e10 con 0x7f6080066f30 2023-10-06T04:38:08.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.137+0000 7f607bfff700 1 -- 172.21.15.8:0/614368885 <== mgr.4105 v2:172.21.15.184:6832/90283 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f60880109b0 con 0x7f6080066f30 2023-10-06T04:38:08.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.139+0000 7f609a651700 1 -- 172.21.15.8:0/614368885 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6080066f30 msgr2=0x7f60800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:08.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.139+0000 7f609a651700 1 --2- 172.21.15.8:0/614368885 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6080066f30 0x7f60800693e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f60880093f0 tx=0x7f6088008040 comp rx=0 tx=0).stop 2023-10-06T04:38:08.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.139+0000 7f609a651700 1 -- 172.21.15.8:0/614368885 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60940af410 msgr2=0x7f60941530b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:08.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.139+0000 7f609a651700 1 --2- 172.21.15.8:0/614368885 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60940af410 0x7f60941530b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f6084009290 tx=0x7f6084017000 comp rx=0 tx=0).stop 2023-10-06T04:38:08.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.139+0000 7f609a651700 1 -- 172.21.15.8:0/614368885 shutdown_connections 2023-10-06T04:38:08.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.139+0000 7f609a651700 1 --2- 172.21.15.8:0/614368885 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6080066f30 0x7f60800693e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:08.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.139+0000 7f609a651700 1 --2- 172.21.15.8:0/614368885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60940cd2f0 0x7f60940cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:08.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.139+0000 7f609a651700 1 --2- 172.21.15.8:0/614368885 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60940af410 0x7f60941530b0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:08.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.139+0000 7f609a651700 1 --2- 172.21.15.8:0/614368885 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60940af7e0 0x7f609414f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:08.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.139+0000 7f609a651700 1 -- 172.21.15.8:0/614368885 >> 172.21.15.8:0/614368885 conn(0x7f6094069890 msgr2=0x7f60940b1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:08.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.139+0000 7f609a651700 1 -- 172.21.15.8:0/614368885 shutdown_connections 2023-10-06T04:38:08.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.139+0000 7f609a651700 1 -- 172.21.15.8:0/614368885 wait complete. 2023-10-06T04:38:08.143 INFO:teuthology.orchestra.run.smithi008.stderr:instructed osd(s) 0 to deep-scrub 2023-10-06T04:38:08.155 INFO:tasks.ceph:Scrubbing osd.1 2023-10-06T04:38:08.155 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:38:08.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.276+0000 7f76ad55c700 1 Processor -- start 2023-10-06T04:38:08.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.276+0000 7f76ad55c700 1 -- start start 2023-10-06T04:38:08.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.277+0000 7f76ad55c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76a80af6f0 0x7f76a815a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:08.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.277+0000 7f76ad55c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f76a8069720 0x7f76a8069b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:08.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.277+0000 7f76ad55c700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f76a80681b0 0x7f76a80685f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:08.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.277+0000 7f76ad55c700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a806a0d0 con 0x7f76a80681b0 2023-10-06T04:38:08.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.277+0000 7f76ad55c700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a815e160 con 0x7f76a8069720 2023-10-06T04:38:08.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.277+0000 7f76ad55c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a80afac0 con 0x7f76a80af6f0 2023-10-06T04:38:08.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.277+0000 7f76acd5b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f76a80681b0 0x7f76a80685f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:08.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.277+0000 7f76acd5b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f76a80681b0 0x7f76a80685f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38466/0 (socket says 172.21.15.8:38466) 2023-10-06T04:38:08.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.277+0000 7f76acd5b700 1 -- 172.21.15.8:0/1806505434 learned_addr learned my addr 172.21.15.8:0/1806505434 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:08.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.277+0000 7f76a7fff700 1 --2- 172.21.15.8:0/1806505434 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76a80af6f0 0x7f76a815a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:08.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.277+0000 7f76a77fe700 1 --2- 172.21.15.8:0/1806505434 >> v2:172.21.15.184:3300/0 conn(0x7f76a8069720 0x7f76a8069b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:08.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.277+0000 7f76acd5b700 1 -- 172.21.15.8:0/1806505434 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76a80af6f0 msgr2=0x7f76a815a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:08.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.277+0000 7f76acd5b700 1 --2- 172.21.15.8:0/1806505434 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76a80af6f0 0x7f76a815a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:08.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.277+0000 7f76acd5b700 1 -- 172.21.15.8:0/1806505434 >> v2:172.21.15.184:3300/0 conn(0x7f76a8069720 msgr2=0x7f76a8069b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:08.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.277+0000 7f76acd5b700 1 --2- 172.21.15.8:0/1806505434 >> v2:172.21.15.184:3300/0 conn(0x7f76a8069720 0x7f76a8069b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:08.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.277+0000 7f76acd5b700 1 -- 172.21.15.8:0/1806505434 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a815ab50 con 0x7f76a80681b0 2023-10-06T04:38:08.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.277+0000 7f76a77fe700 1 --2- 172.21.15.8:0/1806505434 >> v2:172.21.15.184:3300/0 conn(0x7f76a8069720 0x7f76a8069b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:38:08.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.277+0000 7f76a7fff700 1 --2- 172.21.15.8:0/1806505434 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76a80af6f0 0x7f76a815a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:38:08.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.278+0000 7f76acd5b700 1 --2- 172.21.15.8:0/1806505434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76a80681b0 0x7f76a80685f0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f76a806a8c0 tx=0x7f76a0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5b9e5eb28935f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:08.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.278+0000 7f76a6ffd700 1 -- 172.21.15.8:0/1806505434 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a000e070 con 0x7f76a80681b0 2023-10-06T04:38:08.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.278+0000 7f76a6ffd700 1 -- 172.21.15.8:0/1806505434 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a000ba50 con 0x7f76a80681b0 2023-10-06T04:38:08.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.278+0000 7f76a6ffd700 1 -- 172.21.15.8:0/1806505434 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a00092e0 con 0x7f76a80681b0 2023-10-06T04:38:08.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.278+0000 7f76ad55c700 1 -- 172.21.15.8:0/1806505434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76a80681b0 msgr2=0x7f76a80685f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:08.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.278+0000 7f76ad55c700 1 --2- 172.21.15.8:0/1806505434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76a80681b0 0x7f76a80685f0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f76a806a8c0 tx=0x7f76a0009840 comp rx=0 tx=0).stop 2023-10-06T04:38:08.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.278+0000 7f76ad55c700 1 -- 172.21.15.8:0/1806505434 shutdown_connections 2023-10-06T04:38:08.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.278+0000 7f76ad55c700 1 --2- 172.21.15.8:0/1806505434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76a80681b0 0x7f76a80685f0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:08.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.278+0000 7f76ad55c700 1 --2- 172.21.15.8:0/1806505434 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76a80af6f0 0x7f76a815a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:08.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.278+0000 7f76ad55c700 1 --2- 172.21.15.8:0/1806505434 >> v2:172.21.15.184:3300/0 conn(0x7f76a8069720 0x7f76a8069b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:08.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.278+0000 7f76ad55c700 1 -- 172.21.15.8:0/1806505434 >> 172.21.15.8:0/1806505434 conn(0x7f76a80d0280 msgr2=0x7f76a80d0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:08.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.278+0000 7f76ad55c700 1 -- 172.21.15.8:0/1806505434 shutdown_connections 2023-10-06T04:38:08.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.278+0000 7f76ad55c700 1 -- 172.21.15.8:0/1806505434 wait complete. 2023-10-06T04:38:08.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.279+0000 7f76ad55c700 1 Processor -- start 2023-10-06T04:38:08.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.280+0000 7f76ad55c700 1 -- start start 2023-10-06T04:38:08.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.280+0000 7f76ad55c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76a80681b0 0x7f76a80b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:08.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.280+0000 7f76ad55c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76a8069720 0x7f76a81698c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:08.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.280+0000 7f76ad55c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76a80af6f0 0x7f76a8158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:08.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.280+0000 7f76ad55c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a80c9fc0 con 0x7f76a8069720 2023-10-06T04:38:08.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.280+0000 7f76ad55c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a80c7d00 con 0x7f76a80af6f0 2023-10-06T04:38:08.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.280+0000 7f76ad55c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a80c9940 con 0x7f76a80681b0 2023-10-06T04:38:08.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.280+0000 7f76a77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76a8069720 0x7f76a81698c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:08.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.281+0000 7f76a77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76a8069720 0x7f76a81698c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38468/0 (socket says 172.21.15.8:38468) 2023-10-06T04:38:08.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.281+0000 7f76a77fe700 1 -- 172.21.15.8:0/2822701737 learned_addr learned my addr 172.21.15.8:0/2822701737 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:08.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.281+0000 7f76acd5b700 1 --2- 172.21.15.8:0/2822701737 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76a80af6f0 0x7f76a8158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:08.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.281+0000 7f76a7fff700 1 --2- 172.21.15.8:0/2822701737 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76a80681b0 0x7f76a80b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:08.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.281+0000 7f76a77fe700 1 -- 172.21.15.8:0/2822701737 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76a80681b0 msgr2=0x7f76a80b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:08.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.281+0000 7f76a77fe700 1 --2- 172.21.15.8:0/2822701737 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76a80681b0 0x7f76a80b3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:08.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.281+0000 7f76a77fe700 1 -- 172.21.15.8:0/2822701737 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76a80af6f0 msgr2=0x7f76a8158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:08.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.281+0000 7f76a77fe700 1 --2- 172.21.15.8:0/2822701737 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76a80af6f0 0x7f76a8158f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:08.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.281+0000 7f76a77fe700 1 -- 172.21.15.8:0/2822701737 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a0009ae0 con 0x7f76a8069720 2023-10-06T04:38:08.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.281+0000 7f76a77fe700 1 --2- 172.21.15.8:0/2822701737 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76a8069720 0x7f76a81698c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f769800e8d0 tx=0x7f7698008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:08.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.281+0000 7f769ffff700 1 -- 172.21.15.8:0/2822701737 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76980093b0 con 0x7f76a8069720 2023-10-06T04:38:08.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.281+0000 7f769ffff700 1 -- 172.21.15.8:0/2822701737 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7698013410 con 0x7f76a8069720 2023-10-06T04:38:08.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.281+0000 7f76ad55c700 1 -- 172.21.15.8:0/2822701737 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a80b41f0 con 0x7f76a8069720 2023-10-06T04:38:08.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.281+0000 7f769ffff700 1 -- 172.21.15.8:0/2822701737 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76980137b0 con 0x7f76a8069720 2023-10-06T04:38:08.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.281+0000 7f76ad55c700 1 -- 172.21.15.8:0/2822701737 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a80c9be0 con 0x7f76a8069720 2023-10-06T04:38:08.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.282+0000 7f76ad55c700 1 -- 172.21.15.8:0/2822701737 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f76a804c380 con 0x7f76a8069720 2023-10-06T04:38:08.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.283+0000 7f769ffff700 1 -- 172.21.15.8:0/2822701737 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7698013be0 con 0x7f76a8069720 2023-10-06T04:38:08.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.283+0000 7f769ffff700 1 --2- 172.21.15.8:0/2822701737 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7688066f30 0x7f76880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:08.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.283+0000 7f769ffff700 1 -- 172.21.15.8:0/2822701737 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f76980844d0 con 0x7f76a8069720 2023-10-06T04:38:08.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.283+0000 7f76a7fff700 1 --2- 172.21.15.8:0/2822701737 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7688066f30 0x7f76880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:08.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.283+0000 7f769ffff700 1 --2- 172.21.15.8:0/2822701737 >> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] conn(0x7f768806d8f0 0x7f768806fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:08.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.283+0000 7f769ffff700 1 -- 172.21.15.8:0/2822701737 --> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f76880703f0 con 0x7f768806d8f0 2023-10-06T04:38:08.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.283+0000 7f769ffff700 1 -- 172.21.15.8:0/2822701737 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7698086b10 con 0x7f76a8069720 2023-10-06T04:38:08.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.283+0000 7f76acd5b700 1 --2- 172.21.15.8:0/2822701737 >> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] conn(0x7f768806d8f0 0x7f768806fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:08.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.284+0000 7f76a7fff700 1 --2- 172.21.15.8:0/2822701737 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7688066f30 0x7f76880693e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7690006fd0 tx=0x7f7690008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:08.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.284+0000 7f76acd5b700 1 --2- 172.21.15.8:0/2822701737 >> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] conn(0x7f768806d8f0 0x7f768806fd20 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:08.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.284+0000 7f769ffff700 1 -- 172.21.15.8:0/2822701737 <== osd.1 v2:172.21.15.8:6816/90669 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f76880703f0 con 0x7f768806d8f0 2023-10-06T04:38:08.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.298+0000 7f76ad55c700 1 -- 172.21.15.8:0/2822701737 --> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f76a80ce090 con 0x7f768806d8f0 2023-10-06T04:38:08.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.298+0000 7f769ffff700 1 -- 172.21.15.8:0/2822701737 <== osd.1 v2:172.21.15.8:6816/90669 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f76a80ce090 con 0x7f768806d8f0 2023-10-06T04:38:08.301 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T04:38:08.301 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:38:08.301 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T04:38:08.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.299+0000 7f76ad55c700 1 -- 172.21.15.8:0/2822701737 >> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] conn(0x7f768806d8f0 msgr2=0x7f768806fd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:08.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.299+0000 7f76ad55c700 1 --2- 172.21.15.8:0/2822701737 >> [v2:172.21.15.8:6816/90669,v1:172.21.15.8:6817/90669] conn(0x7f768806d8f0 0x7f768806fd20 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:08.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.299+0000 7f76ad55c700 1 -- 172.21.15.8:0/2822701737 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7688066f30 msgr2=0x7f76880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:08.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.299+0000 7f76ad55c700 1 --2- 172.21.15.8:0/2822701737 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7688066f30 0x7f76880693e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7690006fd0 tx=0x7f7690008040 comp rx=0 tx=0).stop 2023-10-06T04:38:08.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.299+0000 7f76ad55c700 1 -- 172.21.15.8:0/2822701737 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76a8069720 msgr2=0x7f76a81698c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:08.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.299+0000 7f76ad55c700 1 --2- 172.21.15.8:0/2822701737 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76a8069720 0x7f76a81698c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f769800e8d0 tx=0x7f7698008040 comp rx=0 tx=0).stop 2023-10-06T04:38:08.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.299+0000 7f76acd5b700 1 -- 172.21.15.8:0/2822701737 reap_dead start 2023-10-06T04:38:08.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.299+0000 7f76ad55c700 1 -- 172.21.15.8:0/2822701737 shutdown_connections 2023-10-06T04:38:08.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.299+0000 7f76ad55c700 1 -- 172.21.15.8:0/2822701737 >> 172.21.15.8:0/2822701737 conn(0x7f76a80d0280 msgr2=0x7f76a815ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:08.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.299+0000 7f76ad55c700 1 -- 172.21.15.8:0/2822701737 shutdown_connections 2023-10-06T04:38:08.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.299+0000 7f76ad55c700 1 -- 172.21.15.8:0/2822701737 wait complete. 2023-10-06T04:38:08.313 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-06T04:38:08.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.430+0000 7f3a2a790700 1 Processor -- start 2023-10-06T04:38:08.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.431+0000 7f3a2a790700 1 -- start start 2023-10-06T04:38:08.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.431+0000 7f3a2a790700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3a240af7e0 0x7f3a240cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:08.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.431+0000 7f3a2a790700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a240cd4c0 0x7f3a240ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:08.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.431+0000 7f3a2a790700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a2415ddd0 con 0x7f3a240af410 2023-10-06T04:38:08.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.431+0000 7f3a2a790700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a2415e260 con 0x7f3a240af7e0 2023-10-06T04:38:08.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.431+0000 7f3a2a790700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2415d4a0 con 0x7f3a240cd4c0 2023-10-06T04:38:08.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.431+0000 7f3a237fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3a240af7e0 0x7f3a240cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:08.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.431+0000 7f3a237fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3a240af7e0 0x7f3a240cb3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38478/0 (socket says 172.21.15.8:38478) 2023-10-06T04:38:08.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.432+0000 7f3a237fe700 1 -- 172.21.15.8:0/972259708 learned_addr learned my addr 172.21.15.8:0/972259708 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:08.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.432+0000 7f3a28d2d700 1 --2- 172.21.15.8:0/972259708 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a240cd4c0 0x7f3a240ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:08.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.432+0000 7f3a237fe700 1 -- 172.21.15.8:0/972259708 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a240cd4c0 msgr2=0x7f3a240ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:08.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.432+0000 7f3a237fe700 1 --2- 172.21.15.8:0/972259708 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a240cd4c0 0x7f3a240ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:08.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.432+0000 7f3a237fe700 1 -- 172.21.15.8:0/972259708 >> v1:172.21.15.184:6789/0 conn(0x7f3a240af410 legacy=0x7f3a240ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:08.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.432+0000 7f3a237fe700 1 -- 172.21.15.8:0/972259708 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2415d780 con 0x7f3a240af7e0 2023-10-06T04:38:08.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.432+0000 7f3a28d2d700 1 --2- 172.21.15.8:0/972259708 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a240cd4c0 0x7f3a240ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:38:08.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.432+0000 7f3a237fe700 1 --2- 172.21.15.8:0/972259708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a240af7e0 0x7f3a240cb3a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f3a140099b0 tx=0x7f3a14009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ade0f1b85ed2650 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:08.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.432+0000 7f3a22ffd700 1 -- 172.21.15.8:0/972259708 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1400b8b0 con 0x7f3a240af7e0 2023-10-06T04:38:08.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.432+0000 7f3a22ffd700 1 -- 172.21.15.8:0/972259708 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1400ba10 con 0x7f3a240af7e0 2023-10-06T04:38:08.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.432+0000 7f3a22ffd700 1 -- 172.21.15.8:0/972259708 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1400bdb0 con 0x7f3a240af7e0 2023-10-06T04:38:08.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.433+0000 7f3a2a790700 1 -- 172.21.15.8:0/972259708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a240af7e0 msgr2=0x7f3a240cb3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:08.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.433+0000 7f3a2a790700 1 --2- 172.21.15.8:0/972259708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a240af7e0 0x7f3a240cb3a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f3a140099b0 tx=0x7f3a14009250 comp rx=0 tx=0).stop 2023-10-06T04:38:08.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.433+0000 7f3a2a790700 1 -- 172.21.15.8:0/972259708 shutdown_connections 2023-10-06T04:38:08.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.433+0000 7f3a2a790700 1 --2- 172.21.15.8:0/972259708 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a240cd4c0 0x7f3a240ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:08.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.433+0000 7f3a2a790700 1 --2- 172.21.15.8:0/972259708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a240af7e0 0x7f3a240cb3a0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:08.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.433+0000 7f3a2a790700 1 -- 172.21.15.8:0/972259708 >> 172.21.15.8:0/972259708 conn(0x7f3a24069890 msgr2=0x7f3a24069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:08.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.433+0000 7f3a2a790700 1 -- 172.21.15.8:0/972259708 shutdown_connections 2023-10-06T04:38:08.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.433+0000 7f3a2a790700 1 -- 172.21.15.8:0/972259708 wait complete. 2023-10-06T04:38:08.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.434+0000 7f3a2a790700 1 Processor -- start 2023-10-06T04:38:08.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.434+0000 7f3a2a790700 1 -- start start 2023-10-06T04:38:08.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.435+0000 7f3a2a790700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a240af410 0x7f3a24153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:08.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.435+0000 7f3a2a790700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a240af7e0 0x7f3a240c65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:08.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.435+0000 7f3a2a790700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a240cd4c0 0x7f3a2414de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:08.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.435+0000 7f3a2a790700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a24151d80 con 0x7f3a240cd4c0 2023-10-06T04:38:08.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.435+0000 7f3a2a790700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a241540d0 con 0x7f3a240af7e0 2023-10-06T04:38:08.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.435+0000 7f3a2a790700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a240b4770 con 0x7f3a240af410 2023-10-06T04:38:08.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.435+0000 7f3a28d2d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a240cd4c0 0x7f3a2414de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:08.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.435+0000 7f3a28d2d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a240cd4c0 0x7f3a2414de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38486/0 (socket says 172.21.15.8:38486) 2023-10-06T04:38:08.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.435+0000 7f3a28d2d700 1 -- 172.21.15.8:0/1403966738 learned_addr learned my addr 172.21.15.8:0/1403966738 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:08.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.435+0000 7f3a237fe700 1 --2- 172.21.15.8:0/1403966738 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a240af7e0 0x7f3a240c65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:08.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.435+0000 7f3a23fff700 1 --2- 172.21.15.8:0/1403966738 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a240af410 0x7f3a24153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:08.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.435+0000 7f3a28d2d700 1 -- 172.21.15.8:0/1403966738 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a240af410 msgr2=0x7f3a24153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:08.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.435+0000 7f3a28d2d700 1 --2- 172.21.15.8:0/1403966738 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a240af410 0x7f3a24153b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:08.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.435+0000 7f3a28d2d700 1 -- 172.21.15.8:0/1403966738 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a240af7e0 msgr2=0x7f3a240c65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:08.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.435+0000 7f3a28d2d700 1 --2- 172.21.15.8:0/1403966738 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a240af7e0 0x7f3a240c65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:08.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.435+0000 7f3a28d2d700 1 -- 172.21.15.8:0/1403966738 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a140094f0 con 0x7f3a240cd4c0 2023-10-06T04:38:08.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.435+0000 7f3a237fe700 1 --2- 172.21.15.8:0/1403966738 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a240af7e0 0x7f3a240c65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:38:08.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.435+0000 7f3a28d2d700 1 --2- 172.21.15.8:0/1403966738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a240cd4c0 0x7f3a2414de20 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c00cef0 tx=0x7f3a1c007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:08.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.435+0000 7f3a1bfff700 1 -- 172.21.15.8:0/1403966738 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c00ae00 con 0x7f3a240cd4c0 2023-10-06T04:38:08.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.435+0000 7f3a1bfff700 1 -- 172.21.15.8:0/1403966738 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1c016420 con 0x7f3a240cd4c0 2023-10-06T04:38:08.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.435+0000 7f3a2a790700 1 -- 172.21.15.8:0/1403966738 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a240b4a50 con 0x7f3a240cd4c0 2023-10-06T04:38:08.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.435+0000 7f3a1bfff700 1 -- 172.21.15.8:0/1403966738 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c0167e0 con 0x7f3a240cd4c0 2023-10-06T04:38:08.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.435+0000 7f3a2a790700 1 -- 172.21.15.8:0/1403966738 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a240b5010 con 0x7f3a240cd4c0 2023-10-06T04:38:08.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.436+0000 7f3a2a790700 1 -- 172.21.15.8:0/1403966738 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a240b5230 con 0x7f3a240cd4c0 2023-10-06T04:38:08.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.437+0000 7f3a1bfff700 1 -- 172.21.15.8:0/1403966738 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3a1c016bd0 con 0x7f3a240cd4c0 2023-10-06T04:38:08.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.437+0000 7f3a1bfff700 1 --2- 172.21.15.8:0/1403966738 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3a04066f30 0x7f3a040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:08.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.437+0000 7f3a1bfff700 1 -- 172.21.15.8:0/1403966738 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f3a1c012070 con 0x7f3a240cd4c0 2023-10-06T04:38:08.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.437+0000 7f3a23fff700 1 --2- 172.21.15.8:0/1403966738 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3a04066f30 0x7f3a040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:08.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.438+0000 7f3a23fff700 1 --2- 172.21.15.8:0/1403966738 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3a04066f30 0x7f3a040693e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c003870 tx=0x7f3a0c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:08.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.441+0000 7f3a1bfff700 1 -- 172.21.15.8:0/1403966738 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3a1c04e5a0 con 0x7f3a240cd4c0 2023-10-06T04:38:08.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.633+0000 7f3a2a790700 1 -- 172.21.15.8:0/1403966738 --> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a24071550 con 0x7f3a04066f30 2023-10-06T04:38:08.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.633+0000 7f3a1bfff700 1 -- 172.21.15.8:0/1403966738 <== mgr.4105 v2:172.21.15.184:6832/90283 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3a24071550 con 0x7f3a04066f30 2023-10-06T04:38:08.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.636+0000 7f3a2a790700 1 -- 172.21.15.8:0/1403966738 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3a04066f30 msgr2=0x7f3a040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:08.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.636+0000 7f3a2a790700 1 --2- 172.21.15.8:0/1403966738 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3a04066f30 0x7f3a040693e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c003870 tx=0x7f3a0c009040 comp rx=0 tx=0).stop 2023-10-06T04:38:08.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.636+0000 7f3a2a790700 1 -- 172.21.15.8:0/1403966738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a240cd4c0 msgr2=0x7f3a2414de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:08.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.636+0000 7f3a2a790700 1 --2- 172.21.15.8:0/1403966738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a240cd4c0 0x7f3a2414de20 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c00cef0 tx=0x7f3a1c007860 comp rx=0 tx=0).stop 2023-10-06T04:38:08.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.636+0000 7f3a2a790700 1 -- 172.21.15.8:0/1403966738 shutdown_connections 2023-10-06T04:38:08.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.636+0000 7f3a2a790700 1 --2- 172.21.15.8:0/1403966738 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f3a04066f30 0x7f3a040693e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:08.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.636+0000 7f3a2a790700 1 --2- 172.21.15.8:0/1403966738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a240cd4c0 0x7f3a2414de20 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:08.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.636+0000 7f3a2a790700 1 --2- 172.21.15.8:0/1403966738 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a240af410 0x7f3a24153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:08.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.636+0000 7f3a2a790700 1 --2- 172.21.15.8:0/1403966738 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a240af7e0 0x7f3a240c65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:08.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.636+0000 7f3a2a790700 1 -- 172.21.15.8:0/1403966738 >> 172.21.15.8:0/1403966738 conn(0x7f3a24069890 msgr2=0x7f3a24150040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:08.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.636+0000 7f3a2a790700 1 -- 172.21.15.8:0/1403966738 shutdown_connections 2023-10-06T04:38:08.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.636+0000 7f3a2a790700 1 -- 172.21.15.8:0/1403966738 wait complete. 2023-10-06T04:38:08.640 INFO:teuthology.orchestra.run.smithi008.stderr:instructed osd(s) 1 to deep-scrub 2023-10-06T04:38:08.650 INFO:tasks.ceph:Scrubbing osd.2 2023-10-06T04:38:08.650 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:38:08.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.771+0000 7f97014b3700 1 Processor -- start 2023-10-06T04:38:08.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.771+0000 7f97014b3700 1 -- start start 2023-10-06T04:38:08.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.772+0000 7f97014b3700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f96fc068cf0 0x7f96fc15d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:08.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.772+0000 7f97014b3700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96fc0c91e0 0x7f96fc159650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:08.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.772+0000 7f97014b3700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96fc15d740 con 0x7f96fc159280 2023-10-06T04:38:08.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.772+0000 7f97014b3700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96fc15da20 con 0x7f96fc068cf0 2023-10-06T04:38:08.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.772+0000 7f97014b3700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc15dd00 con 0x7f96fc0c91e0 2023-10-06T04:38:08.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.772+0000 7f96fa7fc700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f96fc068cf0 0x7f96fc15d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:08.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.772+0000 7f96fa7fc700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f96fc068cf0 0x7f96fc15d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38498/0 (socket says 172.21.15.8:38498) 2023-10-06T04:38:08.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.772+0000 7f96fa7fc700 1 -- 172.21.15.8:0/1608305638 learned_addr learned my addr 172.21.15.8:0/1608305638 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:08.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.772+0000 7f96fb7fe700 1 --2- 172.21.15.8:0/1608305638 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96fc0c91e0 0x7f96fc159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:08.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.772+0000 7f96fa7fc700 1 -- 172.21.15.8:0/1608305638 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96fc0c91e0 msgr2=0x7f96fc159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:08.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.772+0000 7f96fa7fc700 1 --2- 172.21.15.8:0/1608305638 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96fc0c91e0 0x7f96fc159650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:08.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.772+0000 7f96fa7fc700 1 -- 172.21.15.8:0/1608305638 >> v1:172.21.15.184:6789/0 conn(0x7f96fc159280 legacy=0x7f96fc0685e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:08.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.772+0000 7f96fa7fc700 1 -- 172.21.15.8:0/1608305638 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96fc15dfe0 con 0x7f96fc068cf0 2023-10-06T04:38:08.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.772+0000 7f96f9ffb700 1 -- 172.21.15.8:0/1608305638 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3528047097 0 0) 0x7f96fc15d740 con 0x7f96fc159280 2023-10-06T04:38:08.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.772+0000 7f96fa7fc700 1 --2- 172.21.15.8:0/1608305638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96fc068cf0 0x7f96fc15d140 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f96f00099b0 tx=0x7f96f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=364fd7f28e988d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:08.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.773+0000 7f96f9ffb700 1 -- 172.21.15.8:0/1608305638 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f0009ea0 con 0x7f96fc068cf0 2023-10-06T04:38:08.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.773+0000 7f96f9ffb700 1 -- 172.21.15.8:0/1608305638 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f000b860 con 0x7f96fc068cf0 2023-10-06T04:38:08.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.773+0000 7f96f9ffb700 1 -- 172.21.15.8:0/1608305638 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f000bc00 con 0x7f96fc068cf0 2023-10-06T04:38:08.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.773+0000 7f97014b3700 1 -- 172.21.15.8:0/1608305638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96fc068cf0 msgr2=0x7f96fc15d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:08.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.773+0000 7f97014b3700 1 --2- 172.21.15.8:0/1608305638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96fc068cf0 0x7f96fc15d140 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f96f00099b0 tx=0x7f96f0009250 comp rx=0 tx=0).stop 2023-10-06T04:38:08.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.773+0000 7f97014b3700 1 -- 172.21.15.8:0/1608305638 shutdown_connections 2023-10-06T04:38:08.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.773+0000 7f97014b3700 1 --2- 172.21.15.8:0/1608305638 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96fc0c91e0 0x7f96fc159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:08.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.773+0000 7f97014b3700 1 --2- 172.21.15.8:0/1608305638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96fc068cf0 0x7f96fc15d140 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:08.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.773+0000 7f97014b3700 1 -- 172.21.15.8:0/1608305638 >> 172.21.15.8:0/1608305638 conn(0x7f96fc06dd10 msgr2=0x7f96fc06e110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:08.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.773+0000 7f97014b3700 1 -- 172.21.15.8:0/1608305638 shutdown_connections 2023-10-06T04:38:08.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.773+0000 7f97014b3700 1 -- 172.21.15.8:0/1608305638 wait complete. 2023-10-06T04:38:08.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.775+0000 7f97014b3700 1 Processor -- start 2023-10-06T04:38:08.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.775+0000 7f97014b3700 1 -- start start 2023-10-06T04:38:08.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.775+0000 7f97014b3700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96fc068cf0 0x7f96fc16d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:08.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.775+0000 7f97014b3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96fc0c91e0 0x7f96fc13ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:08.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.775+0000 7f97014b3700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96fc159280 0x7f96fc0b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:08.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.775+0000 7f97014b3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc0cc0b0 con 0x7f96fc0c91e0 2023-10-06T04:38:08.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.775+0000 7f97014b3700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc16deb0 con 0x7f96fc159280 2023-10-06T04:38:08.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.775+0000 7f97014b3700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc0b1a30 con 0x7f96fc068cf0 2023-10-06T04:38:08.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.775+0000 7f96fa7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96fc0c91e0 0x7f96fc13ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:08.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.775+0000 7f96fa7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96fc0c91e0 0x7f96fc13ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38508/0 (socket says 172.21.15.8:38508) 2023-10-06T04:38:08.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.775+0000 7f96fa7fc700 1 -- 172.21.15.8:0/1025251497 learned_addr learned my addr 172.21.15.8:0/1025251497 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:08.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.776+0000 7f96fb7fe700 1 --2- 172.21.15.8:0/1025251497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96fc159280 0x7f96fc0b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:08.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.776+0000 7f96faffd700 1 --2- 172.21.15.8:0/1025251497 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96fc068cf0 0x7f96fc16d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:08.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.776+0000 7f96fa7fc700 1 -- 172.21.15.8:0/1025251497 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96fc068cf0 msgr2=0x7f96fc16d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:08.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.776+0000 7f96fa7fc700 1 --2- 172.21.15.8:0/1025251497 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96fc068cf0 0x7f96fc16d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:08.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.776+0000 7f96fa7fc700 1 -- 172.21.15.8:0/1025251497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96fc159280 msgr2=0x7f96fc0b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:08.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.776+0000 7f96fa7fc700 1 --2- 172.21.15.8:0/1025251497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96fc159280 0x7f96fc0b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:08.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.776+0000 7f96fa7fc700 1 -- 172.21.15.8:0/1025251497 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f00094f0 con 0x7f96fc0c91e0 2023-10-06T04:38:08.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.776+0000 7f96fa7fc700 1 --2- 172.21.15.8:0/1025251497 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96fc0c91e0 0x7f96fc13ec80 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f96fc06d970 tx=0x7f96f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:08.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.776+0000 7f96e2ffd700 1 -- 172.21.15.8:0/1025251497 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f000bbe0 con 0x7f96fc0c91e0 2023-10-06T04:38:08.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.776+0000 7f96e2ffd700 1 -- 172.21.15.8:0/1025251497 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f0011420 con 0x7f96fc0c91e0 2023-10-06T04:38:08.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.776+0000 7f97014b3700 1 -- 172.21.15.8:0/1025251497 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96fc13f1c0 con 0x7f96fc0c91e0 2023-10-06T04:38:08.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.776+0000 7f96e2ffd700 1 -- 172.21.15.8:0/1025251497 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f00117e0 con 0x7f96fc0c91e0 2023-10-06T04:38:08.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.776+0000 7f97014b3700 1 -- 172.21.15.8:0/1025251497 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96fc0b2400 con 0x7f96fc0c91e0 2023-10-06T04:38:08.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.777+0000 7f97014b3700 1 -- 172.21.15.8:0/1025251497 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f96fc0afa80 con 0x7f96fc0c91e0 2023-10-06T04:38:08.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.777+0000 7f96e2ffd700 1 -- 172.21.15.8:0/1025251497 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f96f0011c10 con 0x7f96fc0c91e0 2023-10-06T04:38:08.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.778+0000 7f96e2ffd700 1 --2- 172.21.15.8:0/1025251497 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f96e8066f30 0x7f96e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:08.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.778+0000 7f96e2ffd700 1 -- 172.21.15.8:0/1025251497 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f96f0085e80 con 0x7f96fc0c91e0 2023-10-06T04:38:08.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.778+0000 7f96e2ffd700 1 --2- 172.21.15.8:0/1025251497 >> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] conn(0x7f96e806d8f0 0x7f96e806fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:08.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.778+0000 7f96e2ffd700 1 -- 172.21.15.8:0/1025251497 --> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f96e80703f0 con 0x7f96e806d8f0 2023-10-06T04:38:08.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.778+0000 7f96e2ffd700 1 -- 172.21.15.8:0/1025251497 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96f00884c0 con 0x7f96fc0c91e0 2023-10-06T04:38:08.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.778+0000 7f96faffd700 1 --2- 172.21.15.8:0/1025251497 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f96e8066f30 0x7f96e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:08.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.778+0000 7f96fb7fe700 1 --2- 172.21.15.8:0/1025251497 >> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] conn(0x7f96e806d8f0 0x7f96e806fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:08.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.778+0000 7f96fb7fe700 1 --2- 172.21.15.8:0/1025251497 >> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] conn(0x7f96e806d8f0 0x7f96e806fd20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:08.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.779+0000 7f96faffd700 1 --2- 172.21.15.8:0/1025251497 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f96e8066f30 0x7f96e80693e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f96ec003820 tx=0x7f96ec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:08.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.779+0000 7f96e2ffd700 1 -- 172.21.15.8:0/1025251497 <== osd.2 v2:172.21.15.8:6800/90670 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f96e80703f0 con 0x7f96e806d8f0 2023-10-06T04:38:08.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.793+0000 7f97014b3700 1 -- 172.21.15.8:0/1025251497 --> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f96fc071550 con 0x7f96e806d8f0 2023-10-06T04:38:08.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.793+0000 7f96e2ffd700 1 -- 172.21.15.8:0/1025251497 <== osd.2 v2:172.21.15.8:6800/90670 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f96fc071550 con 0x7f96e806d8f0 2023-10-06T04:38:08.796 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T04:38:08.796 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:38:08.796 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T04:38:08.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.793+0000 7f97014b3700 1 -- 172.21.15.8:0/1025251497 >> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] conn(0x7f96e806d8f0 msgr2=0x7f96e806fd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:08.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.793+0000 7f97014b3700 1 --2- 172.21.15.8:0/1025251497 >> [v2:172.21.15.8:6800/90670,v1:172.21.15.8:6801/90670] conn(0x7f96e806d8f0 0x7f96e806fd20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:08.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.793+0000 7f97014b3700 1 -- 172.21.15.8:0/1025251497 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f96e8066f30 msgr2=0x7f96e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:08.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.793+0000 7f97014b3700 1 --2- 172.21.15.8:0/1025251497 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f96e8066f30 0x7f96e80693e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f96ec003820 tx=0x7f96ec009040 comp rx=0 tx=0).stop 2023-10-06T04:38:08.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.793+0000 7f97014b3700 1 -- 172.21.15.8:0/1025251497 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96fc0c91e0 msgr2=0x7f96fc13ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:08.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.793+0000 7f97014b3700 1 --2- 172.21.15.8:0/1025251497 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96fc0c91e0 0x7f96fc13ec80 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f96fc06d970 tx=0x7f96f0017000 comp rx=0 tx=0).stop 2023-10-06T04:38:08.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.793+0000 7f96fb7fe700 1 -- 172.21.15.8:0/1025251497 reap_dead start 2023-10-06T04:38:08.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.793+0000 7f97014b3700 1 -- 172.21.15.8:0/1025251497 shutdown_connections 2023-10-06T04:38:08.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.793+0000 7f97014b3700 1 -- 172.21.15.8:0/1025251497 >> 172.21.15.8:0/1025251497 conn(0x7f96fc06dd10 msgr2=0x7f96fc0ad0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:08.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.794+0000 7f97014b3700 1 -- 172.21.15.8:0/1025251497 shutdown_connections 2023-10-06T04:38:08.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.794+0000 7f97014b3700 1 -- 172.21.15.8:0/1025251497 wait complete. 2023-10-06T04:38:08.807 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-06T04:38:08.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.924+0000 7f880b4eb700 1 Processor -- start 2023-10-06T04:38:08.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.924+0000 7f880b4eb700 1 -- start start 2023-10-06T04:38:08.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.925+0000 7f880b4eb700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f88040b3b50 0x7f8804068bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:08.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.925+0000 7f880b4eb700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f88040afc00 0x7f88040b0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:08.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.925+0000 7f880b4eb700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f880415d510 con 0x7f88040b3f20 2023-10-06T04:38:08.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.925+0000 7f880b4eb700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88040b05c0 con 0x7f88040b3b50 2023-10-06T04:38:08.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.925+0000 7f880b4eb700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f880415d7f0 con 0x7f88040afc00 2023-10-06T04:38:08.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.925+0000 7f8809287700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f88040b3b50 0x7f8804068bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:08.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.925+0000 7f8809287700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f88040b3b50 0x7f8804068bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38510/0 (socket says 172.21.15.8:38510) 2023-10-06T04:38:08.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.925+0000 7f8809287700 1 -- 172.21.15.8:0/780439417 learned_addr learned my addr 172.21.15.8:0/780439417 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:08.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.925+0000 7f8809a88700 1 --2- 172.21.15.8:0/780439417 >> v2:172.21.15.184:3300/0 conn(0x7f88040afc00 0x7f88040b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:08.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.926+0000 7f8809287700 1 -- 172.21.15.8:0/780439417 >> v2:172.21.15.184:3300/0 conn(0x7f88040afc00 msgr2=0x7f88040b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:08.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.926+0000 7f8809287700 1 --2- 172.21.15.8:0/780439417 >> v2:172.21.15.184:3300/0 conn(0x7f88040afc00 0x7f88040b0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:08.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.926+0000 7f8809287700 1 -- 172.21.15.8:0/780439417 >> v1:172.21.15.184:6789/0 conn(0x7f88040b3f20 legacy=0x7f88040cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:08.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.926+0000 7f8809287700 1 -- 172.21.15.8:0/780439417 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880415dad0 con 0x7f88040b3b50 2023-10-06T04:38:08.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.926+0000 7f8809287700 1 --2- 172.21.15.8:0/780439417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88040b3b50 0x7f8804068bb0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f880415e090 tx=0x7f87fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec3a9f1248939b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:08.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.926+0000 7f8803fff700 1 -- 172.21.15.8:0/780439417 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc009e70 con 0x7f88040b3b50 2023-10-06T04:38:08.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.926+0000 7f8803fff700 1 -- 172.21.15.8:0/780439417 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87fc00b860 con 0x7f88040b3b50 2023-10-06T04:38:08.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.926+0000 7f8803fff700 1 -- 172.21.15.8:0/780439417 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc00bc00 con 0x7f88040b3b50 2023-10-06T04:38:08.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.926+0000 7f880b4eb700 1 -- 172.21.15.8:0/780439417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88040b3b50 msgr2=0x7f8804068bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:08.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.926+0000 7f880b4eb700 1 --2- 172.21.15.8:0/780439417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88040b3b50 0x7f8804068bb0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f880415e090 tx=0x7f87fc009250 comp rx=0 tx=0).stop 2023-10-06T04:38:08.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.926+0000 7f880b4eb700 1 -- 172.21.15.8:0/780439417 shutdown_connections 2023-10-06T04:38:08.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.926+0000 7f880b4eb700 1 --2- 172.21.15.8:0/780439417 >> v2:172.21.15.184:3300/0 conn(0x7f88040afc00 0x7f88040b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:08.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.926+0000 7f880b4eb700 1 --2- 172.21.15.8:0/780439417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88040b3b50 0x7f8804068bb0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:08.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.926+0000 7f880b4eb700 1 -- 172.21.15.8:0/780439417 >> 172.21.15.8:0/780439417 conn(0x7f880406df20 msgr2=0x7f88040675d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:08.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.927+0000 7f880b4eb700 1 -- 172.21.15.8:0/780439417 shutdown_connections 2023-10-06T04:38:08.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.927+0000 7f880b4eb700 1 -- 172.21.15.8:0/780439417 wait complete. 2023-10-06T04:38:08.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.928+0000 7f880b4eb700 1 Processor -- start 2023-10-06T04:38:08.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.928+0000 7f880b4eb700 1 -- start start 2023-10-06T04:38:08.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.928+0000 7f880b4eb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88040afc00 0x7f8804154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:08.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.928+0000 7f880b4eb700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88040b3b50 0x7f8804153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:08.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.929+0000 7f880b4eb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88040b3f20 0x7f88041524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:08.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.929+0000 7f880b4eb700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88041538c0 con 0x7f88040b3f20 2023-10-06T04:38:08.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.929+0000 7f880b4eb700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8804154290 con 0x7f88040b3b50 2023-10-06T04:38:08.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.929+0000 7f880b4eb700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8804152a10 con 0x7f88040afc00 2023-10-06T04:38:08.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.929+0000 7f8809a88700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88040b3f20 0x7f88041524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:08.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.929+0000 7f8809a88700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88040b3f20 0x7f88041524d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38520/0 (socket says 172.21.15.8:38520) 2023-10-06T04:38:08.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.929+0000 7f8809a88700 1 -- 172.21.15.8:0/2868052447 learned_addr learned my addr 172.21.15.8:0/2868052447 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:08.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.929+0000 7f8809287700 1 --2- 172.21.15.8:0/2868052447 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88040afc00 0x7f8804154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:08.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.929+0000 7f8808a86700 1 --2- 172.21.15.8:0/2868052447 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88040b3b50 0x7f8804153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:08.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.929+0000 7f8809a88700 1 -- 172.21.15.8:0/2868052447 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88040afc00 msgr2=0x7f8804154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:08.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.929+0000 7f8809a88700 1 --2- 172.21.15.8:0/2868052447 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88040afc00 0x7f8804154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:08.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.929+0000 7f8809a88700 1 -- 172.21.15.8:0/2868052447 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88040b3b50 msgr2=0x7f8804153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:08.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.929+0000 7f8809a88700 1 --2- 172.21.15.8:0/2868052447 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88040b3b50 0x7f8804153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:08.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.929+0000 7f8809a88700 1 -- 172.21.15.8:0/2868052447 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87fc0094f0 con 0x7f88040b3f20 2023-10-06T04:38:08.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.929+0000 7f8808a86700 1 --2- 172.21.15.8:0/2868052447 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88040b3b50 0x7f8804153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:38:08.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.929+0000 7f8809a88700 1 --2- 172.21.15.8:0/2868052447 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88040b3f20 0x7f88041524d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009e90 tx=0x7f87f400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:08.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.929+0000 7f88017fa700 1 -- 172.21.15.8:0/2868052447 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f400cc20 con 0x7f88040b3f20 2023-10-06T04:38:08.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.929+0000 7f88017fa700 1 -- 172.21.15.8:0/2868052447 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f400f040 con 0x7f88040b3f20 2023-10-06T04:38:08.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.929+0000 7f880b4eb700 1 -- 172.21.15.8:0/2868052447 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8804152cb0 con 0x7f88040b3f20 2023-10-06T04:38:08.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.929+0000 7f88017fa700 1 -- 172.21.15.8:0/2868052447 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f4014480 con 0x7f88040b3f20 2023-10-06T04:38:08.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.929+0000 7f880b4eb700 1 -- 172.21.15.8:0/2868052447 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8804153270 con 0x7f88040b3f20 2023-10-06T04:38:08.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.930+0000 7f880b4eb700 1 -- 172.21.15.8:0/2868052447 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8804071550 con 0x7f88040b3f20 2023-10-06T04:38:08.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.931+0000 7f88017fa700 1 -- 172.21.15.8:0/2868052447 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f87f4014830 con 0x7f88040b3f20 2023-10-06T04:38:08.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.931+0000 7f88017fa700 1 --2- 172.21.15.8:0/2868052447 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f87f0066f30 0x7f87f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:08.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.931+0000 7f88017fa700 1 -- 172.21.15.8:0/2868052447 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f87f4085290 con 0x7f88040b3f20 2023-10-06T04:38:08.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.931+0000 7f8809287700 1 --2- 172.21.15.8:0/2868052447 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f87f0066f30 0x7f87f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:08.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.932+0000 7f8809287700 1 --2- 172.21.15.8:0/2868052447 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f87f0066f30 0x7f87f00693e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f880415e090 tx=0x7f87fc017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:08.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:08.935+0000 7f88017fa700 1 -- 172.21.15.8:0/2868052447 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f87f4055f90 con 0x7f88040b3f20 2023-10-06T04:38:09.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.132+0000 7f880b4eb700 1 -- 172.21.15.8:0/2868052447 --> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f880415ddb0 con 0x7f87f0066f30 2023-10-06T04:38:09.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.132+0000 7f88017fa700 1 -- 172.21.15.8:0/2868052447 <== mgr.4105 v2:172.21.15.184:6832/90283 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f880415ddb0 con 0x7f87f0066f30 2023-10-06T04:38:09.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.134+0000 7f880b4eb700 1 -- 172.21.15.8:0/2868052447 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f87f0066f30 msgr2=0x7f87f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:09.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.134+0000 7f880b4eb700 1 --2- 172.21.15.8:0/2868052447 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f87f0066f30 0x7f87f00693e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f880415e090 tx=0x7f87fc017000 comp rx=0 tx=0).stop 2023-10-06T04:38:09.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.135+0000 7f880b4eb700 1 -- 172.21.15.8:0/2868052447 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88040b3f20 msgr2=0x7f88041524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:09.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.135+0000 7f880b4eb700 1 --2- 172.21.15.8:0/2868052447 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88040b3f20 0x7f88041524d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009e90 tx=0x7f87f400b040 comp rx=0 tx=0).stop 2023-10-06T04:38:09.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.135+0000 7f880b4eb700 1 -- 172.21.15.8:0/2868052447 shutdown_connections 2023-10-06T04:38:09.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.135+0000 7f880b4eb700 1 --2- 172.21.15.8:0/2868052447 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f87f0066f30 0x7f87f00693e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:09.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.135+0000 7f880b4eb700 1 --2- 172.21.15.8:0/2868052447 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88040b3f20 0x7f88041524d0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:09.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.135+0000 7f880b4eb700 1 --2- 172.21.15.8:0/2868052447 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88040afc00 0x7f8804154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:09.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.135+0000 7f880b4eb700 1 --2- 172.21.15.8:0/2868052447 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88040b3b50 0x7f8804153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:09.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.135+0000 7f880b4eb700 1 -- 172.21.15.8:0/2868052447 >> 172.21.15.8:0/2868052447 conn(0x7f880406df20 msgr2=0x7f8804069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:09.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.135+0000 7f880b4eb700 1 -- 172.21.15.8:0/2868052447 shutdown_connections 2023-10-06T04:38:09.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.135+0000 7f880b4eb700 1 -- 172.21.15.8:0/2868052447 wait complete. 2023-10-06T04:38:09.139 INFO:teuthology.orchestra.run.smithi008.stderr:instructed osd(s) 2 to deep-scrub 2023-10-06T04:38:09.149 INFO:tasks.ceph:Scrubbing osd.3 2023-10-06T04:38:09.149 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:38:09.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.270+0000 7f6d16750700 1 Processor -- start 2023-10-06T04:38:09.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.270+0000 7f6d16750700 1 -- start start 2023-10-06T04:38:09.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.270+0000 7f6d16750700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d100af5a0 0x7f6d1015d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:09.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.270+0000 7f6d16750700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6d100af970 0x7f6d1015a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:09.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.270+0000 7f6d16750700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d1015e2b0 con 0x7f6d100ccb00 2023-10-06T04:38:09.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.270+0000 7f6d16750700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d1015ada0 con 0x7f6d100af970 2023-10-06T04:38:09.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.270+0000 7f6d16750700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d100ce800 con 0x7f6d100af5a0 2023-10-06T04:38:09.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.271+0000 7f6d0ffff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d100af5a0 0x7f6d1015d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:09.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.271+0000 7f6d0f7fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6d100af970 0x7f6d1015a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:09.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.271+0000 7f6d0ffff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d100af5a0 0x7f6d1015d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.8:35272/0 (socket says 172.21.15.8:35272) 2023-10-06T04:38:09.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.271+0000 7f6d0ffff700 1 -- 172.21.15.8:0/3436964781 learned_addr learned my addr 172.21.15.8:0/3436964781 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:09.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.271+0000 7f6d0ffff700 1 -- 172.21.15.8:0/3436964781 >> v2:172.21.15.184:3300/0 conn(0x7f6d100af970 msgr2=0x7f6d1015a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:09.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.271+0000 7f6d0ffff700 1 --2- 172.21.15.8:0/3436964781 >> v2:172.21.15.184:3300/0 conn(0x7f6d100af970 0x7f6d1015a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:09.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.271+0000 7f6d0ffff700 1 -- 172.21.15.8:0/3436964781 >> v1:172.21.15.184:6789/0 conn(0x7f6d100ccb00 legacy=0x7f6d100ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:09.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.271+0000 7f6d0ffff700 1 -- 172.21.15.8:0/3436964781 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d1015da10 con 0x7f6d100af5a0 2023-10-06T04:38:09.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.271+0000 7f6d0ffff700 1 --2- 172.21.15.8:0/3436964781 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d100af5a0 0x7f6d1015d330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6d000099b0 tx=0x7f6d00009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c312dee70b90312 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:09.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.272+0000 7f6d0effd700 1 -- 172.21.15.8:0/3436964781 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d00009ea0 con 0x7f6d100af5a0 2023-10-06T04:38:09.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.272+0000 7f6d0effd700 1 -- 172.21.15.8:0/3436964781 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d0000b860 con 0x7f6d100af5a0 2023-10-06T04:38:09.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.272+0000 7f6d0effd700 1 -- 172.21.15.8:0/3436964781 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0000bc00 con 0x7f6d100af5a0 2023-10-06T04:38:09.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.272+0000 7f6d16750700 1 -- 172.21.15.8:0/3436964781 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d100af5a0 msgr2=0x7f6d1015d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:09.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.272+0000 7f6d16750700 1 --2- 172.21.15.8:0/3436964781 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d100af5a0 0x7f6d1015d330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6d000099b0 tx=0x7f6d00009250 comp rx=0 tx=0).stop 2023-10-06T04:38:09.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.272+0000 7f6d16750700 1 -- 172.21.15.8:0/3436964781 shutdown_connections 2023-10-06T04:38:09.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.272+0000 7f6d16750700 1 --2- 172.21.15.8:0/3436964781 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d100af5a0 0x7f6d1015d330 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:09.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.272+0000 7f6d16750700 1 --2- 172.21.15.8:0/3436964781 >> v2:172.21.15.184:3300/0 conn(0x7f6d100af970 0x7f6d1015a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:09.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.272+0000 7f6d16750700 1 -- 172.21.15.8:0/3436964781 >> 172.21.15.8:0/3436964781 conn(0x7f6d1006ed00 msgr2=0x7f6d1006f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:09.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.272+0000 7f6d16750700 1 -- 172.21.15.8:0/3436964781 shutdown_connections 2023-10-06T04:38:09.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.272+0000 7f6d16750700 1 -- 172.21.15.8:0/3436964781 wait complete. 2023-10-06T04:38:09.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.273+0000 7f6d16750700 1 Processor -- start 2023-10-06T04:38:09.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.273+0000 7f6d16750700 1 -- start start 2023-10-06T04:38:09.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.274+0000 7f6d16750700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d100af5a0 0x7f6d10157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:09.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.274+0000 7f6d16750700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d100af970 0x7f6d100c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:09.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.274+0000 7f6d16750700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d100ccb00 0x7f6d100d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:09.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.274+0000 7f6d16750700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d100c7fa0 con 0x7f6d100af5a0 2023-10-06T04:38:09.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.274+0000 7f6d16750700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d100c7670 con 0x7f6d100ccb00 2023-10-06T04:38:09.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.274+0000 7f6d16750700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d100c7950 con 0x7f6d100af970 2023-10-06T04:38:09.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.274+0000 7f6d0ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d100af5a0 0x7f6d10157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:09.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.274+0000 7f6d0ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d100af5a0 0x7f6d10157390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38526/0 (socket says 172.21.15.8:38526) 2023-10-06T04:38:09.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.274+0000 7f6d0ffff700 1 -- 172.21.15.8:0/3598418608 learned_addr learned my addr 172.21.15.8:0/3598418608 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:09.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.274+0000 7f6d0f7fe700 1 --2- 172.21.15.8:0/3598418608 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d100af970 0x7f6d100c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:09.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.274+0000 7f6d14ced700 1 --2- 172.21.15.8:0/3598418608 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d100ccb00 0x7f6d100d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:09.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.274+0000 7f6d0ffff700 1 -- 172.21.15.8:0/3598418608 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d100af970 msgr2=0x7f6d100c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:09.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.274+0000 7f6d0ffff700 1 --2- 172.21.15.8:0/3598418608 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d100af970 0x7f6d100c8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:09.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.274+0000 7f6d0ffff700 1 -- 172.21.15.8:0/3598418608 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d100ccb00 msgr2=0x7f6d100d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:09.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.274+0000 7f6d0ffff700 1 --2- 172.21.15.8:0/3598418608 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d100ccb00 0x7f6d100d07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:09.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.274+0000 7f6d0ffff700 1 -- 172.21.15.8:0/3598418608 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d000094f0 con 0x7f6d100af5a0 2023-10-06T04:38:09.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.275+0000 7f6d0ffff700 1 --2- 172.21.15.8:0/3598418608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d100af5a0 0x7f6d10157390 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f6d100ce940 tx=0x7f6d00017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:09.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.275+0000 7f6cf7fff700 1 -- 172.21.15.8:0/3598418608 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d00000d10 con 0x7f6d100af5a0 2023-10-06T04:38:09.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.275+0000 7f6cf7fff700 1 -- 172.21.15.8:0/3598418608 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d0000bbe0 con 0x7f6d100af5a0 2023-10-06T04:38:09.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.275+0000 7f6d16750700 1 -- 172.21.15.8:0/3598418608 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d100c7c30 con 0x7f6d100af5a0 2023-10-06T04:38:09.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.275+0000 7f6cf7fff700 1 -- 172.21.15.8:0/3598418608 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d00011670 con 0x7f6d100af5a0 2023-10-06T04:38:09.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.275+0000 7f6d16750700 1 -- 172.21.15.8:0/3598418608 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d100c8970 con 0x7f6d100af5a0 2023-10-06T04:38:09.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.276+0000 7f6d16750700 1 -- 172.21.15.8:0/3598418608 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6d10071550 con 0x7f6d100af5a0 2023-10-06T04:38:09.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.276+0000 7f6cf7fff700 1 -- 172.21.15.8:0/3598418608 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6d00011aa0 con 0x7f6d100af5a0 2023-10-06T04:38:09.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.276+0000 7f6cf7fff700 1 --2- 172.21.15.8:0/3598418608 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6cfc066f30 0x7f6cfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:09.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.277+0000 7f6cf7fff700 1 -- 172.21.15.8:0/3598418608 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f6d00085da0 con 0x7f6d100af5a0 2023-10-06T04:38:09.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.277+0000 7f6cf7fff700 1 --2- 172.21.15.8:0/3598418608 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x7f6cfc06d780 0x7f6cfc06fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:09.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.277+0000 7f6cf7fff700 1 -- 172.21.15.8:0/3598418608 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6cfc070280 con 0x7f6cfc06d780 2023-10-06T04:38:09.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.277+0000 7f6cf7fff700 1 -- 172.21.15.8:0/3598418608 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d00088300 con 0x7f6d100af5a0 2023-10-06T04:38:09.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.277+0000 7f6d0f7fe700 1 --2- 172.21.15.8:0/3598418608 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6cfc066f30 0x7f6cfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:09.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.277+0000 7f6d14ced700 1 --2- 172.21.15.8:0/3598418608 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x7f6cfc06d780 0x7f6cfc06fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:09.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.277+0000 7f6d14ced700 1 --2- 172.21.15.8:0/3598418608 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x7f6cfc06d780 0x7f6cfc06fbb0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:09.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.277+0000 7f6d0f7fe700 1 --2- 172.21.15.8:0/3598418608 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6cfc066f30 0x7f6cfc0693e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6d100ca4f0 tx=0x7f6d040091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:09.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.278+0000 7f6cf7fff700 1 -- 172.21.15.8:0/3598418608 <== osd.3 v2:172.21.15.8:6823/90671 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f6cfc070280 con 0x7f6cfc06d780 2023-10-06T04:38:09.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.292+0000 7f6d16750700 1 -- 172.21.15.8:0/3598418608 --> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6d1015dcf0 con 0x7f6cfc06d780 2023-10-06T04:38:09.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.292+0000 7f6cf7fff700 1 -- 172.21.15.8:0/3598418608 <== osd.3 v2:172.21.15.8:6823/90671 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6d1015dcf0 con 0x7f6cfc06d780 2023-10-06T04:38:09.295 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T04:38:09.295 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:38:09.296 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T04:38:09.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.292+0000 7f6d16750700 1 -- 172.21.15.8:0/3598418608 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x7f6cfc06d780 msgr2=0x7f6cfc06fbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:09.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.292+0000 7f6d16750700 1 --2- 172.21.15.8:0/3598418608 >> [v2:172.21.15.8:6823/90671,v1:172.21.15.8:6825/90671] conn(0x7f6cfc06d780 0x7f6cfc06fbb0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:09.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.292+0000 7f6d16750700 1 -- 172.21.15.8:0/3598418608 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6cfc066f30 msgr2=0x7f6cfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:09.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.292+0000 7f6d16750700 1 --2- 172.21.15.8:0/3598418608 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f6cfc066f30 0x7f6cfc0693e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6d100ca4f0 tx=0x7f6d040091a0 comp rx=0 tx=0).stop 2023-10-06T04:38:09.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.292+0000 7f6d16750700 1 -- 172.21.15.8:0/3598418608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d100af5a0 msgr2=0x7f6d10157390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:09.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.292+0000 7f6d16750700 1 --2- 172.21.15.8:0/3598418608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d100af5a0 0x7f6d10157390 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f6d100ce940 tx=0x7f6d00017000 comp rx=0 tx=0).stop 2023-10-06T04:38:09.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.292+0000 7f6d14ced700 1 -- 172.21.15.8:0/3598418608 reap_dead start 2023-10-06T04:38:09.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.292+0000 7f6d16750700 1 -- 172.21.15.8:0/3598418608 shutdown_connections 2023-10-06T04:38:09.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.292+0000 7f6d16750700 1 -- 172.21.15.8:0/3598418608 >> 172.21.15.8:0/3598418608 conn(0x7f6d1006ed00 msgr2=0x7f6d10159250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:09.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.292+0000 7f6d16750700 1 -- 172.21.15.8:0/3598418608 shutdown_connections 2023-10-06T04:38:09.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.292+0000 7f6d16750700 1 -- 172.21.15.8:0/3598418608 wait complete. 2023-10-06T04:38:09.306 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-06T04:38:09.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.424+0000 7fc2b0b1b700 1 Processor -- start 2023-10-06T04:38:09.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.424+0000 7fc2b0b1b700 1 -- start start 2023-10-06T04:38:09.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.425+0000 7fc2b0b1b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc2ac156e30 0x7fc2ac0cf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:09.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.425+0000 7fc2b0b1b700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2ac0cf370 con 0x7fc2ac15b490 2023-10-06T04:38:09.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.425+0000 7fc2b0b1b700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2ac0ce800 con 0x7fc2ac0b1c70 2023-10-06T04:38:09.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.425+0000 7fc2b0b1b700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2ac0cea60 con 0x7fc2ac156e30 2023-10-06T04:38:09.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.425+0000 7fc2abfff700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fc2ac15b490 0x7fc2ac15d1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46950/0 (socket says 172.21.15.8:46950) 2023-10-06T04:38:09.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.425+0000 7fc2abfff700 1 -- 172.21.15.8:0/1911715111 learned_addr learned my addr 172.21.15.8:0/1911715111 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:38:09.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.425+0000 7fc2ab7fe700 1 --2- 172.21.15.8:0/1911715111 >> v2:172.21.15.184:3300/0 conn(0x7fc2ac156e30 0x7fc2ac0cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:09.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.425+0000 7fc2aa7fc700 1 -- 172.21.15.8:0/1911715111 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3269161100 0 0) 0x7fc2ac0cf370 con 0x7fc2ac15b490 2023-10-06T04:38:09.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.425+0000 7fc2aa7fc700 1 -- 172.21.15.8:0/1911715111 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc298003570 con 0x7fc2ac15b490 2023-10-06T04:38:09.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.425+0000 7fc2aa7fc700 1 -- 172.21.15.8:0/1911715111 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2838599437 0 0) 0x7fc2ac0ce800 con 0x7fc2ac0b1c70 2023-10-06T04:38:09.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.425+0000 7fc2aa7fc700 1 -- 172.21.15.8:0/1911715111 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2ac0cf370 con 0x7fc2ac0b1c70 2023-10-06T04:38:09.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.426+0000 7fc2ab7fe700 1 -- 172.21.15.8:0/1911715111 >> v1:172.21.15.184:6789/0 conn(0x7fc2ac0b1c70 legacy=0x7fc2ac15ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:09.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.426+0000 7fc2ab7fe700 1 -- 172.21.15.8:0/1911715111 >> v1:172.21.15.8:6789/0 conn(0x7fc2ac15b490 legacy=0x7fc2ac15d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:09.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.426+0000 7fc2ab7fe700 1 -- 172.21.15.8:0/1911715111 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ac0ced20 con 0x7fc2ac156e30 2023-10-06T04:38:09.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.426+0000 7fc2ab7fe700 1 --2- 172.21.15.8:0/1911715111 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2ac156e30 0x7fc2ac0cf800 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc29c009e60 tx=0x7fc29c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abefc667e5d94f9e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:09.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.426+0000 7fc2aa7fc700 1 -- 172.21.15.8:0/1911715111 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c00e070 con 0x7fc2ac156e30 2023-10-06T04:38:09.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.426+0000 7fc2aa7fc700 1 -- 172.21.15.8:0/1911715111 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29c00bab0 con 0x7fc2ac156e30 2023-10-06T04:38:09.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.426+0000 7fc2aa7fc700 1 -- 172.21.15.8:0/1911715111 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c00be70 con 0x7fc2ac156e30 2023-10-06T04:38:09.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.426+0000 7fc2b0b1b700 1 -- 172.21.15.8:0/1911715111 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2ac156e30 msgr2=0x7fc2ac0cf800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:09.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.426+0000 7fc2b0b1b700 1 --2- 172.21.15.8:0/1911715111 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2ac156e30 0x7fc2ac0cf800 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc29c009e60 tx=0x7fc29c009780 comp rx=0 tx=0).stop 2023-10-06T04:38:09.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.426+0000 7fc2b0b1b700 1 -- 172.21.15.8:0/1911715111 shutdown_connections 2023-10-06T04:38:09.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.426+0000 7fc2b0b1b700 1 --2- 172.21.15.8:0/1911715111 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2ac156e30 0x7fc2ac0cf800 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:09.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.426+0000 7fc2b0b1b700 1 -- 172.21.15.8:0/1911715111 >> 172.21.15.8:0/1911715111 conn(0x7fc2ac06ed00 msgr2=0x7fc2ac06f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:09.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.426+0000 7fc2b0b1b700 1 -- 172.21.15.8:0/1911715111 shutdown_connections 2023-10-06T04:38:09.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.426+0000 7fc2b0b1b700 1 -- 172.21.15.8:0/1911715111 wait complete. 2023-10-06T04:38:09.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.428+0000 7fc2b0b1b700 1 Processor -- start 2023-10-06T04:38:09.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.428+0000 7fc2b0b1b700 1 -- start start 2023-10-06T04:38:09.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.428+0000 7fc2b0b1b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2ac0b1c70 0x7fc2ac16a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:09.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.428+0000 7fc2b0b1b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2ac156e30 0x7fc2ac068460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:09.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.428+0000 7fc2b0b1b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2ac15b490 0x7fc2ac16ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:09.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.428+0000 7fc2b0b1b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac169890 con 0x7fc2ac156e30 2023-10-06T04:38:09.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.428+0000 7fc2b0b1b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac16d8e0 con 0x7fc2ac0b1c70 2023-10-06T04:38:09.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.428+0000 7fc2b0b1b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac16dbc0 con 0x7fc2ac15b490 2023-10-06T04:38:09.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.429+0000 7fc2aaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2ac156e30 0x7fc2ac068460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:09.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.429+0000 7fc2aaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2ac156e30 0x7fc2ac068460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38532/0 (socket says 172.21.15.8:38532) 2023-10-06T04:38:09.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.429+0000 7fc2aaffd700 1 -- 172.21.15.8:0/3883223223 learned_addr learned my addr 172.21.15.8:0/3883223223 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:09.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.429+0000 7fc2ab7fe700 1 --2- 172.21.15.8:0/3883223223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2ac0b1c70 0x7fc2ac16a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:09.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.429+0000 7fc2abfff700 1 --2- 172.21.15.8:0/3883223223 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2ac15b490 0x7fc2ac16ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:09.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.429+0000 7fc2aaffd700 1 -- 172.21.15.8:0/3883223223 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2ac15b490 msgr2=0x7fc2ac16ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:09.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.429+0000 7fc2aaffd700 1 --2- 172.21.15.8:0/3883223223 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2ac15b490 0x7fc2ac16ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:09.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.429+0000 7fc2aaffd700 1 -- 172.21.15.8:0/3883223223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2ac0b1c70 msgr2=0x7fc2ac16a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:09.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.429+0000 7fc2aaffd700 1 --2- 172.21.15.8:0/3883223223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2ac0b1c70 0x7fc2ac16a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:09.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.429+0000 7fc2aaffd700 1 -- 172.21.15.8:0/3883223223 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29c009a20 con 0x7fc2ac156e30 2023-10-06T04:38:09.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.429+0000 7fc2aaffd700 1 --2- 172.21.15.8:0/3883223223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2ac156e30 0x7fc2ac068460 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fc29400c790 tx=0x7fc294007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:09.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.429+0000 7fc2a37fe700 1 -- 172.21.15.8:0/3883223223 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc294010510 con 0x7fc2ac156e30 2023-10-06T04:38:09.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.429+0000 7fc2a37fe700 1 -- 172.21.15.8:0/3883223223 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc294010670 con 0x7fc2ac156e30 2023-10-06T04:38:09.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.429+0000 7fc2a37fe700 1 -- 172.21.15.8:0/3883223223 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc294010a10 con 0x7fc2ac156e30 2023-10-06T04:38:09.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.429+0000 7fc2b0b1b700 1 -- 172.21.15.8:0/3883223223 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2ac169aa0 con 0x7fc2ac156e30 2023-10-06T04:38:09.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.429+0000 7fc2b0b1b700 1 -- 172.21.15.8:0/3883223223 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2ac16a7e0 con 0x7fc2ac156e30 2023-10-06T04:38:09.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.430+0000 7fc2b0b1b700 1 -- 172.21.15.8:0/3883223223 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2ac169fc0 con 0x7fc2ac156e30 2023-10-06T04:38:09.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.431+0000 7fc2a37fe700 1 -- 172.21.15.8:0/3883223223 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc29401b3b0 con 0x7fc2ac156e30 2023-10-06T04:38:09.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.431+0000 7fc2a37fe700 1 --2- 172.21.15.8:0/3883223223 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc28c066f30 0x7fc28c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:09.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.431+0000 7fc2a37fe700 1 -- 172.21.15.8:0/3883223223 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fc294083dd0 con 0x7fc2ac156e30 2023-10-06T04:38:09.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.431+0000 7fc2ab7fe700 1 --2- 172.21.15.8:0/3883223223 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc28c066f30 0x7fc28c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:09.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.432+0000 7fc2ab7fe700 1 --2- 172.21.15.8:0/3883223223 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc28c066f30 0x7fc28c0693e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc29c009460 tx=0x7fc29c019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:09.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.435+0000 7fc2a37fe700 1 -- 172.21.15.8:0/3883223223 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc2ac169fc0 con 0x7fc2ac156e30 2023-10-06T04:38:09.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.629+0000 7fc2b0b1b700 1 -- 172.21.15.8:0/3883223223 --> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2ac16dd80 con 0x7fc28c066f30 2023-10-06T04:38:09.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.630+0000 7fc2a37fe700 1 -- 172.21.15.8:0/3883223223 <== mgr.4105 v2:172.21.15.184:6832/90283 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc29c00be40 con 0x7fc28c066f30 2023-10-06T04:38:09.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.631+0000 7fc2b0b1b700 1 -- 172.21.15.8:0/3883223223 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc28c066f30 msgr2=0x7fc28c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:09.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.632+0000 7fc2b0b1b700 1 --2- 172.21.15.8:0/3883223223 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc28c066f30 0x7fc28c0693e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc29c009460 tx=0x7fc29c019000 comp rx=0 tx=0).stop 2023-10-06T04:38:09.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.632+0000 7fc2b0b1b700 1 -- 172.21.15.8:0/3883223223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2ac156e30 msgr2=0x7fc2ac068460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:09.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.632+0000 7fc2b0b1b700 1 --2- 172.21.15.8:0/3883223223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2ac156e30 0x7fc2ac068460 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fc29400c790 tx=0x7fc294007e10 comp rx=0 tx=0).stop 2023-10-06T04:38:09.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.632+0000 7fc2b0b1b700 1 -- 172.21.15.8:0/3883223223 shutdown_connections 2023-10-06T04:38:09.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.632+0000 7fc2b0b1b700 1 --2- 172.21.15.8:0/3883223223 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fc28c066f30 0x7fc28c0693e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:09.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.632+0000 7fc2b0b1b700 1 --2- 172.21.15.8:0/3883223223 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2ac15b490 0x7fc2ac16ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:09.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.632+0000 7fc2b0b1b700 1 --2- 172.21.15.8:0/3883223223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2ac0b1c70 0x7fc2ac16a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:09.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.632+0000 7fc2b0b1b700 1 --2- 172.21.15.8:0/3883223223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2ac156e30 0x7fc2ac068460 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:09.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.632+0000 7fc2b0b1b700 1 -- 172.21.15.8:0/3883223223 >> 172.21.15.8:0/3883223223 conn(0x7fc2ac06ed00 msgr2=0x7fc2ac1573a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:09.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.632+0000 7fc2b0b1b700 1 -- 172.21.15.8:0/3883223223 shutdown_connections 2023-10-06T04:38:09.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.632+0000 7fc2b0b1b700 1 -- 172.21.15.8:0/3883223223 wait complete. 2023-10-06T04:38:09.636 INFO:teuthology.orchestra.run.smithi008.stderr:instructed osd(s) 3 to deep-scrub 2023-10-06T04:38:09.646 INFO:tasks.ceph:Scrubbing osd.4 2023-10-06T04:38:09.646 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:38:09.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.766+0000 7f70f93bf700 1 Processor -- start 2023-10-06T04:38:09.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.766+0000 7f70f93bf700 1 -- start start 2023-10-06T04:38:09.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.767+0000 7f70f93bf700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f70f40cd530 0x7f70f415d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:09.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.767+0000 7f70f93bf700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f40ce820 con 0x7f70f40af5a0 2023-10-06T04:38:09.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.767+0000 7f70f93bf700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f415da30 con 0x7f70f40af970 2023-10-06T04:38:09.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.767+0000 7f70f93bf700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f415e2d0 con 0x7f70f40cd530 2023-10-06T04:38:09.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.767+0000 7f70f2ffd700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f70f40af5a0 0x7f70f40cce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46954/0 (socket says 172.21.15.8:46954) 2023-10-06T04:38:09.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.767+0000 7f70f2ffd700 1 -- 172.21.15.8:0/1526384719 learned_addr learned my addr 172.21.15.8:0/1526384719 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:38:09.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.767+0000 7f70f27fc700 1 --2- 172.21.15.8:0/1526384719 >> v2:172.21.15.184:3300/0 conn(0x7f70f40cd530 0x7f70f415d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:09.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.768+0000 7f70f1ffb700 1 -- 172.21.15.8:0/1526384719 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3237188599 0 0) 0x7f70f40ce820 con 0x7f70f40af5a0 2023-10-06T04:38:09.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.768+0000 7f70f1ffb700 1 -- 172.21.15.8:0/1526384719 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70e0003570 con 0x7f70f40af5a0 2023-10-06T04:38:09.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.768+0000 7f70f1ffb700 1 -- 172.21.15.8:0/1526384719 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1136209390 0 0) 0x7f70f415da30 con 0x7f70f40af970 2023-10-06T04:38:09.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.768+0000 7f70f1ffb700 1 -- 172.21.15.8:0/1526384719 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70f40ce820 con 0x7f70f40af970 2023-10-06T04:38:09.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.768+0000 7f70f27fc700 1 -- 172.21.15.8:0/1526384719 >> v1:172.21.15.184:6789/0 conn(0x7f70f40af970 legacy=0x7f70f40cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:09.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.768+0000 7f70f27fc700 1 -- 172.21.15.8:0/1526384719 >> v1:172.21.15.8:6789/0 conn(0x7f70f40af5a0 legacy=0x7f70f40cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:09.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.768+0000 7f70f27fc700 1 -- 172.21.15.8:0/1526384719 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f415dd10 con 0x7f70f40cd530 2023-10-06T04:38:09.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.768+0000 7f70f27fc700 1 --2- 172.21.15.8:0/1526384719 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70f40cd530 0x7f70f415d330 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f70dc0098e0 tx=0x7f70dc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f13b51a115f4ab1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:09.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.768+0000 7f70f1ffb700 1 -- 172.21.15.8:0/1526384719 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc011630 con 0x7f70f40cd530 2023-10-06T04:38:09.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.768+0000 7f70f1ffb700 1 -- 172.21.15.8:0/1526384719 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70dc011790 con 0x7f70f40cd530 2023-10-06T04:38:09.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.768+0000 7f70f1ffb700 1 -- 172.21.15.8:0/1526384719 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc011b30 con 0x7f70f40cd530 2023-10-06T04:38:09.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.769+0000 7f70f93bf700 1 -- 172.21.15.8:0/1526384719 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70f40cd530 msgr2=0x7f70f415d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:09.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.769+0000 7f70f93bf700 1 --2- 172.21.15.8:0/1526384719 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70f40cd530 0x7f70f415d330 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f70dc0098e0 tx=0x7f70dc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:38:09.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.769+0000 7f70f93bf700 1 -- 172.21.15.8:0/1526384719 shutdown_connections 2023-10-06T04:38:09.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.769+0000 7f70f93bf700 1 --2- 172.21.15.8:0/1526384719 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70f40cd530 0x7f70f415d330 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:09.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.769+0000 7f70f93bf700 1 -- 172.21.15.8:0/1526384719 >> 172.21.15.8:0/1526384719 conn(0x7f70f406ed00 msgr2=0x7f70f406f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:09.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.769+0000 7f70f93bf700 1 -- 172.21.15.8:0/1526384719 shutdown_connections 2023-10-06T04:38:09.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.769+0000 7f70f93bf700 1 -- 172.21.15.8:0/1526384719 wait complete. 2023-10-06T04:38:09.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.770+0000 7f70f93bf700 1 Processor -- start 2023-10-06T04:38:09.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.770+0000 7f70f93bf700 1 -- start start 2023-10-06T04:38:09.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.771+0000 7f70f93bf700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70f40af5a0 0x7f70f415bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:09.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.771+0000 7f70f93bf700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70f40af970 0x7f70f40b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:09.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.771+0000 7f70f93bf700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70f40cd530 0x7f70f4158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:09.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.771+0000 7f70f93bf700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f415b710 con 0x7f70f40af5a0 2023-10-06T04:38:09.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.771+0000 7f70f93bf700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f415a860 con 0x7f70f40cd530 2023-10-06T04:38:09.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.771+0000 7f70f93bf700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f415ab00 con 0x7f70f40af970 2023-10-06T04:38:09.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.771+0000 7f70f2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70f40af5a0 0x7f70f415bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:09.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.771+0000 7f70f2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70f40af5a0 0x7f70f415bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38546/0 (socket says 172.21.15.8:38546) 2023-10-06T04:38:09.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.771+0000 7f70f2ffd700 1 -- 172.21.15.8:0/1849693877 learned_addr learned my addr 172.21.15.8:0/1849693877 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:09.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.771+0000 7f70f27fc700 1 --2- 172.21.15.8:0/1849693877 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70f40af970 0x7f70f40b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:09.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.771+0000 7f70f37fe700 1 --2- 172.21.15.8:0/1849693877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70f40cd530 0x7f70f4158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:09.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.771+0000 7f70f2ffd700 1 -- 172.21.15.8:0/1849693877 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70f40af970 msgr2=0x7f70f40b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:09.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.771+0000 7f70f2ffd700 1 --2- 172.21.15.8:0/1849693877 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70f40af970 0x7f70f40b3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:09.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.771+0000 7f70f2ffd700 1 -- 172.21.15.8:0/1849693877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70f40cd530 msgr2=0x7f70f4158430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:09.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.771+0000 7f70f2ffd700 1 --2- 172.21.15.8:0/1849693877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70f40cd530 0x7f70f4158430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:09.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.771+0000 7f70f2ffd700 1 -- 172.21.15.8:0/1849693877 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70dc009420 con 0x7f70f40af5a0 2023-10-06T04:38:09.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.772+0000 7f70f2ffd700 1 --2- 172.21.15.8:0/1849693877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70f40af5a0 0x7f70f415bba0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f70e400c790 tx=0x7f70e4007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:09.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.772+0000 7f70eaffd700 1 -- 172.21.15.8:0/1849693877 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e4005b30 con 0x7f70f40af5a0 2023-10-06T04:38:09.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.772+0000 7f70eaffd700 1 -- 172.21.15.8:0/1849693877 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e4005c90 con 0x7f70f40af5a0 2023-10-06T04:38:09.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.772+0000 7f70eaffd700 1 -- 172.21.15.8:0/1849693877 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e4007300 con 0x7f70f40af5a0 2023-10-06T04:38:09.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.772+0000 7f70f93bf700 1 -- 172.21.15.8:0/1849693877 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f415ade0 con 0x7f70f40af5a0 2023-10-06T04:38:09.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.772+0000 7f70f93bf700 1 -- 172.21.15.8:0/1849693877 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f415b3a0 con 0x7f70f40af5a0 2023-10-06T04:38:09.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.773+0000 7f70f93bf700 1 -- 172.21.15.8:0/1849693877 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f70f4071550 con 0x7f70f40af5a0 2023-10-06T04:38:09.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.773+0000 7f70eaffd700 1 -- 172.21.15.8:0/1849693877 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f70e401b3b0 con 0x7f70f40af5a0 2023-10-06T04:38:09.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.774+0000 7f70eaffd700 1 --2- 172.21.15.8:0/1849693877 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f70d4066f30 0x7f70d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:09.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.774+0000 7f70eaffd700 1 -- 172.21.15.8:0/1849693877 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f70e4083960 con 0x7f70f40af5a0 2023-10-06T04:38:09.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.774+0000 7f70eaffd700 1 --2- 172.21.15.8:0/1849693877 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x7f70d406d8f0 0x7f70d406fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:09.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.774+0000 7f70f27fc700 1 --2- 172.21.15.8:0/1849693877 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f70d4066f30 0x7f70d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:09.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.774+0000 7f70eaffd700 1 -- 172.21.15.8:0/1849693877 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f70d40703f0 con 0x7f70d406d8f0 2023-10-06T04:38:09.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.774+0000 7f70eaffd700 1 -- 172.21.15.8:0/1849693877 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70e4088240 con 0x7f70f40af5a0 2023-10-06T04:38:09.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.774+0000 7f70f37fe700 1 --2- 172.21.15.8:0/1849693877 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x7f70d406d8f0 0x7f70d406fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:09.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.774+0000 7f70f27fc700 1 --2- 172.21.15.8:0/1849693877 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f70d4066f30 0x7f70d40693e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f70f40cd950 tx=0x7f70dc017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:09.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.775+0000 7f70f37fe700 1 --2- 172.21.15.8:0/1849693877 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x7f70d406d8f0 0x7f70d406fd20 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:09.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.775+0000 7f70eaffd700 1 -- 172.21.15.8:0/1849693877 <== osd.4 v2:172.21.15.184:6800/90868 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f70d40703f0 con 0x7f70d406d8f0 2023-10-06T04:38:09.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.790+0000 7f70f93bf700 1 -- 172.21.15.8:0/1849693877 --> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f70f40cb200 con 0x7f70d406d8f0 2023-10-06T04:38:09.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.790+0000 7f70eaffd700 1 -- 172.21.15.8:0/1849693877 <== osd.4 v2:172.21.15.184:6800/90868 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f70f40cb200 con 0x7f70d406d8f0 2023-10-06T04:38:09.793 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T04:38:09.793 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:38:09.793 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T04:38:09.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.791+0000 7f70f93bf700 1 -- 172.21.15.8:0/1849693877 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x7f70d406d8f0 msgr2=0x7f70d406fd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:09.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.791+0000 7f70f93bf700 1 --2- 172.21.15.8:0/1849693877 >> [v2:172.21.15.184:6800/90868,v1:172.21.15.184:6801/90868] conn(0x7f70d406d8f0 0x7f70d406fd20 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:09.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.791+0000 7f70f93bf700 1 -- 172.21.15.8:0/1849693877 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f70d4066f30 msgr2=0x7f70d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:09.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.791+0000 7f70f93bf700 1 --2- 172.21.15.8:0/1849693877 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f70d4066f30 0x7f70d40693e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f70f40cd950 tx=0x7f70dc017000 comp rx=0 tx=0).stop 2023-10-06T04:38:09.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.791+0000 7f70f93bf700 1 -- 172.21.15.8:0/1849693877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70f40af5a0 msgr2=0x7f70f415bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:09.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.791+0000 7f70f93bf700 1 --2- 172.21.15.8:0/1849693877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70f40af5a0 0x7f70f415bba0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f70e400c790 tx=0x7f70e4007ea0 comp rx=0 tx=0).stop 2023-10-06T04:38:09.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.791+0000 7f70f37fe700 1 -- 172.21.15.8:0/1849693877 reap_dead start 2023-10-06T04:38:09.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.791+0000 7f70f93bf700 1 -- 172.21.15.8:0/1849693877 shutdown_connections 2023-10-06T04:38:09.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.791+0000 7f70f93bf700 1 -- 172.21.15.8:0/1849693877 >> 172.21.15.8:0/1849693877 conn(0x7f70f406ed00 msgr2=0x7f70f41590b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:09.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.791+0000 7f70f93bf700 1 -- 172.21.15.8:0/1849693877 shutdown_connections 2023-10-06T04:38:09.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.791+0000 7f70f93bf700 1 -- 172.21.15.8:0/1849693877 wait complete. 2023-10-06T04:38:09.805 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-06T04:38:09.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.923+0000 7f8d428d2700 1 Processor -- start 2023-10-06T04:38:09.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.923+0000 7f8d428d2700 1 -- start start 2023-10-06T04:38:09.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.923+0000 7f8d428d2700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f8d3c0b3b50 0x7f8d3c068bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:09.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.923+0000 7f8d428d2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d3c0b3f20 0x7f8d3c0cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:09.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.923+0000 7f8d428d2700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8d3c0cdd00 0x7f8d3c0afc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:09.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.923+0000 7f8d428d2700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d3c15d510 con 0x7f8d3c0cdd00 2023-10-06T04:38:09.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.923+0000 7f8d428d2700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d3c15d7f0 con 0x7f8d3c0b3b50 2023-10-06T04:38:09.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.923+0000 7f8d428d2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c15dad0 con 0x7f8d3c0b3f20 2023-10-06T04:38:09.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.924+0000 7f8d40e6f700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8d3c0cdd00 0x7f8d3c0afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:09.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.924+0000 7f8d40e6f700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8d3c0cdd00 0x7f8d3c0afc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38554/0 (socket says 172.21.15.8:38554) 2023-10-06T04:38:09.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.924+0000 7f8d40e6f700 1 -- 172.21.15.8:0/180941080 learned_addr learned my addr 172.21.15.8:0/180941080 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:09.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.924+0000 7f8d3bfff700 1 --2- 172.21.15.8:0/180941080 >> v2:172.21.15.184:3300/0 conn(0x7f8d3c0b3b50 0x7f8d3c068bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:09.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.924+0000 7f8d3b7fe700 1 --2- 172.21.15.8:0/180941080 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d3c0b3f20 0x7f8d3c0cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:09.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.924+0000 7f8d40e6f700 1 -- 172.21.15.8:0/180941080 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d3c0b3f20 msgr2=0x7f8d3c0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:09.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.924+0000 7f8d40e6f700 1 --2- 172.21.15.8:0/180941080 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d3c0b3f20 0x7f8d3c0cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:09.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.924+0000 7f8d40e6f700 1 -- 172.21.15.8:0/180941080 >> v2:172.21.15.184:3300/0 conn(0x7f8d3c0b3b50 msgr2=0x7f8d3c068bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:09.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.924+0000 7f8d40e6f700 1 --2- 172.21.15.8:0/180941080 >> v2:172.21.15.184:3300/0 conn(0x7f8d3c0b3b50 0x7f8d3c068bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:09.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.924+0000 7f8d40e6f700 1 -- 172.21.15.8:0/180941080 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d3c15ddb0 con 0x7f8d3c0cdd00 2023-10-06T04:38:09.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.924+0000 7f8d3b7fe700 1 --2- 172.21.15.8:0/180941080 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d3c0b3f20 0x7f8d3c0cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:38:09.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.924+0000 7f8d40e6f700 1 --2- 172.21.15.8:0/180941080 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d3c0cdd00 0x7f8d3c0afc00 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c06f120 tx=0x7f8d34009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebf0c79a69c18650 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:09.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.924+0000 7f8d3affd700 1 -- 172.21.15.8:0/180941080 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3400e070 con 0x7f8d3c0cdd00 2023-10-06T04:38:09.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.924+0000 7f8d3affd700 1 -- 172.21.15.8:0/180941080 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3400ba50 con 0x7f8d3c0cdd00 2023-10-06T04:38:09.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.924+0000 7f8d3affd700 1 -- 172.21.15.8:0/180941080 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d340092e0 con 0x7f8d3c0cdd00 2023-10-06T04:38:09.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.925+0000 7f8d428d2700 1 -- 172.21.15.8:0/180941080 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d3c0cdd00 msgr2=0x7f8d3c0afc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:09.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.925+0000 7f8d428d2700 1 --2- 172.21.15.8:0/180941080 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d3c0cdd00 0x7f8d3c0afc00 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c06f120 tx=0x7f8d34009840 comp rx=0 tx=0).stop 2023-10-06T04:38:09.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.925+0000 7f8d428d2700 1 -- 172.21.15.8:0/180941080 shutdown_connections 2023-10-06T04:38:09.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.925+0000 7f8d428d2700 1 --2- 172.21.15.8:0/180941080 >> v2:172.21.15.184:3300/0 conn(0x7f8d3c0b3b50 0x7f8d3c068bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:09.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.925+0000 7f8d428d2700 1 --2- 172.21.15.8:0/180941080 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d3c0cdd00 0x7f8d3c0afc00 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:09.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.925+0000 7f8d428d2700 1 --2- 172.21.15.8:0/180941080 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d3c0b3f20 0x7f8d3c0cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:09.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.925+0000 7f8d428d2700 1 -- 172.21.15.8:0/180941080 >> 172.21.15.8:0/180941080 conn(0x7f8d3c06df20 msgr2=0x7f8d3c0675d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:09.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.925+0000 7f8d428d2700 1 -- 172.21.15.8:0/180941080 shutdown_connections 2023-10-06T04:38:09.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.925+0000 7f8d428d2700 1 -- 172.21.15.8:0/180941080 wait complete. 2023-10-06T04:38:09.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.926+0000 7f8d428d2700 1 Processor -- start 2023-10-06T04:38:09.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.926+0000 7f8d428d2700 1 -- start start 2023-10-06T04:38:09.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.927+0000 7f8d428d2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d3c0b3b50 0x7f8d3c1574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:09.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.927+0000 7f8d428d2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d3c0b3f20 0x7f8d3c0ca890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:09.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.927+0000 7f8d428d2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d3c0cdd00 0x7f8d3c15b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:09.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.927+0000 7f8d428d2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c157a10 con 0x7f8d3c0b3b50 2023-10-06T04:38:09.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.927+0000 7f8d428d2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c0cb350 con 0x7f8d3c0b3f20 2023-10-06T04:38:09.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.927+0000 7f8d428d2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c0cb630 con 0x7f8d3c0cdd00 2023-10-06T04:38:09.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.927+0000 7f8d3bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d3c0b3b50 0x7f8d3c1574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:09.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.927+0000 7f8d3bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d3c0b3b50 0x7f8d3c1574d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38556/0 (socket says 172.21.15.8:38556) 2023-10-06T04:38:09.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.927+0000 7f8d3bfff700 1 -- 172.21.15.8:0/635895595 learned_addr learned my addr 172.21.15.8:0/635895595 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:09.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.927+0000 7f8d40e6f700 1 --2- 172.21.15.8:0/635895595 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d3c0cdd00 0x7f8d3c15b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:09.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.927+0000 7f8d3b7fe700 1 --2- 172.21.15.8:0/635895595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d3c0b3f20 0x7f8d3c0ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:09.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.927+0000 7f8d3bfff700 1 -- 172.21.15.8:0/635895595 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d3c0cdd00 msgr2=0x7f8d3c15b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:09.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.927+0000 7f8d3bfff700 1 --2- 172.21.15.8:0/635895595 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d3c0cdd00 0x7f8d3c15b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:09.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.927+0000 7f8d3bfff700 1 -- 172.21.15.8:0/635895595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d3c0b3f20 msgr2=0x7f8d3c0ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:09.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.927+0000 7f8d3bfff700 1 --2- 172.21.15.8:0/635895595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d3c0b3f20 0x7f8d3c0ca890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:09.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.927+0000 7f8d3bfff700 1 -- 172.21.15.8:0/635895595 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d34009ae0 con 0x7f8d3c0b3b50 2023-10-06T04:38:09.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.927+0000 7f8d3bfff700 1 --2- 172.21.15.8:0/635895595 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d3c0b3b50 0x7f8d3c1574d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c00d890 tx=0x7f8d2c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:09.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.928+0000 7f8d23fff700 1 -- 172.21.15.8:0/635895595 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c0125f0 con 0x7f8d3c0b3b50 2023-10-06T04:38:09.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.928+0000 7f8d23fff700 1 -- 172.21.15.8:0/635895595 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d2c012750 con 0x7f8d3c0b3b50 2023-10-06T04:38:09.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.928+0000 7f8d428d2700 1 -- 172.21.15.8:0/635895595 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d3c0c85d0 con 0x7f8d3c0b3b50 2023-10-06T04:38:09.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.928+0000 7f8d23fff700 1 -- 172.21.15.8:0/635895595 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c012af0 con 0x7f8d3c0b3b50 2023-10-06T04:38:09.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.928+0000 7f8d428d2700 1 -- 172.21.15.8:0/635895595 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d3c0cb910 con 0x7f8d3c0b3b50 2023-10-06T04:38:09.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.929+0000 7f8d428d2700 1 -- 172.21.15.8:0/635895595 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d3c071550 con 0x7f8d3c0b3b50 2023-10-06T04:38:09.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.929+0000 7f8d23fff700 1 -- 172.21.15.8:0/635895595 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8d2c01e460 con 0x7f8d3c0b3b50 2023-10-06T04:38:09.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.929+0000 7f8d23fff700 1 --2- 172.21.15.8:0/635895595 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8d28066f30 0x7f8d280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:09.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.930+0000 7f8d23fff700 1 -- 172.21.15.8:0/635895595 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f8d2c084ac0 con 0x7f8d3c0b3b50 2023-10-06T04:38:09.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.930+0000 7f8d3b7fe700 1 --2- 172.21.15.8:0/635895595 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8d28066f30 0x7f8d280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:09.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.930+0000 7f8d3b7fe700 1 --2- 172.21.15.8:0/635895595 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8d28066f30 0x7f8d280693e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8d3000adc0 tx=0x7f8d30006f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:09.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:09.934+0000 7f8d23fff700 1 -- 172.21.15.8:0/635895595 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d2c0557c0 con 0x7f8d3c0b3b50 2023-10-06T04:38:10.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.126+0000 7f8d428d2700 1 -- 172.21.15.8:0/635895595 --> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d3c0690f0 con 0x7f8d28066f30 2023-10-06T04:38:10.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.126+0000 7f8d23fff700 1 -- 172.21.15.8:0/635895595 <== mgr.4105 v2:172.21.15.184:6832/90283 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8d3c0690f0 con 0x7f8d28066f30 2023-10-06T04:38:10.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.128+0000 7f8d428d2700 1 -- 172.21.15.8:0/635895595 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8d28066f30 msgr2=0x7f8d280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:10.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.128+0000 7f8d428d2700 1 --2- 172.21.15.8:0/635895595 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8d28066f30 0x7f8d280693e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8d3000adc0 tx=0x7f8d30006f90 comp rx=0 tx=0).stop 2023-10-06T04:38:10.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.128+0000 7f8d428d2700 1 -- 172.21.15.8:0/635895595 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d3c0b3b50 msgr2=0x7f8d3c1574d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:10.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.128+0000 7f8d428d2700 1 --2- 172.21.15.8:0/635895595 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d3c0b3b50 0x7f8d3c1574d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c00d890 tx=0x7f8d2c008040 comp rx=0 tx=0).stop 2023-10-06T04:38:10.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.128+0000 7f8d428d2700 1 -- 172.21.15.8:0/635895595 shutdown_connections 2023-10-06T04:38:10.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.128+0000 7f8d428d2700 1 --2- 172.21.15.8:0/635895595 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8d28066f30 0x7f8d280693e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:10.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.128+0000 7f8d428d2700 1 --2- 172.21.15.8:0/635895595 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d3c0cdd00 0x7f8d3c15b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:10.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.128+0000 7f8d428d2700 1 --2- 172.21.15.8:0/635895595 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d3c0b3b50 0x7f8d3c1574d0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:10.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.128+0000 7f8d428d2700 1 --2- 172.21.15.8:0/635895595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d3c0b3f20 0x7f8d3c0ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:10.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.128+0000 7f8d428d2700 1 -- 172.21.15.8:0/635895595 >> 172.21.15.8:0/635895595 conn(0x7f8d3c06df20 msgr2=0x7f8d3c0af9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:10.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.128+0000 7f8d428d2700 1 -- 172.21.15.8:0/635895595 shutdown_connections 2023-10-06T04:38:10.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.128+0000 7f8d428d2700 1 -- 172.21.15.8:0/635895595 wait complete. 2023-10-06T04:38:10.132 INFO:teuthology.orchestra.run.smithi008.stderr:instructed osd(s) 4 to deep-scrub 2023-10-06T04:38:10.142 INFO:tasks.ceph:Scrubbing osd.5 2023-10-06T04:38:10.142 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:38:10.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.262+0000 7f1cb455a700 1 Processor -- start 2023-10-06T04:38:10.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.262+0000 7f1cb455a700 1 -- start start 2023-10-06T04:38:10.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.263+0000 7f1cb455a700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1cac0d0a20 0x7f1cac1592b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:10.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.263+0000 7f1cb455a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1cac1597f0 0x7f1cac15d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:10.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.263+0000 7f1cb455a700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cac15e3b0 con 0x7f1cac0d0650 2023-10-06T04:38:10.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.263+0000 7f1cb455a700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cac0c6070 con 0x7f1cac0d0a20 2023-10-06T04:38:10.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.263+0000 7f1cb455a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac0c5740 con 0x7f1cac1597f0 2023-10-06T04:38:10.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.264+0000 7f1cb22f6700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f1cac0d0650 0x7f1cac0b01c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46966/0 (socket says 172.21.15.8:46966) 2023-10-06T04:38:10.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.264+0000 7f1cb22f6700 1 -- 172.21.15.8:0/1559346568 learned_addr learned my addr 172.21.15.8:0/1559346568 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:38:10.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.264+0000 7f1cb2af7700 1 --2- 172.21.15.8:0/1559346568 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1cac1597f0 0x7f1cac15d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:10.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.264+0000 7f1cb12f4700 1 -- 172.21.15.8:0/1559346568 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2531475657 0 0) 0x7f1cac15e3b0 con 0x7f1cac0d0650 2023-10-06T04:38:10.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.264+0000 7f1cb1af5700 1 --2- 172.21.15.8:0/1559346568 >> v2:172.21.15.184:3300/0 conn(0x7f1cac0d0a20 0x7f1cac1592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:10.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.264+0000 7f1cb12f4700 1 -- 172.21.15.8:0/1559346568 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c94003570 con 0x7f1cac0d0650 2023-10-06T04:38:10.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.264+0000 7f1cb12f4700 1 -- 172.21.15.8:0/1559346568 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3832010787 0 0) 0x7f1c94003570 con 0x7f1cac0d0650 2023-10-06T04:38:10.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.264+0000 7f1cb12f4700 1 -- 172.21.15.8:0/1559346568 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1cac1597f0 msgr2=0x7f1cac15d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:10.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.264+0000 7f1cb12f4700 1 --2- 172.21.15.8:0/1559346568 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1cac1597f0 0x7f1cac15d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:10.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.264+0000 7f1cb12f4700 1 -- 172.21.15.8:0/1559346568 >> v2:172.21.15.184:3300/0 conn(0x7f1cac0d0a20 msgr2=0x7f1cac1592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:10.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.264+0000 7f1cb12f4700 1 --2- 172.21.15.8:0/1559346568 >> v2:172.21.15.184:3300/0 conn(0x7f1cac0d0a20 0x7f1cac1592b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:10.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.264+0000 7f1cb12f4700 1 -- 172.21.15.8:0/1559346568 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cac0c5a20 con 0x7f1cac0d0650 2023-10-06T04:38:10.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.264+0000 7f1cb12f4700 1 -- 172.21.15.8:0/1559346568 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7f1c9c0017f0 con 0x7f1cac0d0650 2023-10-06T04:38:10.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.264+0000 7f1cb12f4700 1 -- 172.21.15.8:0/1559346568 >> v1:172.21.15.8:6789/0 conn(0x7f1cac0d0650 legacy=0x7f1cac0b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:10.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.264+0000 7f1cb12f4700 1 --2- 172.21.15.8:0/1559346568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c94003a60 0x7f1c94003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:10.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.264+0000 7f1cb12f4700 1 --2- 172.21.15.8:0/1559346568 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1cac1597f0 0x7f1c94004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:10.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.264+0000 7f1cb12f4700 1 --2- 172.21.15.8:0/1559346568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c94004d50 0x7f1c940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:10.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.264+0000 7f1cb12f4700 1 -- 172.21.15.8:0/1559346568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac0c6070 con 0x7f1c94004d50 2023-10-06T04:38:10.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.264+0000 7f1cb12f4700 1 -- 172.21.15.8:0/1559346568 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac0c5740 con 0x7f1c94003a60 2023-10-06T04:38:10.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.264+0000 7f1cb12f4700 1 -- 172.21.15.8:0/1559346568 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9400ba60 con 0x7f1cac1597f0 2023-10-06T04:38:10.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.264+0000 7f1cb2af7700 1 --2- 172.21.15.8:0/1559346568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c94004d50 0x7f1c940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:10.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.264+0000 7f1cb22f6700 1 --2- 172.21.15.8:0/1559346568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c94003a60 0x7f1c94003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:10.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.264+0000 7f1cb1af5700 1 --2- 172.21.15.8:0/1559346568 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1cac1597f0 0x7f1c94004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:10.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.265+0000 7f1cb2af7700 1 -- 172.21.15.8:0/1559346568 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1cac1597f0 msgr2=0x7f1c94004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:10.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.265+0000 7f1cb2af7700 1 --2- 172.21.15.8:0/1559346568 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1cac1597f0 0x7f1c94004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:10.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.265+0000 7f1cb2af7700 1 -- 172.21.15.8:0/1559346568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c94003a60 msgr2=0x7f1c94003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:10.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.265+0000 7f1cb2af7700 1 --2- 172.21.15.8:0/1559346568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c94003a60 0x7f1c94003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:10.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.265+0000 7f1cb2af7700 1 -- 172.21.15.8:0/1559346568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c94003570 con 0x7f1c94004d50 2023-10-06T04:38:10.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.265+0000 7f1cb2af7700 1 --2- 172.21.15.8:0/1559346568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c94004d50 0x7f1c940051c0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4009c00 tx=0x7f1ca40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd78d6243a85b5a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:10.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.265+0000 7f1cb12f4700 1 -- 172.21.15.8:0/1559346568 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca400e6b0 con 0x7f1c94004d50 2023-10-06T04:38:10.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.265+0000 7f1cb12f4700 1 -- 172.21.15.8:0/1559346568 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca400e810 con 0x7f1c94004d50 2023-10-06T04:38:10.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.265+0000 7f1cb12f4700 1 -- 172.21.15.8:0/1559346568 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca400ebd0 con 0x7f1c94004d50 2023-10-06T04:38:10.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.266+0000 7f1cb455a700 1 -- 172.21.15.8:0/1559346568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c94004d50 msgr2=0x7f1c940051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:10.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.266+0000 7f1cb455a700 1 --2- 172.21.15.8:0/1559346568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c94004d50 0x7f1c940051c0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4009c00 tx=0x7f1ca40091a0 comp rx=0 tx=0).stop 2023-10-06T04:38:10.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.266+0000 7f1cb2af7700 1 -- 172.21.15.8:0/1559346568 reap_dead start 2023-10-06T04:38:10.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.266+0000 7f1cb455a700 1 -- 172.21.15.8:0/1559346568 shutdown_connections 2023-10-06T04:38:10.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.266+0000 7f1cb455a700 1 -- 172.21.15.8:0/1559346568 >> 172.21.15.8:0/1559346568 conn(0x7f1cac0698b0 msgr2=0x7f1cac069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:10.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.266+0000 7f1cb455a700 1 -- 172.21.15.8:0/1559346568 shutdown_connections 2023-10-06T04:38:10.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.266+0000 7f1cb455a700 1 -- 172.21.15.8:0/1559346568 wait complete. 2023-10-06T04:38:10.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.267+0000 7f1cb455a700 1 Processor -- start 2023-10-06T04:38:10.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.267+0000 7f1cb455a700 1 -- start start 2023-10-06T04:38:10.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.268+0000 7f1cb455a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c94004d50 0x7f1cac16ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:10.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.268+0000 7f1cb455a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1cac148cd0 0x7f1cac0b5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:10.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.268+0000 7f1cb455a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1cac0b5cd0 0x7f1cac1537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:10.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.268+0000 7f1cb455a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac16cf60 con 0x7f1c94004d50 2023-10-06T04:38:10.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.268+0000 7f1cb455a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac16aad0 con 0x7f1cac148cd0 2023-10-06T04:38:10.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.268+0000 7f1cb455a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac169ec0 con 0x7f1cac0b5cd0 2023-10-06T04:38:10.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.268+0000 7f1cb22f6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c94004d50 0x7f1cac16ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:10.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.268+0000 7f1cb22f6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c94004d50 0x7f1cac16ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38580/0 (socket says 172.21.15.8:38580) 2023-10-06T04:38:10.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.268+0000 7f1cb22f6700 1 -- 172.21.15.8:0/749224362 learned_addr learned my addr 172.21.15.8:0/749224362 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:10.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.268+0000 7f1cb1af5700 1 --2- 172.21.15.8:0/749224362 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1cac148cd0 0x7f1cac0b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:10.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.268+0000 7f1cb2af7700 1 --2- 172.21.15.8:0/749224362 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1cac0b5cd0 0x7f1cac1537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:10.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.268+0000 7f1cb22f6700 1 -- 172.21.15.8:0/749224362 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1cac0b5cd0 msgr2=0x7f1cac1537c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:10.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.268+0000 7f1cb22f6700 1 --2- 172.21.15.8:0/749224362 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1cac0b5cd0 0x7f1cac1537c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:10.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.268+0000 7f1cb22f6700 1 -- 172.21.15.8:0/749224362 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1cac148cd0 msgr2=0x7f1cac0b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:10.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.268+0000 7f1cb22f6700 1 --2- 172.21.15.8:0/749224362 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1cac148cd0 0x7f1cac0b5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:10.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.268+0000 7f1cb22f6700 1 -- 172.21.15.8:0/749224362 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cac16a1a0 con 0x7f1c94004d50 2023-10-06T04:38:10.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.268+0000 7f1cb22f6700 1 --2- 172.21.15.8:0/749224362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c94004d50 0x7f1cac16ad40 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c007a90 tx=0x7f1cac0c61b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:10.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.268+0000 7f1caa7fc700 1 -- 172.21.15.8:0/749224362 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c00adb0 con 0x7f1c94004d50 2023-10-06T04:38:10.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.268+0000 7f1caa7fc700 1 -- 172.21.15.8:0/749224362 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9c0133f0 con 0x7f1c94004d50 2023-10-06T04:38:10.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.268+0000 7f1cb455a700 1 -- 172.21.15.8:0/749224362 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cac16a480 con 0x7f1c94004d50 2023-10-06T04:38:10.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.268+0000 7f1caa7fc700 1 -- 172.21.15.8:0/749224362 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c0137b0 con 0x7f1c94004d50 2023-10-06T04:38:10.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.268+0000 7f1cb455a700 1 -- 172.21.15.8:0/749224362 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cac169b30 con 0x7f1c94004d50 2023-10-06T04:38:10.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.269+0000 7f1cb455a700 1 -- 172.21.15.8:0/749224362 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1cac071550 con 0x7f1c94004d50 2023-10-06T04:38:10.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.270+0000 7f1caa7fc700 1 -- 172.21.15.8:0/749224362 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1c9c013ba0 con 0x7f1c94004d50 2023-10-06T04:38:10.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.270+0000 7f1caa7fc700 1 --2- 172.21.15.8:0/749224362 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1c98066f30 0x7f1c980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:10.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.270+0000 7f1caa7fc700 1 -- 172.21.15.8:0/749224362 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f1c9c085310 con 0x7f1c94004d50 2023-10-06T04:38:10.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.270+0000 7f1cb1af5700 1 --2- 172.21.15.8:0/749224362 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1c98066f30 0x7f1c980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:10.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.270+0000 7f1caa7fc700 1 --2- 172.21.15.8:0/749224362 >> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] conn(0x7f1c9806d8f0 0x7f1c9806fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:10.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.270+0000 7f1caa7fc700 1 -- 172.21.15.8:0/749224362 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1c980703f0 con 0x7f1c9806d8f0 2023-10-06T04:38:10.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.270+0000 7f1caa7fc700 1 -- 172.21.15.8:0/749224362 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c9c087950 con 0x7f1c94004d50 2023-10-06T04:38:10.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.270+0000 7f1cb2af7700 1 --2- 172.21.15.8:0/749224362 >> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] conn(0x7f1c9806d8f0 0x7f1c9806fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:10.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.271+0000 7f1cb1af5700 1 --2- 172.21.15.8:0/749224362 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1c98066f30 0x7f1c980693e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0006ed0 tx=0x7f1ca0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:10.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.271+0000 7f1cb2af7700 1 --2- 172.21.15.8:0/749224362 >> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] conn(0x7f1c9806d8f0 0x7f1c9806fd20 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:10.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.272+0000 7f1caa7fc700 1 -- 172.21.15.8:0/749224362 <== osd.5 v2:172.21.15.184:6824/90894 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f1c980703f0 con 0x7f1c9806d8f0 2023-10-06T04:38:10.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.285+0000 7f1cb455a700 1 -- 172.21.15.8:0/749224362 --> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1cac1587e0 con 0x7f1c9806d8f0 2023-10-06T04:38:10.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.286+0000 7f1caa7fc700 1 -- 172.21.15.8:0/749224362 <== osd.5 v2:172.21.15.184:6824/90894 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f1cac1587e0 con 0x7f1c9806d8f0 2023-10-06T04:38:10.288 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T04:38:10.289 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:38:10.289 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T04:38:10.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.286+0000 7f1cb455a700 1 -- 172.21.15.8:0/749224362 >> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] conn(0x7f1c9806d8f0 msgr2=0x7f1c9806fd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:10.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.286+0000 7f1cb455a700 1 --2- 172.21.15.8:0/749224362 >> [v2:172.21.15.184:6824/90894,v1:172.21.15.184:6825/90894] conn(0x7f1c9806d8f0 0x7f1c9806fd20 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:10.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.286+0000 7f1cb455a700 1 -- 172.21.15.8:0/749224362 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1c98066f30 msgr2=0x7f1c980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:10.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.286+0000 7f1cb455a700 1 --2- 172.21.15.8:0/749224362 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1c98066f30 0x7f1c980693e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0006ed0 tx=0x7f1ca0008040 comp rx=0 tx=0).stop 2023-10-06T04:38:10.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.286+0000 7f1cb455a700 1 -- 172.21.15.8:0/749224362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c94004d50 msgr2=0x7f1cac16ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:10.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.286+0000 7f1cb455a700 1 --2- 172.21.15.8:0/749224362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c94004d50 0x7f1cac16ad40 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c007a90 tx=0x7f1cac0c61b0 comp rx=0 tx=0).stop 2023-10-06T04:38:10.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.286+0000 7f1cb2af7700 1 -- 172.21.15.8:0/749224362 reap_dead start 2023-10-06T04:38:10.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.286+0000 7f1cb455a700 1 -- 172.21.15.8:0/749224362 shutdown_connections 2023-10-06T04:38:10.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.286+0000 7f1cb455a700 1 -- 172.21.15.8:0/749224362 >> 172.21.15.8:0/749224362 conn(0x7f1cac0698b0 msgr2=0x7f1cac0cb110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:10.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.286+0000 7f1cb455a700 1 -- 172.21.15.8:0/749224362 shutdown_connections 2023-10-06T04:38:10.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.286+0000 7f1cb455a700 1 -- 172.21.15.8:0/749224362 wait complete. 2023-10-06T04:38:10.300 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-06T04:38:10.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.417+0000 7f9e8d47a700 1 Processor -- start 2023-10-06T04:38:10.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.417+0000 7f9e8d47a700 1 -- start start 2023-10-06T04:38:10.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.418+0000 7f9e8d47a700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9e880af410 0x7f9e880cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:10.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.418+0000 7f9e8d47a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e880af7e0 0x7f9e880ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:10.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.418+0000 7f9e8d47a700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9e880cd2f0 0x7f9e88068470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:10.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.418+0000 7f9e8d47a700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e8815e260 con 0x7f9e880cd2f0 2023-10-06T04:38:10.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.418+0000 7f9e8d47a700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e8815ddd0 con 0x7f9e880af410 2023-10-06T04:38:10.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.418+0000 7f9e8d47a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8815d4a0 con 0x7f9e880af7e0 2023-10-06T04:38:10.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.418+0000 7f9e877fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9e880cd2f0 0x7f9e88068470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:10.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.418+0000 7f9e877fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9e880cd2f0 0x7f9e88068470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38588/0 (socket says 172.21.15.8:38588) 2023-10-06T04:38:10.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.418+0000 7f9e877fe700 1 -- 172.21.15.8:0/1342790232 learned_addr learned my addr 172.21.15.8:0/1342790232 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:10.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.419+0000 7f9e867fc700 1 --2- 172.21.15.8:0/1342790232 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e880af7e0 0x7f9e880ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:10.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.419+0000 7f9e86ffd700 1 --2- 172.21.15.8:0/1342790232 >> v2:172.21.15.184:3300/0 conn(0x7f9e880af410 0x7f9e880cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:10.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.419+0000 7f9e877fe700 1 -- 172.21.15.8:0/1342790232 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e880af7e0 msgr2=0x7f9e880ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:10.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.419+0000 7f9e877fe700 1 --2- 172.21.15.8:0/1342790232 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e880af7e0 0x7f9e880ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:10.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.419+0000 7f9e877fe700 1 -- 172.21.15.8:0/1342790232 >> v2:172.21.15.184:3300/0 conn(0x7f9e880af410 msgr2=0x7f9e880cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:10.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.419+0000 7f9e877fe700 1 --2- 172.21.15.8:0/1342790232 >> v2:172.21.15.184:3300/0 conn(0x7f9e880af410 0x7f9e880cb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:10.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.419+0000 7f9e877fe700 1 -- 172.21.15.8:0/1342790232 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8815d780 con 0x7f9e880cd2f0 2023-10-06T04:38:10.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.419+0000 7f9e86ffd700 1 --2- 172.21.15.8:0/1342790232 >> v2:172.21.15.184:3300/0 conn(0x7f9e880af410 0x7f9e880cb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:38:10.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.419+0000 7f9e877fe700 1 --2- 172.21.15.8:0/1342790232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e880cd2f0 0x7f9e88068470 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f9e880694e0 tx=0x7f9e78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92496a195a861978 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:10.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.419+0000 7f9e85ffb700 1 -- 172.21.15.8:0/1342790232 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7800b8f0 con 0x7f9e880cd2f0 2023-10-06T04:38:10.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.419+0000 7f9e85ffb700 1 -- 172.21.15.8:0/1342790232 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7800ba50 con 0x7f9e880cd2f0 2023-10-06T04:38:10.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.419+0000 7f9e85ffb700 1 -- 172.21.15.8:0/1342790232 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7800bdf0 con 0x7f9e880cd2f0 2023-10-06T04:38:10.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.420+0000 7f9e8d47a700 1 -- 172.21.15.8:0/1342790232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e880cd2f0 msgr2=0x7f9e88068470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:10.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.420+0000 7f9e8d47a700 1 --2- 172.21.15.8:0/1342790232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e880cd2f0 0x7f9e88068470 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f9e880694e0 tx=0x7f9e78009250 comp rx=0 tx=0).stop 2023-10-06T04:38:10.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.420+0000 7f9e8d47a700 1 -- 172.21.15.8:0/1342790232 shutdown_connections 2023-10-06T04:38:10.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.420+0000 7f9e8d47a700 1 --2- 172.21.15.8:0/1342790232 >> v2:172.21.15.184:3300/0 conn(0x7f9e880af410 0x7f9e880cb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:10.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.420+0000 7f9e8d47a700 1 --2- 172.21.15.8:0/1342790232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e880cd2f0 0x7f9e88068470 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:10.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.420+0000 7f9e8d47a700 1 --2- 172.21.15.8:0/1342790232 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e880af7e0 0x7f9e880ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:10.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.420+0000 7f9e8d47a700 1 -- 172.21.15.8:0/1342790232 >> 172.21.15.8:0/1342790232 conn(0x7f9e88069890 msgr2=0x7f9e88069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:10.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.420+0000 7f9e8d47a700 1 -- 172.21.15.8:0/1342790232 shutdown_connections 2023-10-06T04:38:10.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.420+0000 7f9e8d47a700 1 -- 172.21.15.8:0/1342790232 wait complete. 2023-10-06T04:38:10.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.421+0000 7f9e8d47a700 1 Processor -- start 2023-10-06T04:38:10.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.421+0000 7f9e8d47a700 1 -- start start 2023-10-06T04:38:10.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.422+0000 7f9e8d47a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e880af410 0x7f9e8813f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:10.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.422+0000 7f9e8d47a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e880af7e0 0x7f9e880b3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:10.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.422+0000 7f9e8d47a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e880cd2f0 0x7f9e881522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:10.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.422+0000 7f9e8d47a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e880b3a70 con 0x7f9e880cd2f0 2023-10-06T04:38:10.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.422+0000 7f9e8d47a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e88153000 con 0x7f9e880af410 2023-10-06T04:38:10.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.422+0000 7f9e8d47a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e881532e0 con 0x7f9e880af7e0 2023-10-06T04:38:10.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.422+0000 7f9e877fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e880cd2f0 0x7f9e881522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:10.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.422+0000 7f9e877fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e880cd2f0 0x7f9e881522b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38600/0 (socket says 172.21.15.8:38600) 2023-10-06T04:38:10.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.422+0000 7f9e877fe700 1 -- 172.21.15.8:0/2341305907 learned_addr learned my addr 172.21.15.8:0/2341305907 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:10.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.422+0000 7f9e867fc700 1 --2- 172.21.15.8:0/2341305907 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e880af7e0 0x7f9e880b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:10.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.422+0000 7f9e86ffd700 1 --2- 172.21.15.8:0/2341305907 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e880af410 0x7f9e8813f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:10.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.422+0000 7f9e877fe700 1 -- 172.21.15.8:0/2341305907 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e880af7e0 msgr2=0x7f9e880b3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:10.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.422+0000 7f9e877fe700 1 --2- 172.21.15.8:0/2341305907 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e880af7e0 0x7f9e880b3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:10.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.422+0000 7f9e877fe700 1 -- 172.21.15.8:0/2341305907 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e880af410 msgr2=0x7f9e8813f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:10.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.422+0000 7f9e877fe700 1 --2- 172.21.15.8:0/2341305907 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e880af410 0x7f9e8813f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:10.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.422+0000 7f9e877fe700 1 -- 172.21.15.8:0/2341305907 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e780094f0 con 0x7f9e880cd2f0 2023-10-06T04:38:10.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.422+0000 7f9e86ffd700 1 --2- 172.21.15.8:0/2341305907 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e880af410 0x7f9e8813f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:38:10.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.422+0000 7f9e877fe700 1 --2- 172.21.15.8:0/2341305907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e880cd2f0 0x7f9e881522b0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f9e880891d0 tx=0x7f9e78017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:10.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.422+0000 7f9e7effd700 1 -- 172.21.15.8:0/2341305907 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7801a630 con 0x7f9e880cd2f0 2023-10-06T04:38:10.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.423+0000 7f9e7effd700 1 -- 172.21.15.8:0/2341305907 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7801a790 con 0x7f9e880cd2f0 2023-10-06T04:38:10.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.423+0000 7f9e7effd700 1 -- 172.21.15.8:0/2341305907 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7801ab50 con 0x7f9e880cd2f0 2023-10-06T04:38:10.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.423+0000 7f9e8d47a700 1 -- 172.21.15.8:0/2341305907 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e881535c0 con 0x7f9e880cd2f0 2023-10-06T04:38:10.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.423+0000 7f9e8d47a700 1 -- 172.21.15.8:0/2341305907 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e880b3740 con 0x7f9e880cd2f0 2023-10-06T04:38:10.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.424+0000 7f9e8d47a700 1 -- 172.21.15.8:0/2341305907 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e880b3c20 con 0x7f9e880cd2f0 2023-10-06T04:38:10.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.424+0000 7f9e7effd700 1 -- 172.21.15.8:0/2341305907 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e780193b0 con 0x7f9e880cd2f0 2023-10-06T04:38:10.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.424+0000 7f9e7effd700 1 --2- 172.21.15.8:0/2341305907 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9e68066f30 0x7f9e680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:10.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.425+0000 7f9e7effd700 1 -- 172.21.15.8:0/2341305907 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f9e780859f0 con 0x7f9e880cd2f0 2023-10-06T04:38:10.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.425+0000 7f9e86ffd700 1 --2- 172.21.15.8:0/2341305907 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9e68066f30 0x7f9e680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:10.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.425+0000 7f9e86ffd700 1 --2- 172.21.15.8:0/2341305907 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9e68066f30 0x7f9e680693e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9e8815e0d0 tx=0x7f9e80007690 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:10.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.429+0000 7f9e7effd700 1 -- 172.21.15.8:0/2341305907 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e880b3c20 con 0x7f9e880cd2f0 2023-10-06T04:38:10.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.621+0000 7f9e8d47a700 1 -- 172.21.15.8:0/2341305907 --> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e880b3c20 con 0x7f9e68066f30 2023-10-06T04:38:10.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.621+0000 7f9e7effd700 1 -- 172.21.15.8:0/2341305907 <== mgr.4105 v2:172.21.15.184:6832/90283 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9e880b3c20 con 0x7f9e68066f30 2023-10-06T04:38:10.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.623+0000 7f9e8d47a700 1 -- 172.21.15.8:0/2341305907 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9e68066f30 msgr2=0x7f9e680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:10.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.623+0000 7f9e8d47a700 1 --2- 172.21.15.8:0/2341305907 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9e68066f30 0x7f9e680693e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9e8815e0d0 tx=0x7f9e80007690 comp rx=0 tx=0).stop 2023-10-06T04:38:10.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.623+0000 7f9e8d47a700 1 -- 172.21.15.8:0/2341305907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e880cd2f0 msgr2=0x7f9e881522b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:10.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.623+0000 7f9e8d47a700 1 --2- 172.21.15.8:0/2341305907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e880cd2f0 0x7f9e881522b0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f9e880891d0 tx=0x7f9e78017000 comp rx=0 tx=0).stop 2023-10-06T04:38:10.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.623+0000 7f9e8d47a700 1 -- 172.21.15.8:0/2341305907 shutdown_connections 2023-10-06T04:38:10.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.623+0000 7f9e8d47a700 1 --2- 172.21.15.8:0/2341305907 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f9e68066f30 0x7f9e680693e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:10.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.623+0000 7f9e8d47a700 1 --2- 172.21.15.8:0/2341305907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e880cd2f0 0x7f9e881522b0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:10.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.623+0000 7f9e8d47a700 1 --2- 172.21.15.8:0/2341305907 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e880af410 0x7f9e8813f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:10.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.623+0000 7f9e8d47a700 1 --2- 172.21.15.8:0/2341305907 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e880af7e0 0x7f9e880b3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:10.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.623+0000 7f9e8d47a700 1 -- 172.21.15.8:0/2341305907 >> 172.21.15.8:0/2341305907 conn(0x7f9e88069890 msgr2=0x7f9e880c5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:10.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.623+0000 7f9e8d47a700 1 -- 172.21.15.8:0/2341305907 shutdown_connections 2023-10-06T04:38:10.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.623+0000 7f9e8d47a700 1 -- 172.21.15.8:0/2341305907 wait complete. 2023-10-06T04:38:10.627 INFO:teuthology.orchestra.run.smithi008.stderr:instructed osd(s) 5 to deep-scrub 2023-10-06T04:38:10.638 INFO:tasks.ceph:Scrubbing osd.6 2023-10-06T04:38:10.638 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:38:10.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.760+0000 7ff3f08d6700 1 Processor -- start 2023-10-06T04:38:10.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.760+0000 7ff3f08d6700 1 -- start start 2023-10-06T04:38:10.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.761+0000 7ff3f08d6700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff3ec157790 0x7ff3ec0b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:10.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.761+0000 7ff3f08d6700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3ec0b3270 con 0x7ff3ec0af480 2023-10-06T04:38:10.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.761+0000 7ff3f08d6700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3ec0b3550 con 0x7ff3ec0af0b0 2023-10-06T04:38:10.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.761+0000 7ff3f08d6700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3ec0b3830 con 0x7ff3ec157790 2023-10-06T04:38:10.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.761+0000 7ff3e9d9b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff3ec157790 0x7ff3ec0b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:10.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.761+0000 7ff3ead9d700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ff3ec0af480 0x7ff3ec0b2a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46978/0 (socket says 172.21.15.8:46978) 2023-10-06T04:38:10.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.761+0000 7ff3ead9d700 1 -- 172.21.15.8:0/2514157366 learned_addr learned my addr 172.21.15.8:0/2514157366 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:38:10.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.761+0000 7ff3e9d9b700 1 -- 172.21.15.8:0/2514157366 >> v1:172.21.15.184:6789/0 conn(0x7ff3ec0af0b0 legacy=0x7ff3ec157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:10.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.761+0000 7ff3e9d9b700 1 -- 172.21.15.8:0/2514157366 >> v1:172.21.15.8:6789/0 conn(0x7ff3ec0af480 legacy=0x7ff3ec0b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:10.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.761+0000 7ff3e9d9b700 1 -- 172.21.15.8:0/2514157366 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3ec0b3b10 con 0x7ff3ec157790 2023-10-06T04:38:10.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.761+0000 7ff3e959a700 1 -- 172.21.15.8:0/2514157366 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1179038547 0 0) 0x7ff3ec0b3270 con 0x7ff3ec0af480 2023-10-06T04:38:10.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.761+0000 7ff3e9d9b700 1 --2- 172.21.15.8:0/2514157366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3ec157790 0x7ff3ec0b2500 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7ff3d40098e0 tx=0x7ff3d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b08200858d1e99 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:10.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.761+0000 7ff3e959a700 1 -- 172.21.15.8:0/2514157366 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4009e80 con 0x7ff3ec157790 2023-10-06T04:38:10.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.761+0000 7ff3e959a700 1 -- 172.21.15.8:0/2514157366 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d400b860 con 0x7ff3ec157790 2023-10-06T04:38:10.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.761+0000 7ff3e959a700 1 -- 172.21.15.8:0/2514157366 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d400bbe0 con 0x7ff3ec157790 2023-10-06T04:38:10.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.762+0000 7ff3f08d6700 1 -- 172.21.15.8:0/2514157366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3ec157790 msgr2=0x7ff3ec0b2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:10.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.762+0000 7ff3f08d6700 1 --2- 172.21.15.8:0/2514157366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3ec157790 0x7ff3ec0b2500 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7ff3d40098e0 tx=0x7ff3d40091a0 comp rx=0 tx=0).stop 2023-10-06T04:38:10.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.762+0000 7ff3f08d6700 1 -- 172.21.15.8:0/2514157366 shutdown_connections 2023-10-06T04:38:10.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.762+0000 7ff3f08d6700 1 --2- 172.21.15.8:0/2514157366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3ec157790 0x7ff3ec0b2500 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:10.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.762+0000 7ff3f08d6700 1 -- 172.21.15.8:0/2514157366 >> 172.21.15.8:0/2514157366 conn(0x7ff3ec0975f0 msgr2=0x7ff3ec067db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:10.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.762+0000 7ff3f08d6700 1 -- 172.21.15.8:0/2514157366 shutdown_connections 2023-10-06T04:38:10.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.762+0000 7ff3f08d6700 1 -- 172.21.15.8:0/2514157366 wait complete. 2023-10-06T04:38:10.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.763+0000 7ff3f08d6700 1 Processor -- start 2023-10-06T04:38:10.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.763+0000 7ff3f08d6700 1 -- start start 2023-10-06T04:38:10.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.764+0000 7ff3f08d6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3ec0af0b0 0x7ff3ec09ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:10.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.764+0000 7ff3f08d6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff3ec0af480 0x7ff3ec097e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:10.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.764+0000 7ff3f08d6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3ec157790 0x7ff3ec098390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:10.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.764+0000 7ff3f08d6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ec0ca350 con 0x7ff3ec157790 2023-10-06T04:38:10.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.764+0000 7ff3f08d6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ec155f10 con 0x7ff3ec0af0b0 2023-10-06T04:38:10.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.764+0000 7ff3f08d6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ec098ce0 con 0x7ff3ec0af480 2023-10-06T04:38:10.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.764+0000 7ff3ead9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3ec157790 0x7ff3ec098390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:10.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.764+0000 7ff3ead9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3ec157790 0x7ff3ec098390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38628/0 (socket says 172.21.15.8:38628) 2023-10-06T04:38:10.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.764+0000 7ff3ead9d700 1 -- 172.21.15.8:0/2210604328 learned_addr learned my addr 172.21.15.8:0/2210604328 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:10.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.764+0000 7ff3ea59c700 1 --2- 172.21.15.8:0/2210604328 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3ec0af0b0 0x7ff3ec09ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:10.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.764+0000 7ff3e9d9b700 1 --2- 172.21.15.8:0/2210604328 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff3ec0af480 0x7ff3ec097e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:10.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.764+0000 7ff3ead9d700 1 -- 172.21.15.8:0/2210604328 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff3ec0af480 msgr2=0x7ff3ec097e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:10.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.764+0000 7ff3ead9d700 1 --2- 172.21.15.8:0/2210604328 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff3ec0af480 0x7ff3ec097e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:10.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.764+0000 7ff3ead9d700 1 -- 172.21.15.8:0/2210604328 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3ec0af0b0 msgr2=0x7ff3ec09ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:10.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.764+0000 7ff3ead9d700 1 --2- 172.21.15.8:0/2210604328 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3ec0af0b0 0x7ff3ec09ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:10.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.764+0000 7ff3ead9d700 1 -- 172.21.15.8:0/2210604328 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d4009420 con 0x7ff3ec157790 2023-10-06T04:38:10.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.765+0000 7ff3ead9d700 1 --2- 172.21.15.8:0/2210604328 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3ec157790 0x7ff3ec098390 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc0011e0 tx=0x7ff3dc007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:10.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.765+0000 7ff3e27fc700 1 -- 172.21.15.8:0/2210604328 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc005b30 con 0x7ff3ec157790 2023-10-06T04:38:10.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.765+0000 7ff3e27fc700 1 -- 172.21.15.8:0/2210604328 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3dc005c90 con 0x7ff3ec157790 2023-10-06T04:38:10.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.765+0000 7ff3e27fc700 1 -- 172.21.15.8:0/2210604328 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc007320 con 0x7ff3ec157790 2023-10-06T04:38:10.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.765+0000 7ff3f08d6700 1 -- 172.21.15.8:0/2210604328 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3ec098fc0 con 0x7ff3ec157790 2023-10-06T04:38:10.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.765+0000 7ff3f08d6700 1 -- 172.21.15.8:0/2210604328 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3ec099580 con 0x7ff3ec157790 2023-10-06T04:38:10.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.766+0000 7ff3f08d6700 1 -- 172.21.15.8:0/2210604328 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff3ec071550 con 0x7ff3ec157790 2023-10-06T04:38:10.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.766+0000 7ff3e27fc700 1 -- 172.21.15.8:0/2210604328 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff3dc007690 con 0x7ff3ec157790 2023-10-06T04:38:10.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.767+0000 7ff3e27fc700 1 --2- 172.21.15.8:0/2210604328 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff3cc066f30 0x7ff3cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:10.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.767+0000 7ff3e27fc700 1 -- 172.21.15.8:0/2210604328 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5698+0+0 (secure 0 0 0) 0x7ff3dc0840d0 con 0x7ff3ec157790 2023-10-06T04:38:10.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.767+0000 7ff3ea59c700 1 --2- 172.21.15.8:0/2210604328 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff3cc066f30 0x7ff3cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:10.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.767+0000 7ff3e27fc700 1 --2- 172.21.15.8:0/2210604328 >> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] conn(0x7ff3cc06d8f0 0x7ff3cc06fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:10.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.767+0000 7ff3e27fc700 1 -- 172.21.15.8:0/2210604328 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff3cc0703f0 con 0x7ff3cc06d8f0 2023-10-06T04:38:10.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.767+0000 7ff3e27fc700 1 -- 172.21.15.8:0/2210604328 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff3dc0844a0 con 0x7ff3ec157790 2023-10-06T04:38:10.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.767+0000 7ff3e9d9b700 1 --2- 172.21.15.8:0/2210604328 >> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] conn(0x7ff3cc06d8f0 0x7ff3cc06fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:10.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.767+0000 7ff3ea59c700 1 --2- 172.21.15.8:0/2210604328 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff3cc066f30 0x7ff3cc0693e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4007fd0 tx=0x7ff3e40016f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:10.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.767+0000 7ff3e9d9b700 1 --2- 172.21.15.8:0/2210604328 >> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] conn(0x7ff3cc06d8f0 0x7ff3cc06fd20 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:10.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.768+0000 7ff3e27fc700 1 -- 172.21.15.8:0/2210604328 <== osd.6 v2:172.21.15.184:6816/90899 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7ff3cc0703f0 con 0x7ff3cc06d8f0 2023-10-06T04:38:10.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.783+0000 7ff3f08d6700 1 -- 172.21.15.8:0/2210604328 --> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff3ec097af0 con 0x7ff3cc06d8f0 2023-10-06T04:38:10.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.783+0000 7ff3e27fc700 1 -- 172.21.15.8:0/2210604328 <== osd.6 v2:172.21.15.184:6816/90899 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff3ec097af0 con 0x7ff3cc06d8f0 2023-10-06T04:38:10.786 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T04:38:10.786 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:38:10.786 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T04:38:10.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.784+0000 7ff3f08d6700 1 -- 172.21.15.8:0/2210604328 >> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] conn(0x7ff3cc06d8f0 msgr2=0x7ff3cc06fd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:10.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.784+0000 7ff3f08d6700 1 --2- 172.21.15.8:0/2210604328 >> [v2:172.21.15.184:6816/90899,v1:172.21.15.184:6817/90899] conn(0x7ff3cc06d8f0 0x7ff3cc06fd20 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:10.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.784+0000 7ff3f08d6700 1 -- 172.21.15.8:0/2210604328 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff3cc066f30 msgr2=0x7ff3cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:10.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.784+0000 7ff3f08d6700 1 --2- 172.21.15.8:0/2210604328 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff3cc066f30 0x7ff3cc0693e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4007fd0 tx=0x7ff3e40016f0 comp rx=0 tx=0).stop 2023-10-06T04:38:10.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.784+0000 7ff3f08d6700 1 -- 172.21.15.8:0/2210604328 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3ec157790 msgr2=0x7ff3ec098390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:10.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.784+0000 7ff3f08d6700 1 --2- 172.21.15.8:0/2210604328 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3ec157790 0x7ff3ec098390 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc0011e0 tx=0x7ff3dc007d30 comp rx=0 tx=0).stop 2023-10-06T04:38:10.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.784+0000 7ff3ead9d700 1 -- 172.21.15.8:0/2210604328 reap_dead start 2023-10-06T04:38:10.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.784+0000 7ff3f08d6700 1 -- 172.21.15.8:0/2210604328 shutdown_connections 2023-10-06T04:38:10.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.784+0000 7ff3f08d6700 1 -- 172.21.15.8:0/2210604328 >> 172.21.15.8:0/2210604328 conn(0x7ff3ec0975f0 msgr2=0x7ff3ec06b440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:10.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.784+0000 7ff3f08d6700 1 -- 172.21.15.8:0/2210604328 shutdown_connections 2023-10-06T04:38:10.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.784+0000 7ff3f08d6700 1 -- 172.21.15.8:0/2210604328 wait complete. 2023-10-06T04:38:10.798 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-06T04:38:10.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.915+0000 7f7ddae16700 1 Processor -- start 2023-10-06T04:38:10.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.915+0000 7f7ddae16700 1 -- start start 2023-10-06T04:38:10.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.916+0000 7f7ddae16700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7dd4153aa0 0x7f7dd40c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:10.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.916+0000 7f7ddae16700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd4068e60 con 0x7f7dd40c8ce0 2023-10-06T04:38:10.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.916+0000 7f7ddae16700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd415a580 con 0x7f7dd415a190 2023-10-06T04:38:10.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.916+0000 7f7ddae16700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd415aad0 con 0x7f7dd4153aa0 2023-10-06T04:38:10.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.916+0000 7f7dd3fff700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f7dd40c8ce0 0x7f7dd4159a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46990/0 (socket says 172.21.15.8:46990) 2023-10-06T04:38:10.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.916+0000 7f7dd3fff700 1 -- 172.21.15.8:0/1277440512 learned_addr learned my addr 172.21.15.8:0/1277440512 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:38:10.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.917+0000 7f7dd8bb2700 1 --2- 172.21.15.8:0/1277440512 >> v2:172.21.15.184:3300/0 conn(0x7f7dd4153aa0 0x7f7dd40c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:10.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.917+0000 7f7dd37fe700 1 -- 172.21.15.8:0/1277440512 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3009943939 0 0) 0x7f7dd4068e60 con 0x7f7dd40c8ce0 2023-10-06T04:38:10.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.917+0000 7f7dd37fe700 1 -- 172.21.15.8:0/1277440512 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dbc003570 con 0x7f7dd40c8ce0 2023-10-06T04:38:10.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.917+0000 7f7dd37fe700 1 -- 172.21.15.8:0/1277440512 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3383798704 0 0) 0x7f7dbc003570 con 0x7f7dd40c8ce0 2023-10-06T04:38:10.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.917+0000 7f7dd37fe700 1 -- 172.21.15.8:0/1277440512 >> v2:172.21.15.184:3300/0 conn(0x7f7dd4153aa0 msgr2=0x7f7dd40c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:10.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.917+0000 7f7dd37fe700 1 --2- 172.21.15.8:0/1277440512 >> v2:172.21.15.184:3300/0 conn(0x7f7dd4153aa0 0x7f7dd40c87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:10.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.917+0000 7f7dd37fe700 1 -- 172.21.15.8:0/1277440512 >> v1:172.21.15.184:6789/0 conn(0x7f7dd415a190 legacy=0x7f7dd40692f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:10.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.917+0000 7f7dd37fe700 1 -- 172.21.15.8:0/1277440512 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd40c9160 con 0x7f7dd40c8ce0 2023-10-06T04:38:10.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.917+0000 7f7dd37fe700 1 -- 172.21.15.8:0/1277440512 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1425896718 0 0) 0x7f7dc8001470 con 0x7f7dd40c8ce0 2023-10-06T04:38:10.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.917+0000 7f7dd37fe700 1 -- 172.21.15.8:0/1277440512 >> v1:172.21.15.8:6789/0 conn(0x7f7dd40c8ce0 legacy=0x7f7dd4159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:10.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.917+0000 7f7dd37fe700 1 --2- 172.21.15.8:0/1277440512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7dbc003a60 0x7f7dbc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:10.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.917+0000 7f7dd37fe700 1 --2- 172.21.15.8:0/1277440512 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7dbc004810 0x7f7dbc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:10.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.917+0000 7f7dd37fe700 1 --2- 172.21.15.8:0/1277440512 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7dbc0051c0 0x7f7dbc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:10.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.917+0000 7f7dd37fe700 1 -- 172.21.15.8:0/1277440512 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd415aad0 con 0x7f7dbc003a60 2023-10-06T04:38:10.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.917+0000 7f7dd37fe700 1 -- 172.21.15.8:0/1277440512 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc00c160 con 0x7f7dbc0051c0 2023-10-06T04:38:10.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.917+0000 7f7dd37fe700 1 -- 172.21.15.8:0/1277440512 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc00c320 con 0x7f7dbc004810 2023-10-06T04:38:10.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.917+0000 7f7dd8bb2700 1 --2- 172.21.15.8:0/1277440512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7dbc003a60 0x7f7dbc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:10.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.917+0000 7f7dd3fff700 1 --2- 172.21.15.8:0/1277440512 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7dbc004810 0x7f7dbc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:10.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.917+0000 7f7dd93b3700 1 --2- 172.21.15.8:0/1277440512 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7dbc0051c0 0x7f7dbc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:10.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.917+0000 7f7dd8bb2700 1 -- 172.21.15.8:0/1277440512 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7dbc004810 msgr2=0x7f7dbc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:10.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.917+0000 7f7dd8bb2700 1 --2- 172.21.15.8:0/1277440512 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7dbc004810 0x7f7dbc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:10.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.917+0000 7f7dd8bb2700 1 -- 172.21.15.8:0/1277440512 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7dbc0051c0 msgr2=0x7f7dbc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:10.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.917+0000 7f7dd8bb2700 1 --2- 172.21.15.8:0/1277440512 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7dbc0051c0 0x7f7dbc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:10.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.917+0000 7f7dd93b3700 1 -- 172.21.15.8:0/1277440512 reap_dead start 2023-10-06T04:38:10.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.917+0000 7f7dd8bb2700 1 -- 172.21.15.8:0/1277440512 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dbc003570 con 0x7f7dbc003a60 2023-10-06T04:38:10.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.918+0000 7f7dd8bb2700 1 --2- 172.21.15.8:0/1277440512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7dbc003a60 0x7f7dbc003e70 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00e210 tx=0x7f7dcc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18fab29581da7afd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:10.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.918+0000 7f7dd37fe700 1 -- 172.21.15.8:0/1277440512 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc00eac0 con 0x7f7dbc003a60 2023-10-06T04:38:10.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.918+0000 7f7dd37fe700 1 -- 172.21.15.8:0/1277440512 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dcc00f040 con 0x7f7dbc003a60 2023-10-06T04:38:10.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.918+0000 7f7dd37fe700 1 -- 172.21.15.8:0/1277440512 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc00ee70 con 0x7f7dbc003a60 2023-10-06T04:38:10.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.918+0000 7f7ddae16700 1 -- 172.21.15.8:0/1277440512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7dbc003a60 msgr2=0x7f7dbc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:10.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.918+0000 7f7ddae16700 1 --2- 172.21.15.8:0/1277440512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7dbc003a60 0x7f7dbc003e70 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00e210 tx=0x7f7dcc00b040 comp rx=0 tx=0).stop 2023-10-06T04:38:10.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.918+0000 7f7ddae16700 1 -- 172.21.15.8:0/1277440512 shutdown_connections 2023-10-06T04:38:10.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.918+0000 7f7ddae16700 1 --2- 172.21.15.8:0/1277440512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7dbc003a60 0x7f7dbc003e70 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:10.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.918+0000 7f7ddae16700 1 -- 172.21.15.8:0/1277440512 >> 172.21.15.8:0/1277440512 conn(0x7f7dd40ce200 msgr2=0x7f7dd40ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:10.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.918+0000 7f7ddae16700 1 -- 172.21.15.8:0/1277440512 shutdown_connections 2023-10-06T04:38:10.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.918+0000 7f7ddae16700 1 -- 172.21.15.8:0/1277440512 wait complete. 2023-10-06T04:38:10.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.919+0000 7f7ddae16700 1 Processor -- start 2023-10-06T04:38:10.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.920+0000 7f7ddae16700 1 -- start start 2023-10-06T04:38:10.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.920+0000 7f7ddae16700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7dbc003a60 0x7f7dd416ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:10.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.920+0000 7f7ddae16700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7dd416a920 0x7f7dd4150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:10.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.920+0000 7f7ddae16700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7dd40c11f0 0x7f7dd4069190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:10.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.920+0000 7f7ddae16700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd416b2a0 con 0x7f7dd40c11f0 2023-10-06T04:38:10.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.920+0000 7f7ddae16700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd415d390 con 0x7f7dbc003a60 2023-10-06T04:38:10.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.920+0000 7f7ddae16700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd415d670 con 0x7f7dd416a920 2023-10-06T04:38:10.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.920+0000 7f7dd93b3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7dd40c11f0 0x7f7dd4069190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:10.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.920+0000 7f7dd93b3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7dd40c11f0 0x7f7dd4069190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38634/0 (socket says 172.21.15.8:38634) 2023-10-06T04:38:10.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.920+0000 7f7dd93b3700 1 -- 172.21.15.8:0/2997679333 learned_addr learned my addr 172.21.15.8:0/2997679333 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:10.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.921+0000 7f7dd8bb2700 1 --2- 172.21.15.8:0/2997679333 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7dbc003a60 0x7f7dd416ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:10.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.921+0000 7f7dd3fff700 1 --2- 172.21.15.8:0/2997679333 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7dd416a920 0x7f7dd4150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:10.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.921+0000 7f7dd93b3700 1 -- 172.21.15.8:0/2997679333 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7dd416a920 msgr2=0x7f7dd4150c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:10.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.921+0000 7f7dd93b3700 1 --2- 172.21.15.8:0/2997679333 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7dd416a920 0x7f7dd4150c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:10.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.921+0000 7f7dd93b3700 1 -- 172.21.15.8:0/2997679333 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7dbc003a60 msgr2=0x7f7dd416ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:10.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.921+0000 7f7dd93b3700 1 --2- 172.21.15.8:0/2997679333 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7dbc003a60 0x7f7dd416ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:10.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.921+0000 7f7dd93b3700 1 -- 172.21.15.8:0/2997679333 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd415d950 con 0x7f7dd40c11f0 2023-10-06T04:38:10.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.921+0000 7f7dd93b3700 1 --2- 172.21.15.8:0/2997679333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7dd40c11f0 0x7f7dd4069190 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7dd406f4b0 tx=0x7f7dc4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:10.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.921+0000 7f7dd0ff9700 1 -- 172.21.15.8:0/2997679333 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc4013420 con 0x7f7dd40c11f0 2023-10-06T04:38:10.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.921+0000 7f7dd0ff9700 1 -- 172.21.15.8:0/2997679333 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc4013580 con 0x7f7dd40c11f0 2023-10-06T04:38:10.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.921+0000 7f7ddae16700 1 -- 172.21.15.8:0/2997679333 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd415dc30 con 0x7f7dd40c11f0 2023-10-06T04:38:10.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.921+0000 7f7dd0ff9700 1 -- 172.21.15.8:0/2997679333 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc4013920 con 0x7f7dd40c11f0 2023-10-06T04:38:10.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.921+0000 7f7ddae16700 1 -- 172.21.15.8:0/2997679333 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd415d040 con 0x7f7dd40c11f0 2023-10-06T04:38:10.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.922+0000 7f7ddae16700 1 -- 172.21.15.8:0/2997679333 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd40ca810 con 0x7f7dd40c11f0 2023-10-06T04:38:10.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.923+0000 7f7dd0ff9700 1 -- 172.21.15.8:0/2997679333 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7dc4013d10 con 0x7f7dd40c11f0 2023-10-06T04:38:10.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.923+0000 7f7dd0ff9700 1 --2- 172.21.15.8:0/2997679333 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7dc0066f30 0x7f7dc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:10.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.923+0000 7f7dd0ff9700 1 -- 172.21.15.8:0/2997679333 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f7dc4084140 con 0x7f7dd40c11f0 2023-10-06T04:38:10.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.923+0000 7f7dd8bb2700 1 --2- 172.21.15.8:0/2997679333 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7dc0066f30 0x7f7dc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:10.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.924+0000 7f7dd8bb2700 1 --2- 172.21.15.8:0/2997679333 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7dc0066f30 0x7f7dc00693e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00afd0 tx=0x7f7dcc01a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:10.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:10.927+0000 7f7dd0ff9700 1 -- 172.21.15.8:0/2997679333 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7dc40513b0 con 0x7f7dd40c11f0 2023-10-06T04:38:11.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.122+0000 7f7ddae16700 1 -- 172.21.15.8:0/2997679333 --> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f7dd4071550 con 0x7f7dc0066f30 2023-10-06T04:38:11.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.122+0000 7f7dd0ff9700 1 -- 172.21.15.8:0/2997679333 <== mgr.4105 v2:172.21.15.184:6832/90283 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7dd4071550 con 0x7f7dc0066f30 2023-10-06T04:38:11.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.124+0000 7f7ddae16700 1 -- 172.21.15.8:0/2997679333 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7dc0066f30 msgr2=0x7f7dc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:11.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.124+0000 7f7ddae16700 1 --2- 172.21.15.8:0/2997679333 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7dc0066f30 0x7f7dc00693e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00afd0 tx=0x7f7dcc01a000 comp rx=0 tx=0).stop 2023-10-06T04:38:11.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.124+0000 7f7ddae16700 1 -- 172.21.15.8:0/2997679333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7dd40c11f0 msgr2=0x7f7dd4069190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:11.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.124+0000 7f7ddae16700 1 --2- 172.21.15.8:0/2997679333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7dd40c11f0 0x7f7dd4069190 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7dd406f4b0 tx=0x7f7dc4009040 comp rx=0 tx=0).stop 2023-10-06T04:38:11.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.124+0000 7f7ddae16700 1 -- 172.21.15.8:0/2997679333 shutdown_connections 2023-10-06T04:38:11.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.124+0000 7f7ddae16700 1 --2- 172.21.15.8:0/2997679333 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f7dc0066f30 0x7f7dc00693e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:11.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.124+0000 7f7ddae16700 1 --2- 172.21.15.8:0/2997679333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7dd40c11f0 0x7f7dd4069190 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:11.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.124+0000 7f7ddae16700 1 --2- 172.21.15.8:0/2997679333 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7dbc003a60 0x7f7dd416ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:11.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.124+0000 7f7ddae16700 1 --2- 172.21.15.8:0/2997679333 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7dd416a920 0x7f7dd4150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:11.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.124+0000 7f7ddae16700 1 -- 172.21.15.8:0/2997679333 >> 172.21.15.8:0/2997679333 conn(0x7f7dd40ce200 msgr2=0x7f7dd4152ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:11.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.125+0000 7f7ddae16700 1 -- 172.21.15.8:0/2997679333 shutdown_connections 2023-10-06T04:38:11.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.125+0000 7f7ddae16700 1 -- 172.21.15.8:0/2997679333 wait complete. 2023-10-06T04:38:11.129 INFO:teuthology.orchestra.run.smithi008.stderr:instructed osd(s) 6 to deep-scrub 2023-10-06T04:38:11.139 INFO:tasks.ceph:Scrubbing osd.7 2023-10-06T04:38:11.139 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:38:11.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.260+0000 7ff462d41700 1 Processor -- start 2023-10-06T04:38:11.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.260+0000 7ff462d41700 1 -- start start 2023-10-06T04:38:11.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.261+0000 7ff462d41700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff45c0af5a0 0x7ff45c15d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:11.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.261+0000 7ff462d41700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff45c0af970 0x7ff45c15a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:11.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.261+0000 7ff462d41700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff45c15e2b0 con 0x7ff45c0ccb00 2023-10-06T04:38:11.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.261+0000 7ff462d41700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff45c15ada0 con 0x7ff45c0af5a0 2023-10-06T04:38:11.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.261+0000 7ff462d41700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c0ce800 con 0x7ff45c0af970 2023-10-06T04:38:11.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.261+0000 7ff460add700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff45c0af5a0 0x7ff45c15d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:11.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.261+0000 7ff4612de700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ff45c0ccb00 0x7ff45c0ccf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:47002/0 (socket says 172.21.15.8:47002) 2023-10-06T04:38:11.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.261+0000 7ff4612de700 1 -- 172.21.15.8:0/2063793891 learned_addr learned my addr 172.21.15.8:0/2063793891 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:38:11.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.261+0000 7ff460add700 1 -- 172.21.15.8:0/2063793891 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff45c0af970 msgr2=0x7ff45c15a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:11.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.261+0000 7ff45bfff700 1 --2- 172.21.15.8:0/2063793891 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff45c0af970 0x7ff45c15a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:11.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.261+0000 7ff460add700 1 --2- 172.21.15.8:0/2063793891 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff45c0af970 0x7ff45c15a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:11.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.261+0000 7ff45b7fe700 1 -- 172.21.15.8:0/2063793891 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4042221858 0 0) 0x7ff45c15e2b0 con 0x7ff45c0ccb00 2023-10-06T04:38:11.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.261+0000 7ff460add700 1 -- 172.21.15.8:0/2063793891 >> v1:172.21.15.8:6789/0 conn(0x7ff45c0ccb00 legacy=0x7ff45c0ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:11.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.261+0000 7ff460add700 1 -- 172.21.15.8:0/2063793891 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45c15da10 con 0x7ff45c0af5a0 2023-10-06T04:38:11.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.261+0000 7ff45bfff700 1 --2- 172.21.15.8:0/2063793891 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff45c0af970 0x7ff45c15a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:38:11.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.261+0000 7ff460add700 1 --2- 172.21.15.8:0/2063793891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff45c0af5a0 0x7ff45c15d330 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ff4500098e0 tx=0x7ff4500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9209fbab52da824 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:11.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.261+0000 7ff45b7fe700 1 -- 172.21.15.8:0/2063793891 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff450009e80 con 0x7ff45c0af5a0 2023-10-06T04:38:11.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.262+0000 7ff45b7fe700 1 -- 172.21.15.8:0/2063793891 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff45000b860 con 0x7ff45c0af5a0 2023-10-06T04:38:11.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.262+0000 7ff45b7fe700 1 -- 172.21.15.8:0/2063793891 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45000bbe0 con 0x7ff45c0af5a0 2023-10-06T04:38:11.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.262+0000 7ff462d41700 1 -- 172.21.15.8:0/2063793891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff45c0af5a0 msgr2=0x7ff45c15d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:11.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.262+0000 7ff462d41700 1 --2- 172.21.15.8:0/2063793891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff45c0af5a0 0x7ff45c15d330 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ff4500098e0 tx=0x7ff4500091a0 comp rx=0 tx=0).stop 2023-10-06T04:38:11.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.262+0000 7ff462d41700 1 -- 172.21.15.8:0/2063793891 shutdown_connections 2023-10-06T04:38:11.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.262+0000 7ff462d41700 1 --2- 172.21.15.8:0/2063793891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff45c0af5a0 0x7ff45c15d330 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:11.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.262+0000 7ff462d41700 1 --2- 172.21.15.8:0/2063793891 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff45c0af970 0x7ff45c15a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:11.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.262+0000 7ff462d41700 1 -- 172.21.15.8:0/2063793891 >> 172.21.15.8:0/2063793891 conn(0x7ff45c06ed00 msgr2=0x7ff45c06f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:11.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.262+0000 7ff462d41700 1 -- 172.21.15.8:0/2063793891 shutdown_connections 2023-10-06T04:38:11.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.262+0000 7ff462d41700 1 -- 172.21.15.8:0/2063793891 wait complete. 2023-10-06T04:38:11.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.263+0000 7ff462d41700 1 Processor -- start 2023-10-06T04:38:11.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.263+0000 7ff462d41700 1 -- start start 2023-10-06T04:38:11.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.264+0000 7ff462d41700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff45c0af5a0 0x7ff45c0ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:11.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.264+0000 7ff462d41700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff45c0af970 0x7ff45c0b4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:11.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.264+0000 7ff462d41700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff45c0ccb00 0x7ff45c0c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:11.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.264+0000 7ff462d41700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c0b4e70 con 0x7ff45c0af970 2023-10-06T04:38:11.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.264+0000 7ff462d41700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c0b5150 con 0x7ff45c0ccb00 2023-10-06T04:38:11.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.264+0000 7ff462d41700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c0b5430 con 0x7ff45c0af5a0 2023-10-06T04:38:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.264+0000 7ff45bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff45c0af970 0x7ff45c0b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.264+0000 7ff45bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff45c0af970 0x7ff45c0b4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38648/0 (socket says 172.21.15.8:38648) 2023-10-06T04:38:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.264+0000 7ff45bfff700 1 -- 172.21.15.8:0/3573324816 learned_addr learned my addr 172.21.15.8:0/3573324816 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.264+0000 7ff460add700 1 --2- 172.21.15.8:0/3573324816 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff45c0af5a0 0x7ff45c0ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.264+0000 7ff4612de700 1 --2- 172.21.15.8:0/3573324816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff45c0ccb00 0x7ff45c0c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.264+0000 7ff45bfff700 1 -- 172.21.15.8:0/3573324816 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff45c0af5a0 msgr2=0x7ff45c0ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.265+0000 7ff45bfff700 1 --2- 172.21.15.8:0/3573324816 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff45c0af5a0 0x7ff45c0ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.265+0000 7ff45bfff700 1 -- 172.21.15.8:0/3573324816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff45c0ccb00 msgr2=0x7ff45c0c5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.265+0000 7ff45bfff700 1 --2- 172.21.15.8:0/3573324816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff45c0ccb00 0x7ff45c0c5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.265+0000 7ff45bfff700 1 -- 172.21.15.8:0/3573324816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff450009420 con 0x7ff45c0af970 2023-10-06T04:38:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.265+0000 7ff45bfff700 1 --2- 172.21.15.8:0/3573324816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff45c0af970 0x7ff45c0b4620 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff44800c830 tx=0x7ff448008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.265+0000 7ff458ff9700 1 -- 172.21.15.8:0/3573324816 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff448011600 con 0x7ff45c0af970 2023-10-06T04:38:11.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.265+0000 7ff458ff9700 1 -- 172.21.15.8:0/3573324816 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff448011760 con 0x7ff45c0af970 2023-10-06T04:38:11.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.265+0000 7ff462d41700 1 -- 172.21.15.8:0/3573324816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff45c0b5710 con 0x7ff45c0af970 2023-10-06T04:38:11.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.265+0000 7ff458ff9700 1 -- 172.21.15.8:0/3573324816 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff448011b20 con 0x7ff45c0af970 2023-10-06T04:38:11.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.265+0000 7ff462d41700 1 -- 172.21.15.8:0/3573324816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff45c0b4b60 con 0x7ff45c0af970 2023-10-06T04:38:11.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.266+0000 7ff462d41700 1 -- 172.21.15.8:0/3573324816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff45c071550 con 0x7ff45c0af970 2023-10-06T04:38:11.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.266+0000 7ff458ff9700 1 -- 172.21.15.8:0/3573324816 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff448018360 con 0x7ff45c0af970 2023-10-06T04:38:11.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.267+0000 7ff458ff9700 1 --2- 172.21.15.8:0/3573324816 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff440066f30 0x7ff4400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:11.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.267+0000 7ff458ff9700 1 -- 172.21.15.8:0/3573324816 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5698+0+0 (secure 0 0 0) 0x7ff448084600 con 0x7ff45c0af970 2023-10-06T04:38:11.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.267+0000 7ff458ff9700 1 --2- 172.21.15.8:0/3573324816 >> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] conn(0x7ff44006d8f0 0x7ff44006fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:11.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.267+0000 7ff458ff9700 1 -- 172.21.15.8:0/3573324816 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff4400703f0 con 0x7ff44006d8f0 2023-10-06T04:38:11.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.267+0000 7ff460add700 1 --2- 172.21.15.8:0/3573324816 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff440066f30 0x7ff4400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:11.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.267+0000 7ff458ff9700 1 -- 172.21.15.8:0/3573324816 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff448086b60 con 0x7ff45c0af970 2023-10-06T04:38:11.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.267+0000 7ff4612de700 1 --2- 172.21.15.8:0/3573324816 >> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] conn(0x7ff44006d8f0 0x7ff44006fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:11.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.267+0000 7ff460add700 1 --2- 172.21.15.8:0/3573324816 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff440066f30 0x7ff4400693e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff4500091e0 tx=0x7ff450017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:11.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.268+0000 7ff4612de700 1 --2- 172.21.15.8:0/3573324816 >> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] conn(0x7ff44006d8f0 0x7ff44006fd20 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:11.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.268+0000 7ff458ff9700 1 -- 172.21.15.8:0/3573324816 <== osd.7 v2:172.21.15.184:6808/90869 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7ff4400703f0 con 0x7ff44006d8f0 2023-10-06T04:38:11.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.282+0000 7ff462d41700 1 -- 172.21.15.8:0/3573324816 --> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff45c15dcf0 con 0x7ff44006d8f0 2023-10-06T04:38:11.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.283+0000 7ff458ff9700 1 -- 172.21.15.8:0/3573324816 <== osd.7 v2:172.21.15.184:6808/90869 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff45c15dcf0 con 0x7ff44006d8f0 2023-10-06T04:38:11.285 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T04:38:11.285 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:38:11.285 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T04:38:11.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.283+0000 7ff462d41700 1 -- 172.21.15.8:0/3573324816 >> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] conn(0x7ff44006d8f0 msgr2=0x7ff44006fd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:11.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.283+0000 7ff462d41700 1 --2- 172.21.15.8:0/3573324816 >> [v2:172.21.15.184:6808/90869,v1:172.21.15.184:6809/90869] conn(0x7ff44006d8f0 0x7ff44006fd20 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:11.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.283+0000 7ff462d41700 1 -- 172.21.15.8:0/3573324816 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff440066f30 msgr2=0x7ff4400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:11.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.283+0000 7ff462d41700 1 --2- 172.21.15.8:0/3573324816 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7ff440066f30 0x7ff4400693e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff4500091e0 tx=0x7ff450017000 comp rx=0 tx=0).stop 2023-10-06T04:38:11.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.283+0000 7ff462d41700 1 -- 172.21.15.8:0/3573324816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff45c0af970 msgr2=0x7ff45c0b4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:11.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.283+0000 7ff462d41700 1 --2- 172.21.15.8:0/3573324816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff45c0af970 0x7ff45c0b4620 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff44800c830 tx=0x7ff448008040 comp rx=0 tx=0).stop 2023-10-06T04:38:11.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.283+0000 7ff4612de700 1 -- 172.21.15.8:0/3573324816 reap_dead start 2023-10-06T04:38:11.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.283+0000 7ff462d41700 1 -- 172.21.15.8:0/3573324816 shutdown_connections 2023-10-06T04:38:11.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.283+0000 7ff462d41700 1 -- 172.21.15.8:0/3573324816 >> 172.21.15.8:0/3573324816 conn(0x7ff45c06ed00 msgr2=0x7ff45c159d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:11.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.283+0000 7ff462d41700 1 -- 172.21.15.8:0/3573324816 shutdown_connections 2023-10-06T04:38:11.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.283+0000 7ff462d41700 1 -- 172.21.15.8:0/3573324816 wait complete. 2023-10-06T04:38:11.297 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-06T04:38:11.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.414+0000 7fd3148f7700 1 Processor -- start 2023-10-06T04:38:11.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.414+0000 7fd3148f7700 1 -- start start 2023-10-06T04:38:11.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.415+0000 7fd3148f7700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd310156e30 0x7fd3100cf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:11.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.415+0000 7fd3148f7700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd3100b1c70 0x7fd3100b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:11.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.415+0000 7fd3148f7700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3100b2620 con 0x7fd31015ad80 2023-10-06T04:38:11.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.415+0000 7fd3148f7700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3100cf370 con 0x7fd310156e30 2023-10-06T04:38:11.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.415+0000 7fd3148f7700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3100ce800 con 0x7fd3100b1c70 2023-10-06T04:38:11.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.415+0000 7fd30ed9d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd310156e30 0x7fd3100cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:11.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.415+0000 7fd30ed9d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd310156e30 0x7fd3100cf800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38660/0 (socket says 172.21.15.8:38660) 2023-10-06T04:38:11.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.415+0000 7fd30ed9d700 1 -- 172.21.15.8:0/2163191878 learned_addr learned my addr 172.21.15.8:0/2163191878 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:11.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.415+0000 7fd30e59c700 1 --2- 172.21.15.8:0/2163191878 >> v2:172.21.15.184:3300/0 conn(0x7fd3100b1c70 0x7fd3100b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:11.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.415+0000 7fd30ed9d700 1 -- 172.21.15.8:0/2163191878 >> v2:172.21.15.184:3300/0 conn(0x7fd3100b1c70 msgr2=0x7fd3100b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:11.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.415+0000 7fd30ed9d700 1 --2- 172.21.15.8:0/2163191878 >> v2:172.21.15.184:3300/0 conn(0x7fd3100b1c70 0x7fd3100b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:11.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.415+0000 7fd30ed9d700 1 -- 172.21.15.8:0/2163191878 >> v1:172.21.15.184:6789/0 conn(0x7fd31015ad80 legacy=0x7fd31015b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:11.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.415+0000 7fd30ed9d700 1 -- 172.21.15.8:0/2163191878 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3100cea60 con 0x7fd310156e30 2023-10-06T04:38:11.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.415+0000 7fd30ed9d700 1 --2- 172.21.15.8:0/2163191878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd310156e30 0x7fd3100cf800 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fd310067f30 tx=0x7fd300009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c7162061e271a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:11.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.416+0000 7fd30dd9b700 1 -- 172.21.15.8:0/2163191878 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30000e070 con 0x7fd310156e30 2023-10-06T04:38:11.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.416+0000 7fd30dd9b700 1 -- 172.21.15.8:0/2163191878 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30000ba20 con 0x7fd310156e30 2023-10-06T04:38:11.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.416+0000 7fd30dd9b700 1 -- 172.21.15.8:0/2163191878 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3000092e0 con 0x7fd310156e30 2023-10-06T04:38:11.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.416+0000 7fd3148f7700 1 -- 172.21.15.8:0/2163191878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd310156e30 msgr2=0x7fd3100cf800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:11.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.416+0000 7fd3148f7700 1 --2- 172.21.15.8:0/2163191878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd310156e30 0x7fd3100cf800 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fd310067f30 tx=0x7fd300009840 comp rx=0 tx=0).stop 2023-10-06T04:38:11.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.416+0000 7fd3148f7700 1 -- 172.21.15.8:0/2163191878 shutdown_connections 2023-10-06T04:38:11.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.416+0000 7fd3148f7700 1 --2- 172.21.15.8:0/2163191878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd310156e30 0x7fd3100cf800 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:11.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.416+0000 7fd3148f7700 1 --2- 172.21.15.8:0/2163191878 >> v2:172.21.15.184:3300/0 conn(0x7fd3100b1c70 0x7fd3100b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:11.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.416+0000 7fd3148f7700 1 -- 172.21.15.8:0/2163191878 >> 172.21.15.8:0/2163191878 conn(0x7fd31006ed00 msgr2=0x7fd31006f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:11.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.416+0000 7fd3148f7700 1 -- 172.21.15.8:0/2163191878 shutdown_connections 2023-10-06T04:38:11.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.416+0000 7fd3148f7700 1 -- 172.21.15.8:0/2163191878 wait complete. 2023-10-06T04:38:11.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.418+0000 7fd3148f7700 1 Processor -- start 2023-10-06T04:38:11.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.418+0000 7fd3148f7700 1 -- start start 2023-10-06T04:38:11.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.418+0000 7fd3148f7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3100b1c70 0x7fd310154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:11.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.418+0000 7fd3148f7700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd310156e30 0x7fd31016cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:11.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.418+0000 7fd3148f7700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd31015ad80 0x7fd310155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:11.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.418+0000 7fd3148f7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3101554c0 con 0x7fd3100b1c70 2023-10-06T04:38:11.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.418+0000 7fd3148f7700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3100b5480 con 0x7fd310156e30 2023-10-06T04:38:11.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.418+0000 7fd3148f7700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3100a94a0 con 0x7fd31015ad80 2023-10-06T04:38:11.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.418+0000 7fd30ed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3100b1c70 0x7fd310154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:11.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.418+0000 7fd30ed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3100b1c70 0x7fd310154f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38672/0 (socket says 172.21.15.8:38672) 2023-10-06T04:38:11.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.418+0000 7fd30ed9d700 1 -- 172.21.15.8:0/490393645 learned_addr learned my addr 172.21.15.8:0/490393645 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:11.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.419+0000 7fd30ed9d700 1 -- 172.21.15.8:0/490393645 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd31015ad80 msgr2=0x7fd310155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:11.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.419+0000 7fd30ed9d700 1 --2- 172.21.15.8:0/490393645 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd31015ad80 0x7fd310155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:11.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.419+0000 7fd30ed9d700 1 -- 172.21.15.8:0/490393645 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd310156e30 msgr2=0x7fd31016cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:11.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.419+0000 7fd30e59c700 1 --2- 172.21.15.8:0/490393645 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd310156e30 0x7fd31016cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:11.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.419+0000 7fd30ed9d700 1 --2- 172.21.15.8:0/490393645 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd310156e30 0x7fd31016cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:11.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.419+0000 7fd30ed9d700 1 -- 172.21.15.8:0/490393645 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd300009ae0 con 0x7fd3100b1c70 2023-10-06T04:38:11.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.419+0000 7fd30ed9d700 1 --2- 172.21.15.8:0/490393645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3100b1c70 0x7fd310154f80 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fd310067f00 tx=0x7fd300018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:11.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.419+0000 7fd306ffd700 1 -- 172.21.15.8:0/490393645 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd300008a80 con 0x7fd3100b1c70 2023-10-06T04:38:11.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.419+0000 7fd306ffd700 1 -- 172.21.15.8:0/490393645 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd300008c00 con 0x7fd3100b1c70 2023-10-06T04:38:11.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.419+0000 7fd3148f7700 1 -- 172.21.15.8:0/490393645 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd31016cff0 con 0x7fd3100b1c70 2023-10-06T04:38:11.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.419+0000 7fd306ffd700 1 -- 172.21.15.8:0/490393645 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd300026460 con 0x7fd3100b1c70 2023-10-06T04:38:11.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.419+0000 7fd3148f7700 1 -- 172.21.15.8:0/490393645 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3100a8b70 con 0x7fd3100b1c70 2023-10-06T04:38:11.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.420+0000 7fd3148f7700 1 -- 172.21.15.8:0/490393645 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd31004c380 con 0x7fd3100b1c70 2023-10-06T04:38:11.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.420+0000 7fd306ffd700 1 -- 172.21.15.8:0/490393645 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd300003040 con 0x7fd3100b1c70 2023-10-06T04:38:11.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.421+0000 7fd306ffd700 1 --2- 172.21.15.8:0/490393645 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd2f0066f30 0x7fd2f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:11.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.421+0000 7fd306ffd700 1 -- 172.21.15.8:0/490393645 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fd300086420 con 0x7fd3100b1c70 2023-10-06T04:38:11.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.421+0000 7fd30e59c700 1 --2- 172.21.15.8:0/490393645 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd2f0066f30 0x7fd2f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:11.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.422+0000 7fd30e59c700 1 --2- 172.21.15.8:0/490393645 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd2f0066f30 0x7fd2f00693e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd2f80093f0 tx=0x7fd2f8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:11.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.425+0000 7fd306ffd700 1 -- 172.21.15.8:0/490393645 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd3000536a0 con 0x7fd3100b1c70 2023-10-06T04:38:11.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.617+0000 7fd3148f7700 1 -- 172.21.15.8:0/490393645 --> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fd310159780 con 0x7fd2f0066f30 2023-10-06T04:38:11.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.618+0000 7fd306ffd700 1 -- 172.21.15.8:0/490393645 <== mgr.4105 v2:172.21.15.184:6832/90283 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd310159780 con 0x7fd2f0066f30 2023-10-06T04:38:11.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.620+0000 7fd3148f7700 1 -- 172.21.15.8:0/490393645 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd2f0066f30 msgr2=0x7fd2f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:11.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.620+0000 7fd3148f7700 1 --2- 172.21.15.8:0/490393645 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd2f0066f30 0x7fd2f00693e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd2f80093f0 tx=0x7fd2f8008040 comp rx=0 tx=0).stop 2023-10-06T04:38:11.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.620+0000 7fd3148f7700 1 -- 172.21.15.8:0/490393645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3100b1c70 msgr2=0x7fd310154f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:11.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.620+0000 7fd3148f7700 1 --2- 172.21.15.8:0/490393645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3100b1c70 0x7fd310154f80 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fd310067f00 tx=0x7fd300018000 comp rx=0 tx=0).stop 2023-10-06T04:38:11.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.620+0000 7fd3148f7700 1 -- 172.21.15.8:0/490393645 shutdown_connections 2023-10-06T04:38:11.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.620+0000 7fd3148f7700 1 --2- 172.21.15.8:0/490393645 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7fd2f0066f30 0x7fd2f00693e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:11.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.620+0000 7fd3148f7700 1 --2- 172.21.15.8:0/490393645 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd31015ad80 0x7fd310155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:11.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.620+0000 7fd3148f7700 1 --2- 172.21.15.8:0/490393645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd3100b1c70 0x7fd310154f80 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:11.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.620+0000 7fd3148f7700 1 --2- 172.21.15.8:0/490393645 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd310156e30 0x7fd31016cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:11.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.620+0000 7fd3148f7700 1 -- 172.21.15.8:0/490393645 >> 172.21.15.8:0/490393645 conn(0x7fd31006ed00 msgr2=0x7fd310153db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:11.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.620+0000 7fd3148f7700 1 -- 172.21.15.8:0/490393645 shutdown_connections 2023-10-06T04:38:11.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.620+0000 7fd3148f7700 1 -- 172.21.15.8:0/490393645 wait complete. 2023-10-06T04:38:11.624 INFO:teuthology.orchestra.run.smithi008.stderr:instructed osd(s) 7 to deep-scrub 2023-10-06T04:38:11.635 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:38:11.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.751+0000 7efc6b59e700 1 Processor -- start 2023-10-06T04:38:11.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.751+0000 7efc6b59e700 1 -- start start 2023-10-06T04:38:11.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.752+0000 7efc6b59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc6c157350 0x7efc6c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:11.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.752+0000 7efc6b59e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7efc6c0b3c80 0x7efc6c068df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:11.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.752+0000 7efc6b59e700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc6c15d590 con 0x7efc6c156f80 2023-10-06T04:38:11.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.752+0000 7efc6b59e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc6c15ab20 con 0x7efc6c0b3c80 2023-10-06T04:38:11.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.752+0000 7efc6b59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c15d870 con 0x7efc6c157350 2023-10-06T04:38:11.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.752+0000 7efc6a59c700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7efc6c156f80 0x7efc6c0b3570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:47006/0 (socket says 172.21.15.8:47006) 2023-10-06T04:38:11.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.752+0000 7efc6a59c700 1 -- 172.21.15.8:0/179446229 learned_addr learned my addr 172.21.15.8:0/179446229 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:38:11.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.752+0000 7efc69d9b700 1 --2- 172.21.15.8:0/179446229 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc6c157350 0x7efc6c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:11.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.752+0000 7efc6ad9d700 1 --2- 172.21.15.8:0/179446229 >> v2:172.21.15.184:3300/0 conn(0x7efc6c0b3c80 0x7efc6c068df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:11.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.752+0000 7efc6959a700 1 -- 172.21.15.8:0/179446229 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1470542471 0 0) 0x7efc6c15d590 con 0x7efc6c156f80 2023-10-06T04:38:11.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.752+0000 7efc6959a700 1 -- 172.21.15.8:0/179446229 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc58003570 con 0x7efc6c156f80 2023-10-06T04:38:11.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.752+0000 7efc69d9b700 1 -- 172.21.15.8:0/179446229 >> v2:172.21.15.184:3300/0 conn(0x7efc6c0b3c80 msgr2=0x7efc6c068df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:11.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.752+0000 7efc6959a700 1 -- 172.21.15.8:0/179446229 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 633322332 0 0) 0x7efc58003570 con 0x7efc6c156f80 2023-10-06T04:38:11.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.753+0000 7efc69d9b700 1 --2- 172.21.15.8:0/179446229 >> v2:172.21.15.184:3300/0 conn(0x7efc6c0b3c80 0x7efc6c068df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:11.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.753+0000 7efc69d9b700 1 -- 172.21.15.8:0/179446229 >> v1:172.21.15.8:6789/0 conn(0x7efc6c156f80 legacy=0x7efc6c0b3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:11.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.753+0000 7efc69d9b700 1 -- 172.21.15.8:0/179446229 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6c15db50 con 0x7efc6c157350 2023-10-06T04:38:11.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.753+0000 7efc6ad9d700 1 --2- 172.21.15.8:0/179446229 >> v2:172.21.15.184:3300/0 conn(0x7efc6c0b3c80 0x7efc6c068df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:38:11.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.753+0000 7efc69d9b700 1 --2- 172.21.15.8:0/179446229 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc6c157350 0x7efc6c15a5e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efc540098e0 tx=0x7efc540091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=686c7e2b33ee2cc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:11.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.753+0000 7efc6959a700 1 -- 172.21.15.8:0/179446229 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c0015f0 con 0x7efc6c157350 2023-10-06T04:38:11.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.753+0000 7efc6959a700 1 -- 172.21.15.8:0/179446229 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc54011420 con 0x7efc6c157350 2023-10-06T04:38:11.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.753+0000 7efc6959a700 1 -- 172.21.15.8:0/179446229 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc540117c0 con 0x7efc6c157350 2023-10-06T04:38:11.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.753+0000 7efc6b59e700 1 -- 172.21.15.8:0/179446229 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc6c157350 msgr2=0x7efc6c15a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:11.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.753+0000 7efc6b59e700 1 --2- 172.21.15.8:0/179446229 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc6c157350 0x7efc6c15a5e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efc540098e0 tx=0x7efc540091a0 comp rx=0 tx=0).stop 2023-10-06T04:38:11.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.754+0000 7efc6b59e700 1 -- 172.21.15.8:0/179446229 shutdown_connections 2023-10-06T04:38:11.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.754+0000 7efc6b59e700 1 --2- 172.21.15.8:0/179446229 >> v2:172.21.15.184:3300/0 conn(0x7efc6c0b3c80 0x7efc6c068df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:11.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.754+0000 7efc6b59e700 1 --2- 172.21.15.8:0/179446229 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc6c157350 0x7efc6c15a5e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:11.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.754+0000 7efc6b59e700 1 -- 172.21.15.8:0/179446229 >> 172.21.15.8:0/179446229 conn(0x7efc6c0675d0 msgr2=0x7efc6c0679d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:11.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.754+0000 7efc6b59e700 1 -- 172.21.15.8:0/179446229 shutdown_connections 2023-10-06T04:38:11.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.754+0000 7efc6b59e700 1 -- 172.21.15.8:0/179446229 wait complete. 2023-10-06T04:38:11.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.755+0000 7efc6b59e700 1 Processor -- start 2023-10-06T04:38:11.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.755+0000 7efc6b59e700 1 -- start start 2023-10-06T04:38:11.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.755+0000 7efc6b59e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc6c0b3c80 0x7efc6c158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:11.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.755+0000 7efc6b59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc6c156f80 0x7efc6c0c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:11.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.755+0000 7efc6b59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc6c0c8990 0x7efc6c146900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:11.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.755+0000 7efc6b59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c0c8e10 con 0x7efc6c0c8990 2023-10-06T04:38:11.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.755+0000 7efc6b59e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c153360 con 0x7efc6c0b3c80 2023-10-06T04:38:11.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.755+0000 7efc6b59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c0c9ff0 con 0x7efc6c156f80 2023-10-06T04:38:11.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.755+0000 7efc6ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc6c0c8990 0x7efc6c146900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:11.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.755+0000 7efc6ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc6c0c8990 0x7efc6c146900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38686/0 (socket says 172.21.15.8:38686) 2023-10-06T04:38:11.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.755+0000 7efc6ad9d700 1 -- 172.21.15.8:0/4036798564 learned_addr learned my addr 172.21.15.8:0/4036798564 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:11.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.756+0000 7efc6a59c700 1 --2- 172.21.15.8:0/4036798564 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc6c0b3c80 0x7efc6c158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:11.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.756+0000 7efc6ad9d700 1 -- 172.21.15.8:0/4036798564 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc6c156f80 msgr2=0x7efc6c0c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:11.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.756+0000 7efc6ad9d700 1 --2- 172.21.15.8:0/4036798564 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc6c156f80 0x7efc6c0c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:11.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.756+0000 7efc6ad9d700 1 -- 172.21.15.8:0/4036798564 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc6c0b3c80 msgr2=0x7efc6c158af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:11.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.756+0000 7efc6ad9d700 1 --2- 172.21.15.8:0/4036798564 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc6c0b3c80 0x7efc6c158af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:11.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.756+0000 7efc6ad9d700 1 -- 172.21.15.8:0/4036798564 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc64009a20 con 0x7efc6c0c8990 2023-10-06T04:38:11.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.756+0000 7efc6ad9d700 1 --2- 172.21.15.8:0/4036798564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc6c0c8990 0x7efc6c146900 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7efc64009f40 tx=0x7efc6400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:11.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.756+0000 7efc627fc700 1 -- 172.21.15.8:0/4036798564 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6400ccd0 con 0x7efc6c0c8990 2023-10-06T04:38:11.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.756+0000 7efc627fc700 1 -- 172.21.15.8:0/4036798564 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6400f040 con 0x7efc6c0c8990 2023-10-06T04:38:11.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.756+0000 7efc6b59e700 1 -- 172.21.15.8:0/4036798564 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc54009420 con 0x7efc6c0c8990 2023-10-06T04:38:11.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.756+0000 7efc627fc700 1 -- 172.21.15.8:0/4036798564 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc640146d0 con 0x7efc6c0c8990 2023-10-06T04:38:11.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.756+0000 7efc6b59e700 1 -- 172.21.15.8:0/4036798564 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc6c0ca5b0 con 0x7efc6c0c8990 2023-10-06T04:38:11.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.757+0000 7efc6b59e700 1 -- 172.21.15.8:0/4036798564 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc6c0ca740 con 0x7efc6c0c8990 2023-10-06T04:38:11.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.757+0000 7efc627fc700 1 -- 172.21.15.8:0/4036798564 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efc64003020 con 0x7efc6c0c8990 2023-10-06T04:38:11.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.758+0000 7efc627fc700 1 --2- 172.21.15.8:0/4036798564 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7efc4c066f30 0x7efc4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:11.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.758+0000 7efc627fc700 1 -- 172.21.15.8:0/4036798564 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5698+0+0 (secure 0 0 0) 0x7efc64084fb0 con 0x7efc6c0c8990 2023-10-06T04:38:11.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.758+0000 7efc6a59c700 1 --2- 172.21.15.8:0/4036798564 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7efc4c066f30 0x7efc4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:11.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.759+0000 7efc6a59c700 1 --2- 172.21.15.8:0/4036798564 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7efc4c066f30 0x7efc4c0693e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7efc5c007af0 tx=0x7efc5c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:11.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.762+0000 7efc627fc700 1 -- 172.21.15.8:0/4036798564 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efc64052180 con 0x7efc6c0c8990 2023-10-06T04:38:11.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.950+0000 7efc6b59e700 1 -- 172.21.15.8:0/4036798564 --> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efc6c0c93d0 con 0x7efc4c066f30 2023-10-06T04:38:11.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.953+0000 7efc627fc700 1 -- 172.21.15.8:0/4036798564 <== mgr.4105 v2:172.21.15.184:6832/90283 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73832 (secure 0 0 0) 0x7efc6c0c93d0 con 0x7efc4c066f30 2023-10-06T04:38:11.956 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:38:11.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.955+0000 7efc6b59e700 1 -- 172.21.15.8:0/4036798564 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7efc4c066f30 msgr2=0x7efc4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:11.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.955+0000 7efc6b59e700 1 --2- 172.21.15.8:0/4036798564 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7efc4c066f30 0x7efc4c0693e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7efc5c007af0 tx=0x7efc5c009040 comp rx=0 tx=0).stop 2023-10-06T04:38:11.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.955+0000 7efc6b59e700 1 -- 172.21.15.8:0/4036798564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc6c0c8990 msgr2=0x7efc6c146900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:11.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.955+0000 7efc6b59e700 1 --2- 172.21.15.8:0/4036798564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc6c0c8990 0x7efc6c146900 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7efc64009f40 tx=0x7efc6400b040 comp rx=0 tx=0).stop 2023-10-06T04:38:11.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.955+0000 7efc6b59e700 1 -- 172.21.15.8:0/4036798564 shutdown_connections 2023-10-06T04:38:11.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.955+0000 7efc6b59e700 1 --2- 172.21.15.8:0/4036798564 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7efc4c066f30 0x7efc4c0693e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:11.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.955+0000 7efc6b59e700 1 --2- 172.21.15.8:0/4036798564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc6c0c8990 0x7efc6c146900 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:11.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.955+0000 7efc6b59e700 1 --2- 172.21.15.8:0/4036798564 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc6c0b3c80 0x7efc6c158af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:11.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.955+0000 7efc6b59e700 1 --2- 172.21.15.8:0/4036798564 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc6c156f80 0x7efc6c0c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:11.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.955+0000 7efc6b59e700 1 -- 172.21.15.8:0/4036798564 >> 172.21.15.8:0/4036798564 conn(0x7efc6c0675d0 msgr2=0x7efc6c15b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:11.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.955+0000 7efc6b59e700 1 -- 172.21.15.8:0/4036798564 shutdown_connections 2023-10-06T04:38:11.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:11.955+0000 7efc6b59e700 1 -- 172.21.15.8:0/4036798564 wait complete. 2023-10-06T04:38:11.959 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-06T04:38:11.969 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2023-10-06T04:38:10.659012+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384124,"kb_used_data":5820,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752590596,"statfs":{"total":773094113280,"available":770652770304,"internally_reserved":0,"allocated":5959680,"data_stored":3404042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6291456,"num_objects":-2,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":-16,"num_read_kb":-9,"num_write":-8,"num_write_kb":-6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.472309"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":41,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T04:38:01.190283+0000","last_change":"2023-10-06T04:36:11.192215+0000","last_active":"2023-10-06T04:38:01.190283+0000","last_peered":"2023-10-06T04:38:01.190283+0000","last_clean":"2023-10-06T04:38:01.190283+0000","last_became_active":"2023-10-06T04:36:11.191953+0000","last_became_peered":"2023-10-06T04:36:11.191953+0000","last_unstale":"2023-10-06T04:38:01.190283+0000","last_undegraded":"2023-10-06T04:38:01.190283+0000","last_fullsized":"2023-10-06T04:38:01.190283+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:37.026121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":39,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:38:02.187167+0000","last_change":"2023-10-06T04:36:11.184555+0000","last_active":"2023-10-06T04:38:02.187167+0000","last_peered":"2023-10-06T04:38:02.187167+0000","last_clean":"2023-10-06T04:38:02.187167+0000","last_became_active":"2023-10-06T04:36:11.184229+0000","last_became_peered":"2023-10-06T04:36:11.184229+0000","last_unstale":"2023-10-06T04:38:02.187167+0000","last_undegraded":"2023-10-06T04:38:02.187167+0000","last_fullsized":"2023-10-06T04:38:02.187167+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":38,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:38:02.332762+0000","last_change":"2023-10-06T04:36:11.184460+0000","last_active":"2023-10-06T04:38:02.332762+0000","last_peered":"2023-10-06T04:38:02.332762+0000","last_clean":"2023-10-06T04:38:02.332762+0000","last_became_active":"2023-10-06T04:36:11.184119+0000","last_became_peered":"2023-10-06T04:36:11.184119+0000","last_unstale":"2023-10-06T04:38:02.332762+0000","last_undegraded":"2023-10-06T04:38:02.332762+0000","last_fullsized":"2023-10-06T04:38:02.332762+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":185,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T04:38:01.418137+0000","last_change":"2023-10-06T04:36:12.183155+0000","last_active":"2023-10-06T04:38:01.418137+0000","last_peered":"2023-10-06T04:38:01.418137+0000","last_clean":"2023-10-06T04:38:01.418137+0000","last_became_active":"2023-10-06T04:36:12.182903+0000","last_became_peered":"2023-10-06T04:36:12.182903+0000","last_unstale":"2023-10-06T04:38:01.418137+0000","last_undegraded":"2023-10-06T04:38:01.418137+0000","last_fullsized":"2023-10-06T04:38:01.418137+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:11.171104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:11.171104+0000","last_clean_scrub_stamp":"2023-10-06T04:36:11.171104+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:38:54.323364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":36,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T04:38:01.415844+0000","last_change":"2023-10-06T04:36:11.193056+0000","last_active":"2023-10-06T04:38:01.415844+0000","last_peered":"2023-10-06T04:38:01.415844+0000","last_clean":"2023-10-06T04:38:01.415844+0000","last_became_active":"2023-10-06T04:36:11.192712+0000","last_became_peered":"2023-10-06T04:36:11.192712+0000","last_unstale":"2023-10-06T04:38:01.415844+0000","last_undegraded":"2023-10-06T04:38:01.415844+0000","last_fullsized":"2023-10-06T04:38:01.415844+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:00.008654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":36,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T04:38:01.418068+0000","last_change":"2023-10-06T04:36:11.192701+0000","last_active":"2023-10-06T04:38:01.418068+0000","last_peered":"2023-10-06T04:38:01.418068+0000","last_clean":"2023-10-06T04:38:01.418068+0000","last_became_active":"2023-10-06T04:36:11.192335+0000","last_became_peered":"2023-10-06T04:36:11.192335+0000","last_unstale":"2023-10-06T04:38:01.418068+0000","last_undegraded":"2023-10-06T04:38:01.418068+0000","last_fullsized":"2023-10-06T04:38:01.418068+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:18.643570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":37,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T04:38:01.417552+0000","last_change":"2023-10-06T04:36:11.193497+0000","last_active":"2023-10-06T04:38:01.417552+0000","last_peered":"2023-10-06T04:38:01.417552+0000","last_clean":"2023-10-06T04:38:01.417552+0000","last_became_active":"2023-10-06T04:36:11.193215+0000","last_became_peered":"2023-10-06T04:36:11.193215+0000","last_unstale":"2023-10-06T04:38:01.417552+0000","last_undegraded":"2023-10-06T04:38:01.417552+0000","last_fullsized":"2023-10-06T04:38:01.417552+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:07.497987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":35,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T04:38:01.417063+0000","last_change":"2023-10-06T04:36:11.193111+0000","last_active":"2023-10-06T04:38:01.417063+0000","last_peered":"2023-10-06T04:38:01.417063+0000","last_clean":"2023-10-06T04:38:01.417063+0000","last_became_active":"2023-10-06T04:36:11.192836+0000","last_became_peered":"2023-10-06T04:36:11.192836+0000","last_unstale":"2023-10-06T04:38:01.417063+0000","last_undegraded":"2023-10-06T04:38:01.417063+0000","last_fullsized":"2023-10-06T04:38:01.417063+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:19.938716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":35,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T04:38:01.415890+0000","last_change":"2023-10-06T04:36:11.182804+0000","last_active":"2023-10-06T04:38:01.415890+0000","last_peered":"2023-10-06T04:38:01.415890+0000","last_clean":"2023-10-06T04:38:01.415890+0000","last_became_active":"2023-10-06T04:36:11.182575+0000","last_became_peered":"2023-10-06T04:36:11.182575+0000","last_unstale":"2023-10-06T04:38:01.415890+0000","last_undegraded":"2023-10-06T04:38:01.415890+0000","last_fullsized":"2023-10-06T04:38:01.415890+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:36:10.166367+0000","last_clean_scrub_stamp":"2023-10-06T04:36:10.166367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:07.497987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298452,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073388,"statfs":{"total":96636764160,"available":96331149312,"internally_reserved":0,"allocated":1191936,"data_stored":868648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.629},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.51200000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.66300000000000003}]},{"osd":2,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.70799999999999996}]},{"osd":3,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.68100000000000005}]},{"osd":4,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.497},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.69299999999999995}]},{"osd":5,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.57199999999999995}]},{"osd":6,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.71999999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":278280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":10.045999999999999,"5min":10.045999999999999,"15min":10.045999999999999},"last":0.53700000000000003}]},{"osd":1,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":10.125999999999999,"5min":10.125999999999999,"15min":10.125999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.55400000000000005}]},{"osd":2,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":10.238,"5min":10.238,"15min":10.238},"last":0.40799999999999997}]},{"osd":3,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":4.4870000000000001,"5min":4.4870000000000001,"15min":4.4870000000000001},"last":0.438},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":10.393000000000001,"5min":10.393000000000001,"15min":10.393000000000001},"last":0.52400000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.34599999999999997}]},{"osd":5,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.38100000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.498}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298452,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073388,"statfs":{"total":96636764160,"available":96331149312,"internally_reserved":0,"allocated":1191936,"data_stored":868648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.437},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.33900000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.35699999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.44700000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.68200000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.74099999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.61899999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.71199999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297868,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073972,"statfs":{"total":96636764160,"available":96331747328,"internally_reserved":0,"allocated":593920,"data_stored":277302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.443,"5min":0.443,"15min":0.443},"last":0.47899999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.34300000000000003}]},{"osd":3,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.66700000000000004}]},{"osd":4,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.624}]},{"osd":5,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.40500000000000003}]},{"osd":6,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.69299999999999995}]},{"osd":7,"last update":"Fri Oct 6 04:37:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.44500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297868,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073972,"statfs":{"total":96636764160,"available":96331747328,"internally_reserved":0,"allocated":593920,"data_stored":277302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.35699999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.433},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.40699999999999997}]},{"osd":3,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.46800000000000003}]},{"osd":4,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.49099999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.373},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.68899999999999995}]},{"osd":6,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.48199999999999998}]},{"osd":7,"last update":"Fri Oct 6 04:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.44600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297868,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073972,"statfs":{"total":96636764160,"available":96331747328,"internally_reserved":0,"allocated":593920,"data_stored":277302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.442,"5min":0.442,"15min":0.442},"last":0.377}]},{"osd":1,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.436,"5min":0.436,"15min":0.436},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.41699999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.39200000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.1070000000000002,"5min":2.1070000000000002,"15min":2.1070000000000002},"last":0.60399999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.66200000000000003}]},{"osd":6,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.71799999999999997}]},{"osd":7,"last update":"Fri Oct 6 04:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.61599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":278280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":4.2919999999999998,"5min":4.2919999999999998,"15min":4.2919999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.52600000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":4.3520000000000003,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":0.56799999999999995}]},{"osd":2,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.42199999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.55000000000000004}]},{"osd":5,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.39900000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.47299999999999998}]},{"osd":7,"last update":"Fri Oct 6 04:37:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.503}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":278280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.40100000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.53900000000000003}]},{"osd":2,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.52200000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.55700000000000005}]},{"osd":4,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.61199999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.621}]},{"osd":7,"last update":"Fri Oct 6 04:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.68999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:38:11.974 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2023-10-06T04:36:10.166367+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=36, tm_sec=10, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=38, tm_sec=6, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:38:11.974 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2023-10-06T04:36:10.166367+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=36, tm_sec=10, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=38, tm_sec=6, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:38:11.974 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2023-10-06T04:36:10.166367+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=36, tm_sec=10, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=38, tm_sec=6, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:38:11.974 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-06T04:36:11.171104+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=36, tm_sec=11, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=38, tm_sec=6, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:38:11.974 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-10-06T04:36:10.166367+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=36, tm_sec=10, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=38, tm_sec=6, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:38:11.974 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-06T04:36:10.166367+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=36, tm_sec=10, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=38, tm_sec=6, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:38:11.975 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-10-06T04:36:10.166367+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=36, tm_sec=10, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=38, tm_sec=6, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:38:11.975 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-10-06T04:36:10.166367+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=36, tm_sec=10, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=38, tm_sec=6, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:38:11.975 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-10-06T04:36:10.166367+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=36, tm_sec=10, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=38, tm_sec=6, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:38:11.975 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-06T04:38:25.286 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:38:25.289 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:38:31.976 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:38:32.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.107+0000 7f8b88a69700 1 Processor -- start 2023-10-06T04:38:32.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.107+0000 7f8b88a69700 1 -- start start 2023-10-06T04:38:32.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.108+0000 7f8b88a69700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b840af680 0x7f8b8415e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:32.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.108+0000 7f8b88a69700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8b840cb360 0x7f8b840d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:32.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.108+0000 7f8b88a69700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b840cc4c0 con 0x7f8b840d08d0 2023-10-06T04:38:32.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.108+0000 7f8b88a69700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b8415d460 con 0x7f8b840cb360 2023-10-06T04:38:32.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.108+0000 7f8b88a69700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b840d0d50 con 0x7f8b840af680 2023-10-06T04:38:32.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.108+0000 7f8b81d9b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8b840cb360 0x7f8b840d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:32.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.108+0000 7f8b81d9b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8b840cb360 0x7f8b840d0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54564/0 (socket says 172.21.15.8:54564) 2023-10-06T04:38:32.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.108+0000 7f8b81d9b700 1 -- 172.21.15.8:0/1271267967 learned_addr learned my addr 172.21.15.8:0/1271267967 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:32.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.109+0000 7f8b8259c700 1 --2- 172.21.15.8:0/1271267967 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b840af680 0x7f8b8415e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:32.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.109+0000 7f8b81d9b700 1 -- 172.21.15.8:0/1271267967 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b840af680 msgr2=0x7f8b8415e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:32.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.109+0000 7f8b81d9b700 1 --2- 172.21.15.8:0/1271267967 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b840af680 0x7f8b8415e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:32.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.109+0000 7f8b81d9b700 1 -- 172.21.15.8:0/1271267967 >> v1:172.21.15.184:6789/0 conn(0x7f8b840d08d0 legacy=0x7f8b840b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:32.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.109+0000 7f8b81d9b700 1 -- 172.21.15.8:0/1271267967 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b8415e580 con 0x7f8b840cb360 2023-10-06T04:38:32.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.109+0000 7f8b81d9b700 1 --2- 172.21.15.8:0/1271267967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b840cb360 0x7f8b840d0390 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0099e0 tx=0x7f8b6c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad47fbb4ec9f2041 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:32.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.109+0000 7f8b8159a700 1 -- 172.21.15.8:0/1271267967 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c00b820 con 0x7f8b840cb360 2023-10-06T04:38:32.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.109+0000 7f8b8159a700 1 -- 172.21.15.8:0/1271267967 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b6c00b980 con 0x7f8b840cb360 2023-10-06T04:38:32.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.109+0000 7f8b8159a700 1 -- 172.21.15.8:0/1271267967 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c00bd20 con 0x7f8b840cb360 2023-10-06T04:38:32.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.110+0000 7f8b88a69700 1 -- 172.21.15.8:0/1271267967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b840cb360 msgr2=0x7f8b840d0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:32.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.110+0000 7f8b88a69700 1 --2- 172.21.15.8:0/1271267967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b840cb360 0x7f8b840d0390 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0099e0 tx=0x7f8b6c009250 comp rx=0 tx=0).stop 2023-10-06T04:38:32.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.110+0000 7f8b88a69700 1 -- 172.21.15.8:0/1271267967 shutdown_connections 2023-10-06T04:38:32.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.110+0000 7f8b88a69700 1 --2- 172.21.15.8:0/1271267967 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b840af680 0x7f8b8415e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:32.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.110+0000 7f8b88a69700 1 --2- 172.21.15.8:0/1271267967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b840cb360 0x7f8b840d0390 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:32.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.110+0000 7f8b88a69700 1 -- 172.21.15.8:0/1271267967 >> 172.21.15.8:0/1271267967 conn(0x7f8b840633d0 msgr2=0x7f8b840637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:32.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.110+0000 7f8b88a69700 1 -- 172.21.15.8:0/1271267967 shutdown_connections 2023-10-06T04:38:32.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.110+0000 7f8b88a69700 1 -- 172.21.15.8:0/1271267967 wait complete. 2023-10-06T04:38:32.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.111+0000 7f8b88a69700 1 Processor -- start 2023-10-06T04:38:32.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.111+0000 7f8b88a69700 1 -- start start 2023-10-06T04:38:32.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.112+0000 7f8b88a69700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b840af680 0x7f8b84149280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:32.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.112+0000 7f8b88a69700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b840cb360 0x7f8b840c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:32.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.112+0000 7f8b88a69700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b840d08d0 0x7f8b8416bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:32.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.112+0000 7f8b88a69700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8416bb60 con 0x7f8b840af680 2023-10-06T04:38:32.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.112+0000 7f8b88a69700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8416af50 con 0x7f8b840d08d0 2023-10-06T04:38:32.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.112+0000 7f8b88a69700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8416b230 con 0x7f8b840cb360 2023-10-06T04:38:32.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.112+0000 7f8b8259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b840af680 0x7f8b84149280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:32.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.112+0000 7f8b8259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b840af680 0x7f8b84149280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54572/0 (socket says 172.21.15.8:54572) 2023-10-06T04:38:32.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.112+0000 7f8b8259c700 1 -- 172.21.15.8:0/478427922 learned_addr learned my addr 172.21.15.8:0/478427922 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:32.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.112+0000 7f8b81d9b700 1 --2- 172.21.15.8:0/478427922 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b840cb360 0x7f8b840c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:32.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.112+0000 7f8b82d9d700 1 --2- 172.21.15.8:0/478427922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b840d08d0 0x7f8b8416bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:32.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.112+0000 7f8b8259c700 1 -- 172.21.15.8:0/478427922 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b840cb360 msgr2=0x7f8b840c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:32.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.112+0000 7f8b8259c700 1 --2- 172.21.15.8:0/478427922 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b840cb360 0x7f8b840c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:32.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.112+0000 7f8b8259c700 1 -- 172.21.15.8:0/478427922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b840d08d0 msgr2=0x7f8b8416bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:32.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.112+0000 7f8b8259c700 1 --2- 172.21.15.8:0/478427922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b840d08d0 0x7f8b8416bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:32.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.112+0000 7f8b8259c700 1 -- 172.21.15.8:0/478427922 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b6c0094f0 con 0x7f8b840af680 2023-10-06T04:38:32.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.112+0000 7f8b8259c700 1 --2- 172.21.15.8:0/478427922 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b840af680 0x7f8b84149280 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f8b7400ec80 tx=0x7f8b740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:32.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.112+0000 7f8b7a7fc700 1 -- 172.21.15.8:0/478427922 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7400c850 con 0x7f8b840af680 2023-10-06T04:38:32.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.112+0000 7f8b7a7fc700 1 -- 172.21.15.8:0/478427922 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b7400c9b0 con 0x7f8b840af680 2023-10-06T04:38:32.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.112+0000 7f8b88a69700 1 -- 172.21.15.8:0/478427922 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b8416b510 con 0x7f8b840af680 2023-10-06T04:38:32.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.112+0000 7f8b7a7fc700 1 -- 172.21.15.8:0/478427922 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7400cd50 con 0x7f8b840af680 2023-10-06T04:38:32.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.112+0000 7f8b88a69700 1 -- 172.21.15.8:0/478427922 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b8416aac0 con 0x7f8b840af680 2023-10-06T04:38:32.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.113+0000 7f8b88a69700 1 -- 172.21.15.8:0/478427922 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b8416be40 con 0x7f8b840af680 2023-10-06T04:38:32.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.114+0000 7f8b7a7fc700 1 -- 172.21.15.8:0/478427922 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8b74013680 con 0x7f8b840af680 2023-10-06T04:38:32.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.114+0000 7f8b7a7fc700 1 --2- 172.21.15.8:0/478427922 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8b64066f30 0x7f8b640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:32.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.114+0000 7f8b7a7fc700 1 -- 172.21.15.8:0/478427922 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f8b740847f0 con 0x7f8b840af680 2023-10-06T04:38:32.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.114+0000 7f8b81d9b700 1 --2- 172.21.15.8:0/478427922 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8b64066f30 0x7f8b640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:32.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.115+0000 7f8b81d9b700 1 --2- 172.21.15.8:0/478427922 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8b64066f30 0x7f8b640693e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0099e0 tx=0x7f8b6c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:32.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.118+0000 7f8b7a7fc700 1 -- 172.21.15.8:0/478427922 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8b74051a60 con 0x7f8b840af680 2023-10-06T04:38:32.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.305+0000 7f8b88a69700 1 -- 172.21.15.8:0/478427922 --> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b8416bca0 con 0x7f8b64066f30 2023-10-06T04:38:32.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.308+0000 7f8b7a7fc700 1 -- 172.21.15.8:0/478427922 <== mgr.4105 v2:172.21.15.184:6832/90283 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73563 (secure 0 0 0) 0x7f8b6c00baf0 con 0x7f8b64066f30 2023-10-06T04:38:32.311 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:38:32.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.310+0000 7f8b88a69700 1 -- 172.21.15.8:0/478427922 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8b64066f30 msgr2=0x7f8b640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:32.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.310+0000 7f8b88a69700 1 --2- 172.21.15.8:0/478427922 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8b64066f30 0x7f8b640693e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0099e0 tx=0x7f8b6c017000 comp rx=0 tx=0).stop 2023-10-06T04:38:32.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.310+0000 7f8b88a69700 1 -- 172.21.15.8:0/478427922 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b840af680 msgr2=0x7f8b84149280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:32.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.310+0000 7f8b88a69700 1 --2- 172.21.15.8:0/478427922 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b840af680 0x7f8b84149280 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f8b7400ec80 tx=0x7f8b740091a0 comp rx=0 tx=0).stop 2023-10-06T04:38:32.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.310+0000 7f8b88a69700 1 -- 172.21.15.8:0/478427922 shutdown_connections 2023-10-06T04:38:32.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.310+0000 7f8b88a69700 1 --2- 172.21.15.8:0/478427922 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f8b64066f30 0x7f8b640693e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:32.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.310+0000 7f8b88a69700 1 --2- 172.21.15.8:0/478427922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b840d08d0 0x7f8b8416bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:32.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.310+0000 7f8b88a69700 1 --2- 172.21.15.8:0/478427922 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b840af680 0x7f8b84149280 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:32.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.310+0000 7f8b88a69700 1 --2- 172.21.15.8:0/478427922 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b840cb360 0x7f8b840c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:32.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.310+0000 7f8b88a69700 1 -- 172.21.15.8:0/478427922 >> 172.21.15.8:0/478427922 conn(0x7f8b840633d0 msgr2=0x7f8b840b05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:32.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.310+0000 7f8b88a69700 1 -- 172.21.15.8:0/478427922 shutdown_connections 2023-10-06T04:38:32.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.310+0000 7f8b88a69700 1 -- 172.21.15.8:0/478427922 wait complete. 2023-10-06T04:38:32.314 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-06T04:38:32.324 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2023-10-06T04:38:30.663458+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384124,"kb_used_data":5820,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752590596,"statfs":{"total":773094113280,"available":770652770304,"internally_reserved":0,"allocated":5959680,"data_stored":3404042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002809"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":52,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:38:11.271803+0000","last_change":"2023-10-06T04:38:11.271776+0000","last_active":"2023-10-06T04:38:11.271803+0000","last_peered":"2023-10-06T04:38:11.271803+0000","last_clean":"2023-10-06T04:38:11.271803+0000","last_became_active":"2023-10-06T04:36:11.191953+0000","last_became_peered":"2023-10-06T04:36:11.191953+0000","last_unstale":"2023-10-06T04:38:11.271803+0000","last_undegraded":"2023-10-06T04:38:11.271803+0000","last_fullsized":"2023-10-06T04:38:11.271803+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:38:11.271681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:38:11.271681+0000","last_clean_scrub_stamp":"2023-10-06T04:38:11.271681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:45:31.631185+0000","scrub_duration":0.001556212,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:38:22.104304+0000","last_change":"2023-10-06T04:38:22.104270+0000","last_active":"2023-10-06T04:38:22.104304+0000","last_peered":"2023-10-06T04:38:22.104304+0000","last_clean":"2023-10-06T04:38:22.104304+0000","last_became_active":"2023-10-06T04:36:11.184229+0000","last_became_peered":"2023-10-06T04:36:11.184229+0000","last_unstale":"2023-10-06T04:38:22.104304+0000","last_undegraded":"2023-10-06T04:38:22.104304+0000","last_fullsized":"2023-10-06T04:38:22.104304+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:38:22.104167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:38:22.104167+0000","last_clean_scrub_stamp":"2023-10-06T04:38:22.104167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:53.556494+0000","scrub_duration":0.0020617970000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":48,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:38:11.893408+0000","last_change":"2023-10-06T04:38:11.893388+0000","last_active":"2023-10-06T04:38:11.893408+0000","last_peered":"2023-10-06T04:38:11.893408+0000","last_clean":"2023-10-06T04:38:11.893408+0000","last_became_active":"2023-10-06T04:36:11.184119+0000","last_became_peered":"2023-10-06T04:36:11.184119+0000","last_unstale":"2023-10-06T04:38:11.893408+0000","last_undegraded":"2023-10-06T04:38:11.893408+0000","last_fullsized":"2023-10-06T04:38:11.893408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:38:11.893311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:38:11.893311+0000","last_clean_scrub_stamp":"2023-10-06T04:38:11.893311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:33.335083+0000","scrub_duration":0.002013305,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"50'119","reported_seq":198,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:38:21.606759+0000","last_change":"2023-10-06T04:38:21.606719+0000","last_active":"2023-10-06T04:38:21.606759+0000","last_peered":"2023-10-06T04:38:21.606759+0000","last_clean":"2023-10-06T04:38:21.606759+0000","last_became_active":"2023-10-06T04:36:12.182903+0000","last_became_peered":"2023-10-06T04:36:12.182903+0000","last_unstale":"2023-10-06T04:38:21.606759+0000","last_undegraded":"2023-10-06T04:38:21.606759+0000","last_fullsized":"2023-10-06T04:38:21.606759+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"50'119","last_scrub_stamp":"2023-10-06T04:38:21.606594+0000","last_deep_scrub":"50'119","last_deep_scrub_stamp":"2023-10-06T04:38:21.606594+0000","last_clean_scrub_stamp":"2023-10-06T04:38:21.606594+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:44.088725+0000","scrub_duration":0.0047420120000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":47,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:38:20.570266+0000","last_change":"2023-10-06T04:38:20.570236+0000","last_active":"2023-10-06T04:38:20.570266+0000","last_peered":"2023-10-06T04:38:20.570266+0000","last_clean":"2023-10-06T04:38:20.570266+0000","last_became_active":"2023-10-06T04:36:11.192712+0000","last_became_peered":"2023-10-06T04:36:11.192712+0000","last_unstale":"2023-10-06T04:38:20.570266+0000","last_undegraded":"2023-10-06T04:38:20.570266+0000","last_fullsized":"2023-10-06T04:38:20.570266+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:38:20.570138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:38:20.570138+0000","last_clean_scrub_stamp":"2023-10-06T04:38:20.570138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:43:58.894027+0000","scrub_duration":0.0020952620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":47,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:38:13.573667+0000","last_change":"2023-10-06T04:38:13.573638+0000","last_active":"2023-10-06T04:38:13.573667+0000","last_peered":"2023-10-06T04:38:13.573667+0000","last_clean":"2023-10-06T04:38:13.573667+0000","last_became_active":"2023-10-06T04:36:11.192335+0000","last_became_peered":"2023-10-06T04:36:11.192335+0000","last_unstale":"2023-10-06T04:38:13.573667+0000","last_undegraded":"2023-10-06T04:38:13.573667+0000","last_fullsized":"2023-10-06T04:38:13.573667+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:38:13.573528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:38:13.573528+0000","last_clean_scrub_stamp":"2023-10-06T04:38:13.573528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:31:24.259294+0000","scrub_duration":0.0021065340000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":48,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:38:12.804498+0000","last_change":"2023-10-06T04:38:12.804473+0000","last_active":"2023-10-06T04:38:12.804498+0000","last_peered":"2023-10-06T04:38:12.804498+0000","last_clean":"2023-10-06T04:38:12.804498+0000","last_became_active":"2023-10-06T04:36:11.193215+0000","last_became_peered":"2023-10-06T04:36:11.193215+0000","last_unstale":"2023-10-06T04:38:12.804498+0000","last_undegraded":"2023-10-06T04:38:12.804498+0000","last_fullsized":"2023-10-06T04:38:12.804498+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:38:12.804372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:38:12.804372+0000","last_clean_scrub_stamp":"2023-10-06T04:38:12.804372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:22:45.544051+0000","scrub_duration":0.0017090989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:38:12.613283+0000","last_change":"2023-10-06T04:38:12.613243+0000","last_active":"2023-10-06T04:38:12.613283+0000","last_peered":"2023-10-06T04:38:12.613283+0000","last_clean":"2023-10-06T04:38:12.613283+0000","last_became_active":"2023-10-06T04:36:11.192836+0000","last_became_peered":"2023-10-06T04:36:11.192836+0000","last_unstale":"2023-10-06T04:38:12.613283+0000","last_undegraded":"2023-10-06T04:38:12.613283+0000","last_fullsized":"2023-10-06T04:38:12.613283+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:38:12.613137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:38:12.613137+0000","last_clean_scrub_stamp":"2023-10-06T04:38:12.613137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:30.547924+0000","scrub_duration":0.0021689600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T04:38:14.558175+0000","last_change":"2023-10-06T04:38:14.558146+0000","last_active":"2023-10-06T04:38:14.558175+0000","last_peered":"2023-10-06T04:38:14.558175+0000","last_clean":"2023-10-06T04:38:14.558175+0000","last_became_active":"2023-10-06T04:36:11.182575+0000","last_became_peered":"2023-10-06T04:36:11.182575+0000","last_unstale":"2023-10-06T04:38:14.558175+0000","last_undegraded":"2023-10-06T04:38:14.558175+0000","last_fullsized":"2023-10-06T04:38:14.558175+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:38:14.558047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:38:14.558047+0000","last_clean_scrub_stamp":"2023-10-06T04:38:14.558047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:39:11.394685+0000","scrub_duration":0.002195425,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298452,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073388,"statfs":{"total":96636764160,"available":96331149312,"internally_reserved":0,"allocated":1191936,"data_stored":868648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.47299999999999998,"15min":0.46899999999999997},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.65600000000000003,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.48899999999999999,"15min":0.495},"min":{"1min":0.33300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68400000000000005,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.71799999999999997}]},{"osd":1,"last update":"Fri Oct 6 04:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.56399999999999995,"15min":0.53200000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":4.4039999999999999,"5min":4.4039999999999999,"15min":4.4039999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.70399999999999996}]},{"osd":2,"last update":"Fri Oct 6 04:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54400000000000004,"15min":0.54600000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.745}]},{"osd":3,"last update":"Fri Oct 6 04:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.55900000000000005,"15min":0.52900000000000003},"min":{"1min":0.39200000000000002,"5min":0.373,"15min":0.373},"max":{"1min":4.4169999999999998,"5min":4.4169999999999998,"15min":4.4169999999999998},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56100000000000005,"15min":0.55500000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73499999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.79200000000000004}]},{"osd":4,"last update":"Fri Oct 6 04:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.46800000000000003,"15min":0.46100000000000002},"min":{"1min":0.34699999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.36699999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.53600000000000003}]},{"osd":5,"last update":"Fri Oct 6 04:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.505,"15min":0.501},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.76300000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.51700000000000002,"15min":0.51500000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.76200000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.49399999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.52500000000000002,"15min":0.51700000000000002},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71999999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.504}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":278280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.46899999999999997,"15min":0.46200000000000002},"min":{"1min":0.38900000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.66800000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.79600000000000004,"15min":0.84299999999999997},"min":{"1min":0.38200000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.61599999999999999,"5min":10.045999999999999,"15min":10.045999999999999},"last":0.54600000000000004}]},{"osd":1,"last update":"Fri Oct 6 04:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.79000000000000004,"15min":0.83799999999999997},"min":{"1min":0.40600000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.65800000000000003,"5min":10.125999999999999,"15min":10.125999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.47899999999999998,"15min":0.47599999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.52900000000000003}]},{"osd":2,"last update":"Fri Oct 6 04:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.51400000000000001,"15min":0.51900000000000002},"min":{"1min":0.32700000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.60699999999999998,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.84599999999999997,"15min":0.89600000000000002},"min":{"1min":0.40799999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.70299999999999996,"5min":10.238,"15min":10.238},"last":0.53900000000000003}]},{"osd":3,"last update":"Fri Oct 6 04:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.64300000000000002,"15min":0.65600000000000003},"min":{"1min":0.41799999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.67700000000000005,"5min":4.4870000000000001,"15min":4.4870000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.86299999999999999,"15min":0.91300000000000003},"min":{"1min":0.439,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64400000000000002,"5min":10.393000000000001,"15min":10.393000000000001},"last":0.56699999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.50800000000000001,"15min":0.505},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.66800000000000004,"5min":0.753,"15min":0.753},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56000000000000005,"15min":0.56299999999999994},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67700000000000005,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.41699999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53500000000000003,"15min":0.53700000000000003},"min":{"1min":0.38100000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71799999999999997,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.377}]},{"osd":7,"last update":"Fri Oct 6 04:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.55100000000000005,"15min":0.55900000000000005},"min":{"1min":0.38200000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66700000000000004,"5min":0.995,"15min":0.995},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60599999999999998,"15min":0.60699999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76300000000000001,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.44700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298452,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073388,"statfs":{"total":96636764160,"available":96331149312,"internally_reserved":0,"allocated":1191936,"data_stored":868648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.34300000000000003,"15min":0.34799999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.437,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.35299999999999998,"15min":0.35699999999999998},"min":{"1min":0.249,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.40500000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.57799999999999996}]},{"osd":2,"last update":"Fri Oct 6 04:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.27600000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.46999999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.39200000000000002,"15min":0.39600000000000002},"min":{"1min":0.28799999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57699999999999996,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.443}]},{"osd":3,"last update":"Fri Oct 6 04:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39200000000000002,"15min":0.39400000000000002},"min":{"1min":0.30399999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.51000000000000001,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.63},{"interface":"front","average":{"1min":0.375,"5min":0.39000000000000001,"15min":0.39200000000000002},"min":{"1min":0.28699999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.45800000000000002,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.66500000000000004}]},{"osd":4,"last update":"Fri Oct 6 04:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.61299999999999999,"15min":0.621},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81699999999999995,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.64200000000000002,"15min":0.65200000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.86499999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.63500000000000001,"15min":0.64100000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89700000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.876}]},{"osd":6,"last update":"Fri Oct 6 04:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.64700000000000002,"15min":0.65400000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65000000000000002,"15min":0.65800000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.90100000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.64800000000000002,"15min":0.66000000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.96299999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297868,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073972,"statfs":{"total":96636764160,"available":96331747328,"internally_reserved":0,"allocated":593920,"data_stored":277302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.30399999999999999,"15min":0.30499999999999999},"min":{"1min":0.214,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.39700000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.33500000000000002,"15min":0.33400000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.39200000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36299999999999999,"15min":0.35999999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.33200000000000002,"15min":0.32800000000000001},"min":{"1min":0.251,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.60199999999999998,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.41899999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36399999999999999,"15min":0.36199999999999999},"min":{"1min":0.29099999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.495,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.376},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.40300000000000002,"15min":0.40100000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.46700000000000003}]},{"osd":4,"last update":"Fri Oct 6 04:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53900000000000003,"15min":0.53800000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.81999999999999995,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56000000000000005,"15min":0.56100000000000005},"min":{"1min":0.35299999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71499999999999997,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.60199999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55300000000000005,"15min":0.54900000000000004},"min":{"1min":0.40300000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58799999999999997,"15min":0.58299999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.61699999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.75800000000000001,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57399999999999995,"15min":0.56899999999999995},"min":{"1min":0.48599999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.69399999999999995}]},{"osd":7,"last update":"Fri Oct 6 04:38:13 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.58799999999999997,"15min":0.58199999999999996},"min":{"1min":0.52200000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59799999999999998,"15min":0.59899999999999998},"min":{"1min":0.42699999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.73299999999999998,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.70899999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297868,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073972,"statfs":{"total":96636764160,"available":96331747328,"internally_reserved":0,"allocated":593920,"data_stored":277302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.35699999999999998,"15min":0.35299999999999998},"min":{"1min":0.23200000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.36599999999999999,"15min":0.35899999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.59099999999999997,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.309}]},{"osd":1,"last update":"Fri Oct 6 04:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.26800000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.378},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.39100000000000001,"15min":0.38700000000000001},"min":{"1min":0.29599999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.39900000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.35699999999999998,"15min":0.35399999999999998},"min":{"1min":0.28299999999999997,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.55000000000000004,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.434,"15min":0.432},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63600000000000001,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.61399999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.61599999999999999,"15min":0.61799999999999999},"min":{"1min":0.43099999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.79000000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58799999999999997,"15min":0.58499999999999996},"min":{"1min":0.47099999999999997,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.51300000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.60199999999999998,"15min":0.60299999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.5},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.61799999999999999,"15min":0.61399999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.57399999999999995}]},{"osd":6,"last update":"Fri Oct 6 04:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.436,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.874,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.624,"15min":0.622},"min":{"1min":0.435,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82899999999999996,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.58999999999999997}]},{"osd":7,"last update":"Fri Oct 6 04:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.65400000000000003,"15min":0.65900000000000003},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.83899999999999997,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63200000000000001,"15min":0.629},"min":{"1min":0.44600000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.55100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297868,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073972,"statfs":{"total":96636764160,"available":96331747328,"internally_reserved":0,"allocated":593920,"data_stored":277302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"min":{"1min":0.216,"5min":0.19,"15min":0.19},"max":{"1min":0.505,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.308,"5min":0.33100000000000002,"15min":0.33500000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.40400000000000003,"5min":0.442,"15min":0.442},"last":0.38800000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.33100000000000002,"15min":0.33300000000000002},"min":{"1min":0.23599999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.27700000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.46400000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.52700000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.371,"15min":0.371},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40300000000000002,"15min":0.40500000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.56599999999999995,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.443}]},{"osd":4,"last update":"Fri Oct 6 04:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56299999999999994,"15min":0.56000000000000005},"min":{"1min":0.48899999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.77200000000000002,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.35999999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.83399999999999996,"5min":2.1070000000000002,"15min":2.1070000000000002},"last":0.57599999999999996}]},{"osd":5,"last update":"Fri Oct 6 04:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.63400000000000001,"15min":0.64000000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.78700000000000003,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.622,"15min":0.624},"min":{"1min":0.505,"5min":0.379,"15min":0.379},"max":{"1min":0.81000000000000005,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.76800000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.59299999999999997,"15min":0.58899999999999997},"min":{"1min":0.44700000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.77900000000000003,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.752},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.65600000000000003,"15min":0.66500000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83199999999999996,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.69299999999999995}]},{"osd":7,"last update":"Fri Oct 6 04:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63,"15min":0.629},"min":{"1min":0.504,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.74099999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.59299999999999997},"min":{"1min":0.433,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.79200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":278280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.67000000000000004,"15min":0.69199999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72399999999999998,"5min":4.2919999999999998,"15min":4.2919999999999998},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52500000000000002,"15min":0.52700000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.70499999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.55200000000000005}]},{"osd":1,"last update":"Fri Oct 6 04:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52400000000000002,"15min":0.52200000000000002},"min":{"1min":0.36499999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79700000000000004,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.70199999999999996,"15min":0.72799999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73199999999999998,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":0.63800000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.35399999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.41399999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.76300000000000001,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.58599999999999997}]},{"osd":3,"last update":"Fri Oct 6 04:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54800000000000004,"15min":0.55200000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73799999999999999,"5min":0.754,"15min":0.754},"last":0.623},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58699999999999997,"15min":0.58899999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.75,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.50700000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54600000000000004,"15min":0.55300000000000005},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65200000000000002,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.37}]},{"osd":6,"last update":"Fri Oct 6 04:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.52600000000000002,"15min":0.53200000000000003},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.65500000000000003,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.45900000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56299999999999994,"15min":0.56499999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.69199999999999995,"5min":0.745,"15min":0.745},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79600000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.66600000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":278280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47099999999999997,"15min":0.46899999999999997},"min":{"1min":0.308,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.51800000000000002,"15min":0.51000000000000001},"min":{"1min":0.33900000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.59999999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.51300000000000001,"15min":0.49099999999999999},"min":{"1min":0.377,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":3.6949999999999998,"5min":3.6949999999999998,"15min":3.6949999999999998},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.54300000000000004,"15min":0.52200000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":3.5499999999999998,"5min":3.5499999999999998,"15min":3.5499999999999998},"last":0.58099999999999996}]},{"osd":2,"last update":"Fri Oct 6 04:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54000000000000004,"15min":0.53400000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.57599999999999996,"15min":0.56799999999999995},"min":{"1min":0.42099999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":0.69999999999999996}]},{"osd":3,"last update":"Fri Oct 6 04:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55600000000000005,"15min":0.56000000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.628},{"interface":"front","average":{"1min":0.623,"5min":0.56599999999999995,"15min":0.55600000000000005},"min":{"1min":0.45900000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":2.2290000000000001,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":0.56999999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.503,"15min":0.51100000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.372},{"interface":"front","average":{"1min":0.503,"5min":0.52600000000000002,"15min":0.53000000000000003},"min":{"1min":0.34799999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.38700000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54000000000000004,"15min":0.53500000000000003},"min":{"1min":0.35299999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58699999999999997,"15min":0.59099999999999997},"min":{"1min":0.437,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.42599999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.60199999999999998,"15min":0.60799999999999998},"min":{"1min":0.443,"5min":0.375,"15min":0.375},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.63300000000000001,"15min":0.627},"min":{"1min":0.504,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":0.44600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:38:32.327 DEBUG:teuthology.orchestra.run.smithi008:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-06T04:38:32.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.443+0000 7f1043782700 1 Processor -- start 2023-10-06T04:38:32.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.443+0000 7f1043782700 1 -- start start 2023-10-06T04:38:32.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.444+0000 7f1043782700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f103c0cc440 0x7f103c06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:32.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.444+0000 7f1043782700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f103c06c3f0 0x7f103c0686e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:32.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.444+0000 7f1043782700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f103c06d8c0 con 0x7f103c0cc070 2023-10-06T04:38:32.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.444+0000 7f1043782700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f103c06c830 con 0x7f103c0cc440 2023-10-06T04:38:32.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.444+0000 7f1043782700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f103c143270 con 0x7f103c06c3f0 2023-10-06T04:38:32.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.444+0000 7f1040d1d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f103c0cc440 0x7f103c06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:32.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.444+0000 7f104151e700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f103c0cc070 0x7f103c06cbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:33890/0 (socket says 172.21.15.8:33890) 2023-10-06T04:38:32.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.444+0000 7f104151e700 1 -- 172.21.15.8:0/2287971161 learned_addr learned my addr 172.21.15.8:0/2287971161 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:38:32.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.444+0000 7f1041d1f700 1 --2- 172.21.15.8:0/2287971161 >> v2:172.21.15.184:3300/0 conn(0x7f103c06c3f0 0x7f103c0686e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:32.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.445+0000 7f1040d1d700 1 -- 172.21.15.8:0/2287971161 >> v2:172.21.15.184:3300/0 conn(0x7f103c06c3f0 msgr2=0x7f103c0686e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:32.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.445+0000 7f1040d1d700 1 --2- 172.21.15.8:0/2287971161 >> v2:172.21.15.184:3300/0 conn(0x7f103c06c3f0 0x7f103c0686e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:32.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.445+0000 7f1040d1d700 1 -- 172.21.15.8:0/2287971161 >> v1:172.21.15.8:6789/0 conn(0x7f103c0cc070 legacy=0x7f103c06cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:32.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.445+0000 7f103bfff700 1 -- 172.21.15.8:0/2287971161 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1337408353 0 0) 0x7f103c06d8c0 con 0x7f103c0cc070 2023-10-06T04:38:32.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.445+0000 7f1040d1d700 1 -- 172.21.15.8:0/2287971161 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f103c06b910 con 0x7f103c0cc440 2023-10-06T04:38:32.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.445+0000 7f1040d1d700 1 --2- 172.21.15.8:0/2287971161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f103c0cc440 0x7f103c06d2c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f103c06f150 tx=0x7f10300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f202c2c5de7b699d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:32.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.445+0000 7f103bfff700 1 -- 172.21.15.8:0/2287971161 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1030011630 con 0x7f103c0cc440 2023-10-06T04:38:32.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.445+0000 7f103bfff700 1 -- 172.21.15.8:0/2287971161 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1030011790 con 0x7f103c0cc440 2023-10-06T04:38:32.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.445+0000 7f103bfff700 1 -- 172.21.15.8:0/2287971161 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1030011b30 con 0x7f103c0cc440 2023-10-06T04:38:32.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.446+0000 7f1043782700 1 -- 172.21.15.8:0/2287971161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f103c0cc440 msgr2=0x7f103c06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:32.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.446+0000 7f1043782700 1 --2- 172.21.15.8:0/2287971161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f103c0cc440 0x7f103c06d2c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f103c06f150 tx=0x7f10300091a0 comp rx=0 tx=0).stop 2023-10-06T04:38:32.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.446+0000 7f1043782700 1 -- 172.21.15.8:0/2287971161 shutdown_connections 2023-10-06T04:38:32.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.446+0000 7f1043782700 1 --2- 172.21.15.8:0/2287971161 >> v2:172.21.15.184:3300/0 conn(0x7f103c06c3f0 0x7f103c0686e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:32.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.446+0000 7f1043782700 1 --2- 172.21.15.8:0/2287971161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f103c0cc440 0x7f103c06d2c0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:32.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.446+0000 7f1043782700 1 -- 172.21.15.8:0/2287971161 >> 172.21.15.8:0/2287971161 conn(0x7f103c0ce250 msgr2=0x7f103c0ce650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:32.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.446+0000 7f1043782700 1 -- 172.21.15.8:0/2287971161 shutdown_connections 2023-10-06T04:38:32.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.446+0000 7f1043782700 1 -- 172.21.15.8:0/2287971161 wait complete. 2023-10-06T04:38:32.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.447+0000 7f1043782700 1 Processor -- start 2023-10-06T04:38:32.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.447+0000 7f1043782700 1 -- start start 2023-10-06T04:38:32.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.448+0000 7f1043782700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f103c06c3f0 0x7f103c13d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:32.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.448+0000 7f1043782700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f103c0cc070 0x7f103c0b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:32.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.448+0000 7f1043782700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f103c0cc440 0x7f103c158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:32.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.448+0000 7f1043782700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103c0c5be0 con 0x7f103c0cc440 2023-10-06T04:38:32.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.448+0000 7f1043782700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103c0c5d70 con 0x7f103c06c3f0 2023-10-06T04:38:32.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.448+0000 7f1043782700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f103c1593a0 con 0x7f103c0cc070 2023-10-06T04:38:32.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.448+0000 7f1041d1f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f103c0cc440 0x7f103c158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:32.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.448+0000 7f1041d1f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f103c0cc440 0x7f103c158e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54592/0 (socket says 172.21.15.8:54592) 2023-10-06T04:38:32.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.448+0000 7f1041d1f700 1 -- 172.21.15.8:0/2176546143 learned_addr learned my addr 172.21.15.8:0/2176546143 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:32.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.448+0000 7f104151e700 1 --2- 172.21.15.8:0/2176546143 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f103c06c3f0 0x7f103c13d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:32.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.448+0000 7f1040d1d700 1 --2- 172.21.15.8:0/2176546143 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f103c0cc070 0x7f103c0b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:32.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.448+0000 7f1041d1f700 1 -- 172.21.15.8:0/2176546143 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f103c0cc070 msgr2=0x7f103c0b30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:32.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.448+0000 7f1041d1f700 1 --2- 172.21.15.8:0/2176546143 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f103c0cc070 0x7f103c0b30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:32.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.448+0000 7f1041d1f700 1 -- 172.21.15.8:0/2176546143 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f103c06c3f0 msgr2=0x7f103c13d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:32.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.448+0000 7f1041d1f700 1 --2- 172.21.15.8:0/2176546143 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f103c06c3f0 0x7f103c13d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:32.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.448+0000 7f1041d1f700 1 -- 172.21.15.8:0/2176546143 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1030009420 con 0x7f103c0cc440 2023-10-06T04:38:32.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.448+0000 7f1040d1d700 1 --2- 172.21.15.8:0/2176546143 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f103c0cc070 0x7f103c0b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:38:32.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.448+0000 7f104151e700 1 --2- 172.21.15.8:0/2176546143 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f103c06c3f0 0x7f103c13d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:38:32.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.448+0000 7f1041d1f700 1 --2- 172.21.15.8:0/2176546143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f103c0cc440 0x7f103c158e60 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f103400e8d0 tx=0x7f10340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:32.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.449+0000 7f10397fa700 1 -- 172.21.15.8:0/2176546143 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103400ee70 con 0x7f103c0cc440 2023-10-06T04:38:32.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.449+0000 7f10397fa700 1 -- 172.21.15.8:0/2176546143 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f103400c850 con 0x7f103c0cc440 2023-10-06T04:38:32.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.449+0000 7f10397fa700 1 -- 172.21.15.8:0/2176546143 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103400cc50 con 0x7f103c0cc440 2023-10-06T04:38:32.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.449+0000 7f1043782700 1 -- 172.21.15.8:0/2176546143 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f103c13dd40 con 0x7f103c0cc440 2023-10-06T04:38:32.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.449+0000 7f1043782700 1 -- 172.21.15.8:0/2176546143 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f103c13e300 con 0x7f103c0cc440 2023-10-06T04:38:32.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.449+0000 7f1043782700 1 -- 172.21.15.8:0/2176546143 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f103c0c5f00 con 0x7f103c0cc440 2023-10-06T04:38:32.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.450+0000 7f10397fa700 1 -- 172.21.15.8:0/2176546143 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1034013680 con 0x7f103c0cc440 2023-10-06T04:38:32.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.450+0000 7f10397fa700 1 --2- 172.21.15.8:0/2176546143 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1028066f30 0x7f10280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:32.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.450+0000 7f10397fa700 1 -- 172.21.15.8:0/2176546143 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f10340846f0 con 0x7f103c0cc440 2023-10-06T04:38:32.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.451+0000 7f104151e700 1 --2- 172.21.15.8:0/2176546143 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1028066f30 0x7f10280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:32.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.451+0000 7f104151e700 1 --2- 172.21.15.8:0/2176546143 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1028066f30 0x7f10280693e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f102c001560 tx=0x7f102c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:32.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.455+0000 7f10397fa700 1 -- 172.21.15.8:0/2176546143 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1034051960 con 0x7f103c0cc440 2023-10-06T04:38:32.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.648+0000 7f1043782700 1 -- 172.21.15.8:0/2176546143 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f103c071550 con 0x7f103c0cc440 2023-10-06T04:38:32.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.652+0000 7f10397fa700 1 -- 172.21.15.8:0/2176546143 <== mon.0 v2:172.21.15.8:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1034051960 con 0x7f103c0cc440 2023-10-06T04:38:32.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.652+0000 7f10397fa700 1 -- 172.21.15.8:0/2176546143 <== mon.0 v2:172.21.15.8:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v14)=0 v14) v1 ==== 123+0+0 (secure 0 0 0) 0x7f1034054f80 con 0x7f103c0cc440 2023-10-06T04:38:32.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.655+0000 7f1043782700 1 -- 172.21.15.8:0/2176546143 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1028066f30 msgr2=0x7f10280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:32.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.655+0000 7f1043782700 1 --2- 172.21.15.8:0/2176546143 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1028066f30 0x7f10280693e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f102c001560 tx=0x7f102c009040 comp rx=0 tx=0).stop 2023-10-06T04:38:32.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.655+0000 7f1043782700 1 -- 172.21.15.8:0/2176546143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f103c0cc440 msgr2=0x7f103c158e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:32.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.655+0000 7f1043782700 1 --2- 172.21.15.8:0/2176546143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f103c0cc440 0x7f103c158e60 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f103400e8d0 tx=0x7f10340091a0 comp rx=0 tx=0).stop 2023-10-06T04:38:32.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.655+0000 7f1043782700 1 -- 172.21.15.8:0/2176546143 shutdown_connections 2023-10-06T04:38:32.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.655+0000 7f1043782700 1 --2- 172.21.15.8:0/2176546143 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f1028066f30 0x7f10280693e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:32.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.655+0000 7f1043782700 1 --2- 172.21.15.8:0/2176546143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f103c0cc440 0x7f103c158e60 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:32.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.655+0000 7f1043782700 1 --2- 172.21.15.8:0/2176546143 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f103c06c3f0 0x7f103c13d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:32.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.655+0000 7f1043782700 1 --2- 172.21.15.8:0/2176546143 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f103c0cc070 0x7f103c0b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:32.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.655+0000 7f1043782700 1 -- 172.21.15.8:0/2176546143 >> 172.21.15.8:0/2176546143 conn(0x7f103c0ce250 msgr2=0x7f103c13cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:32.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.655+0000 7f1043782700 1 -- 172.21.15.8:0/2176546143 shutdown_connections 2023-10-06T04:38:32.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.655+0000 7f1043782700 1 -- 172.21.15.8:0/2176546143 wait complete. 2023-10-06T04:38:32.669 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T04:38:32.669 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:38:32.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.785+0000 7f4e912e0700 1 Processor -- start 2023-10-06T04:38:32.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.786+0000 7f4e912e0700 1 -- start start 2023-10-06T04:38:32.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.786+0000 7f4e912e0700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e8c0af680 0x7f4e8c15e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:32.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.786+0000 7f4e912e0700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4e8c0d0aa0 0x7f4e8c0cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:32.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.786+0000 7f4e912e0700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e8c0cc4c0 con 0x7f4e8c0cb360 2023-10-06T04:38:32.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.786+0000 7f4e912e0700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e8c15d460 con 0x7f4e8c0d0aa0 2023-10-06T04:38:32.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.786+0000 7f4e912e0700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c15e580 con 0x7f4e8c0af680 2023-10-06T04:38:32.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.786+0000 7f4e8b7fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4e8c0d0aa0 0x7f4e8c0cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:32.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.786+0000 7f4e8a7fc700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f4e8c0cb360 0x7f4e8c0d0390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:33898/0 (socket says 172.21.15.8:33898) 2023-10-06T04:38:32.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.786+0000 7f4e8a7fc700 1 -- 172.21.15.8:0/2669620761 learned_addr learned my addr 172.21.15.8:0/2669620761 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-06T04:38:32.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.787+0000 7f4e8affd700 1 --2- 172.21.15.8:0/2669620761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e8c0af680 0x7f4e8c15e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:32.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.787+0000 7f4e8b7fe700 1 -- 172.21.15.8:0/2669620761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e8c0af680 msgr2=0x7f4e8c15e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:38:32.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.787+0000 7f4e8b7fe700 1 --2- 172.21.15.8:0/2669620761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e8c0af680 0x7f4e8c15e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:32.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.787+0000 7f4e8b7fe700 1 -- 172.21.15.8:0/2669620761 >> v1:172.21.15.8:6789/0 conn(0x7f4e8c0cb360 legacy=0x7f4e8c0d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:32.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.787+0000 7f4e8b7fe700 1 -- 172.21.15.8:0/2669620761 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8c0cb8b0 con 0x7f4e8c0d0aa0 2023-10-06T04:38:32.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.787+0000 7f4e89ffb700 1 -- 172.21.15.8:0/2669620761 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 649820132 0 0) 0x7f4e8c0cc4c0 con 0x7f4e8c0cb360 2023-10-06T04:38:32.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.787+0000 7f4e8affd700 1 --2- 172.21.15.8:0/2669620761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e8c0af680 0x7f4e8c15e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:38:32.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.787+0000 7f4e8b7fe700 1 --2- 172.21.15.8:0/2669620761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e8c0d0aa0 0x7f4e8c0cc950 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c0098e0 tx=0x7f4e7c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d600539406f65e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:32.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.787+0000 7f4e89ffb700 1 -- 172.21.15.8:0/2669620761 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c009e80 con 0x7f4e8c0d0aa0 2023-10-06T04:38:32.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.787+0000 7f4e89ffb700 1 -- 172.21.15.8:0/2669620761 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4e7c00b860 con 0x7f4e8c0d0aa0 2023-10-06T04:38:32.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.787+0000 7f4e89ffb700 1 -- 172.21.15.8:0/2669620761 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c00bc00 con 0x7f4e8c0d0aa0 2023-10-06T04:38:32.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.788+0000 7f4e912e0700 1 -- 172.21.15.8:0/2669620761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e8c0d0aa0 msgr2=0x7f4e8c0cc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:32.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.788+0000 7f4e912e0700 1 --2- 172.21.15.8:0/2669620761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e8c0d0aa0 0x7f4e8c0cc950 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c0098e0 tx=0x7f4e7c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:38:32.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.788+0000 7f4e912e0700 1 -- 172.21.15.8:0/2669620761 shutdown_connections 2023-10-06T04:38:32.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.788+0000 7f4e912e0700 1 --2- 172.21.15.8:0/2669620761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e8c0d0aa0 0x7f4e8c0cc950 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:32.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.788+0000 7f4e912e0700 1 --2- 172.21.15.8:0/2669620761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e8c0af680 0x7f4e8c15e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:32.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.788+0000 7f4e912e0700 1 -- 172.21.15.8:0/2669620761 >> 172.21.15.8:0/2669620761 conn(0x7f4e8c0633d0 msgr2=0x7f4e8c0637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:32.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.788+0000 7f4e912e0700 1 -- 172.21.15.8:0/2669620761 shutdown_connections 2023-10-06T04:38:32.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.788+0000 7f4e912e0700 1 -- 172.21.15.8:0/2669620761 wait complete. 2023-10-06T04:38:32.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.789+0000 7f4e912e0700 1 Processor -- start 2023-10-06T04:38:32.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.789+0000 7f4e912e0700 1 -- start start 2023-10-06T04:38:32.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.790+0000 7f4e912e0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e8c0af680 0x7f4e8c14eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:32.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.790+0000 7f4e912e0700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e8c0cb360 0x7f4e8c0c3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:32.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.790+0000 7f4e912e0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e8c0d0aa0 0x7f4e8c0ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:32.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.790+0000 7f4e912e0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c14c2b0 con 0x7f4e8c0d0aa0 2023-10-06T04:38:32.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.790+0000 7f4e912e0700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c0c4710 con 0x7f4e8c0af680 2023-10-06T04:38:32.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.790+0000 7f4e912e0700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c0c49f0 con 0x7f4e8c0cb360 2023-10-06T04:38:32.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.790+0000 7f4e8b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e8c0d0aa0 0x7f4e8c0ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:32.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.790+0000 7f4e8b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e8c0d0aa0 0x7f4e8c0ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54604/0 (socket says 172.21.15.8:54604) 2023-10-06T04:38:32.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.790+0000 7f4e8b7fe700 1 -- 172.21.15.8:0/1546881567 learned_addr learned my addr 172.21.15.8:0/1546881567 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T04:38:32.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.790+0000 7f4e8affd700 1 --2- 172.21.15.8:0/1546881567 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e8c0af680 0x7f4e8c14eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:32.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.790+0000 7f4e8a7fc700 1 --2- 172.21.15.8:0/1546881567 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e8c0cb360 0x7f4e8c0c3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:32.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.790+0000 7f4e8b7fe700 1 -- 172.21.15.8:0/1546881567 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e8c0cb360 msgr2=0x7f4e8c0c3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:32.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.790+0000 7f4e8b7fe700 1 --2- 172.21.15.8:0/1546881567 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e8c0cb360 0x7f4e8c0c3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:32.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.790+0000 7f4e8b7fe700 1 -- 172.21.15.8:0/1546881567 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e8c0af680 msgr2=0x7f4e8c14eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:32.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.790+0000 7f4e8b7fe700 1 --2- 172.21.15.8:0/1546881567 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e8c0af680 0x7f4e8c14eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:32.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.790+0000 7f4e8b7fe700 1 -- 172.21.15.8:0/1546881567 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e7c009420 con 0x7f4e8c0d0aa0 2023-10-06T04:38:32.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.790+0000 7f4e8b7fe700 1 --2- 172.21.15.8:0/1546881567 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e8c0d0aa0 0x7f4e8c0ccd30 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c063f80 tx=0x7f4e7c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:32.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.790+0000 7f4e82ffd700 1 -- 172.21.15.8:0/1546881567 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c011420 con 0x7f4e8c0d0aa0 2023-10-06T04:38:32.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.790+0000 7f4e82ffd700 1 -- 172.21.15.8:0/1546881567 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4e7c011580 con 0x7f4e8c0d0aa0 2023-10-06T04:38:32.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.791+0000 7f4e912e0700 1 -- 172.21.15.8:0/1546881567 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e8c0c4cd0 con 0x7f4e8c0d0aa0 2023-10-06T04:38:32.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.791+0000 7f4e82ffd700 1 -- 172.21.15.8:0/1546881567 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c011960 con 0x7f4e8c0d0aa0 2023-10-06T04:38:32.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.791+0000 7f4e912e0700 1 -- 172.21.15.8:0/1546881567 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e8c0c5290 con 0x7f4e8c0d0aa0 2023-10-06T04:38:32.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.791+0000 7f4e912e0700 1 -- 172.21.15.8:0/1546881567 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e8c0c54b0 con 0x7f4e8c0d0aa0 2023-10-06T04:38:32.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.792+0000 7f4e82ffd700 1 -- 172.21.15.8:0/1546881567 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4e7c011d50 con 0x7f4e8c0d0aa0 2023-10-06T04:38:32.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.792+0000 7f4e82ffd700 1 --2- 172.21.15.8:0/1546881567 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4e6c066f30 0x7f4e6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:38:32.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.792+0000 7f4e82ffd700 1 -- 172.21.15.8:0/1546881567 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f4e7c086040 con 0x7f4e8c0d0aa0 2023-10-06T04:38:32.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.792+0000 7f4e8affd700 1 --2- 172.21.15.8:0/1546881567 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4e6c066f30 0x7f4e6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:38:32.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.793+0000 7f4e8affd700 1 --2- 172.21.15.8:0/1546881567 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4e6c066f30 0x7f4e6c0693e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4e840076a0 tx=0x7f4e84009930 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:38:32.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:32.797+0000 7f4e82ffd700 1 -- 172.21.15.8:0/1546881567 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e7c0b75a0 con 0x7f4e8c0d0aa0 2023-10-06T04:38:33.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:33.033+0000 7f4e912e0700 1 -- 172.21.15.8:0/1546881567 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e8c071550 con 0x7f4e8c0d0aa0 2023-10-06T04:38:33.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:33.034+0000 7f4e82ffd700 1 -- 172.21.15.8:0/1546881567 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f4e7c015090 con 0x7f4e8c0d0aa0 2023-10-06T04:38:33.037 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T04:38:33.037 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":32,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/867081044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":867081044},{"type":"v1","addr":"172.21.15.184:6835","nonce":867081044}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5176,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2754847040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2754847040},{"type":"v1","addr":"172.21.15.184:6837","nonce":2754847040}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5358,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/1957165234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1957165234},{"type":"v1","addr":"172.21.15.8:6834","nonce":1957165234}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5883,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2736527654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":2736527654},{"type":"v1","addr":"172.21.15.8:6835","nonce":2736527654}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[]} 2023-10-06T04:38:33.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:33.036+0000 7f4e912e0700 1 -- 172.21.15.8:0/1546881567 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4e6c066f30 msgr2=0x7f4e6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:33.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:33.036+0000 7f4e912e0700 1 --2- 172.21.15.8:0/1546881567 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4e6c066f30 0x7f4e6c0693e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4e840076a0 tx=0x7f4e84009930 comp rx=0 tx=0).stop 2023-10-06T04:38:33.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:33.036+0000 7f4e912e0700 1 -- 172.21.15.8:0/1546881567 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e8c0d0aa0 msgr2=0x7f4e8c0ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:38:33.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:33.036+0000 7f4e912e0700 1 --2- 172.21.15.8:0/1546881567 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e8c0d0aa0 0x7f4e8c0ccd30 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c063f80 tx=0x7f4e7c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:38:33.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:33.036+0000 7f4e912e0700 1 -- 172.21.15.8:0/1546881567 shutdown_connections 2023-10-06T04:38:33.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:33.036+0000 7f4e912e0700 1 --2- 172.21.15.8:0/1546881567 >> [v2:172.21.15.184:6832/90283,v1:172.21.15.184:6833/90283] conn(0x7f4e6c066f30 0x7f4e6c0693e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:33.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:33.036+0000 7f4e912e0700 1 --2- 172.21.15.8:0/1546881567 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e8c0d0aa0 0x7f4e8c0ccd30 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:33.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:33.036+0000 7f4e912e0700 1 --2- 172.21.15.8:0/1546881567 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e8c0af680 0x7f4e8c14eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:33.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:33.036+0000 7f4e912e0700 1 --2- 172.21.15.8:0/1546881567 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e8c0cb360 0x7f4e8c0c3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:38:33.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:33.036+0000 7f4e912e0700 1 -- 172.21.15.8:0/1546881567 >> 172.21.15.8:0/1546881567 conn(0x7f4e8c0633d0 msgr2=0x7f4e8c0afa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:38:33.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:33.036+0000 7f4e912e0700 1 -- 172.21.15.8:0/1546881567 shutdown_connections 2023-10-06T04:38:33.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T04:38:33.036+0000 7f4e912e0700 1 -- 172.21.15.8:0/1546881567 wait complete. 2023-10-06T04:38:33.040 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 32 2023-10-06T04:38:33.050 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-06T04:38:33.050 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-06T04:38:33.051 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T04:38:33.051 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:38:33.059 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T04:38:33.059 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T04:38:33.059 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:38:33.108 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T04:38:33.108 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T04:38:33.108 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:38:33.119 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T04:38:33.119 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T04:38:33.119 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:38:33.169 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T04:38:33.170 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-06T04:38:33.170 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-06T04:38:33.170 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:38:33.199 INFO:tasks.ceph.osd.0:Stopped 2023-10-06T04:38:33.200 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-06T04:38:33.200 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:38:33.265 INFO:tasks.ceph.osd.1:Stopped 2023-10-06T04:38:33.265 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-06T04:38:33.265 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:38:33.332 INFO:tasks.ceph.osd.2:Stopped 2023-10-06T04:38:33.332 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-06T04:38:33.332 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:38:33.371 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-10-06T04:38:33.371 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-10-06T04:38:33.371 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-10-06T04:38:33.371 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-10-06T04:38:33.398 INFO:tasks.ceph.osd.3:Stopped 2023-10-06T04:38:33.398 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-06T04:38:33.398 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:38:33.432 INFO:tasks.ceph.osd.4:Stopped 2023-10-06T04:38:33.432 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-06T04:38:33.432 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:38:33.513 INFO:tasks.ceph.osd.5:Stopped 2023-10-06T04:38:33.514 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-06T04:38:33.514 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:38:33.584 INFO:tasks.ceph.osd.6:Stopped 2023-10-06T04:38:33.584 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-06T04:38:33.584 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:38:33.657 INFO:tasks.ceph.osd.7:Stopped 2023-10-06T04:38:33.657 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-06T04:38:33.657 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-06T04:38:33.657 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:38:33.680 INFO:tasks.ceph.mgr.y:Stopped 2023-10-06T04:38:33.681 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-06T04:38:33.681 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:38:33.725 INFO:tasks.ceph.mgr.x:Stopped 2023-10-06T04:38:33.725 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-06T04:38:33.725 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-06T04:38:33.725 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:38:33.735 INFO:tasks.ceph.mon.a:Stopped 2023-10-06T04:38:33.735 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-06T04:38:33.736 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:38:33.776 INFO:tasks.ceph.mon.b:Stopped 2023-10-06T04:38:33.776 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-06T04:38:33.776 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:38:33.828 INFO:tasks.ceph.mon.c:Stopped 2023-10-06T04:38:33.828 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-06T04:38:33.828 DEBUG:teuthology.orchestra.run.smithi008:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'bad backtrace' | egrep -v 'object missing on disk' | egrep -v 'error reading table object' | egrep -v 'error reading sessionmap' | egrep -v 'unmatched fragstat' | egrep -v 'unmatched rstat' | egrep -v 'was unreadable, recreating it now' | egrep -v 'Scrub error on inode' | egrep -v 'Metadata damage detected' | egrep -v MDS_FAILED | egrep -v MDS_DAMAGE | head -n 1 2023-10-06T04:38:33.859 INFO:teuthology.orchestra.run.smithi008.stdout:1696566971.170832 mon.a (mon.0) 107 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T04:38:33.860 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-06T04:38:33.860 DEBUG:teuthology.orchestra.run.smithi008:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'bad backtrace' | egrep -v 'object missing on disk' | egrep -v 'error reading table object' | egrep -v 'error reading sessionmap' | egrep -v 'unmatched fragstat' | egrep -v 'unmatched rstat' | egrep -v 'was unreadable, recreating it now' | egrep -v 'Scrub error on inode' | egrep -v 'Metadata damage detected' | egrep -v MDS_FAILED | egrep -v MDS_DAMAGE | head -n 1 2023-10-06T04:38:33.931 DEBUG:teuthology.orchestra.run.smithi008:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'bad backtrace' | egrep -v 'object missing on disk' | egrep -v 'error reading table object' | egrep -v 'error reading sessionmap' | egrep -v 'unmatched fragstat' | egrep -v 'unmatched rstat' | egrep -v 'was unreadable, recreating it now' | egrep -v 'Scrub error on inode' | egrep -v 'Metadata damage detected' | egrep -v MDS_FAILED | egrep -v MDS_DAMAGE | head -n 1 2023-10-06T04:38:34.003 DEBUG:teuthology.orchestra.run.smithi008:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'bad backtrace' | egrep -v 'object missing on disk' | egrep -v 'error reading table object' | egrep -v 'error reading sessionmap' | egrep -v 'unmatched fragstat' | egrep -v 'unmatched rstat' | egrep -v 'was unreadable, recreating it now' | egrep -v 'Scrub error on inode' | egrep -v 'Metadata damage detected' | egrep -v MDS_FAILED | egrep -v MDS_DAMAGE | head -n 1 2023-10-06T04:38:34.074 INFO:teuthology.orchestra.run.smithi008.stdout:1696566971.170832 mon.a (mon.0) 107 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T04:38:34.074 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi008.front.sepia.ceph.com 2023-10-06T04:38:34.075 DEBUG:teuthology.orchestra.run.smithi008:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-06T04:38:34.317 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi008.front.sepia.ceph.com 2023-10-06T04:38:34.317 DEBUG:teuthology.orchestra.run.smithi008:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-06T04:38:34.426 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi008.front.sepia.ceph.com 2023-10-06T04:38:34.427 DEBUG:teuthology.orchestra.run.smithi008:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-06T04:38:34.496 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi008.front.sepia.ceph.com 2023-10-06T04:38:34.496 DEBUG:teuthology.orchestra.run.smithi008:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-06T04:38:34.566 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi184.front.sepia.ceph.com 2023-10-06T04:38:34.566 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-06T04:38:34.744 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi184.front.sepia.ceph.com 2023-10-06T04:38:34.744 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-06T04:38:34.826 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi184.front.sepia.ceph.com 2023-10-06T04:38:34.826 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-06T04:38:34.924 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi184.front.sepia.ceph.com 2023-10-06T04:38:34.924 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-06T04:38:34.987 INFO:tasks.ceph:Archiving mon data... 2023-10-06T04:38:34.988 DEBUG:teuthology.misc:Transferring archived files from smithi008:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412279/data/mon.a.tgz 2023-10-06T04:38:34.989 DEBUG:teuthology.orchestra.run.smithi008:> mktemp 2023-10-06T04:38:35.005 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/tmp.10McJNdVhl 2023-10-06T04:38:35.005 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.10McJNdVhl 2023-10-06T04:38:35.165 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0666 /tmp/tmp.10McJNdVhl 2023-10-06T04:38:35.248 DEBUG:teuthology.orchestra.remote:smithi008:/tmp/tmp.10McJNdVhl is 319KB 2023-10-06T04:38:35.344 DEBUG:teuthology.orchestra.run.smithi008:> rm -fr /tmp/tmp.10McJNdVhl 2023-10-06T04:38:35.358 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412279/data/mon.b.tgz 2023-10-06T04:38:35.359 DEBUG:teuthology.orchestra.run.smithi184:> mktemp 2023-10-06T04:38:35.374 INFO:teuthology.orchestra.run.smithi184.stdout:/tmp/tmp.hChSAaq4W3 2023-10-06T04:38:35.374 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.hChSAaq4W3 2023-10-06T04:38:35.534 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0666 /tmp/tmp.hChSAaq4W3 2023-10-06T04:38:35.615 DEBUG:teuthology.orchestra.remote:smithi184:/tmp/tmp.hChSAaq4W3 is 423KB 2023-10-06T04:38:35.711 DEBUG:teuthology.orchestra.run.smithi184:> rm -fr /tmp/tmp.hChSAaq4W3 2023-10-06T04:38:35.726 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412279/data/mon.c.tgz 2023-10-06T04:38:35.726 DEBUG:teuthology.orchestra.run.smithi184:> mktemp 2023-10-06T04:38:35.779 INFO:teuthology.orchestra.run.smithi184.stdout:/tmp/tmp.DWpFJu5mit 2023-10-06T04:38:35.780 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.DWpFJu5mit 2023-10-06T04:38:35.921 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0666 /tmp/tmp.DWpFJu5mit 2023-10-06T04:38:36.003 DEBUG:teuthology.orchestra.remote:smithi184:/tmp/tmp.DWpFJu5mit is 423KB 2023-10-06T04:38:36.099 DEBUG:teuthology.orchestra.run.smithi184:> rm -fr /tmp/tmp.DWpFJu5mit 2023-10-06T04:38:36.114 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-06T04:38:36.114 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T04:38:36.116 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T04:38:36.177 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-06T04:38:36.178 DEBUG:teuthology.orchestra.run.smithi008:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T04:38:36.184 DEBUG:teuthology.orchestra.run.smithi184:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T04:38:36.210 INFO:teuthology.orchestra.run.smithi008.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T04:38:36.242 INFO:teuthology.orchestra.run.smithi184.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T04:38:36.248 INFO:tasks.ceph:Archiving crash dumps... 2023-10-06T04:38:36.250 DEBUG:teuthology.misc:Transferring archived files from smithi008:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412279/remote/smithi008/crash 2023-10-06T04:38:36.250 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T04:38:36.282 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412279/remote/smithi184/crash 2023-10-06T04:38:36.283 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T04:38:36.312 INFO:tasks.ceph:Shutting down logrotate 2023-10-06T04:38:36.312 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:38:36.327 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:38:36.448 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T04:38:36.473 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T04:38:36.497 INFO:tasks.ceph:Compressing logs... 2023-10-06T04:38:36.498 DEBUG:teuthology.orchestra.run.smithi008:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T04:38:36.516 DEBUG:teuthology.orchestra.run.smithi184:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T04:38:38.372 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-10-06T04:38:38.372 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-10-06T04:38:38.373 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-10-06T04:38:38.373 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-10-06T04:38:40.234 INFO:tasks.ceph:Archiving logs... 2023-10-06T04:38:40.235 DEBUG:teuthology.misc:Transferring archived files from smithi008:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412279/remote/smithi008/log 2023-10-06T04:38:40.236 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T04:38:40.925 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412279/remote/smithi184/log 2023-10-06T04:38:40.926 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T04:38:41.356 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-06T04:38:41.365 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-06T04:38:41.366 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T04:38:41.368 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T04:38:41.456 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-06T04:38:41.466 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-06T04:38:41.466 DEBUG:teuthology.orchestra.run.smithi008:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T04:38:41.469 DEBUG:teuthology.orchestra.run.smithi184:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T04:38:41.483 INFO:teuthology.orchestra.run.smithi008.stderr:bash: ntpq: command not found 2023-10-06T04:38:41.485 INFO:teuthology.orchestra.run.smithi184.stderr:bash: ntpq: command not found 2023-10-06T04:38:41.487 INFO:teuthology.orchestra.run.smithi008.stdout:210 Number of sources = 4 2023-10-06T04:38:41.487 INFO:teuthology.orchestra.run.smithi008.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T04:38:41.487 INFO:teuthology.orchestra.run.smithi008.stdout:=============================================================================== 2023-10-06T04:38:41.487 INFO:teuthology.orchestra.run.smithi008.stdout:^* hv01.front.sepia.ceph.com 2 6 377 63 +414us[ +412us] +/- 75ms 2023-10-06T04:38:41.487 INFO:teuthology.orchestra.run.smithi008.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 0 -489us[ -489us] +/- 52ms 2023-10-06T04:38:41.487 INFO:teuthology.orchestra.run.smithi008.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 1 +57us[ +57us] +/- 87ms 2023-10-06T04:38:41.487 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:38:41.488 INFO:teuthology.orchestra.run.smithi184.stdout:210 Number of sources = 4 2023-10-06T04:38:41.489 INFO:teuthology.orchestra.run.smithi184.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T04:38:41.489 INFO:teuthology.orchestra.run.smithi184.stdout:=============================================================================== 2023-10-06T04:38:41.489 INFO:teuthology.orchestra.run.smithi184.stdout:^* hv01.front.sepia.ceph.com 2 6 377 64 +411us[ +408us] +/- 75ms 2023-10-06T04:38:41.489 INFO:teuthology.orchestra.run.smithi184.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 63 -489us[ -489us] +/- 79ms 2023-10-06T04:38:41.489 INFO:teuthology.orchestra.run.smithi184.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 63 +68us[ +68us] +/- 86ms 2023-10-06T04:38:41.489 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:38:41.489 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-06T04:38:41.523 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-06T04:38:41.523 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-06T04:38:41.533 DEBUG:teuthology.orchestra.run.smithi008:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T04:38:41.639 DEBUG:teuthology.orchestra.run.smithi184:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T04:38:41.733 DEBUG:teuthology.orchestra.run.smithi008:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T04:38:41.765 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:38:41.766 DEBUG:teuthology.orchestra.run.smithi184:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T04:38:41.795 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:38:41.796 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-06T04:38:41.806 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-06T04:38:41.815 INFO:teuthology.task.internal:Duration was 837.025943 seconds 2023-10-06T04:38:41.815 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-06T04:38:41.824 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-06T04:38:41.824 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T04:38:41.827 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T04:38:41.871 INFO:teuthology.orchestra.run.smithi008.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T04:38:41.880 INFO:teuthology.orchestra.run.smithi184.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T04:38:42.153 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-06T04:38:42.153 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi008.front.sepia.ceph.com 2023-10-06T04:38:42.153 DEBUG:teuthology.orchestra.run.smithi008:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T04:38:42.174 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi184.front.sepia.ceph.com 2023-10-06T04:38:42.174 DEBUG:teuthology.orchestra.run.smithi184:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T04:38:42.212 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-06T04:38:42.213 DEBUG:teuthology.orchestra.run.smithi008:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T04:38:42.216 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T04:38:42.291 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-06T04:38:42.292 DEBUG:teuthology.orchestra.run.smithi008:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T04:38:42.299 DEBUG:teuthology.orchestra.run.smithi184:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T04:38:42.405 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-06T04:38:42.416 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-06T04:38:42.416 DEBUG:teuthology.orchestra.run.smithi008:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T04:38:42.442 DEBUG:teuthology.orchestra.run.smithi184:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T04:38:42.466 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-06T04:38:42.478 DEBUG:teuthology.orchestra.run.smithi008:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T04:38:42.484 DEBUG:teuthology.orchestra.run.smithi184:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T04:38:42.507 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern = core 2023-10-06T04:38:42.530 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = core 2023-10-06T04:38:42.543 DEBUG:teuthology.orchestra.run.smithi008:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T04:38:42.575 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:38:42.576 DEBUG:teuthology.orchestra.run.smithi184:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T04:38:42.597 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:38:42.598 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-06T04:38:42.610 INFO:teuthology.task.internal:Transferring archived files... 2023-10-06T04:38:42.611 DEBUG:teuthology.misc:Transferring archived files from smithi008:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412279/remote/smithi008 2023-10-06T04:38:42.611 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T04:38:42.663 DEBUG:teuthology.misc:Transferring archived files from smithi184:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412279/remote/smithi184 2023-10-06T04:38:42.664 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T04:38:42.701 INFO:teuthology.task.internal:Removing archive directory... 2023-10-06T04:38:42.701 DEBUG:teuthology.orchestra.run.smithi008:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T04:38:42.704 DEBUG:teuthology.orchestra.run.smithi184:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T04:38:42.750 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-06T04:38:42.765 INFO:teuthology.task.internal:Not uploading archives. 2023-10-06T04:38:42.765 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-06T04:38:42.778 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-06T04:38:42.778 DEBUG:teuthology.orchestra.run.smithi008:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T04:38:42.780 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T04:38:42.793 INFO:teuthology.orchestra.run.smithi008.stdout: 262184 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 04:38 /home/ubuntu/cephtest 2023-10-06T04:38:42.804 INFO:teuthology.orchestra.run.smithi184.stdout: 262691 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 04:38 /home/ubuntu/cephtest 2023-10-06T04:38:42.805 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-06T04:38:42.816 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-06T04:38:42.839 INFO:teuthology.nuke:Checking targets against current locks 2023-10-06T04:38:42.866 DEBUG:teuthology.nuke:shortname: smithi008 2023-10-06T04:38:42.867 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T04:38:42.891 DEBUG:teuthology.nuke:shortname: smithi184 2023-10-06T04:38:42.891 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T04:38:42.895 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412279', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 04:18:01.080374', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIo0QN1QY8bs+wQIFzVw3f/mTM2iPX5y10ShPml9hTHVPd6MYxPJSGOldqrVjgpInPZ0mQgyVpqIvGcB0+5dRWQ='} 2023-10-06T04:38:42.917 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412279', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 04:18:01.078923', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNHnsmBL45Qs5cNPlTOPZoi39J/JUz0zxyDMxkeWW6uWlO8/WqOWdJHuwXz8+4To7WZ+LDy33tWa1H/myoLMUK8='} 2023-10-06T04:38:42.949 INFO:teuthology.orchestra.console.smithi008:Power off 2023-10-06T04:38:42.949 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T04:38:42.964 INFO:teuthology.orchestra.console.smithi184:Power off 2023-10-06T04:38:42.964 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T04:38:42.974 DEBUG:teuthology.orchestra.console.smithi008:power off output: Chassis Power Control: Down/Off 2023-10-06T04:38:42.974 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:38:42.987 DEBUG:teuthology.orchestra.console.smithi184:power off output: Chassis Power Control: Down/Off 2023-10-06T04:38:42.987 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:38:42.999 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2023-10-06T04:38:43.019 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2023-10-06T04:38:47.000 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:38:47.020 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:38:47.111 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2023-10-06T04:38:47.130 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2023-10-06T04:38:51.114 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:38:51.131 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:38:51.226 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2023-10-06T04:38:51.240 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2023-10-06T04:38:51.328 INFO:teuthology.orchestra.console.smithi008:Power off completed 2023-10-06T04:38:51.341 INFO:teuthology.orchestra.console.smithi184:Power off completed 2023-10-06T04:38:51.446 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/alternate-pool} duration: 837.0259428024292 failure_reason: '"1696566971.170832 mon.a (mon.0) 107 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-10-06T04:38:51.446 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T04:38:51.553 INFO:teuthology.run:FAIL